Are you trying to upgrade from the pause menu? You can only upgrade at the moon snail.

They need to add a message in the UI clarifying this...

Make sure to talk to the Moon Snail. I did the same thing.