If you wear a 9-1/2 shoe, I would definitely go with a size 11 boot. What may feel comfortable on dry land can be tight in 3 or 4 feet of water due to the pressure of the water. And that will be miserable. You can always put some heavier socks on and some insole inserts in if they are too lose.

Dave