I like fishing for panfish on the beds, but try to stay away from bass. I read somewhere about Smallmouth in particular not spawning after being caught, or something to that effect.

If you've ever watched fish on the nest, there's always a few little fish hanging on the edge of the nest. In the time it takes you to catch, land and release the fish guarding that nest, those little fish can really do a lot of damage, if not clean the nest out completely.
That's a great point by bluegill22, something I never considered till now.