I do that all the time. After two or three fish I'll often change flies, sometimes even after just one fish, just to see if I can fool them with something else. I've had some reasonably good days...