Barring some fairweather hatches, the worse the weather, the better the fishing can be. I have had some incredible days in rain and snow. The light is lower, fish seem to be more active, and there are fewer people around, usually. Go for it.