In my experience color matters more when fishing under the surface. However, fly colors change when wet depending on the materials. What you think is orange when dry, it could become a brown under a couple of feet of water (assuming good water clarity). On top, you can get along most of the time with light vs. dark colors. For example a light gray dun to fish a sulfur hatch.
M