I'm pretty convinced of two very likely possibilities:

1) They congregate in water too shallow to hold a fish big enough to eat them and

2) They can sense a fish nearby.

However, some species of water skimmers have a peculiar mating ritual. The mail will actually drum the water, threatening a female with death-by-fish if she doesn't scurry off and mate with him. So maybe you and I have just missed the action!