Bob Tabbert of the FFF did a study on flooded waders and drowning potential. These were carefully structured pool tests. His findings were conclusive that water in waders (not even completely full) made walking, swimming and surviving VERY difficult.
PFDs are like seat belts. You often hear about the folks who died without one, not the other way around.