I can't answer your question. I have caught shallow water perch on the fly, but when I'm fishing from a boat over deep water for Perch or other pan fish, I use one of my UL spinning rod & reels. What you want to do is possible and like you said will be a challenge. Good luck to you. I don't want to discourage you from trying. Personally, I have stopped trying to use the fly rod in all situations. I try to match my tackle to the conditions. Once hooked it's as much fun for me to feel a fish pull on a light spinning rod as it is a fly rod.
Tom