I would not remove a fly from the end of my line as long as the fish were still biting no matter how it looks! Its what the fish likes that counts in the number of hook ups.
My suggestion because of the fraying of the leader would be to retie the fly onto the leader or replace the leader and retie the fly to the leader.

Fishin'Jimmy