Christopher,
Knowing you as I do (from posts and photos) I think you might fish even if there was no family. Fishing with family just increases exponentially the joy of it all.

For me I fish because it puts me in places, both physical and mental that I truly enjoy. I fish alone and enjoy the solitude. I fish while my wife is birding and we share the outdoors and solitude, so often just pointing at things that are of interest or beauty. I fish with my children and we share all of the above plus the adventure of the fishing itself.

I rarely keep fish, not a a matter of principle, but just because it does not enhance my experience. My joy comes from seeing them come to the net or to my hand. I think that I would even fish if I knew that there were no fish to catch or no hook at the end of the line. It sounds strange, but the experience of being there and doing something as close to perfection as you can is enough for me. The fish part is extra.

jed