It sounds like the way forward is to do it both ways. I don't know how others go about it but the few videos I've done took me a long long time to edit. Maybe with practice that will come down a bit. I can do a photo SbS in an hour or two, a video takes me 12+ hours. I'll see what I can do.
Cheers,
A.