Look at the Griffin Superior 1A vise at around $50 for a clamp version and $60 for a pedestal base version. Or the Griffin Montana Pro Vise at $80 for clamp and $90 for pedestal version. The Montana Pro holds hooks up to 7/0. The Montana Pro II kit, which includes some tying tools and carry case is $129.
If you want a rotary vise the Griffin Odyssey Spider is around $85 and the Danvise a few $ more. BT's Flyfishing Products, a sponsor of this website is a source for the Danvise. A pedestal base will set you back about another $25-$30.
I have a Renzetti, two Dyna King, and a Regal vise, but if I had to start again on a limited budget I would be quite happy with the Griffin vises or Danvise.
If you look at the sponsor page for this website you will find a number of online sources for materials including Hook and Hackle and J. Stockard. Another favorite of mine is Cascade Crest Tools, which has a great selection of vises, tools, and materials.
You can find a lot of instructional videos on youtube and there are some great ones here
www.kwsu.org/Offers/FlyTying.aspx