I usually change "something" every 20-30 minutes... amount of split shot, position of strike indicator (assuming I'm fishing the same type and depth of water, otherwise I make an adjustment as soon as I switch holes), or flies. If I'm fishing dries, then I switch after about my 3rd or 4th refusal.