I think perhaps you ae rubbing it too much with the balled up cloth. I also use Micron pens. I usually let the lettering dry for a day and other hit it with a blow dryer to help set...