Well it just about has to be an adhesion problem. The problem my and most likely was in the base paint/primer. If it is all the way to the steel, the primer and all is coming off.
To fix it, sand it to bare metal and spray it with etching primer first and then with a good urethane primer. If you prefer not to use etching primer, treat the metal with metal conditioner before priming.