Wrap tape around the parts which may get scuffed by sandpaper... you only want to remove the paint from the ball. Also keep some Brake Cleaner handy, to clean after paint removal and periodically afterwards. If it's a fixed towball, and exposed to the elements, it will probably go rusty, so you'll have to keep cleaning it.
I hate seeing rusty balls on a car. :woohoo: