Went to the local towbar installer this morning, who looked at the towball and how it sitted in the collar. Said straight away rust or debris inside the collar was preventing it from locating properly.
Came back home, wire brush and a bit of spray white lithium grease, the towball now sits...