The OP clearly stated it was electric underfloor heating, so it should have a switch, not a gas tap.
Being a Hobby caravan, I wonder if it was purchased in the UK or elsewhere, as this may affect what support you can expect from the seller.
However I'm not familiar with this type of heating so I can't give focused help. But if you can't turn it "off" it is clearly malfunctioning, and potentially dangerous. Have you read the caravans handbook or asked the seller about it?
If its been built for the UK market, it should have a a fused spur isolator switch so the system can be isolated. Removing the fuse should be easy and stop the heating. The system may have its own Miniature Circuit Breaker (MCB) in the mains electrical consumer unit. or it might share its MCB with some other mains circuits or appliances in the caravan. switching the MCB off should s top the heating, but it may also prevent some other appliances from working.
If you have only just purchased the caravan in the UK, and it was a private sale, then you have very few legal rights to get it repaired by the seller, but if its was purchased from a UK dealer then you should look up your rights given to you by the Consumer Rights Act as the dealer has certain liabilities to you, to repair faulty goods.
The EU has some very similar "rights" . Check up how they apply to the country you purchased the caravan in.