Hi Emmerson,
That is exactly what I would expect, and it is perfectly normal.
For a solar panel or any other charger to work, it has to be able to produce a higher voltage than the battery it is trying to charge.
Although the panel produces 18V at its terminals, it can't produce much current, so as soon as any type of load (like a battery to be charged) is connected the terminal voltage will fall. You tell us the panel is rated only 4Watts, so at best it will only produce 1/3 amp, at 12V so its not going to make a massive or sudden difference to your battery
To check if the panel is working, disconnect everything from you battery and measure the voltage at its terminals, Now connect the solar panel, If it is working you should see a small increase in the terminal voltage of the battery.
A 4 Watt panel will only provide a small trickle charge to a caravan battery, It would be enough to keep a battery topped up as long as virtually nothing else is using the battery.