St Remy is a lovely town - and on market day it really buzzes. We took my 90 year old mum-in-law to France for her first ever flight, in January 2008 - and had a morning walking around the market in St Remy, which she absolutely loved. We were 'serenaded' by Patrick and Muriel (two street singers) outside the cafe where we sat (yes in January!!!) to have a coffee - and she was given an autographed CD when they heard it was a birthday treat!
We also did Les Baux, and Glanum (a roman village nearby, which is like a mini-Ephesus). As said, you're near enough to the Camargue, Arles, and also the 'Peter Mayle' country, of Gordes, Bonnieux, etc. Do visit Fontaine de Vaucluse, for the stunning river scenery, and also Rousillon for the red ochre rocks - make sure you take a camera, the colours are amazing.
We've never caravanned there, usually choosing to be nearer to the coast, but would like to do so in the future. I can't imagine that you'll have a problem finding pitches - though it is a popular place, and even in winter there was quite a crowd 'doing' the market!