Hi Russell,
The off-taste can be caused by manufacturing chemicals leaching out of the plastic pipes and containers in your water system. An in-line water filter can remove these compounds, but will saturate and stop working after quite limited use.
However if someone has used chlorine or chlorine bleach (in regions where the water is slightly acidic) to sterilise the water system, then very small amounts of the chlorine react with dissolved organic chemicals - such as fallen leaves or peat in the water companies supply reservoir, or leached chemicals from your water tank - to make organo-chlorine compounds.
If you are unlucky you can taste these particular organo-chlorine compounds at levels around one part in a billion, and the in-line filters don't help unless they are new.
Both Brenda and myself are very sensitive to the taste of organo-chlorines, and we don't drink water stored in our Eriba's water system. Somewhere in France last Summer we got a tank full of water with a splash of chlorine in it.
If we are making tea or coffee, we fresh fill our kettle from the drinking water tap - and even then notice vast differences in water taste. On some sites you know they've done work on the pipework or they have just been sterilising the pipes because of the taste of these organo-chlorines.
So if the water from the site tap is oK we use that, or end up buying Tesco "Value Spring Water" to make hot drinks.
Robert