A French bank, (obviously) but you will have to jump through the identification hoops and might be refused on the grounds of residency. They might not extend credit to a non-resident and might require you to keep a balance (i.e. your money) on the account to draw against.
we have recently opened a French bank account with Credit Agricole and they gave us a credit card immediately. Obviously you have to maintain sufficient funds in the account to pay for the credit card bills but there was no problem in opening the account
I think you need a French bank account. I have a friend with one but he has an account over there. Try searching the internet for French Banks and see what you come up with.
Eventually I suppose that once the French banks have changed all their 'chip and Pin' card machines to our newer standard, then this should become less and less of a problem.