Character set conversions

[Kagamin]

Adam D. Ruppe Wrote:

> The first problem I had was users can upload csv files, which they
> generally make in Excel... which apparently outputs Windows-1252.
> Fine for 99% of text, but then someone puts in a curly quote or
> an em dash and it throws an invalid utf 8 sequence.

The client usually send information about its locale, from this info you can infer ANSI encoding.