Investigate if we can implement UTF-8 with ISO-8859-1 fallback when parsing text files
|Reported by:||Nicklas Nordborg||Owned by:||Nicklas Nordborg|
See also #2156.
The two most common encodings (in our lab) is UTF-8 and ISO-8859-1 (or Windows-1252), but the typical user has no idea about which encoding is used. On the server side we always prefer UTF-8 since that will cause less problems in the long run. Then there is the problem with Microsoft Excel on Windows which seems to be problematic when it comes to saving text as UTF-8. It would be nice to have a parser that is able to parse UTF-8 and if it encounter invalid sequences interpret that as ISO-8859-1 or Windows-1252.
For background information see: https://en.wikipedia.org/wiki/UTF-8