Opened 17 years ago

Closed 16 years ago

Last modified 16 years ago

#425 closed enhancement (fixed)

Store the character encoding for text files

Reported by: Nicklas Nordborg Owned by: Nicklas Nordborg
Priority: major Milestone: BASE 2.9
Component: core Version:
Keywords: Cc:

Description

When the FlatFileParser reads files it uses the system default encoding. On my Linux machine the default is UTF-8 and on Windows the default is cp1252. This causes problems since files doesn't have to use any of these encodings but cp1252 or ISO-8859-1 is more likely than UTF-8. The first step towards solving this problem is to add a configuration option in the base.config file for the encoding to use (ticket #424). The second step is to make it possible to select an encoding on a per-file basis. This possible also affects the encoding used in web pages, the view/download servlet, export plugins, etc.

Change History (13)

comment:1 by Jari Häkkinen, 17 years ago

Milestone: BASE 2.x+BASE 2.5

comment:2 by Jari Häkkinen, 17 years ago

Milestone: BASE 2.5BASE 2.x+

Is there a need to fix this ticket.

comment:3 by Nicklas Nordborg, 16 years ago

Milestone: BASE 2.x+BASE 2.9

comment:4 by Nicklas Nordborg, 16 years ago

Status: newassigned

comment:5 by Nicklas Nordborg, 16 years ago

(In [4520]) References #425: Store the character encoding for text files

Fixed in data and core layer, test program, list and view page on web, file upload and download. Remains to fix in "Test with file" and auto-detect file format functionality.

comment:6 by Nicklas Nordborg, 16 years ago

(In [4521]) References #425: Store the character encoding for text files

"Test with file" function fixed.

comment:7 by Nicklas Nordborg, 16 years ago

(In [4522]) References #425: Store the character encoding for text files

Added missing file needed for the "Test with file" function.

comment:8 by Nicklas Nordborg, 16 years ago

(In [4523]) References #425: Store the character encoding for text files

Export plug-ins saves the character set used when exporting the data.

comment:9 by Nicklas Nordborg, 16 years ago

(In [4524]) References #425: Store the character encoding for text files

Document changes in ExportOutputStream.

comment:10 by Nicklas Nordborg, 16 years ago

(In [4525]) References #425: Store the character encoding for text files

Adding support for selecting character set in the autodetect file format function.

comment:11 by Nicklas Nordborg, 16 years ago

(In [4526]) References #425: Store the character encoding for text files

Updated the UML diagram

comment:12 by Nicklas Nordborg, 16 years ago

Resolution: fixed
Status: assignedclosed

comment:13 by Nicklas Nordborg, 16 years ago

(In [4540]) References #425, #1126. Now sets character set correctly when file upload.

Note: See TracTickets for help on using tickets.