Skip to content

CSV Parser does not allow columns > 100,000 characters #133

@alangrafu

Description

@alangrafu

When converting ftp://ftp.ncbi.nih.gov/pub/taxonomy/taxdump.tar.gz -> citations.dmp, there is one row with a REALLY long value (it happens to be listing every taxon) and causes:

java.io.IOException: Maximum column length of 100,000 exceeded in column 6 in record 13,566. 
Set the SafetySwitch property to false if you're expecting column lengths greater than 
100,000 characters to avoid this error.

There should be an enhancement parameter to set the flag in the csv parser to use large amount of memory when columns are large

csvReader.setSafetySwitch(false)

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions