Varun created BEAM-14526:
----------------------------
Summary: SnowflakeIO fails to recognize new-line char in a column
Key: BEAM-14526
URL: https://issues.apache.org/jira/browse/BEAM-14526
Project: Beam
Issue Type: Bug
Components: io-java-snowflake
Affects Versions: 2.38.0
Reporter: Varun
When a snowflake string column contains new-line, the snowflakeIO fails to
read it as a record. Instead two invalid records gets created.
I see the issue due to the usage of TextIO; as the exported extract from the
snowflake contains the column data enclosed with quoted string, making it a
valid CSV.
Possibly be solved if FileIO(with custom splitable dofn to handle big file) is
used instead of TextIO.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
