Chamikara Jayalath created BEAM-2531:
----------------------------------------
Summary: Improve efficiency of reading compressed text files
Key: BEAM-2531
URL: https://issues.apache.org/jira/browse/BEAM-2531
Project: Beam
Issue Type: Improvement
Components: sdk-py
Reporter: Chamikara Jayalath
Reading compressed text files using textio.ReadFromText() is about five times
slower compared to the corresponding transform in Java SDK. This is specially
noticeable when using DirectRunner. We should look into how we can improve
efficiency of this so that Python SDK is more comparable to Java SDK in this
regard.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
