[
https://issues.apache.org/jira/browse/SPARK-14688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261895#comment-15261895
]
seth commented on SPARK-14688:
------------------------------
Hi Wei,
would you kindly share with me how you made it work.
what was the file extension?
A simple sample script would be awesome!
everything I tried failed.
{{winStream.pprint()}} returns me the filename enclosed by the binary
reprasantation.
{{?????@?@??file.txt.gz??????}}.
thanks
> pyspark textFileStream gzipped
> ------------------------------
>
> Key: SPARK-14688
> URL: https://issues.apache.org/jira/browse/SPARK-14688
> Project: Spark
> Issue Type: Improvement
> Components: PySpark, Streaming
> Affects Versions: 1.6.1
> Reporter: seth
> Labels: pyspark, streaming
>
> pyspark streamingObject does not support reading gzip files.
> Note that regular sparkContext does support gzip files
> [edited]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
