[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344312#comment-17344312
]
Nick Hryhoriev commented on SPARK-11844:
[~sungwy92]
spark.hadoop.fs.s3a.fast.upload": "true",
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344105#comment-17344105
]
Sungwon commented on SPARK-11844:
-
I'm in agreement with your intuition that S3aOutputStream may be
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344095#comment-17344095
]
Sungwon commented on SPARK-11844:
-
[~hryhoriev.nick] where do you see this option?
I don't see it in
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342447#comment-17342447
]
Nick Hryhoriev commented on SPARK-11844:
I turn off `fast.data.upload` in spark Hadoop config
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17334577#comment-17334577
]
Nick Hryhoriev commented on SPARK-11844:
[~Xu_Guang_Lv] My issue is also always reproducible
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320926#comment-17320926
]
Xu Guang Lv commented on SPARK-11844:
-
I got the same error too, but I can definitely reproduce the
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317066#comment-17317066
]
Nick Hryhoriev commented on SPARK-11844:
I have experienced the same issue with spark 2.4.7 and
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288693#comment-17288693
]
Sungwon commented on SPARK-11844:
-
I'm seeing the same issue on spark-2.4
I'm able to read the parquet
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16213216#comment-16213216
]
Cosmin Lehene commented on SPARK-11844:
---
I'm seeing these with spark-2.2.1-SNAPSHOT
{noformat}
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015497#comment-15015497
]
Hyukjin Kwon commented on SPARK-11844:
--
Just a question.. Does this just happen randomly? if the
[
https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15018445#comment-15018445
]
Yin Huai commented on SPARK-11844:
--
It did happen randomly. I only saw it once or twice. The file was
11 matches
Mail list logo
