Github user sbcd90 commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-222180929
@HyukjinKwon , closing this PR for now.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project d
Github user sbcd90 closed the pull request at:
https://github.com/apache/spark/pull/13257
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is ena
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-221455213
@sbcd90 I currently can't think of other alternatives and it seems that's
why it has not been enabled again.
---
If your project is set up for it, you can reply to
Github user sbcd90 commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-221452898
Hello @HyukjinKwon , I think it is an ORC issue. There is a final call to
ORC api & feel that the issue should be fixed in ORC.
```
new OrcOutputFormat().get
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-221132286
Ah, I think he meant this below:
- Parquet
```scala
val emptyDf = spark.range(10).limit(0).toDF()
emptyDf.write
.format("parquet")
Github user sbcd90 commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-220959617
@HyukjinKwon, this PR exactly fixes that issue. If you test this PR with
the sample code you provided in the JIRA ticket
```
val conf = new SparkConf().setAp
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-220898876
@sbcd90 I just read this JIRA
[SPARK-8501](https://issues.apache.org/jira/browse/SPARK-8501) to figure out
why it was disabled and tried to manually test this.
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-220886604
Hi @sbcd90 I am not a committer but I just left a comment because I like
your PR. Let me add some more comments which I think might be changed.
---
If your project
Github user sbcd90 commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-220885344
Hello @HyukjinKwon , I have added a testcase now. Please review.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub a
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-220860596
@sbcd90 I think we will need a test to make sure this fixes the issue and
other changes in the future do not break this change.
---
If your project is set up for i
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/13257#issuecomment-220860424
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your p
GitHub user sbcd90 opened a pull request:
https://github.com/apache/spark/pull/13257
[SPARK-15474][SQL]ORC data source fails to write and read back empty
dataframe
## What changes were proposed in this pull request?
Currently ORC data source fails to write and read empty da
12 matches
Mail list logo
