[GitHub] spark pull request: [spark-15212][SQL]CSV file reader when read fi...

2016-05-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/12987#issuecomment-218958088 @WeichenXu123 I tried that with `ignoreLeadingWhiteSpace` and `ignoreTrailingWhiteSpace` and it seems working fine. I am careful of saying this because I am not a c

[GitHub] spark pull request: [spark-15212][SQL]CSV file reader when read fi...

2016-05-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/12987#issuecomment-217755229 I think this option should be associated with `ignoreLeadingWhiteSpace` and `ignoreTrailingWhiteSpace` options. --- If your project is set up for it, you can reply

[GitHub] spark pull request: [spark-15212][SQL]CSV file reader when read fi...

2016-05-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/12987#issuecomment-217754950 Also, the JIRA in the title, `spark-15212` might better be `SPARK-15212` (See https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark) --- If your

[GitHub] spark pull request: [spark-15212][SQL]CSV file reader when read fi...

2016-05-08 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/12987#discussion_r62441323 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/DefaultSource.scala --- @@ -61,7 +61,7 @@ class DefaultSource extends F

[GitHub] spark pull request: [spark-15212][SQL]CSV file reader when read fi...

2016-05-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12987#issuecomment-217710660 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [spark-15212][SQL]CSV file reader when read fi...

2016-05-08 Thread WeichenXu123
GitHub user WeichenXu123 opened a pull request: https://github.com/apache/spark/pull/12987 [spark-15212][SQL]CSV file reader when read file with first line schema do not filter blank in schema column name ## What changes were proposed in this pull request? When load csv fil