[GitHub] spark pull request: Fix SPARK-1413: Parquet messes up stdout and s...

2014-04-09 Thread julienledem
Github user julienledem commented on the pull request: https://github.com/apache/spark/pull/325#issuecomment-40033694 @pwendell I'm perfectly happy with removing this static initialization in parquet: https://github.com/Parquet/parquet-mr/blob

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45136303 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45135755 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45134955 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/SpecificParquetRecordReaderBase.java --- @@ -0,0 +1,233

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45136501 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45136485 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45135353 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/SpecificParquetRecordReaderBase.java --- @@ -0,0 +1,233

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45136171 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45136577 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45136673 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-18 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45236894 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45162142 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark pull request: [WIP] [SPARK-11787] [SQL] Improve Parquet scan...

2015-11-17 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/9774#discussion_r45162171 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/UnsafeRowParquetRecordReader.java --- @@ -0,0 +1,428

[GitHub] spark issue #16281: [SPARK-13127][SQL] Update Parquet to 1.9.0

2017-01-27 Thread julienledem
Github user julienledem commented on the issue: https://github.com/apache/spark/pull/16281 FYI: Parquet 1.8.2 vote thread passed: https://mail-archives.apache.org/mod_mbox/parquet-dev/201701.mbox/%3CCAO4re1mHLT%2BLYn8s1RTEDZK8-9WSVugY8-HQqAN%2BtU%3DBOi1L9w%40mail.gmail.com%3E

[GitHub] spark issue #16281: [SPARK-13127][SQL] Update Parquet to 1.9.0

2016-12-15 Thread julienledem
Github user julienledem commented on the issue: https://github.com/apache/spark/pull/16281 Like @rdblue said, I don't recall people asking for a 1.8.2 on the parquet dev list. We are happy to help and if there is a 1.8.x patch release branch it's better to maintain

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105321652 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105321141 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105324023 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105322283 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105322098 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105324269 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ArrowConvertersSuite.scala --- @@ -0,0 +1,567 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105321731 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105322470 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105322707 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105323172 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-09 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105322928 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software

[GitHub] spark pull request #15821: [SPARK-13534][PySpark] Using Apache Arrow to incr...

2017-03-10 Thread julienledem
Github user julienledem commented on a diff in the pull request: https://github.com/apache/spark/pull/15821#discussion_r105466801 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/ArrowConverters.scala --- @@ -0,0 +1,411 @@ +/* +* Licensed to the Apache Software