[GitHub] hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

2019-01-21 Thread GitBox
hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#discussion_r249369346 ## File path:

[GitHub] hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

2019-01-21 Thread GitBox
hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#discussion_r249369278 ## File path:

[GitHub] hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

2019-01-21 Thread GitBox
hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#discussion_r249369278 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456011308 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456011314 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456011308 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456011314 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
SparkQA removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456010992 **[Test build #101471 has

[GitHub] AmplabJenkins commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456011512 Merged build finished. Test FAILed.

[GitHub] SparkQA commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
SparkQA commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456011499 **[Test build #101471 has

[GitHub] gaborgsomogyi commented on a change in pull request #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
gaborgsomogyi commented on a change in pull request #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#discussion_r249387575 ## File path:

[GitHub] gaborgsomogyi commented on a change in pull request #23499: [SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core.

2019-01-21 Thread GitBox
gaborgsomogyi commented on a change in pull request #23499: [SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core. URL: https://github.com/apache/spark/pull/23499#discussion_r249406329 ## File path:

[GitHub] ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray

2019-01-21 Thread GitBox
ayudovin commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r249419959 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@

[GitHub] SparkQA commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
SparkQA commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#issuecomment-456047082 **[Test build #101474 has

[GitHub] AmplabJenkins commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#issuecomment-456047317 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#issuecomment-456047313 Merged build finished. Test PASSed.

[GitHub] cloud-fan commented on a change in pull request #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#discussion_r249366878 ## File path:

[GitHub] cloud-fan commented on a change in pull request #23539: [SPARK-26617][SQL] Cache manager locks

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#discussion_r249370269 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ## @@ -136,19

[GitHub] AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456011517 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456011512 Merged build finished. Test FAILed.

[GitHub] sujith71955 commented on a change in pull request #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
sujith71955 commented on a change in pull request #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#discussion_r249402172 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456036327 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] cloud-fan commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#discussion_r249372484 ## File path:

[GitHub] hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

2019-01-21 Thread GitBox
hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#discussion_r249372411 ## File path:

[GitHub] SparkQA commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
SparkQA commented on issue #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601#issuecomment-456010992 **[Test build #101471 has

[GitHub] AmplabJenkins commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456031531 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456031538 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins removed a comment on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456031531 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456031538 Test PASSed. Refer to this link for build results (access rights

[GitHub] rvesse commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

2019-01-21 Thread GitBox
rvesse commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249403231 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -714,6 +714,24

[GitHub] AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456034754 Build finished. Test FAILed.

[GitHub] AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456034759 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] maropu commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray

2019-01-21 Thread GitBox
maropu commented on a change in pull request #23569: [SPARK-25713][Core] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r249418442 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@

[GitHub] AmplabJenkins commented on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame URL: https://github.com/apache/spark/pull/23602#issuecomment-456045563 Can one of the admins verify this patch? This

[GitHub] hvanhovell commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

2019-01-21 Thread GitBox
hvanhovell commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-456004821 @DaveDeCaprio what kind of process is processing these plans? As soon as we are dealing with plans of this

[GitHub] mridulm commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

2019-01-21 Thread GitBox
mridulm commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#discussion_r249378387 ## File path:

[GitHub] maropu commented on a change in pull request #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

2019-01-21 Thread GitBox
maropu commented on a change in pull request #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#discussion_r249411893 ## File path:

[GitHub] maropu commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
maropu commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#issuecomment-456046544 retest this please This is an

[GitHub] maropu commented on a change in pull request #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
maropu commented on a change in pull request #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#discussion_r249419838 ## File path:

[GitHub] cloud-fan commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

2019-01-21 Thread GitBox
cloud-fan commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#issuecomment-456002411 good catch! LGTM except a comment for the test.

[GitHub] cloud-fan commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#discussion_r249384748 ## File path:

[GitHub] cloud-fan commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#discussion_r249384748 ## File path:

[GitHub] sujith71955 commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
sujith71955 commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456028681 > Other than the small thing looks good. > Maybe it's better not to use

[GitHub] viirya commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
viirya commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456034296 Changed default config value to false and added a note to migration guide. Please take a look when

[GitHub] SparkQA commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
SparkQA commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456034403 **[Test build #101473 has

[GitHub] gaborgsomogyi commented on a change in pull request #23499: [SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core.

2019-01-21 Thread GitBox
gaborgsomogyi commented on a change in pull request #23499: [SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core. URL: https://github.com/apache/spark/pull/23499#discussion_r249413297 ## File path:

[GitHub] gaborgsomogyi commented on a change in pull request #23499: [SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core.

2019-01-21 Thread GitBox
gaborgsomogyi commented on a change in pull request #23499: [SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core. URL: https://github.com/apache/spark/pull/23499#discussion_r249413063 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#issuecomment-456047317 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins removed a comment on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#issuecomment-456047313 Merged build finished. Test PASSed.

[GitHub] maropu commented on a change in pull request #23569: [SPARK-25713][SQL] - adding copy for ColumnArray

2019-01-21 Thread GitBox
maropu commented on a change in pull request #23569: [SPARK-25713][SQL] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r249423462 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@ -46,7

[GitHub] sujith71955 commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
sujith71955 commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-45596 @all Please let me know is any issues still needs to be addressed in this

[GitHub] hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

2019-01-21 Thread GitBox
hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#discussion_r249371798 ## File path:

[GitHub] mridulm commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

2019-01-21 Thread GitBox
mridulm commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#discussion_r249378387 ## File path:

[GitHub] rvesse commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS

2019-01-21 Thread GitBox
rvesse commented on a change in pull request #23546: [SPARK-23153][K8s] Support client dependencies with a HCFS URL: https://github.com/apache/spark/pull/23546#discussion_r249403231 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -714,6 +714,24

[GitHub] SparkQA commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
SparkQA commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456031083 **[Test build #101472 has

[GitHub] viirya commented on a change in pull request #23499: [SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core.

2019-01-21 Thread GitBox
viirya commented on a change in pull request #23499: [SPARK-26254][CORE] Extract Hive + Kafka dependencies from Core. URL: https://github.com/apache/spark/pull/23499#discussion_r249412644 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame URL: https://github.com/apache/spark/pull/23602#issuecomment-456044978 Can one of the admins verify this patch?

[GitHub] AmplabJenkins commented on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame URL: https://github.com/apache/spark/pull/23602#issuecomment-456045080 Can one of the admins verify this patch? This

[GitHub] AmplabJenkins commented on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame URL: https://github.com/apache/spark/pull/23602#issuecomment-456044978 Can one of the admins verify this patch? This

[GitHub] hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

2019-01-21 Thread GitBox
hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#discussion_r249370703 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] cloud-fan commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#discussion_r249371205 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456034754 Build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456051801 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456051801 Merged build finished. Test PASSed. This is an

[GitHub] SparkQA commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

2019-01-21 Thread GitBox
SparkQA commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456051626 **[Test build #101475 has

[GitHub] AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456051808 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456051808 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] gengliangwang opened a new pull request #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it

2019-01-21 Thread GitBox
gengliangwang opened a new pull request #23601: [WIP][SPARK-26673] File source V2 write: create framework and migrate ORC to it URL: https://github.com/apache/spark/pull/23601 ## What changes were proposed in this pull request? WIP ## How was this patch tested?

[GitHub] mridulm commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

2019-01-21 Thread GitBox
mridulm commented on a change in pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#discussion_r249396035 ## File path:

[GitHub] AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456036327 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456036321 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame URL: https://github.com/apache/spark/pull/23602#issuecomment-456045080 Can one of the admins verify this patch?

[GitHub] Ngone51 commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

2019-01-21 Thread GitBox
Ngone51 commented on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-456045680 kindly ping

[GitHub] maropu commented on issue #23569: [SPARK-25713][Core] - adding copy for ColumnArray

2019-01-21 Thread GitBox
maropu commented on issue #23569: [SPARK-25713][Core] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#issuecomment-456045753 not `[CORE]` but `[SQL]` in the title. This is an automated message

[GitHub] cloud-fan commented on a change in pull request #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#discussion_r249366878 ## File path:

[GitHub] cloud-fan commented on a change in pull request #23539: [SPARK-26617][SQL] Cache manager locks

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#discussion_r249368526 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ## @@ -136,21

[GitHub] hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans

2019-01-21 Thread GitBox
hvanhovell commented on a change in pull request #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#discussion_r249370703 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala

[GitHub] ayudovin commented on issue #23569: [SPARK-25713][Core] - adding copy for ColumnArray

2019-01-21 Thread GitBox
ayudovin commented on issue #23569: [SPARK-25713][Core] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#issuecomment-456003803 @srowen, can you review this pull request? This is an automated

[GitHub] AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#issuecomment-456036321 Merged build finished. Test PASSed.

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

2019-01-21 Thread GitBox
beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r248908002 ## File path:

[GitHub] beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties.

2019-01-21 Thread GitBox
beliefer commented on a change in pull request #23574: [SPARK-26643][SQL] Fix incorrect analysis exception about set table properties. URL: https://github.com/apache/spark/pull/23574#discussion_r248908002 ## File path:

[GitHub] liupc opened a new pull request #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame

2019-01-21 Thread GitBox
liupc opened a new pull request #23602: [SPARK-26674]Consolidate CompositeByteBuf when reading large frame URL: https://github.com/apache/spark/pull/23602 ## What changes were proposed in this pull request? Currently, TransportFrameDecoder will not consolidate the buffers read from

[GitHub] AmplabJenkins removed a comment on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal URL: https://github.com/apache/spark/pull/23603#issuecomment-456071527 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal URL: https://github.com/apache/spark/pull/23603#issuecomment-456074754 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal URL: https://github.com/apache/spark/pull/23603#issuecomment-456074747 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins commented on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal URL: https://github.com/apache/spark/pull/23603#issuecomment-456074747 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins commented on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal URL: https://github.com/apache/spark/pull/23603#issuecomment-456074754 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA removed a comment on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
SparkQA removed a comment on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#issuecomment-456047082 **[Test build #101474 has

[GitHub] SparkQA commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD

2019-01-21 Thread GitBox
SparkQA commented on issue #23559: [SPARK-26630][SQL] Fix ClassCastException in TableReader while creating HadoopRDD URL: https://github.com/apache/spark/pull/23559#issuecomment-456085268 **[Test build #101474 has

[GitHub] AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions

2019-01-21 Thread GitBox
AmplabJenkins removed a comment on issue #23581: [SPARK-22465][CORE][FOLLOWUP]Use existing partitioner when defaultNumPartitions is equal to maxPartitioner.numPartitions URL: https://github.com/apache/spark/pull/23581#issuecomment-455458800 Can one of the admins verify this patch?

[GitHub] HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-21 Thread GitBox
HyukjinKwon commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-456084845 Our coverage looks roughly 90% in PySpark. Looks not that bad :D.

[GitHub] srowen commented on a change in pull request #23569: [SPARK-25713][SQL] - adding copy for ColumnArray

2019-01-21 Thread GitBox
srowen commented on a change in pull request #23569: [SPARK-25713][SQL] - adding copy for ColumnArray URL: https://github.com/apache/spark/pull/23569#discussion_r249461375 ## File path: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarArray.java ## @@ -46,7

[GitHub] cloud-fan commented on a change in pull request #23596: [SPARK-26652][SQL] Use Proleptic Gregorian Calendar in Literal.fromString

2019-01-21 Thread GitBox
cloud-fan commented on a change in pull request #23596: [SPARK-26652][SQL] Use Proleptic Gregorian Calendar in Literal.fromString URL: https://github.com/apache/spark/pull/23596#discussion_r249467071 ## File path:

[GitHub] HyukjinKwon commented on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal

2019-01-21 Thread GitBox
HyukjinKwon commented on issue #23603: [SPARK-26652][SQL] Remove fromJSON and fromString from Literal URL: https://github.com/apache/spark/pull/23603#issuecomment-456090035 retest this please This is an automated message

[GitHub] AmplabJenkins commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456109647 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
AmplabJenkins commented on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456109638 Merged build finished. Test PASSed.

[GitHub] SparkQA removed a comment on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API

2019-01-21 Thread GitBox
SparkQA removed a comment on issue #23429: [SPARK-26432][CORE] Obtain HBase delegation token operation compatible with HBase 2.x.x version API URL: https://github.com/apache/spark/pull/23429#issuecomment-456031083 **[Test build #101472 has

[GitHub] HyukjinKwon edited a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

2019-01-21 Thread GitBox
HyukjinKwon edited a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-440950478 cc @rxin, @srowen, @JoshRosen, @shaneknapp, @gatorsmile, @BryanCutler, @holdenk,

[GitHub] srowen commented on a change in pull request #21627: [SPARK-24484][MLLIB]Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

2019-01-21 Thread GitBox
srowen commented on a change in pull request #21627: [SPARK-24484][MLLIB]Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values. URL: https://github.com/apache/spark/pull/21627#discussion_r249507037 ## File path:

[GitHub] maropu commented on issue #23597: [SPARK-26653][SQL] Use Proleptic Gregorian calendar in parsing JDBC lower/upper bounds

2019-01-21 Thread GitBox
maropu commented on issue #23597: [SPARK-26653][SQL] Use Proleptic Gregorian calendar in parsing JDBC lower/upper bounds URL: https://github.com/apache/spark/pull/23597#issuecomment-456056911 LGTM except for one minor comment. cc: @gatorsmile

  1   2   3   4   5   6   7   8   >