[GitHub] [spark] AmplabJenkins commented on issue #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD URL: https://github.com/apache/spark/pull/25856#issuecomment-534402311 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD URL: https://github.com/apache/spark/pull/25856#issuecomment-534402305 Merged build finished. Test PASSed. This is an

[GitHub] [spark] viirya commented on a change in pull request #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD

2019-09-23 Thread GitBox
viirya commented on a change in pull request #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD URL: https://github.com/apache/spark/pull/25856#discussion_r327437921 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ##

[GitHub] [spark] SparkQA commented on issue #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD

2019-09-23 Thread GitBox
SparkQA commented on issue #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD URL: https://github.com/apache/spark/pull/25856#issuecomment-534401969 **[Test build #111258 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534400705 Test FAILed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
SparkQA removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534378099 **[Test build #111255 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534400696 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534400696 Merged build finished. Test FAILed.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog

2019-09-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog URL: https://github.com/apache/spark/pull/25903#discussion_r327436761 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534400705 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
SparkQA commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534400581 **[Test build #111255 has

[GitHub] [spark] TomokoKomiyama commented on a change in pull request #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands

2019-09-23 Thread GitBox
TomokoKomiyama commented on a change in pull request #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands URL: https://github.com/apache/spark/pull/25848#discussion_r327434109 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog URL: https://github.com/apache/spark/pull/17254#issuecomment-534395647 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog URL: https://github.com/apache/spark/pull/17254#issuecomment-534395651 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog URL: https://github.com/apache/spark/pull/17254#issuecomment-534395651 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] LantaoJin commented on issue #25840: [SPARK-29166][SQL] Add parameters to limit the number of dynamic partitions for data source table

2019-09-23 Thread GitBox
LantaoJin commented on issue #25840: [SPARK-29166][SQL] Add parameters to limit the number of dynamic partitions for data source table URL: https://github.com/apache/spark/pull/25840#issuecomment-534395761 I found current implementation has a problem that `FileCommitProtocol` is SerDe

[GitHub] [spark] AmplabJenkins commented on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog URL: https://github.com/apache/spark/pull/17254#issuecomment-534395647 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog

2019-09-23 Thread GitBox
SparkQA removed a comment on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog URL: https://github.com/apache/spark/pull/17254#issuecomment-534355173 **[Test build #111248 has

[GitHub] [spark] SparkQA commented on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog

2019-09-23 Thread GitBox
SparkQA commented on issue #17254: [SPARK-19917][SQL]qualified partition path stored in catalog URL: https://github.com/apache/spark/pull/17254#issuecomment-534395274 **[Test build #111248 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode URL: https://github.com/apache/spark/pull/25889#issuecomment-534393615 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode URL: https://github.com/apache/spark/pull/25889#issuecomment-534393613 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system URL: https://github.com/apache/spark/pull/25910#issuecomment-534393255 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode URL: https://github.com/apache/spark/pull/25889#issuecomment-534393615 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode URL: https://github.com/apache/spark/pull/25889#issuecomment-534393613 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system URL: https://github.com/apache/spark/pull/25910#issuecomment-534393507 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system URL: https://github.com/apache/spark/pull/25910#issuecomment-534393255 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode

2019-09-23 Thread GitBox
SparkQA commented on issue #25889: [SPARK-29202][Deploy]driver java options are not passed to driver process in Yarn client mode URL: https://github.com/apache/spark/pull/25889#issuecomment-534393323 **[Test build #111257 has

[GitHub] [spark] igozali opened a new pull request #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system

2019-09-23 Thread GitBox
igozali opened a new pull request #25910: [SPARK-28762][CORE] Read JAR main class if JAR is not located in local file system URL: https://github.com/apache/spark/pull/25910 ### What changes were proposed in this pull request? JIRA:

[GitHub] [spark] imback82 commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog

2019-09-23 Thread GitBox
imback82 commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog URL: https://github.com/apache/spark/pull/25903#discussion_r327427897 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog

2019-09-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog URL: https://github.com/apache/spark/pull/25903#discussion_r327428402 ## File path:

[GitHub] [spark] imback82 commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-23 Thread GitBox
imback82 commented on a change in pull request #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#discussion_r327428016 ## File path:

[GitHub] [spark] imback82 commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog

2019-09-23 Thread GitBox
imback82 commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog URL: https://github.com/apache/spark/pull/25903#discussion_r327427897 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534387915 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534387909 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
SparkQA removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534359754 **[Test build #111249 has

[GitHub] [spark] SparkQA commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
SparkQA commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534387804 **[Test build #111249 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534387687 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534387909 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534387691 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534387915 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534387687 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534387691 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
SparkQA commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534387409 **[Test build #111256 has

[GitHub] [spark] wangshuo128 edited a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
wangshuo128 edited a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534381006 @cloud-fan @viirya Sorry, my earlier description and fix are not

[GitHub] [spark] cloud-fan commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog

2019-09-23 Thread GitBox
cloud-fan commented on a change in pull request #25903: [SPARK-29215][SQL] current namespace should be tracked in SessionCatalog if the current catalog is session catalog URL: https://github.com/apache/spark/pull/25903#discussion_r327422022 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #25868: [SPARK-28527][SQL] Enable ThriftServerQueryTestSuite

2019-09-23 Thread GitBox
dongjoon-hyun commented on issue #25868: [SPARK-28527][SQL] Enable ThriftServerQueryTestSuite URL: https://github.com/apache/spark/pull/25868#issuecomment-534382506 Thank you, @wangyum . Please merge this after PST midnight to avoid Jenkins reset.

[GitHub] [spark] wangshuo128 edited a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
wangshuo128 edited a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534381006 @cloud-fan @viirya Sorry, my earlier description and fix are not

[GitHub] [spark] wangshuo128 edited a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
wangshuo128 edited a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534381006 @cloud-fan @viirya Sorry, my earlier description and fix are not

[GitHub] [spark] wangshuo128 commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
wangshuo128 commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534381006 @cloud-fan @viirya Sorry, my earlier description and fix is not good

[GitHub] [spark] cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534380034 I ran additional measurements testing out different thread numbers on

[GitHub] [spark] cozos commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
cozos commented on a change in pull request #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#discussion_r327420221 ## File path:

[GitHub] [spark] cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534380034 I ran additional measurements testing out different thread numbers on

[GitHub] [spark] itskals commented on a change in pull request #25840: [SPARK-29166][SQL] Add parameters to limit the number of dynamic partitions for data source table

2019-09-23 Thread GitBox
itskals commented on a change in pull request #25840: [SPARK-29166][SQL] Add parameters to limit the number of dynamic partitions for data source table URL: https://github.com/apache/spark/pull/25840#discussion_r327420033 ## File path:

[GitHub] [spark] cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534380034 I ran additional measurements testing out different thread numbers on

[GitHub] [spark] cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534380034 I ran additional measurements testing out different thread numbers on

[GitHub] [spark] cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534380034 I ran additional measurements testing out different thread numbers on

[GitHub] [spark] cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
cozos edited a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534380034 I ran additional measurements testing out different thread numbers on

[GitHub] [spark] cozos commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
cozos commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534380034 I ran additional measurements testing out different thread numbers on the S3 Landsat

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r327419105 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r327419105 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r327418746 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534378330 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534378336 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534378336 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534378330 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r327418424 ## File path:

[GitHub] [spark] wangshuo128 commented on a change in pull request #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
wangshuo128 commented on a change in pull request #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#discussion_r327418429 ## File path:

[GitHub] [spark] SparkQA commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-23 Thread GitBox
SparkQA commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-534378099 **[Test build #111255 has

[GitHub] [spark] dongjoon-hyun commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
dongjoon-hyun commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-534378139 Thank you for adding `// TODO(SPARK-29076): Validate with docker 4 desktop`, @holdenk !

[GitHub] [spark] sarutak edited a comment on issue #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow.

2019-09-23 Thread GitBox
sarutak edited a comment on issue #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow. URL: https://github.com/apache/spark/pull/25905#issuecomment-534376262 @dongjoon-hyun I've noticed Chrome `77.0.3865.90 (latest)` and Firefox `69.01 (latest)` both of which run

[GitHub] [spark] dongjoon-hyun commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling

2019-09-23 Thread GitBox
dongjoon-hyun commented on issue #24613: [SPARK-27549][SS] Add support for committing kafka offsets per batch for supporting external tooling URL: https://github.com/apache/spark/pull/24613#issuecomment-534377141 Thank you, @HeartSaVioR .

[GitHub] [spark] SparkQA commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
SparkQA commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534376827 **[Test build #111254 has

[GitHub] [spark] HeartSaVioR commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
HeartSaVioR commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534376699 Test failure: https://issues.apache.org/jira/browse/SPARK-29221

[GitHub] [spark] HeartSaVioR commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
HeartSaVioR commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534376715 retest this, please This is an

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow.

2019-09-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow. URL: https://github.com/apache/spark/pull/25905#discussion_r327416560 ## File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow.

2019-09-23 Thread GitBox
dongjoon-hyun commented on a change in pull request #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow. URL: https://github.com/apache/spark/pull/25905#discussion_r327416560 ## File path: core/src/main/resources/org/apache/spark/ui/static/stagepage.js

[GitHub] [spark] AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534376096 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] sarutak commented on issue #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow.

2019-09-23 Thread GitBox
sarutak commented on issue #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow. URL: https://github.com/apache/spark/pull/25905#issuecomment-534376262 @dongjoon-hyun I've noticed Chrome `77.0.3865.90 (latest)` and Firefox `69.01 (latest)` both of which run on

[GitHub] [spark] AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534376091 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534376096 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
SparkQA commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534375976 **[Test build #111247 has

[GitHub] [spark] AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534376091 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query

2019-09-23 Thread GitBox
SparkQA removed a comment on issue #22952: [SPARK-20568][SS] Provide option to clean up completed files in streaming query URL: https://github.com/apache/spark/pull/22952#issuecomment-534345931 **[Test build #111247 has

[GitHub] [spark] dongjoon-hyun commented on issue #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow.

2019-09-23 Thread GitBox
dongjoon-hyun commented on issue #25905: [SPARK-29218][WEBUI] Widths of checkboxes in StagePage are too narrow. URL: https://github.com/apache/spark/pull/25905#issuecomment-534375300 This PR's description? This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-534374447 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-534374442 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-534374442 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-534374447 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file

2019-09-23 Thread GitBox
SparkQA commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-534374173 **[Test build #111253 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-534371288 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-534371286 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-534371261 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/16320/

[GitHub] [spark] AmplabJenkins commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-534371286 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-534371288 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire

2019-09-23 Thread GitBox
SparkQA commented on issue #25748: [SPARK-28904][K8S] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#issuecomment-534368310 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/16320/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534367464 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
AmplabJenkins removed a comment on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534367462 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534367464 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
AmplabJenkins commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534367462 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary

2019-09-23 Thread GitBox
SparkQA commented on issue #25899: [SPARK-29089][SQL] Parallelize blocking FileSystem calls in DataSource#checkAndGlobPathIfNecessary URL: https://github.com/apache/spark/pull/25899#issuecomment-534367219 **[Test build #111252 has

  1   2   3   4   5   6   7   8   9   10   >