[jira] [Created] (SPARK-32402) Implement ALTER TABLE in JDBC Table Catalog

2020-07-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32402: -- Summary: Implement ALTER TABLE in JDBC Table Catalog Key: SPARK-32402 URL: https://issues.apache.org/jira/browse/SPARK-32402 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

2020-07-23 Thread Abhijit Das (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163288#comment-17163288 ] Abhijit Das commented on SPARK-20427: - [~Kyrdan] Can you explain your implementation ? Have you

[jira] [Assigned] (SPARK-32406) Support reset one particular configuration

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32406: Assignee: (was: Apache Spark) > Support reset one particular configuration >

[jira] [Created] (SPARK-32407) Remove upperbound of Sphinx version

2020-07-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32407: Summary: Remove upperbound of Sphinx version Key: SPARK-32407 URL: https://issues.apache.org/jira/browse/SPARK-32407 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-32406) Support reset one particular configuration

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32406: Assignee: Apache Spark > Support reset one particular configuration >

[jira] [Commented] (SPARK-32406) Support reset one particular configuration

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163317#comment-17163317 ] Apache Spark commented on SPARK-32406: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32403: Assignee: Apache Spark > SCRIP TRANSFORM Extract common method from process row to avoid

[jira] [Assigned] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32403: Assignee: (was: Apache Spark) > SCRIP TRANSFORM Extract common method from process

[jira] [Commented] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163271#comment-17163271 ] Apache Spark commented on SPARK-32403: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163270#comment-17163270 ] Apache Spark commented on SPARK-32403: -- User 'AngersZh' has created a pull request for this

[jira] [Resolved] (SPARK-32404) Catch and adding excetion about HiveInspector can't converted data type

2020-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32404. --- Resolution: Duplicate > Catch and adding excetion about HiveInspector can't converted data type >

[jira] [Created] (SPARK-32404) Catch and adding excetion about HiveInspector can't converted data type

2020-07-23 Thread angerszhu (Jira)
angerszhu created SPARK-32404: - Summary: Catch and adding excetion about HiveInspector can't converted data type Key: SPARK-32404 URL: https://issues.apache.org/jira/browse/SPARK-32404 Project: Spark

[jira] [Comment Edited] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade

2020-07-23 Thread sooyeon shin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163355#comment-17163355 ] sooyeon shin edited comment on SPARK-27780 at 7/23/20, 8:55 AM: Hi

[jira] [Commented] (SPARK-27780) Shuffle server & client should be versioned to enable smoother upgrade

2020-07-23 Thread sooyeon shin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163355#comment-17163355 ] sooyeon shin commented on SPARK-27780: -- Hi there. I had same issue. In 3.0, dynamic allocation can

[jira] [Created] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

2020-07-23 Thread angerszhu (Jira)
angerszhu created SPARK-32403: - Summary: SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement Key: SPARK-32403 URL: https://issues.apache.org/jira/browse/SPARK-32403

[jira] [Updated] (SPARK-32403) SCRIP TRANSFORM Extract common method from process row to avoid repeated judgement

2020-07-23 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-32403: -- Parent: SPARK-31936 Issue Type: Sub-task (was: Bug) > SCRIP TRANSFORM Extract common method

[jira] [Commented] (SPARK-32251) fix SQL keyword document

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163266#comment-17163266 ] Apache Spark commented on SPARK-32251: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163304#comment-17163304 ] Apache Spark commented on SPARK-32237: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Commented] (SPARK-32237) Cannot resolve column when put hint in the views of common table expression

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163305#comment-17163305 ] Apache Spark commented on SPARK-32237: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Created] (SPARK-32405) Apply table options while creating tables in JDBC Table Catalog

2020-07-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32405: -- Summary: Apply table options while creating tables in JDBC Table Catalog Key: SPARK-32405 URL: https://issues.apache.org/jira/browse/SPARK-32405 Project: Spark

[jira] [Created] (SPARK-32408) Reflect the removed Scala version directory to the classpaths

2020-07-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32408: Summary: Reflect the removed Scala version directory to the classpaths Key: SPARK-32408 URL: https://issues.apache.org/jira/browse/SPARK-32408 Project: Spark

[jira] [Resolved] (SPARK-32389) Add all hive.execution suites in the parallel test group

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32389. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28977

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Issue Type: Improvement (was: Test) > Disable crossPaths only in GitHub Actions to prevent

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Issue Type: Test (was: Improvement) > Disable crossPaths only in GitHub Actions to prevent

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Description: After SPARK-32245, crossPaths was disabled in SBT build to run the Junit tests

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Parent: SPARK-32244 Issue Type: Sub-task (was: Improvement) > Disable crossPaths only

[jira] [Assigned] (SPARK-32412) Unify error handling for spark thrift server operations

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32412: Assignee: (was: Apache Spark) > Unify error handling for spark thrift server

[jira] [Assigned] (SPARK-32412) Unify error handling for spark thrift server operations

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32412: Assignee: Apache Spark > Unify error handling for spark thrift server operations >

[jira] [Commented] (SPARK-32412) Unify error handling for spark thrift server operations

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163539#comment-17163539 ] Apache Spark commented on SPARK-32412: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-32406) Support reset one particular configuration

2020-07-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-32406: Summary: Support reset one particular configuration Key: SPARK-32406 URL: https://issues.apache.org/jira/browse/SPARK-32406 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-32409) Remove dependency between spark.metrics.staticSources.enabled and JVMSource registration

2020-07-23 Thread Luca Canali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-32409: Description: SPARK-29654 has introduced the configuration

[jira] [Assigned] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32408: Assignee: Apache Spark > Disable crossPaths only in GitHub Actions to prevent side

[jira] [Created] (SPARK-32410) Support the BATCH_WRITE capability by JDBCTable

2020-07-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32410: -- Summary: Support the BATCH_WRITE capability by JDBCTable Key: SPARK-32410 URL: https://issues.apache.org/jira/browse/SPARK-32410 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32396) Support the BATCH_READ capability by JDBCTable

2020-07-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32396: --- Summary: Support the BATCH_READ capability by JDBCTable (was: Support BATCH_READ by JDBCTable) >

[jira] [Updated] (SPARK-32410) Support the BATCH_WRITE capability by JDBCTable

2020-07-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32410: --- Description: Extend JDBCTable introduced in https://github.com/apache/spark/pull/29168 by

[jira] [Commented] (SPARK-32409) Remove dependency between spark.metrics.staticSources.enabled and JVMSource registration

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163451#comment-17163451 ] Apache Spark commented on SPARK-32409: -- User 'LucaCanali' has created a pull request for this

[jira] [Commented] (SPARK-32409) Remove dependency between spark.metrics.staticSources.enabled and JVMSource registration

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163454#comment-17163454 ] Apache Spark commented on SPARK-32409: -- User 'LucaCanali' has created a pull request for this

[jira] [Assigned] (SPARK-32409) Remove dependency between spark.metrics.staticSources.enabled and JVMSource registration

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32409: Assignee: (was: Apache Spark) > Remove dependency between

[jira] [Assigned] (SPARK-32409) Remove dependency between spark.metrics.staticSources.enabled and JVMSource registration

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32409: Assignee: Apache Spark > Remove dependency between spark.metrics.staticSources.enabled

[jira] [Commented] (SPARK-31851) Redesign PySpark documentation

2020-07-23 Thread Lidiya Nixon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163474#comment-17163474 ] Lidiya Nixon commented on SPARK-31851: -- I would also like to work on this > Redesign PySpark

[jira] [Updated] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32408: - Description: After SPARK-32245, crossPaths was disabled in SBT build to run the Junit tests

[jira] [Created] (SPARK-32409) Remove dependency between spark.metrics.staticSources.enabled and JVMSource registration

2020-07-23 Thread Luca Canali (Jira)
Luca Canali created SPARK-32409: --- Summary: Remove dependency between spark.metrics.staticSources.enabled and JVMSource registration Key: SPARK-32409 URL: https://issues.apache.org/jira/browse/SPARK-32409

[jira] [Updated] (SPARK-32409) Remove dependency between spark.metrics.staticSources.enabled and JVMSource registration

2020-07-23 Thread Luca Canali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-32409: Description: SPARK-29654 has introduced the configuration

[jira] [Assigned] (SPARK-32389) Add all hive.execution suites in the parallel test group

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32389: Assignee: Yuanjian Li > Add all hive.execution suites in the parallel test group >

[jira] [Created] (SPARK-32411) GPU Cluster Fail

2020-07-23 Thread Vinh Tran (Jira)
Vinh Tran created SPARK-32411: - Summary: GPU Cluster Fail Key: SPARK-32411 URL: https://issues.apache.org/jira/browse/SPARK-32411 Project: Spark Issue Type: Bug Components: PySpark,

[jira] [Created] (SPARK-32412) Unify error handling for spark thrift server operations

2020-07-23 Thread Kent Yao (Jira)
Kent Yao created SPARK-32412: Summary: Unify error handling for spark thrift server operations Key: SPARK-32412 URL: https://issues.apache.org/jira/browse/SPARK-32412 Project: Spark Issue Type:

[jira] [Created] (SPARK-32413) Guidance for my project

2020-07-23 Thread Suat Toksoz (Jira)
Suat Toksoz created SPARK-32413: --- Summary: Guidance for my project Key: SPARK-32413 URL: https://issues.apache.org/jira/browse/SPARK-32413 Project: Spark Issue Type: Brainstorming

[jira] [Commented] (SPARK-32334) Investigate commonizing Columnar and Row data transformations

2020-07-23 Thread Robert Joseph Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163576#comment-17163576 ] Robert Joseph Evans commented on SPARK-32334: - Row to columnar and columnar to row is mostly

[jira] [Assigned] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32408: Assignee: (was: Apache Spark) > Disable crossPaths only in GitHub Actions to prevent

[jira] [Commented] (SPARK-32408) Disable crossPaths only in GitHub Actions to prevent side effects

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163595#comment-17163595 ] Apache Spark commented on SPARK-32408: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32415: Assignee: Maxim Gekk > Enable JSON tests for the allowNonNumericNumbers option >

[jira] [Updated] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32419: - Description: If you take a close look for GitHub Actions log: {code:java} Installing dist into

[jira] [Created] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32419: Summary: Leverage Conda environment at pip packaging test in GitHub Actions Key: SPARK-32419 URL: https://issues.apache.org/jira/browse/SPARK-32419 Project: Spark

[jira] [Assigned] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32419: Assignee: Apache Spark > Leverage Conda environment at pip packaging test in GitHub

[jira] [Assigned] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32419: Assignee: (was: Apache Spark) > Leverage Conda environment at pip packaging test in

[jira] [Assigned] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32264: Assignee: Holden Karau > More resources in Github Actions >

[jira] [Commented] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164062#comment-17164062 ] Hyukjin Kwon commented on SPARK-32264: -- I'll assign this to [~holden] for now .. since she's being

[jira] [Resolved] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32415. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29207

[jira] [Commented] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164066#comment-17164066 ] Holden Karau commented on SPARK-32264: -- It's being routed inside of GitHub as of my last contact

[jira] [Commented] (SPARK-32419) Leverage Conda environment at pip packaging test in GitHub Actions

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164067#comment-17164067 ] Apache Spark commented on SPARK-32419: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32264) More resources in Github Actions

2020-07-23 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164070#comment-17164070 ] Hyukjin Kwon commented on SPARK-32264: -- Thank you [~holden]! > More resources in Github Actions >

[jira] [Commented] (SPARK-14820) Reduce shuffle data by pushing filter toward storage

2020-07-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-14820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164074#comment-17164074 ] Yuming Wang commented on SPARK-14820: - It seems the issue fixed by SPARK-31705. > Reduce shuffle

[jira] [Assigned] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32280: --- Assignee: wuyi > AnalysisException thrown when query contains several JOINs >

[jira] [Created] (SPARK-32415) Enable JSON tests from the allowNonNumericNumbers option

2020-07-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-32415: -- Summary: Enable JSON tests from the allowNonNumericNumbers option Key: SPARK-32415 URL: https://issues.apache.org/jira/browse/SPARK-32415 Project: Spark Issue

[jira] [Updated] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-32415: --- Summary: Enable JSON tests for the allowNonNumericNumbers option (was: Enable JSON tests from the

[jira] [Commented] (SPARK-32411) GPU Cluster Fail

2020-07-23 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163742#comment-17163742 ] L. C. Hsieh commented on SPARK-32411: - I think it is because the configs.

[jira] [Resolved] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32280. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Description: Hello, {{I have been trying to run a pyspark script on Spark on

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Description: Hello, {{I have been trying to run a pyspark script on Spark on

[jira] [Created] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
cyrille cazenave created SPARK-32414: Summary: pyspark crashes in cluster mode with kafka structured streaming Key: SPARK-32414 URL: https://issues.apache.org/jira/browse/SPARK-32414 Project:

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Attachment: fulllogs.txt > pyspark crashes in cluster mode with kafka structured

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Attachment: spark.py > pyspark crashes in cluster mode with kafka structured streaming

[jira] [Commented] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163720#comment-17163720 ] Apache Spark commented on SPARK-32415: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32415: Assignee: Apache Spark > Enable JSON tests for the allowNonNumericNumbers option >

[jira] [Assigned] (SPARK-32415) Enable JSON tests for the allowNonNumericNumbers option

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32415: Assignee: (was: Apache Spark) > Enable JSON tests for the allowNonNumericNumbers

[jira] [Resolved] (SPARK-32411) GPU Cluster Fail

2020-07-23 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-32411. - Resolution: Not A Problem > GPU Cluster Fail > > > Key:

[jira] [Assigned] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32374: --- Assignee: Terry Kim (was: Apache Spark) > Disallow setting properties when creating

[jira] [Updated] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32372: Priority: Major (was: Critical) > "Resolved attribute(s) XXX missing" after dudup conflict

[jira] [Updated] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-32372: Priority: Critical (was: Blocker) > "Resolved attribute(s) XXX missing" after dudup conflict

[jira] [Resolved] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32372. - Fix Version/s: 3.1.0 3.0.1 Assignee: wuyi Resolution: Fixed

[jira] [Commented] (SPARK-30648) Support filters pushdown in JSON datasource

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163690#comment-17163690 ] Apache Spark commented on SPARK-30648: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-32414) pyspark crashes in cluster mode with kafka structured streaming

2020-07-23 Thread cyrille cazenave (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cyrille cazenave updated SPARK-32414: - Description: Hello, {{I have been trying to run a pyspark script on Spark on

[jira] [Resolved] (SPARK-32374) Disallow setting properties when creating temporary views

2020-07-23 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32374. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29167

[jira] [Resolved] (SPARK-32386) Fix temp view leaking in Structured Streaming tests

2020-07-23 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li resolved SPARK-32386. - Resolution: Won't Fix In various suites, we need this temp view for checking results, e.g 

[jira] [Resolved] (SPARK-32413) Guidance for my project

2020-07-23 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-32413. -- Resolution: Not A Problem Hi [~stoksoz] , this type of discussion is more appropriate for the

[jira] [Commented] (SPARK-32372) "Resolved attribute(s) XXX missing" after dudup conflict references

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163781#comment-17163781 ] Apache Spark commented on SPARK-32372: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Closed] (SPARK-32413) Guidance for my project

2020-07-23 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler closed SPARK-32413. > Guidance for my project > > > Key: SPARK-32413 >

[jira] [Commented] (SPARK-32280) AnalysisException thrown when query contains several JOINs

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163780#comment-17163780 ] Apache Spark commented on SPARK-32280: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Resolved] (SPARK-31418) Blacklisting feature aborts Spark job without retrying for max num retries in case of Dynamic allocation

2020-07-23 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-31418. --- Fix Version/s: 3.1.0 Assignee: Venkata krishnan Sowrirajan Resolution: Fixed

[jira] [Commented] (SPARK-24497) ANSI SQL: Recursive query

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163864#comment-17163864 ] Apache Spark commented on SPARK-24497: -- User 'peter-toth' has created a pull request for this

[jira] [Created] (SPARK-32417) Flaky test: BlockManagerDecommissionIntegrationSuite.verify that an already running task which is going to cache data succeeds on a decommissioned executor

2020-07-23 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-32417: - Summary: Flaky test: BlockManagerDecommissionIntegrationSuite.verify that an already running task which is going to cache data succeeds on a decommissioned executor Key: SPARK-32417

[jira] [Commented] (SPARK-17053) Spark ignores hive.exec.drop.ignorenonexistent=true option

2020-07-23 Thread Jeffrey E Rodriguez (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163821#comment-17163821 ] Jeffrey E Rodriguez commented on SPARK-17053: -- [~rxin] as  esoteric as

[jira] [Commented] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163857#comment-17163857 ] Apache Spark commented on SPARK-32364: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-32416) Flaky test: SparkContextSuite.Cancelling stages/jobs with custom reasons

2020-07-23 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-32416: - Summary: Flaky test: SparkContextSuite.Cancelling stages/jobs with custom reasons Key: SPARK-32416 URL: https://issues.apache.org/jira/browse/SPARK-32416 Project:

[jira] [Updated] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-07-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32364: -- Fix Version/s: 2.4.7 > Use CaseInsensitiveMap for DataFrameReader/Writer options >

[jira] [Commented] (SPARK-31197) Exit the executor once all tasks & migrations are finished

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163983#comment-17163983 ] Apache Spark commented on SPARK-31197: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31197) Exit the executor once all tasks & migrations are finished

2020-07-23 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163981#comment-17163981 ] Apache Spark commented on SPARK-31197: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31693) Investigate AmpLab Jenkins server network issue

2020-07-23 Thread Wing Yew Poon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163987#comment-17163987 ] Wing Yew Poon commented on SPARK-31693: --- I'm seeing a problem with the .m2 cache on

[jira] [Created] (SPARK-32418) Flaky test: org.apache.spark.DistributedSuite.caching in memory, serialized, replicated (encryption = off)

2020-07-23 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-32418: Summary: Flaky test: org.apache.spark.DistributedSuite.caching in memory, serialized, replicated (encryption = off) Key: SPARK-32418 URL:

[jira] [Resolved] (SPARK-32398) Upgrade to scalatest 3.2.0 for Scala 2.13.3 compatibility

2020-07-23 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32398. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29196

  1   2   >