[jira] [Updated] (SPARK-33131) Fix grouping sets with having clause can not resolve qualified col name

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33131: -- Fix Version/s: 3.0.2 > Fix grouping sets with having clause can not resolve qualified col

[jira] [Updated] (SPARK-33131) Fix grouping sets with having clause can not resolve qualified col name

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33131: -- Affects Version/s: 2.4.0 2.4.1 2.4.2

[jira] [Updated] (SPARK-33131) Fix grouping sets with having clause can not resolve qualified col name

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33131: -- Affects Version/s: 2.4.7 > Fix grouping sets with having clause can not resolve qualified col

[jira] [Resolved] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33173. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30072

[jira] [Assigned] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33173: - Assignee: Dongjoon Hyun > Fix Flaky Test "SPARK-33088: executor failed tasks trigger

[jira] [Commented] (SPARK-33131) Fix grouping sets with having clause can not resolve qualified col name

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215714#comment-17215714 ] Apache Spark commented on SPARK-33131: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-32862) Left semi stream-stream join

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215713#comment-17215713 ] Apache Spark commented on SPARK-32862: -- User 'c21' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32862) Left semi stream-stream join

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32862: Assignee: Apache Spark > Left semi stream-stream join > > >

[jira] [Assigned] (SPARK-32862) Left semi stream-stream join

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32862: Assignee: (was: Apache Spark) > Left semi stream-stream join >

[jira] [Commented] (SPARK-32862) Left semi stream-stream join

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215712#comment-17215712 ] Apache Spark commented on SPARK-32862: -- User 'c21' has created a pull request for this issue:

[jira] [Commented] (SPARK-33131) Fix grouping sets with having clause can not resolve qualified col name

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215709#comment-17215709 ] Apache Spark commented on SPARK-33131: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-33170) Add SQL config to control fast-fail behavior in FileFormatWriter

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215706#comment-17215706 ] Apache Spark commented on SPARK-33170: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33170) Add SQL config to control fast-fail behavior in FileFormatWriter

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33170: Assignee: L. C. Hsieh (was: Apache Spark) > Add SQL config to control fast-fail

[jira] [Commented] (SPARK-33170) Add SQL config to control fast-fail behavior in FileFormatWriter

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215705#comment-17215705 ] Apache Spark commented on SPARK-33170: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33170) Add SQL config to control fast-fail behavior in FileFormatWriter

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33170: Assignee: Apache Spark (was: L. C. Hsieh) > Add SQL config to control fast-fail

[jira] [Updated] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33173: -- Description: -

[jira] [Assigned] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33173: Assignee: (was: Apache Spark) > Fix Flaky Test "SPARK-33088: executor failed tasks

[jira] [Assigned] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33173: Assignee: Apache Spark > Fix Flaky Test "SPARK-33088: executor failed tasks trigger

[jira] [Commented] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215699#comment-17215699 ] Apache Spark commented on SPARK-33173: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33173) Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls"

2020-10-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33173: - Summary: Fix Flaky Test "SPARK-33088: executor failed tasks trigger plugin calls" Key: SPARK-33173 URL: https://issues.apache.org/jira/browse/SPARK-33173 Project:

[jira] [Assigned] (SPARK-33172) Spark SQL CodeGenerator does not check for UserDefined type

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33172: Assignee: (was: Apache Spark) > Spark SQL CodeGenerator does not check for

[jira] [Assigned] (SPARK-33172) Spark SQL CodeGenerator does not check for UserDefined type

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33172: Assignee: Apache Spark > Spark SQL CodeGenerator does not check for UserDefined type >

[jira] [Commented] (SPARK-33172) Spark SQL CodeGenerator does not check for UserDefined type

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215698#comment-17215698 ] Apache Spark commented on SPARK-33172: -- User 'davidrabinowitz' has created a pull request for this

[jira] [Updated] (SPARK-33109) Upgrade to SBT 1.4

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33109: -- Summary: Upgrade to SBT 1.4 (was: Upgrade to SBT 1.4 and support `dependencyTree` back) >

[jira] [Updated] (SPARK-33109) Upgrade to SBT 1.4 and support `dependencyTree` back

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33109: -- Summary: Upgrade to SBT 1.4 and support `dependencyTree` back (was: Upgrade to SBT 1.4) >

[jira] [Resolved] (SPARK-33109) Upgrade to SBT 1.4 and support `dependencyTree` back

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33109. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30070

[jira] [Assigned] (SPARK-33109) Upgrade to SBT 1.4 and support `dependencyTree` back

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33109: - Assignee: Denis Pyshev > Upgrade to SBT 1.4 and support `dependencyTree` back >

[jira] [Updated] (SPARK-33172) Spark SQL CodeGenerator does not check for UserDefined type

2020-10-16 Thread David Rabinowitz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Rabinowitz updated SPARK-33172: - Description: The CodeGenerator takes the DataType given to   {{getValueFromVector()}}

[jira] [Updated] (SPARK-33172) Spark SQL CodeGenerator does not check for UserDefined type

2020-10-16 Thread David Rabinowitz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Rabinowitz updated SPARK-33172: - Description: The CodeGenerator takes the DataType given to   {{getValueFromVector()}}

[jira] [Created] (SPARK-33172) Spark SQL CodeGenerator does not check for UserDefined type

2020-10-16 Thread David Rabinowitz (Jira)
David Rabinowitz created SPARK-33172: Summary: Spark SQL CodeGenerator does not check for UserDefined type Key: SPARK-33172 URL: https://issues.apache.org/jira/browse/SPARK-33172 Project: Spark

[jira] [Updated] (SPARK-32376) Make unionByName null-filling behavior work with struct columns

2020-10-16 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32376: Fix Version/s: 3.1.0 > Make unionByName null-filling behavior work with struct columns >

[jira] [Resolved] (SPARK-32376) Make unionByName null-filling behavior work with struct columns

2020-10-16 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-32376. - Resolution: Fixed > Make unionByName null-filling behavior work with struct columns >

[jira] [Commented] (SPARK-32376) Make unionByName null-filling behavior work with struct columns

2020-10-16 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215671#comment-17215671 ] L. C. Hsieh commented on SPARK-32376: - Resolved by https://github.com/apache/spark/pull/29587. >

[jira] [Resolved] (SPARK-33154) Handle shuffle blocks being removed during decommissioning

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33154. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30046

[jira] [Commented] (SPARK-32436) Initialize numNonEmptyBlocks in HighlyCompressedMapStatus.readExternal

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215655#comment-17215655 ] Dongjoon Hyun commented on SPARK-32436: --- This lands at `branch-3.0` based on the community

[jira] [Updated] (SPARK-32436) Initialize numNonEmptyBlocks in HighlyCompressedMapStatus.readExternal

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32436: -- Fix Version/s: 3.0.2 > Initialize numNonEmptyBlocks in HighlyCompressedMapStatus.readExternal

[jira] [Assigned] (SPARK-33109) Upgrade to SBT 1.4 and support `dependencyTree` back

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33109: Assignee: Apache Spark > Upgrade to SBT 1.4 and support `dependencyTree` back >

[jira] [Assigned] (SPARK-33109) Upgrade to SBT 1.4 and support `dependencyTree` back

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33109: Assignee: (was: Apache Spark) > Upgrade to SBT 1.4 and support `dependencyTree` back

[jira] [Commented] (SPARK-33109) Upgrade to SBT 1.4 and support `dependencyTree` back

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215651#comment-17215651 ] Apache Spark commented on SPARK-33109: -- User 'gemelen' has created a pull request for this issue:

[jira] [Commented] (SPARK-33152) Constraint Propagation code causes OOM issues or increasing compilation time to hours

2020-10-16 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215645#comment-17215645 ] Asif commented on SPARK-33152: -- [~yumwang], Hi. I need some help. I started the tests run via 

[jira] [Updated] (SPARK-33171) Mark Parquet*FilterSuite as ExtendedSQLTest

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33171: -- Fix Version/s: 3.0.2 > Mark Parquet*FilterSuite as ExtendedSQLTest >

[jira] [Assigned] (SPARK-33171) Mark Parquet*FilterSuite as ExtendedSQLTest

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33171: - Assignee: Dongjoon Hyun > Mark Parquet*FilterSuite as ExtendedSQLTest >

[jira] [Resolved] (SPARK-33171) Mark Parquet*FilterSuite as ExtendedSQLTest

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33171. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30068

[jira] [Commented] (SPARK-33000) cleanCheckpoints config does not clean all checkpointed RDDs on shutdown

2020-10-16 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215577#comment-17215577 ] Nicholas Chammas commented on SPARK-33000: -- Ctrl-D gracefully shuts down the Python REPL, so

[jira] [Assigned] (SPARK-33171) Mark Parquet*FilterSuite as ExtendedSQLTest

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33171: Assignee: Apache Spark > Mark Parquet*FilterSuite as ExtendedSQLTest >

[jira] [Assigned] (SPARK-33171) Mark Parquet*FilterSuite as ExtendedSQLTest

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33171: Assignee: (was: Apache Spark) > Mark Parquet*FilterSuite as ExtendedSQLTest >

[jira] [Commented] (SPARK-33171) Mark Parquet*FilterSuite as ExtendedSQLTest

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215534#comment-17215534 ] Apache Spark commented on SPARK-33171: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33171) Mark Parquet*FilterSuite as ExtendedSQLTest

2020-10-16 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33171: - Summary: Mark Parquet*FilterSuite as ExtendedSQLTest Key: SPARK-33171 URL: https://issues.apache.org/jira/browse/SPARK-33171 Project: Spark Issue Type:

[jira] [Created] (SPARK-33170) Add SQL config to control fast-fail behavior in FileFormatWriter

2020-10-16 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33170: --- Summary: Add SQL config to control fast-fail behavior in FileFormatWriter Key: SPARK-33170 URL: https://issues.apache.org/jira/browse/SPARK-33170 Project: Spark

[jira] [Commented] (SPARK-33000) cleanCheckpoints config does not clean all checkpointed RDDs on shutdown

2020-10-16 Thread Haoyuan Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215515#comment-17215515 ] Haoyuan Wang commented on SPARK-33000: -- I'm not sure what ctrl-D does. It closed bash, but does it

[jira] [Resolved] (SPARK-33167) Throw Spark specific exception for commit protocol errors

2020-10-16 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33167. - Resolution: Not A Problem > Throw Spark specific exception for commit protocol errors >

[jira] [Assigned] (SPARK-33159) Use hive-service-rpc dep instead of inline the generated code

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33159: - Assignee: Kent Yao > Use hive-service-rpc dep instead of inline the generated code >

[jira] [Resolved] (SPARK-33159) Use hive-service-rpc dep instead of inline the generated code

2020-10-16 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33159. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30055

[jira] [Commented] (SPARK-33000) cleanCheckpoints config does not clean all checkpointed RDDs on shutdown

2020-10-16 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215469#comment-17215469 ] Nicholas Chammas commented on SPARK-33000: -- I've tested this out a bit more, and I think the

[jira] [Commented] (SPARK-33057) Cannot use filter with window operations

2020-10-16 Thread Li Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215468#comment-17215468 ] Li Jin commented on SPARK-33057: I agree this is an improvement rather than a bug. Although, I am not

[jira] [Commented] (SPARK-33077) Spark 3 / Cats 2.2.0 classpath issue

2020-10-16 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215461#comment-17215461 ] Sean R. Owen commented on SPARK-33077: -- Adding a little flavor - the issue ends up being the

[jira] [Commented] (SPARK-33161) Spark 3: Partition count changing on dataframe select cols

2020-10-16 Thread Ankush Kankariya (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215451#comment-17215451 ] Ankush Kankariya commented on SPARK-33161: -- [~hyukjin.kwon] Thank you !! will avoid using

[jira] [Commented] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

2020-10-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215447#comment-17215447 ] Gengliang Wang commented on SPARK-33145: [~echohlne] Thanks for the fix. I think it is minor and

[jira] [Updated] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

2020-10-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-33145: --- Priority: Minor (was: Major) > In Execution web page, when `Succeeded Job` has many child

[jira] [Commented] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

2020-10-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215446#comment-17215446 ] Gengliang Wang commented on SPARK-33145: The issue is resolved in

[jira] [Updated] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

2020-10-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-33145: --- Fix Version/s: (was: 3.0.2) 3.1.0 > In Execution web page, when

[jira] [Assigned] (SPARK-33145) In Execution web page, when `Succeeded Job` has many child url elements,they will extend over the edge of the page.

2020-10-16 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-33145: -- Assignee: akiyamaneko > In Execution web page, when `Succeeded Job` has many child

[jira] [Assigned] (SPARK-33088) Enhance ExecutorPlugin API to include methods for task start and end events

2020-10-16 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-33088: - Assignee: Samuel Souza > Enhance ExecutorPlugin API to include methods for task start

[jira] [Commented] (SPARK-33169) Check propagation of datasource options to underlying file system for built-in file-based datasources

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215371#comment-17215371 ] Apache Spark commented on SPARK-33169: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33169) Check propagation of datasource options to underlying file system for built-in file-based datasources

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33169: Assignee: (was: Apache Spark) > Check propagation of datasource options to

[jira] [Assigned] (SPARK-33169) Check propagation of datasource options to underlying file system for built-in file-based datasources

2020-10-16 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33169: Assignee: Apache Spark > Check propagation of datasource options to underlying file

[jira] [Created] (SPARK-33169) Check propagation of datasource options to underlying file system for built-in file-based datasources

2020-10-16 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33169: -- Summary: Check propagation of datasource options to underlying file system for built-in file-based datasources Key: SPARK-33169 URL: https://issues.apache.org/jira/browse/SPARK-33169

[jira] [Commented] (SPARK-32032) Eliminate deprecated poll(long) API calls to avoid infinite wait in driver

2020-10-16 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-32032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215352#comment-17215352 ] Hélder Hugo Ferreira commented on SPARK-32032: -- Hi, we are getting the following error when

[jira] [Assigned] (SPARK-33131) Fix grouping sets with having clause can not resolve qualified col name

2020-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33131: --- Assignee: ulysses you > Fix grouping sets with having clause can not resolve qualified col

[jira] [Resolved] (SPARK-33131) Fix grouping sets with having clause can not resolve qualified col name

2020-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33131. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30029

[jira] [Resolved] (SPARK-33126) Simplify offset window function(Remove direction field)

2020-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33126. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30023

[jira] [Assigned] (SPARK-33126) Simplify offset window function(Remove direction field)

2020-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33126: --- Assignee: jiaan.geng > Simplify offset window function(Remove direction field) >

[jira] [Created] (SPARK-33168) spark REST API Unable to get JobDescription

2020-10-16 Thread zhaoyachao (Jira)
zhaoyachao created SPARK-33168: -- Summary: spark REST API Unable to get JobDescription Key: SPARK-33168 URL: https://issues.apache.org/jira/browse/SPARK-33168 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-33158) Check whether the executor and external service connection is available

2020-10-16 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215244#comment-17215244 ] dzcxzl edited comment on SPARK-33158 at 10/16/20, 8:08 AM: ---

[jira] [Comment Edited] (SPARK-33158) Check whether the executor and external service connection is available

2020-10-16 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215244#comment-17215244 ] dzcxzl edited comment on SPARK-33158 at 10/16/20, 8:06 AM: ---

[jira] [Commented] (SPARK-33143) Make SocketAuthServer socket timeout configurable

2020-10-16 Thread Miklos Szurap (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215249#comment-17215249 ] Miklos Szurap commented on SPARK-33143: --- It has been observed with big RDDs. {noformat} 20/10/07

[jira] [Comment Edited] (SPARK-33158) Check whether the executor and external service connection is available

2020-10-16 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215244#comment-17215244 ] dzcxzl edited comment on SPARK-33158 at 10/16/20, 7:52 AM: ---

[jira] [Commented] (SPARK-33158) Check whether the executor and external service connection is available

2020-10-16 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215244#comment-17215244 ] dzcxzl commented on SPARK-33158:

[jira] [Assigned] (SPARK-32691) Test org.apache.spark.DistributedSuite failed on arm64 jenkins

2020-10-16 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-32691: Assignee: zhengruifeng > Test org.apache.spark.DistributedSuite failed on arm64 jenkins

[jira] [Commented] (SPARK-32323) Javascript/HTML bug in spark application UI

2020-10-16 Thread akiyamaneko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215222#comment-17215222 ] akiyamaneko commented on SPARK-32323: - [~ibobak] hi, can you provide your browser info> >

[jira] [Assigned] (SPARK-33139) protect setActiveSession and clearActiveSession

2020-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33139: --- Assignee: Leanken.Lin > protect setActiveSession and clearActiveSession >

[jira] [Resolved] (SPARK-33139) protect setActiveSession and clearActiveSession

2020-10-16 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33139. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30042