[jira] [Updated] (SPARK-32732) Convert schema only once in OrcSerializer

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32732: - Description: This is to track a TODO item in [Pull

[jira] [Resolved] (SPARK-32737) readResolve() in BlockManagerId

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32737. -- Resolution: Invalid Looks like a question. Please ask questions to mailing list, see also

[jira] [Commented] (SPARK-32751) Add code-gen for ObjectHashAggregateExec

2020-08-30 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187446#comment-17187446 ] Cheng Su commented on SPARK-32751: -- Just FYI - will raise a PR in next couple of weeks. Thanks. > Add

[jira] [Commented] (SPARK-32742) FileOutputCommitter warns "No Output found for attempt"

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187445#comment-17187445 ] Hyukjin Kwon commented on SPARK-32742: -- Please don't specify a blocker which is usually reserved

[jira] [Created] (SPARK-32751) Add code-gen for ObjectHashAggregateExec

2020-08-30 Thread Cheng Su (Jira)
Cheng Su created SPARK-32751: Summary: Add code-gen for ObjectHashAggregateExec Key: SPARK-32751 URL: https://issues.apache.org/jira/browse/SPARK-32751 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-32742) FileOutputCommitter warns "No Output found for attempt"

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32742: - Priority: Major (was: Blocker) > FileOutputCommitter warns "No Output found for attempt" >

[jira] [Commented] (SPARK-32744) request executor cores with decimal when spark on k8s

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187444#comment-17187444 ] Hyukjin Kwon commented on SPARK-32744: -- Is it realistic to have 2147483647+ cores? or did I miss

[jira] [Commented] (SPARK-32746) Not able to run Pandas UDF

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187443#comment-17187443 ] Hyukjin Kwon commented on SPARK-32746: -- [~rahulbhatia], please share your analysis on the logs and

[jira] [Commented] (SPARK-32750) Add code-gen for SortAggregateExec

2020-08-30 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187441#comment-17187441 ] Cheng Su commented on SPARK-32750: -- Just FYI - will raise a PR in next couple of weeks. Thanks. > Add

[jira] [Created] (SPARK-32750) Add code-gen for SortAggregateExec

2020-08-30 Thread Cheng Su (Jira)
Cheng Su created SPARK-32750: Summary: Add code-gen for SortAggregateExec Key: SPARK-32750 URL: https://issues.apache.org/jira/browse/SPARK-32750 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32749) Refactor DataFrameStatPerfSuite to use main method

2020-08-30 Thread JiangYang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187438#comment-17187438 ] JiangYang commented on SPARK-32749: --- Im working on. > Refactor DataFrameStatPerfSuite to use main

[jira] [Updated] (SPARK-32749) Refactor DataFrameStatPerfSuite to use main method

2020-08-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32749: Description:

[jira] [Created] (SPARK-32749) Refactor DataFrameStatPerfSuite to use main method

2020-08-30 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-32749: --- Summary: Refactor DataFrameStatPerfSuite to use main method Key: SPARK-32749 URL: https://issues.apache.org/jira/browse/SPARK-32749 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-32748) Support local property propagation in SubqueryBroadcastExec

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32748: Assignee: (was: Apache Spark) > Support local property propagation in

[jira] [Commented] (SPARK-32748) Support local property propagation in SubqueryBroadcastExec

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187436#comment-17187436 ] Apache Spark commented on SPARK-32748: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Commented] (SPARK-32748) Support local property propagation in SubqueryBroadcastExec

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187435#comment-17187435 ] Apache Spark commented on SPARK-32748: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32748) Support local property propagation in SubqueryBroadcastExec

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32748: Assignee: Apache Spark > Support local property propagation in SubqueryBroadcastExec >

[jira] [Created] (SPARK-32748) Support local property propagation in SubqueryBroadcastExec

2020-08-30 Thread Zhenhua Wang (Jira)
Zhenhua Wang created SPARK-32748: Summary: Support local property propagation in SubqueryBroadcastExec Key: SPARK-32748 URL: https://issues.apache.org/jira/browse/SPARK-32748 Project: Spark

[jira] [Created] (SPARK-32747) Deduplicate configuration set/unset in test_sparkSQL_arrow.R

2020-08-30 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32747: Summary: Deduplicate configuration set/unset in test_sparkSQL_arrow.R Key: SPARK-32747 URL: https://issues.apache.org/jira/browse/SPARK-32747 Project: Spark

[jira] [Commented] (SPARK-23812) DFS should be removed from unsupportedHiveNativeCommands in SqlBase.g4

2020-08-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187414#comment-17187414 ] Yuming Wang commented on SPARK-23812: - We don’t support {{dfs}}. {noformat} scala> spark.sql("dfs

[jira] [Updated] (SPARK-32746) Not able to run Pandas UDF

2020-08-30 Thread Rahul Bhatia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Bhatia updated SPARK-32746: - Description: Hi, I am facing issues in running Pandas UDF on a yarn cluster with multiple

[jira] [Updated] (SPARK-32746) Not able to run Pandas UDF

2020-08-30 Thread Rahul Bhatia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Bhatia updated SPARK-32746: - Attachment: Screenshot 2020-08-31 at 9.04.07 AM.png > Not able to run Pandas UDF >

[jira] [Updated] (SPARK-32746) Not able to run Pandas UDF

2020-08-30 Thread Rahul Bhatia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Bhatia updated SPARK-32746: - Description: Hi, I am facing issues in running Pandas UDF on a yarn cluster with multiple

[jira] [Created] (SPARK-32746) Not able to run Pandas UDF

2020-08-30 Thread Rahul Bhatia (Jira)
Rahul Bhatia created SPARK-32746: Summary: Not able to run Pandas UDF Key: SPARK-32746 URL: https://issues.apache.org/jira/browse/SPARK-32746 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32400) Test coverage of HiveScripTransformationExec

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187403#comment-17187403 ] Apache Spark commented on SPARK-32400: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-32745) Add an option to reject block migrations when under disk pressure

2020-08-30 Thread Holden Karau (Jira)
Holden Karau created SPARK-32745: Summary: Add an option to reject block migrations when under disk pressure Key: SPARK-32745 URL: https://issues.apache.org/jira/browse/SPARK-32745 Project: Spark

[jira] [Assigned] (SPARK-32376) Make unionByName null-filling behavior work with struct columns

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32376: Assignee: Apache Spark (was: L. C. Hsieh) > Make unionByName null-filling behavior work

[jira] [Assigned] (SPARK-32376) Make unionByName null-filling behavior work with struct columns

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32376: Assignee: L. C. Hsieh (was: Apache Spark) > Make unionByName null-filling behavior work

[jira] [Commented] (SPARK-32376) Make unionByName null-filling behavior work with struct columns

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187382#comment-17187382 ] Apache Spark commented on SPARK-32376: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32719) Add Flake8 check for missing imports

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32719: Assignee: Fokko Driesprong > Add Flake8 check for missing imports >

[jira] [Commented] (SPARK-32719) Add Flake8 check for missing imports

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187381#comment-17187381 ] Hyukjin Kwon commented on SPARK-32719: -- Fixed in https://github.com/apache/spark/pull/29563 > Add

[jira] [Resolved] (SPARK-32719) Add Flake8 check for missing imports

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32719. -- Fix Version/s: 3.1.0 Resolution: Fixed > Add Flake8 check for missing imports >

[jira] [Created] (SPARK-32744) request executor cores with decimal when spark on k8s

2020-08-30 Thread Yu Wang (Jira)
Yu Wang created SPARK-32744: --- Summary: request executor cores with decimal when spark on k8s Key: SPARK-32744 URL: https://issues.apache.org/jira/browse/SPARK-32744 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32744) request executor cores with decimal when spark on k8s

2020-08-30 Thread Yu Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Wang updated SPARK-32744: Attachment: screenshot-1.png > request executor cores with decimal when spark on k8s >

[jira] [Updated] (SPARK-32744) request executor cores with decimal when spark on k8s

2020-08-30 Thread Yu Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Wang updated SPARK-32744: Description: In current spark version which does not support to request executor cores with decimal

[jira] [Assigned] (SPARK-32733) Add extended information - arguments/examples/since/notes of expressions to the remarks field of GetFunctionsOperation

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32733: Assignee: Kent Yao > Add extended information - arguments/examples/since/notes of

[jira] [Resolved] (SPARK-32733) Add extended information - arguments/examples/since/notes of expressions to the remarks field of GetFunctionsOperation

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32733. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29577

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

2020-08-30 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187365#comment-17187365 ] Hyukjin Kwon commented on SPARK-32084: -- Hey [~nchammas], thanks for taking a look. I basically just

[jira] [Commented] (SPARK-32084) Replace dictionary-based function definitions to proper functions in functions.py

2020-08-30 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187364#comment-17187364 ] Nicholas Chammas commented on SPARK-32084: -- Can you share a couple of examples of what you are

[jira] [Commented] (SPARK-32743) Add distinct info at UnresolvedFunction toString

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187347#comment-17187347 ] Apache Spark commented on SPARK-32743: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-32743) Add distinct info at UnresolvedFunction toString

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32743: Assignee: (was: Apache Spark) > Add distinct info at UnresolvedFunction toString >

[jira] [Assigned] (SPARK-32743) Add distinct info at UnresolvedFunction toString

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32743: Assignee: Apache Spark > Add distinct info at UnresolvedFunction toString >

[jira] [Commented] (SPARK-32743) Add distinct info at UnresolvedFunction toString

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187346#comment-17187346 ] Apache Spark commented on SPARK-32743: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-32743) Add distinct info at UnresolvedFunction toString

2020-08-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187341#comment-17187341 ] Takeshi Yamamuro commented on SPARK-32743: -- Please describe more in the description to make

[jira] [Updated] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-08-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31511: -- Affects Version/s: 1.4.1 1.5.2 1.6.3

[jira] [Commented] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-08-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187337#comment-17187337 ] Dongjoon Hyun commented on SPARK-31511: --- Thank you for updating issue type and labeling

[jira] [Commented] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-08-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187334#comment-17187334 ] Dongjoon Hyun commented on SPARK-31511: --- This is backported to branch-3.0 via

[jira] [Updated] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-08-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31511: -- Fix Version/s: 3.0.2 > Make BytesToBytesMap iterator() thread-safe >

[jira] [Updated] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-08-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-31511: -- Labels: correctness (was: ) > Make BytesToBytesMap iterator() thread-safe >

[jira] [Updated] (SPARK-31511) Make BytesToBytesMap iterator() thread-safe

2020-08-30 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-31511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-31511: -- Issue Type: Bug (was: Improvement) > Make BytesToBytesMap iterator() thread-safe >

[jira] [Resolved] (SPARK-32481) Support truncate table to move the data to trash

2020-08-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32481. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29552

[jira] [Assigned] (SPARK-32481) Support truncate table to move the data to trash

2020-08-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-32481: - Assignee: Udbhav Agrawal > Support truncate table to move the data to trash >

[jira] [Created] (SPARK-32743) Add distinct info at UnresolvedFunction toString

2020-08-30 Thread ulysses you (Jira)
ulysses you created SPARK-32743: --- Summary: Add distinct info at UnresolvedFunction toString Key: SPARK-32743 URL: https://issues.apache.org/jira/browse/SPARK-32743 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32742) FileOutputCommitter warns "No Output found for attempt"

2020-08-30 Thread Ryan Luo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Luo updated SPARK-32742: - Description: Hi team, This is my first time to report an issue here. We submitted and ran the spark

[jira] [Updated] (SPARK-32742) FileOutputCommitter warns "No Output found for attempt"

2020-08-30 Thread Ryan Luo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Luo updated SPARK-32742: - Component/s: (was: Spark Submit) Spark Core > FileOutputCommitter warns "No Output

[jira] [Updated] (SPARK-32742) FileOutputCommitter warns "No Output found for attempt"

2020-08-30 Thread Ryan Luo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Luo updated SPARK-32742: - Priority: Blocker (was: Major) > FileOutputCommitter warns "No Output found for attempt" >

[jira] [Created] (SPARK-32742) FileOutputCommitter warns "No Output found for attempt"

2020-08-30 Thread Ryan Luo (Jira)
Ryan Luo created SPARK-32742: Summary: FileOutputCommitter warns "No Output found for attempt" Key: SPARK-32742 URL: https://issues.apache.org/jira/browse/SPARK-32742 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32677) Load function resource before create

2020-08-30 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-32677: Summary: Load function resource before create (was: Cache function directly after create) >

[jira] [Commented] (SPARK-32739) support prune right for left semi join in DPP

2020-08-30 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187202#comment-17187202 ] Takeshi Yamamuro commented on SPARK-32739: -- Could you fill the description, too? > support

[jira] [Commented] (SPARK-32741) Check if the same ExprId refers to the unique attribute in logical plans

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187200#comment-17187200 ] Apache Spark commented on SPARK-32741: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32741) Check if the same ExprId refers to the unique attribute in logical plans

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32741: Assignee: (was: Apache Spark) > Check if the same ExprId refers to the unique

[jira] [Commented] (SPARK-32741) Check if the same ExprId refers to the unique attribute in logical plans

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187199#comment-17187199 ] Apache Spark commented on SPARK-32741: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32741) Check if the same ExprId refers to the unique attribute in logical plans

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32741: Assignee: Apache Spark > Check if the same ExprId refers to the unique attribute in

[jira] [Created] (SPARK-32741) Check if the same ExprId refers to the unique attribute in logical plans

2020-08-30 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-32741: Summary: Check if the same ExprId refers to the unique attribute in logical plans Key: SPARK-32741 URL: https://issues.apache.org/jira/browse/SPARK-32741

[jira] [Commented] (SPARK-32364) Use CaseInsensitiveMap for DataFrameReader/Writer options

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187152#comment-17187152 ] Apache Spark commented on SPARK-32364: -- User 'karolchmist' has created a pull request for this

[jira] [Assigned] (SPARK-32740) Refactor common partitioning/distribution logic to BaseAggregateExec

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32740: Assignee: Apache Spark > Refactor common partitioning/distribution logic to

[jira] [Assigned] (SPARK-32740) Refactor common partitioning/distribution logic to BaseAggregateExec

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32740: Assignee: (was: Apache Spark) > Refactor common partitioning/distribution logic to

[jira] [Commented] (SPARK-32740) Refactor common partitioning/distribution logic to BaseAggregateExec

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187150#comment-17187150 ] Apache Spark commented on SPARK-32740: -- User 'c21' has created a pull request for this issue:

[jira] [Created] (SPARK-32740) Refactor common partitioning/distribution logic to BaseAggregateExec

2020-08-30 Thread Cheng Su (Jira)
Cheng Su created SPARK-32740: Summary: Refactor common partitioning/distribution logic to BaseAggregateExec Key: SPARK-32740 URL: https://issues.apache.org/jira/browse/SPARK-32740 Project: Spark

[jira] [Commented] (SPARK-32739) support prune right for left semi join in DPP

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17187149#comment-17187149 ] Apache Spark commented on SPARK-32739: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32739) support prune right for left semi join in DPP

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32739: Assignee: Apache Spark > support prune right for left semi join in DPP >

[jira] [Assigned] (SPARK-32739) support prune right for left semi join in DPP

2020-08-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32739: Assignee: (was: Apache Spark) > support prune right for left semi join in DPP >

[jira] [Created] (SPARK-32739) support prune right for left semi join in DPP

2020-08-30 Thread Zhenhua Wang (Jira)
Zhenhua Wang created SPARK-32739: Summary: support prune right for left semi join in DPP Key: SPARK-32739 URL: https://issues.apache.org/jira/browse/SPARK-32739 Project: Spark Issue Type: