[jira] [Created] (SPARK-39009) Spark Log4j vul - CVE-2021-44228

Prakash Shankar created SPARK-39009: --- Summary: Spark Log4j vul - CVE-2021-44228 Key: SPARK-39009 URL: https://issues.apache.org/jira/browse/SPARK-39009 Project: Spark Issue Type: New Featur

[jira] [Commented] (SPARK-25511) Map with "null" key not working in spark 2.3

[ https://issues.apache.org/jira/browse/SPARK-25511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626138#comment-16626138 ] Ravi Shankar commented on SPARK-25511: -- Is there any option to have a key->value da

[jira] [Updated] (SPARK-25511) Map with "null" key not working in spark 2.3

[ https://issues.apache.org/jira/browse/SPARK-25511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Shankar updated SPARK-25511: - Description: I had a use case where i was creating a histogram of column values through a UDAF

[jira] [Created] (SPARK-25511) Map with "null" key not working in spark 2.3

Ravi Shankar created SPARK-25511: Summary: Map with "null" key not working in spark 2.3 Key: SPARK-25511 URL: https://issues.apache.org/jira/browse/SPARK-25511 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217333#comment-16217333 ] Ashwin Shankar commented on SPARK-18105: Hi [~davies] [~cloud_fan] We hit the sam

[jira] [Commented] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15802194#comment-15802194 ] shankar commented on SPARK-2356: Hey thanks a lot Steve..It worked perfectly fine with you

[jira] [Commented] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15801947#comment-15801947 ] shankar commented on SPARK-2356: I have followed this solution -- https://qnalist.com/que

[jira] [Created] (SPARK-17667) Make locking fine grained in YarnAllocator#enqueueGetLossReasonRequest

Ashwin Shankar created SPARK-17667: -- Summary: Make locking fine grained in YarnAllocator#enqueueGetLossReasonRequest Key: SPARK-17667 URL: https://issues.apache.org/jira/browse/SPARK-17667 Project: S

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15488465#comment-15488465 ] Ashwin Shankar commented on SPARK-16441: hey, Thanks! I don't think either of the

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485711#comment-15485711 ] Ashwin Shankar commented on SPARK-16441: Hey [~Dhruve Ashar], we hit the same iss

[jira] [Commented] (SPARK-14101) Hive on Spark 1.6.1 - Maven BUILD FAILURE ?

[ https://issues.apache.org/jira/browse/SPARK-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209879#comment-15209879 ] Shankar commented on SPARK-14101: - Thanks.. its working now. Updated java alternatives t

[jira] [Commented] (SPARK-14101) Hive on Spark 1.6.1 - Maven BUILD FAILURE ?

[ https://issues.apache.org/jira/browse/SPARK-14101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15209149#comment-15209149 ] Shankar commented on SPARK-14101: - You mean I have to use Java 7 explicitly? I have alr

[jira] [Created] (SPARK-14101) Hive on Spark 1.6.1 - Maven BUILD FAILURE ?

Shankar created SPARK-14101: --- Summary: Hive on Spark 1.6.1 - Maven BUILD FAILURE ? Key: SPARK-14101 URL: https://issues.apache.org/jira/browse/SPARK-14101 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15138381#comment-15138381 ] Ashwin Shankar commented on SPARK-12329: Yep, feel free to take it. > spark-sql

[jira] [Created] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

Ashwin Shankar created SPARK-12329: -- Summary: spark-sql prints out SET commands to stdout instead of stderr Key: SPARK-12329 URL: https://issues.apache.org/jira/browse/SPARK-12329 Project: Spark

[jira] [Commented] (SPARK-10553) Allow Ctrl-C in pyspark shell to kill running job

[ https://issues.apache.org/jira/browse/SPARK-10553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739783#comment-14739783 ] Ashwin Shankar commented on SPARK-10553: Hi [~davies], this jira is a duplicate o

[jira] [Updated] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated SPARK-8170: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-7006 > Ctrl-C in pyspark shell do

[jira] [Created] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

Ashwin Shankar created SPARK-8170: - Summary: Ctrl-C in pyspark shell doesn't kill running job Key: SPARK-8170 URL: https://issues.apache.org/jira/browse/SPARK-8170 Project: Spark Issue Type:

[jira] [Created] (SPARK-7451) Spark on Yarn : Preemption of executors is counted as failure causing Spark job to fail

Ashwin Shankar created SPARK-7451: - Summary: Spark on Yarn : Preemption of executors is counted as failure causing Spark job to fail Key: SPARK-7451 URL: https://issues.apache.org/jira/browse/SPARK-7451

[jira] [Commented] (SPARK-7451) Spark on Yarn : Preemption of executors is counted as failure causing Spark job to fail

[ https://issues.apache.org/jira/browse/SPARK-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533410#comment-14533410 ] Ashwin Shankar commented on SPARK-7451: --- Working on it. > Spark on Yarn : Preemptio

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531325#comment-14531325 ] Ashwin Shankar commented on SPARK-6910: --- +1, this is causing pretty bad user experie