[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2020-08-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171724#comment-17171724 ] Udit Mehrotra commented on SPARK-29767: --- The issue has been open for quite sometime. Can someone

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2020-03-19 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17062898#comment-17062898 ] Udit Mehrotra commented on SPARK-29767: --- [~hyukjin.kwon] Can you take a look at it ? There has

[jira] [Comment Edited] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-06 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968895#comment-16968895 ] Udit Mehrotra edited comment on SPARK-29767 at 11/7/19 3:41 AM:

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-06 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Attachment: coredump.zip > Core dump happening on executors while doing simple union of Data

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-06 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968895#comment-16968895 ] Udit Mehrotra commented on SPARK-29767: --- [~hyukjin.kwon] was finally able to get the core dump of

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-06 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Attachment: hs_err_pid13885.log > Core dump happening on executors while doing simple union

[jira] [Commented] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-06 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16968757#comment-16968757 ] Udit Mehrotra commented on SPARK-29767: --- [~hyukjin.kwon] As I have mentioned in the description

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-06 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Attachment: part-0-0189b5c2-7f7b-4d0e-bdb8-506380253597-c000.snappy.parquet > Core dump

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Updated] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-29767: -- Description: Running a union operation on two DataFrames through both Scala Spark Shell and

[jira] [Created] (SPARK-29767) Core dump happening on executors while doing simple union of Data Frames

2019-11-05 Thread Udit Mehrotra (Jira)
Udit Mehrotra created SPARK-29767: - Summary: Core dump happening on executors while doing simple union of Data Frames Key: SPARK-29767 URL: https://issues.apache.org/jira/browse/SPARK-29767 Project:

[jira] [Updated] (SPARK-21494) Spark 2.2.0 AES encryption not working with External shuffle

2017-07-20 Thread Udit Mehrotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-21494: -- Attachment: logs.zip > Spark 2.2.0 AES encryption not working with External shuffle >

[jira] [Updated] (SPARK-21494) Spark 2.2.0 AES encryption not working with External shuffle

2017-07-20 Thread Udit Mehrotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-21494: -- Description: Spark’s new AES based authentication mechanism does not seem to work when

[jira] [Created] (SPARK-21494) Spark 2.2.0 AES encryption not working with External shuffle

2017-07-20 Thread Udit Mehrotra (JIRA)
Udit Mehrotra created SPARK-21494: - Summary: Spark 2.2.0 AES encryption not working with External shuffle Key: SPARK-21494 URL: https://issues.apache.org/jira/browse/SPARK-21494 Project: Spark

[jira] [Created] (SPARK-20515) Issue with reading Hive ORC tables having char/varchar columns in Spark SQL

2017-04-27 Thread Udit Mehrotra (JIRA)
Udit Mehrotra created SPARK-20515: - Summary: Issue with reading Hive ORC tables having char/varchar columns in Spark SQL Key: SPARK-20515 URL: https://issues.apache.org/jira/browse/SPARK-20515

[jira] [Created] (SPARK-20115) Fix DAGScheduler to recompute all the lost shuffle blocks when external shuffle service is unavailable

2017-03-27 Thread Udit Mehrotra (JIRA)
Udit Mehrotra created SPARK-20115: - Summary: Fix DAGScheduler to recompute all the lost shuffle blocks when external shuffle service is unavailable Key: SPARK-20115 URL:

[jira] [Updated] (SPARK-18756) Memory leak in Spark streaming

2016-12-06 Thread Udit Mehrotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated SPARK-18756: -- Description: We have a Spark streaming application, that processes data from Kinesis. In our

[jira] [Created] (SPARK-18756) Memory leak in Spark streaming

2016-12-06 Thread Udit Mehrotra (JIRA)
Udit Mehrotra created SPARK-18756: - Summary: Memory leak in Spark streaming Key: SPARK-18756 URL: https://issues.apache.org/jira/browse/SPARK-18756 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17380) Spark streaming with a multi shard Kinesis freezes after several days (memory/resource leak?)

2016-11-19 Thread Udit Mehrotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15680276#comment-15680276 ] Udit Mehrotra commented on SPARK-17380: --- The above leak was seen with Spark 2.0 running on EMR. I

[jira] [Commented] (SPARK-17380) Spark streaming with a multi shard Kinesis freezes after several days (memory/resource leak?)

2016-11-19 Thread Udit Mehrotra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15680270#comment-15680270 ] Udit Mehrotra commented on SPARK-17380: --- We came across this Memory Leak in the executor logs, by

[jira] [Created] (SPARK-17512) Specifying remote files for Python based Spark jobs in Yarn cluster mode not working

2016-09-12 Thread Udit Mehrotra (JIRA)
Udit Mehrotra created SPARK-17512: - Summary: Specifying remote files for Python based Spark jobs in Yarn cluster mode not working Key: SPARK-17512 URL: https://issues.apache.org/jira/browse/SPARK-17512