[jira] [Created] (SPARK-21177) Append to hive slows down linearly, with number of appends.

2017-06-22 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-21177: --- Summary: Append to hive slows down linearly, with number of appends. Key: SPARK-21177 URL: https://issues.apache.org/jira/browse/SPARK-21177 Project: Spark

[jira] [Updated] (SPARK-21177) df.SaveAsTable slows down linearly, with number of appends.

2017-06-22 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-21177: Summary: df.SaveAsTable slows down linearly, with number of appends. (was: Append to hive

[jira] [Updated] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2017-06-22 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-21177: Summary: df.saveAsTable slows down linearly, with number of appends (was: df.SaveAsTable s

[jira] [Closed] (SPARK-20738) Option to turn off building docs in sbt build.

2017-06-22 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-20738. --- Resolution: Won't Fix > Option to turn off building docs in sbt build. >

[jira] [Resolved] (SPARK-17689) _temporary files breaks the Spark SQL streaming job.

2017-06-29 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-17689. - Resolution: Cannot Reproduce I am unable to reproduce this anymore, looks like this might

[jira] [Commented] (SPARK-20870) Update the output of spark-sql -H

2017-07-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077988#comment-16077988 ] Prashant Sharma commented on SPARK-20870: - Is it okay to use, https://github.com/

[jira] [Commented] (SPARK-20376) Make StateStoreProvider plugable

2017-07-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16079900#comment-16079900 ] Prashant Sharma commented on SPARK-20376: - [~tdas] This patch has been merged, bu

[jira] [Commented] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2017-07-19 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16093080#comment-16093080 ] Prashant Sharma commented on SPARK-21177: - I can reproduce it on another system w

[jira] [Commented] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2017-07-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098139#comment-16098139 ] Prashant Sharma commented on SPARK-21177: - It is pretty easy to reproduce, you ne

[jira] [Updated] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2017-07-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-21177: Description: In short, please use the following shell transcript for the reproducer. {cod

[jira] [Commented] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2017-07-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098149#comment-16098149 ] Prashant Sharma commented on SPARK-21177: - Well, I have tried it on three differe

[jira] [Updated] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2017-07-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-21177: Description: In short, please use the following shell transcript for the reproducer. {cod

[jira] [Commented] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2017-07-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16098255#comment-16098255 ] Prashant Sharma commented on SPARK-21177: - Yes. In fact, hive should not be setup

[jira] [Updated] (SPARK-20919) Simplificaiton of CachedKafkaConsumer.

2017-07-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-20919: Summary: Simplificaiton of CachedKafkaConsumer. (was: Simplificaiton of CachedKafkaConsume

[jira] [Updated] (SPARK-20919) Simplificaiton of CachedKafkaConsumer.

2017-07-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-20919: Description: Using an object pool instead of a cache for recycling objects in Kafka consume

[jira] [Updated] (SPARK-16128) Allow setting length of characters to be truncated to, in Dataset.show function.

2016-06-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-16128: Summary: Allow setting length of characters to be truncated to, in Dataset.show function.

[jira] [Updated] (SPARK-16251) LocalCheckpointSuite's - missing checkpoint block fails with informative message is flaky.

2016-06-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-16251: Summary: LocalCheckpointSuite's - missing checkpoint block fails with informative message i

[jira] [Created] (SPARK-16251) LocalCheckpointSuite's missing checkpoint block fails with informative message is flaky.

2016-06-28 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-16251: --- Summary: LocalCheckpointSuite's missing checkpoint block fails with informative message is flaky. Key: SPARK-16251 URL: https://issues.apache.org/jira/browse/SPARK-16251

[jira] [Assigned] (SPARK-16128) Allow setting length of characters to be truncated to, in Dataset.show function.

2016-06-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reassigned SPARK-16128: --- Assignee: Prashant Sharma > Allow setting length of characters to be truncated to, i

[jira] [Resolved] (SPARK-16128) Allow setting length of characters to be truncated to, in Dataset.show function.

2016-06-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-16128. - Resolution: Fixed Fix Version/s: 2.1.0 Fixed by PR https://github.com/apache/spark

[jira] [Commented] (SPARK-16233) test_sparkSQL.R is failing

2016-06-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15352885#comment-15352885 ] Prashant Sharma commented on SPARK-16233: - Did you build spark with -Phive ? > t

[jira] [Created] (SPARK-16411) Add textFile API to structured streaming.

2016-07-07 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-16411: --- Summary: Add textFile API to structured streaming. Key: SPARK-16411 URL: https://issues.apache.org/jira/browse/SPARK-16411 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-16411) Add textFile API to structured streaming.

2016-07-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-16411: Affects Version/s: 2.0.0 > Add textFile API to structured streaming. >

[jira] [Created] (SPARK-16496) Add wholetext as data source for SQL.

2016-07-12 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-16496: --- Summary: Add wholetext as data source for SQL. Key: SPARK-16496 URL: https://issues.apache.org/jira/browse/SPARK-16496 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-16496) Add wholetext as option for reading text in SQL.

2016-07-13 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-16496: Summary: Add wholetext as option for reading text in SQL. (was: Add wholetext as data sour

[jira] [Updated] (SPARK-16496) Add wholetext as option for reading text in SQL.

2016-07-13 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-16496: Description: In multiple text analysis problems, it is not often desirable for the rows to

[jira] [Created] (SPARK-16747) MQTT as a streaming source for SQL Streaming.

2016-07-26 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-16747: --- Summary: MQTT as a streaming source for SQL Streaming. Key: SPARK-16747 URL: https://issues.apache.org/jira/browse/SPARK-16747 Project: Spark Issue Typ

[jira] [Commented] (SPARK-16747) MQTT as a streaming source for SQL Streaming.

2016-07-26 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395046#comment-15395046 ] Prashant Sharma commented on SPARK-16747: - This created by mistake. > MQTT as a

[jira] [Comment Edited] (SPARK-16747) MQTT as a streaming source for SQL Streaming.

2016-07-26 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395046#comment-15395046 ] Prashant Sharma edited comment on SPARK-16747 at 7/27/16 5:05 AM: -

[jira] [Closed] (SPARK-16747) MQTT as a streaming source for SQL Streaming.

2016-07-26 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-16747. --- Resolution: Won't Fix > MQTT as a streaming source for SQL Streaming. > -

[jira] [Created] (SPARK-27664) Performance issue with FileStatusCache, while reading from object stores.

2019-05-09 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-27664: --- Summary: Performance issue with FileStatusCache, while reading from object stores. Key: SPARK-27664 URL: https://issues.apache.org/jira/browse/SPARK-27664 Proje

[jira] [Updated] (SPARK-27664) Performance issue with FileStatusCache, while reading from object stores.

2019-05-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-27664: Description: In short, This issue(i.e. degraded performance ) surfaces when the number of

[jira] [Updated] (SPARK-27664) Performance issue with FileStatusCache, while reading from object stores.

2019-05-10 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-27664: Description: In short, This issue(i.e. degraded performance ) surfaces when the number of

[jira] [Updated] (SPARK-27664) Performance issue with FileStatusCache, while reading from object stores.

2019-05-10 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-27664: Description: In short, This issue(i.e. degraded performance ) surfaces when the number of

[jira] [Created] (SPARK-18526) [Kafka] The property max.poll.records is set to a very low non overridable default.

2016-11-21 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-18526: --- Summary: [Kafka] The property max.poll.records is set to a very low non overridable default. Key: SPARK-18526 URL: https://issues.apache.org/jira/browse/SPARK-18526

[jira] [Closed] (SPARK-18526) [Kafka] The property max.poll.records is set to a very low non overridable default.

2016-11-22 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-18526. --- Resolution: Invalid > [Kafka] The property max.poll.records is set to a very low non overrida

[jira] [Commented] (SPARK-14597) Streaming Listener timing metrics should include time spent in JobGenerator's graph.generateJobs

2016-04-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255980#comment-15255980 ] Prashant Sharma commented on SPARK-14597: - {quote} On digging further, we found

[jira] [Commented] (SPARK-14597) Streaming Listener timing metrics should include time spent in JobGenerator's graph.generateJobs

2016-04-25 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255993#comment-15255993 ] Prashant Sharma commented on SPARK-14597: - It would be good to know the usefulnes

[jira] [Commented] (SPARK-15227) InputStream stop-start semantics + empty implementations

2016-05-16 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15286089#comment-15286089 ] Prashant Sharma commented on SPARK-15227: - If start and stop are overridden by a

[jira] [Comment Edited] (SPARK-15227) InputStream stop-start semantics + empty implementations

2016-05-16 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15286089#comment-15286089 ] Prashant Sharma edited comment on SPARK-15227 at 5/17/16 5:44 AM: -

[jira] [Commented] (SPARK-15408) Spark streaming app crashes with NotLeaderForPartitionException

2016-05-23 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297741#comment-15297741 ] Prashant Sharma commented on SPARK-15408: - Please correct me if I am wrong. I thi

[jira] [Created] (SPARK-34327) Omit inlining passwords during build process.

2021-02-02 Thread Prashant Sharma (Jira)
Prashant Sharma created SPARK-34327: --- Summary: Omit inlining passwords during build process. Key: SPARK-34327 URL: https://issues.apache.org/jira/browse/SPARK-34327 Project: Spark Issue Typ

[jira] [Created] (SPARK-25065) Provide a way to add a custom logging configuration file.

2018-08-09 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25065: --- Summary: Provide a way to add a custom logging configuration file. Key: SPARK-25065 URL: https://issues.apache.org/jira/browse/SPARK-25065 Project: Spark

[jira] [Commented] (SPARK-25065) Provide a way to add a custom logging configuration file.

2018-08-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574414#comment-16574414 ] Prashant Sharma commented on SPARK-25065: - One work around is to edit Dockerfile

[jira] [Created] (SPARK-25066) Provide Spark R image for deploying Spark on kubernetes.

2018-08-09 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25066: --- Summary: Provide Spark R image for deploying Spark on kubernetes. Key: SPARK-25066 URL: https://issues.apache.org/jira/browse/SPARK-25066 Project: Spark

[jira] [Updated] (SPARK-25065) Provide a way to add a custom logging configuration file.

2018-08-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25065: Description: Currently, when running in kubernetes mode, it sets necessary configuration

[jira] [Updated] (SPARK-25065) Provide a way to add a custom logging configuration file.

2018-08-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25065: Description: Currently, when running in kubernetes mode, it sets necessary configuration

[jira] [Commented] (SPARK-25066) Provide Spark R image for deploying Spark on kubernetes.

2018-08-17 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16583788#comment-16583788 ] Prashant Sharma commented on SPARK-25066: - Yes, I was planning to work on R supp

[jira] [Commented] (SPARK-25065) Provide a way to add a custom logging configuration file.

2018-08-17 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16583789#comment-16583789 ] Prashant Sharma commented on SPARK-25065: - Since this picks up the wrong logging

[jira] [Updated] (SPARK-25065) Driver and executors pick the wrong logging configuration file.

2018-08-17 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25065: Summary: Driver and executors pick the wrong logging configuration file. (was: Provide a

[jira] [Updated] (SPARK-25065) Provide a way to add a custom logging configuration file.

2018-08-17 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25065: Issue Type: Bug (was: Improvement) > Provide a way to add a custom logging configuration

[jira] [Resolved] (SPARK-25066) Provide Spark R image for deploying Spark on kubernetes.

2018-08-17 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-25066. - Resolution: Duplicate Ahh found it, sorry for the mess. > Provide Spark R image for dep

[jira] [Created] (SPARK-25282) Fix support for spark-shell with K8s

2018-08-30 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25282: --- Summary: Fix support for spark-shell with K8s Key: SPARK-25282 URL: https://issues.apache.org/jira/browse/SPARK-25282 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s

2018-08-30 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25282: Description: Spark shell when run with kubernetes master, gives following errors. {noforma

[jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s

2018-08-30 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25282: Description: Spark shell when run with kubernetes master, gives following errors. {noforma

[jira] [Created] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown.

2018-08-30 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25295: --- Summary: Pod names conflicts in client mode, if previous submission was not a clean shutdown. Key: SPARK-25295 URL: https://issues.apache.org/jira/browse/SPARK-25295

[jira] [Updated] (SPARK-25295) Pod names conflicts in client mode, if previous submission was not a clean shutdown.

2018-08-30 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25295: Description: If the previous job was killed somehow, by disconnecting the client. It leave

[jira] [Created] (SPARK-24279) Incompatible byte code errors, when using test-jar of spark sql.

2018-05-15 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-24279: --- Summary: Incompatible byte code errors, when using test-jar of spark sql. Key: SPARK-24279 URL: https://issues.apache.org/jira/browse/SPARK-24279 Project: Spark

[jira] [Updated] (SPARK-24279) Incompatible byte code errors, when using test-jar of spark sql.

2018-05-15 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-24279: Description: Using test libraries available with spark sql streaming, produces weird incom

[jira] [Updated] (SPARK-24279) Incompatible byte code errors, when using test-jar of spark sql.

2018-05-15 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-24279: Component/s: Tests > Incompatible byte code errors, when using test-jar of spark sql. > ---

[jira] [Commented] (SPARK-24279) Incompatible byte code errors, when using test-jar of spark sql.

2018-06-06 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16504246#comment-16504246 ] Prashant Sharma commented on SPARK-24279: - Thanks a lot, that was the mistake. 

[jira] [Resolved] (SPARK-24279) Incompatible byte code errors, when using test-jar of spark sql.

2018-06-06 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-24279. - Resolution: Invalid > Incompatible byte code errors, when using test-jar of spark sql. >

[jira] [Commented] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2019-01-16 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743783#comment-16743783 ] Prashant Sharma commented on SPARK-26059: - One work around is to capture the JVM

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2019-02-20 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772875#comment-16772875 ] Prashant Sharma commented on SPARK-24432: - Any update on this work? > Add suppo

[jira] [Created] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

2018-09-24 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25515: --- Summary: Add a config property for disabling auto deletion of PODS for debugging. Key: SPARK-25515 URL: https://issues.apache.org/jira/browse/SPARK-25515 Projec

[jira] [Updated] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

2018-09-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25515: Description: Currently, if a pod fails to start due to some failure, it gets removed and n

[jira] [Commented] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

2018-09-24 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625575#comment-16625575 ] Prashant Sharma commented on SPARK-25515: - Also add a fail fast option, if the p

[jira] [Created] (SPARK-25543) Confusing log messages at DEBUG level, in K8s mode.

2018-09-26 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25543: --- Summary: Confusing log messages at DEBUG level, in K8s mode. Key: SPARK-25543 URL: https://issues.apache.org/jira/browse/SPARK-25543 Project: Spark Iss

[jira] [Commented] (SPARK-25282) Fix support for spark-shell with K8s

2018-09-26 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629816#comment-16629816 ] Prashant Sharma commented on SPARK-25282: - The reason, I was running into this,

[jira] [Updated] (SPARK-25282) Fix support for spark-shell with K8s

2018-09-27 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25282: Issue Type: Improvement (was: Bug) > Fix support for spark-shell with K8s > -

[jira] [Commented] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

2018-09-27 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629857#comment-16629857 ] Prashant Sharma commented on SPARK-25515: - Also looking for an option in Kuberne

[jira] [Created] (SPARK-25647) Add spark streaming compatibility suite for kubernetes.

2018-10-05 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25647: --- Summary: Add spark streaming compatibility suite for kubernetes. Key: SPARK-25647 URL: https://issues.apache.org/jira/browse/SPARK-25647 Project: Spark

[jira] [Updated] (SPARK-25647) Add spark streaming compatibility suite for kubernetes.

2018-10-05 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25647: Affects Version/s: (was: 2.5.0) 3.0.0 > Add spark streaming com

[jira] [Resolved] (SPARK-25282) Document custom builds needed for K8S development

2018-10-08 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-25282. - Resolution: Not A Problem Fix Version/s: 3.0.0 Looks like this is working without

[jira] [Created] (SPARK-25744) Allow kubernetes integration tests to be run against a real cluster.

2018-10-16 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25744: --- Summary: Allow kubernetes integration tests to be run against a real cluster. Key: SPARK-25744 URL: https://issues.apache.org/jira/browse/SPARK-25744 Project: S

[jira] [Created] (SPARK-25796) Enable external shuffle service for kubernetes mode.

2018-10-21 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-25796: --- Summary: Enable external shuffle service for kubernetes mode. Key: SPARK-25796 URL: https://issues.apache.org/jira/browse/SPARK-25796 Project: Spark Is

[jira] [Resolved] (SPARK-25796) Enable external shuffle service for kubernetes mode.

2018-10-22 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-25796. - Resolution: Duplicate > Enable external shuffle service for kubernetes mode. > -

[jira] [Created] (SPARK-17689) _temporary files breaks the Spark SQL streaming job.

2016-09-27 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-17689: --- Summary: _temporary files breaks the Spark SQL streaming job. Key: SPARK-17689 URL: https://issues.apache.org/jira/browse/SPARK-17689 Project: Spark Is

[jira] [Created] (SPARK-17690) Mini dfs cluster based HDFS tests for FileStreamSourceSuite.

2016-09-27 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-17690: --- Summary: Mini dfs cluster based HDFS tests for FileStreamSourceSuite. Key: SPARK-17690 URL: https://issues.apache.org/jira/browse/SPARK-17690 Project: Spark

[jira] [Created] (SPARK-26058) Incorrect logging class loaded for all the logs.

2018-11-14 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-26058: --- Summary: Incorrect logging class loaded for all the logs. Key: SPARK-26058 URL: https://issues.apache.org/jira/browse/SPARK-26058 Project: Spark Issue

[jira] [Created] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-14 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-26059: --- Summary: Spark standalone mode, does not correctly record a failed Spark Job. Key: SPARK-26059 URL: https://issues.apache.org/jira/browse/SPARK-26059 Project: S

[jira] [Commented] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-16 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689210#comment-16689210 ] Prashant Sharma commented on SPARK-26059: - Well to reproduce it, we need to subm

[jira] [Updated] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-23 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-26059: Description: In order to reproduce submit a failing job to spark standalone master. The s

[jira] [Updated] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-25 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-26059: Description: In order to reproduce submit a failing job to spark standalone master. The s

[jira] [Commented] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-25 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16698483#comment-16698483 ] Prashant Sharma commented on SPARK-26059: - To fix this, we need to either create

[jira] [Updated] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-25 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-26059: Description: In order to reproduce submit a failing job to spark standalone master. The s

[jira] [Resolved] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma resolved SPARK-26059. - Resolution: Won't Fix > Spark standalone mode, does not correctly record a failed Spark

[jira] [Comment Edited] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702809#comment-16702809 ] Prashant Sharma edited comment on SPARK-26059 at 11/29/18 7:33 AM: ---

[jira] [Commented] (SPARK-26059) Spark standalone mode, does not correctly record a failed Spark Job.

2018-11-28 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702809#comment-16702809 ] Prashant Sharma commented on SPARK-26059: - This will be a won't fix, as to fix i

[jira] [Commented] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

2016-02-23 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15160147#comment-15160147 ] Prashant Sharma commented on SPARK-1199: Did you try the :paste option ? > Type m

[jira] [Closed] (SPARK-13634) Assigning spark context to variable results in serialization error

2016-03-02 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-13634. --- Resolution: Duplicate > Assigning spark context to variable results in serialization error >

[jira] [Updated] (SPARK-13231) Make Accumulable.countFailedValues a user facing API.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-13231: Summary: Make Accumulable.countFailedValues a user facing API. (was: Rename Accumulable.co

[jira] [Commented] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184468#comment-15184468 ] Prashant Sharma commented on SPARK-3200: Hi [~chrismattmann], It never worked. I h

[jira] [Reopened] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma reopened SPARK-3200: I am reopening only to close it again with Won't Fix. > Class defined with reference to externa

[jira] [Closed] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma closed SPARK-3200. -- Resolution: Won't Fix > Class defined with reference to external variables crashes in REPL. > --

[jira] [Comment Edited] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184468#comment-15184468 ] Prashant Sharma edited comment on SPARK-3200 at 3/8/16 6:06 AM:

[jira] [Commented] (SPARK-3200) Class defined with reference to external variables crashes in REPL.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184510#comment-15184510 ] Prashant Sharma commented on SPARK-3200: Yes, the issue SPARK-13634 is actually a

[jira] [Updated] (SPARK-13231) Make Accumulable.countFailedValues a user facing API.

2016-03-07 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-13231: Description: Exposing it to user has no disadvantage I can think of, but it can be useful f

[jira] [Updated] (SPARK-3330) Successive test runs with different profiles fail SparkSubmitSuite

2014-08-31 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-3330: --- Assignee: Sean Owen > Successive test runs with different profiles fail SparkSubmitSuite > ---

[jira] [Updated] (SPARK-3330) Successive test runs with different profiles fail SparkSubmitSuite

2014-08-31 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-3330: --- Assignee: (was: Sean Owen) > Successive test runs with different profiles fail SparkSubmit

  1   2   3   4   5   >