[jira] [Commented] (SPARK-10401) spark-submit --unsupervise

2015-09-12 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14742252#comment-14742252 ] Sanket Reddy commented on SPARK-10401: -- I would like to work on it > spark-submit --unsupervise >

[jira] [Issue Comment Deleted] (SPARK-10401) spark-submit --unsupervise

2015-09-12 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanket Reddy updated SPARK-10401: - Comment: was deleted (was: I would like to work on it) > spark-submit --unsupervise >

[jira] [Commented] (SPARK-10436) spark-submit overwrites spark.files defaults with the job script filename

2015-09-09 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737544#comment-14737544 ] Sanket Reddy commented on SPARK-10436: -- I am a newbie and interested in it, I will take a look at

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2016-01-15 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101995#comment-15101995 ] Sanket Reddy commented on SPARK-6166: - Hi, I modified the code to fit the latest Spark build, I will

[jira] [Updated] (SPARK-14279) Improve the spark build to pick the version information from the pom file instead of package.scala

2016-03-30 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanket Reddy updated SPARK-14279: - Description: Right now the spark-submit --version and other parts of the code pick up version

[jira] [Created] (SPARK-14279) Improve the spark build to pick the version information from the pom file instead of package.scala

2016-03-30 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-14279: Summary: Improve the spark build to pick the version information from the pom file instead of package.scala Key: SPARK-14279 URL:

[jira] [Commented] (SPARK-14279) Improve the spark build to pick the version information from the pom file and add git commit information

2016-05-23 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15296577#comment-15296577 ] Sanket Reddy commented on SPARK-14279: -- @tgraves Please assign this issue to dhruve > Improve the

[jira] [Created] (SPARK-20355) Display Spark version on history page

2017-04-17 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-20355: Summary: Display Spark version on history page Key: SPARK-20355 URL: https://issues.apache.org/jira/browse/SPARK-20355 Project: Spark Issue Type:

[jira] [Commented] (SPARK-21501) Spark shuffle index cache size should be memory based

2017-07-25 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100658#comment-16100658 ] Sanket Reddy commented on SPARK-21501: -- Hi I am working on this issue just to avoid any redundancies

[jira] [Created] (SPARK-21798) No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server

2017-08-21 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-21798: Summary: No config to replace deprecated SPARK_CLASSPATH config for launching daemons like History Server Key: SPARK-21798 URL: https://issues.apache.org/jira/browse/SPARK-21798

[jira] [Commented] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

2017-09-01 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150762#comment-16150762 ] Sanket Reddy commented on SPARK-21890: -- Will put up a PR for master too thanks > ObtainCredentials

[jira] [Updated] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

2017-09-01 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanket Reddy updated SPARK-21890: - Description: I observed this while running a oozie job trying to connect to hbase via spark. It

[jira] [Created] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

2017-08-31 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-21890: Summary: ObtainCredentials does not pass creds to addDelegationTokens Key: SPARK-21890 URL: https://issues.apache.org/jira/browse/SPARK-21890 Project: Spark

[jira] [Created] (SPARK-24533) typesafe has rebranded to lightbend. change the build/mvn endpoint from downloads.typesafe.com to downloads.lightbend.com

2018-06-12 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-24533: Summary: typesafe has rebranded to lightbend. change the build/mvn endpoint from downloads.typesafe.com to downloads.lightbend.com Key: SPARK-24533 URL:

[jira] [Commented] (SPARK-24533) typesafe has rebranded to lightbend. change the build/mvn endpoint from downloads.typesafe.com to downloads.lightbend.com

2018-06-12 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509850#comment-16509850 ] Sanket Reddy commented on SPARK-24533: -- I will put up a PR shortly thanks > typesafe has rebranded

[jira] [Created] (SPARK-24416) Update configuration definition for spark.blacklist.killBlacklistedExecutors

2018-05-29 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-24416: Summary: Update configuration definition for spark.blacklist.killBlacklistedExecutors Key: SPARK-24416 URL: https://issues.apache.org/jira/browse/SPARK-24416

[jira] [Created] (SPARK-24986) OOM in BufferHolder during writes to a stream

2018-07-31 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-24986: Summary: OOM in BufferHolder during writes to a stream Key: SPARK-24986 URL: https://issues.apache.org/jira/browse/SPARK-24986 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24787) Events being dropped at an alarming rate due to hsync being slow for eventLogging

2018-08-17 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16583964#comment-16583964 ] Sanket Reddy commented on SPARK-24787: -- Thanks [~ste...@apache.org] [~vanzin] [~tgraves] it seems

[jira] [Commented] (SPARK-24787) Events being dropped at an alarming rate due to hsync being slow for eventLogging

2018-07-16 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545436#comment-16545436 ] Sanket Reddy commented on SPARK-24787: -- [~vanzin] do you have any suggestions regarding this issue?

[jira] [Commented] (SPARK-24787) Events being dropped at an alarming rate due to hsync being slow for eventLogging

2018-07-11 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540638#comment-16540638 ] Sanket Reddy commented on SPARK-24787: -- I am happy to work on this... will have a potential

[jira] [Created] (SPARK-24787) Events being dropped at an alarming rate due to hsync being slow for eventLogging

2018-07-11 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-24787: Summary: Events being dropped at an alarming rate due to hsync being slow for eventLogging Key: SPARK-24787 URL: https://issues.apache.org/jira/browse/SPARK-24787

[jira] [Commented] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite

2018-10-22 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658985#comment-16658985 ] Sanket Reddy commented on SPARK-25692: -- Sure [~tgraves] [~zsxwing] i am taking a look. Thanks for

[jira] [Updated] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite

2018-10-22 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanket Reddy updated SPARK-25692: - Attachment: Screen Shot 2018-10-22 at 4.12.41 PM.png > Flaky test: ChunkFetchIntegrationSuite >

[jira] [Commented] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite

2018-10-22 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659644#comment-16659644 ] Sanket Reddy commented on SPARK-25692: -- [~zsxwing] I haven't been able to reproduce this, but the

[jira] [Commented] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite

2018-10-24 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662409#comment-16662409 ] Sanket Reddy commented on SPARK-25692: -- [https://github.com/apache/spark/pull/22628/files] went it

[jira] [Created] (SPARK-25641) Change the spark.shuffle.server.chunkFetchHandlerThreadsPercent default to 100

2018-10-04 Thread Sanket Reddy (JIRA)
Sanket Reddy created SPARK-25641: Summary: Change the spark.shuffle.server.chunkFetchHandlerThreadsPercent default to 100 Key: SPARK-25641 URL: https://issues.apache.org/jira/browse/SPARK-25641

[jira] [Commented] (SPARK-26201) python broadcast.value on driver fails with disk encryption enabled

2018-11-28 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702046#comment-16702046 ] Sanket Reddy commented on SPARK-26201: -- Thanks [~tgraves] will put up the patch shortly > python

[jira] [Commented] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite.fetchBothChunks

2019-01-28 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754406#comment-16754406 ] Sanket Reddy commented on SPARK-25692: -- I had a few observations regarding this test suite... When

[jira] [Commented] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite.fetchBothChunks

2019-01-30 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756226#comment-16756226 ] Sanket Reddy commented on SPARK-25692: -- Created a pr [https://github.com/apache/spark/pull/23700] 

[jira] [Commented] (SPARK-25692) Flaky test: ChunkFetchIntegrationSuite.fetchBothChunks

2019-01-30 Thread Sanket Reddy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756210#comment-16756210 ] Sanket Reddy commented on SPARK-25692: -- Did some further digging How to reproduce ./build/mvn test

[jira] [Commented] (SPARK-30411) saveAsTable does not honor spark.hadoop.hive.warehouse.subdir.inherit.perms

2020-01-08 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010799#comment-17010799 ] Sanket Reddy commented on SPARK-30411: -- spark.sql.orc.impl=hive does not work. [~yumwang]

[jira] [Updated] (SPARK-30411) saveAsTable does not honor spark.hadoop.hive.warehouse.subdir.inherit.perms

2020-01-02 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanket Reddy updated SPARK-30411: - Description: -bash-4.2$ hdfs dfs -ls /tmp | grep my_databases drwxr-x--T - redsanket users 0

[jira] [Created] (SPARK-30411) saveAsTable does not honor spark.hadoop.hive.warehouse.subdir.inherit.perms

2020-01-02 Thread Sanket Reddy (Jira)
Sanket Reddy created SPARK-30411: Summary: saveAsTable does not honor spark.hadoop.hive.warehouse.subdir.inherit.perms Key: SPARK-30411 URL: https://issues.apache.org/jira/browse/SPARK-30411 Project:

[jira] [Comment Edited] (SPARK-30411) saveAsTable does not honor spark.hadoop.hive.warehouse.subdir.inherit.perms

2020-01-06 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009381#comment-17009381 ] Sanket Reddy edited comment on SPARK-30411 at 1/7/20 5:39 AM: -- [~yumwang]  

[jira] [Commented] (SPARK-30411) saveAsTable does not honor spark.hadoop.hive.warehouse.subdir.inherit.perms

2020-01-06 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009381#comment-17009381 ] Sanket Reddy commented on SPARK-30411: -- [~yumwang]  

[jira] [Updated] (SPARK-31788) Cannot convert org.apache.spark.api.java.JavaPairRDD to org.apache.spark.api.java.JavaRDD

2020-05-21 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanket Reddy updated SPARK-31788: - Description: Union RDD of Pair RDD's seems to have issues SparkSession available as 'spark'.

[jira] [Updated] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-21 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanket Reddy updated SPARK-31788: - Summary: Error when creating UnionRDD of PairRDDs (was: Cannot convert

[jira] [Commented] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-21 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113623#comment-17113623 ] Sanket Reddy commented on SPARK-31788: -- Took a naive dig at it 

[jira] [Commented] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-21 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113566#comment-17113566 ] Sanket Reddy commented on SPARK-31788: --

[jira] [Comment Edited] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-21 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113566#comment-17113566 ] Sanket Reddy edited comment on SPARK-31788 at 5/21/20, 11:37 PM: -

[jira] [Updated] (SPARK-31788) Cannot convert org.apache.spark.api.java.JavaPairRDD to org.apache.spark.api.java.JavaRDD

2020-05-21 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanket Reddy updated SPARK-31788: - Description: Pair RDD conversion seems to have issues SparkSession available as 'spark'. >>>

[jira] [Created] (SPARK-31788) Cannot convert org.apache.spark.api.java.JavaPairRDD to org.apache.spark.api.java.JavaRDD

2020-05-21 Thread Sanket Reddy (Jira)
Sanket Reddy created SPARK-31788: Summary: Cannot convert org.apache.spark.api.java.JavaPairRDD to org.apache.spark.api.java.JavaRDD Key: SPARK-31788 URL: https://issues.apache.org/jira/browse/SPARK-31788

[jira] [Created] (SPARK-33741) Add minimum threshold speculation config

2020-12-10 Thread Sanket Reddy (Jira)
Sanket Reddy created SPARK-33741: Summary: Add minimum threshold speculation config Key: SPARK-33741 URL: https://issues.apache.org/jira/browse/SPARK-33741 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34545) PySpark Python UDF return inconsistent results when applying 2 UDFs with different return type to 2 columns together

2021-02-25 Thread Sanket Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291164#comment-17291164 ] Sanket Reddy commented on SPARK-34545: -- cc [~hyukjin.kwon] > PySpark Python UDF return

[jira] [Created] (SPARK-36685) Fix wrong assert statement

2021-09-07 Thread Sanket Reddy (Jira)
Sanket Reddy created SPARK-36685: Summary: Fix wrong assert statement Key: SPARK-36685 URL: https://issues.apache.org/jira/browse/SPARK-36685 Project: Spark Issue Type: Improvement