[jira] [Commented] (SPARK-26404) set spark.pyspark.python or PYSPARK_PYTHON doesn't work in k8s client-cluster mode.

2019-01-10 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16740011#comment-16740011 ] Nihar Sheth commented on SPARK-26404: - Yup, ran into the same issue then. What I've

[jira] [Commented] (SPARK-26404) set spark.pyspark.python or PYSPARK_PYTHON doesn't work in k8s client-cluster mode.

2019-01-10 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16739760#comment-16739760 ] Nihar Sheth commented on SPARK-26404: - Hi, I think I ran into a similar issue. How a

[jira] [Resolved] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

2018-12-17 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nihar Sheth resolved SPARK-26386. - Resolution: Not A Problem Attempted reinvention of "spark.kubernetes.driver.pod.name", which han

[jira] [Commented] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

2018-12-17 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723299#comment-16723299 ] Nihar Sheth commented on SPARK-26386: - Ah, yes, that seems like it does...Testing it

[jira] [Commented] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

2018-12-17 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723281#comment-16723281 ] Nihar Sheth commented on SPARK-26386: - I'll be working on this > [K8s] Add configur

[jira] [Created] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

2018-12-17 Thread Nihar Sheth (JIRA)
Nihar Sheth created SPARK-26386: --- Summary: [K8s] Add configuration for executor OwnerReference when running in client mode Key: SPARK-26386 URL: https://issues.apache.org/jira/browse/SPARK-26386 Project

[jira] [Commented] (SPARK-25960) Support subpath mounting with Kubernetes

2018-11-08 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680644#comment-16680644 ] Nihar Sheth commented on SPARK-25960: - Spoke with Tim, I'll be looking into this >

[jira] [Commented] (SPARK-25230) Upper behavior incorrect for string contains "ß"

2018-08-24 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592216#comment-16592216 ] Nihar Sheth commented on SPARK-25230: - This seems to be a JVM thing  [https://docs.

[jira] [Commented] (SPARK-24918) Executor Plugin API

2018-08-22 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589248#comment-16589248 ] Nihar Sheth commented on SPARK-24918: - [~irashid] has asked me to add testing to his

[jira] [Commented] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools

2018-08-14 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580225#comment-16580225 ] Nihar Sheth commented on SPARK-24938: - His comment for that change is "The header is

[jira] [Commented] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools

2018-08-14 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580113#comment-16580113 ] Nihar Sheth commented on SPARK-24938: - Your expectation is correct, the offheap pool

[jira] [Commented] (SPARK-24938) Understand usage of netty's onheap memory use, even with offheap pools

2018-08-13 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579039#comment-16579039 ] Nihar Sheth commented on SPARK-24938: - After making the change and running the tool

[jira] [Commented] (SPARK-24536) Query with nonsensical LIMIT hits AssertionError

2018-07-17 Thread Nihar Sheth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16547074#comment-16547074 ] Nihar Sheth commented on SPARK-24536: - I'd like to take a shot at this, if no one el