[jira] [Commented] (SPARK-23588) Add interpreted execution for CatalystToExternalMap expression

2018-03-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394827#comment-16394827 ] Takeshi Yamamuro commented on SPARK-23588: -- I'll make a pr later:

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2018-03-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394787#comment-16394787 ] Takeshi Yamamuro commented on SPARK-18134: -- Sorry for interrupting you, but the current proposed

[jira] [Commented] (SPARK-23627) Provide isEmpty() function in DataSet

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394782#comment-16394782 ] Apache Spark commented on SPARK-23627: -- User 'goungoun' has created a pull request for this issue:

[jira] [Commented] (SPARK-23634) AttributeReferences may be too conservative wrt nullability after optimization

2018-03-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394777#comment-16394777 ] Takeshi Yamamuro commented on SPARK-23634: -- Probably, this ticket is duplicate to

[jira] [Assigned] (SPARK-23635) Spark executor env variable is overwritten by same name AM env variable

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23635: Assignee: Apache Spark > Spark executor env variable is overwritten by same name AM env

[jira] [Commented] (SPARK-23635) Spark executor env variable is overwritten by same name AM env variable

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394767#comment-16394767 ] Apache Spark commented on SPARK-23635: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23635) Spark executor env variable is overwritten by same name AM env variable

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23635: Assignee: (was: Apache Spark) > Spark executor env variable is overwritten by same

[jira] [Assigned] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23645: Assignee: Apache Spark > pandas_udf can not be called with keyword arguments >

[jira] [Assigned] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23645: Assignee: (was: Apache Spark) > pandas_udf can not be called with keyword arguments >

[jira] [Commented] (SPARK-23645) pandas_udf can not be called with keyword arguments

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394639#comment-16394639 ] Apache Spark commented on SPARK-23645: -- User 'mstewart141' has created a pull request for this

[jira] [Assigned] (SPARK-23583) Add interpreted execution to Invoke expression

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23583: Assignee: Apache Spark > Add interpreted execution to Invoke expression >

[jira] [Commented] (SPARK-23583) Add interpreted execution to Invoke expression

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394626#comment-16394626 ] Apache Spark commented on SPARK-23583: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23583) Add interpreted execution to Invoke expression

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23583: Assignee: (was: Apache Spark) > Add interpreted execution to Invoke expression >

[jira] [Updated] (SPARK-23650) Slow SparkR udf (dapply)

2018-03-11 Thread Deepansh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepansh updated SPARK-23650: - Description: For eg, I am getting streams from Kafka and I want to implement a model made in R for

[jira] [Created] (SPARK-23650) Slow SparkR udf (dapply)

2018-03-11 Thread Deepansh (JIRA)
Deepansh created SPARK-23650: Summary: Slow SparkR udf (dapply) Key: SPARK-23650 URL: https://issues.apache.org/jira/browse/SPARK-23650 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-23650) Slow SparkR udf (dapply)

2018-03-11 Thread Deepansh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepansh updated SPARK-23650: - Description: For eg, I am getting streams from Kafka and I want to implement a model made in R for

[jira] [Commented] (SPARK-23638) Spark on k8s: spark.kubernetes.initContainer.image has no effect

2018-03-11 Thread Anton Okolnychyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394615#comment-16394615 ] Anton Okolnychyi commented on SPARK-23638: -- Could you also share your spark-submit command? It

[jira] [Comment Edited] (SPARK-10815) Public API: Streaming Sources and Sinks

2018-03-11 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394583#comment-16394583 ] Richard Yu edited comment on SPARK-10815 at 3/11/18 5:42 PM: -

[jira] [Commented] (SPARK-10815) Public API: Streaming Sources and Sinks

2018-03-11 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394583#comment-16394583 ] Richard Yu commented on SPARK-10815: [~c...@koeninger.org] Is this still applicable to Spark? This

[jira] [Assigned] (SPARK-23649) CSV schema inferring fails on some UTF-8 chars

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23649: Assignee: Apache Spark > CSV schema inferring fails on some UTF-8 chars >

[jira] [Assigned] (SPARK-23649) CSV schema inferring fails on some UTF-8 chars

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23649: Assignee: (was: Apache Spark) > CSV schema inferring fails on some UTF-8 chars >

[jira] [Commented] (SPARK-23649) CSV schema inferring fails on some UTF-8 chars

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394582#comment-16394582 ] Apache Spark commented on SPARK-23649: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-16859) History Server storage information is missing

2018-03-11 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394580#comment-16394580 ] Richard Yu edited comment on SPARK-16859 at 3/11/18 5:26 PM: - Is this issue

[jira] [Updated] (SPARK-23649) CSV schema inferring fails on some UTF-8 chars

2018-03-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-23649: --- Shepherd: Herman van Hovell > CSV schema inferring fails on some UTF-8 chars >

[jira] [Commented] (SPARK-16859) History Server storage information is missing

2018-03-11 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394580#comment-16394580 ] Richard Yu commented on SPARK-16859: Is this issue not already resolved? When looking into

[jira] [Comment Edited] (SPARK-16859) History Server storage information is missing

2018-03-11 Thread Richard Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394580#comment-16394580 ] Richard Yu edited comment on SPARK-16859 at 3/11/18 5:25 PM: - Is this issue

[jira] [Updated] (SPARK-23649) CSV schema inferring fails on some UTF-8 chars

2018-03-11 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-23649: --- Attachment: utf8xFF.csv > CSV schema inferring fails on some UTF-8 chars >

[jira] [Created] (SPARK-23649) CSV schema inferring fails on some UTF-8 chars

2018-03-11 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-23649: -- Summary: CSV schema inferring fails on some UTF-8 chars Key: SPARK-23649 URL: https://issues.apache.org/jira/browse/SPARK-23649 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2018-03-11 Thread Sital Kedia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394571#comment-16394571 ] Sital Kedia commented on SPARK-18134: - [~hvanhovell]- What is the state of this JIRA? Do we expect to

[jira] [Commented] (SPARK-19737) New analysis rule for reporting unregistered functions without relying on relation resolution

2018-03-11 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394550#comment-16394550 ] kevin yu commented on SPARK-19737: -- [~LANDAIS Christophe], I submit a PR under  SPARK-23486, can you try

[jira] [Assigned] (SPARK-23647) extend hint syntax to support any expression for Python

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23647: Assignee: (was: Apache Spark) > extend hint syntax to support any expression for

[jira] [Assigned] (SPARK-23647) extend hint syntax to support any expression for Python

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23647: Assignee: Apache Spark > extend hint syntax to support any expression for Python >

[jira] [Commented] (SPARK-23647) extend hint syntax to support any expression for Python

2018-03-11 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394499#comment-16394499 ] Apache Spark commented on SPARK-23647: -- User 'DylanGuedes' has created a pull request for this

[jira] [Created] (SPARK-23648) extend hint syntax to support any expression for R

2018-03-11 Thread Dylan Guedes (JIRA)
Dylan Guedes created SPARK-23648: Summary: extend hint syntax to support any expression for R Key: SPARK-23648 URL: https://issues.apache.org/jira/browse/SPARK-23648 Project: Spark Issue

[jira] [Created] (SPARK-23647) extend hint syntax to support any expression for Python

2018-03-11 Thread Dylan Guedes (JIRA)
Dylan Guedes created SPARK-23647: Summary: extend hint syntax to support any expression for Python Key: SPARK-23647 URL: https://issues.apache.org/jira/browse/SPARK-23647 Project: Spark

[jira] [Resolved] (SPARK-23646) pyspark DataFrameWriter ignores customized settings?

2018-03-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23646. -- Resolution: Invalid Let me leave this resolved but please feel free to reopen when it becomes