[jira] [Assigned] (SPARK-23853) Skip doctests which require hive support built in PySpark

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23853: Assignee: Apache Spark > Skip doctests which require hive support built in PySpark >

[jira] [Assigned] (SPARK-23853) Skip doctests which require hive support built in PySpark

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23853: Assignee: (was: Apache Spark) > Skip doctests which require hive support built in

[jira] [Commented] (SPARK-23853) Skip doctests which require hive support built in PySpark

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449651#comment-16449651 ] Apache Spark commented on SPARK-23853: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-22600) Fix 64kb limit for deeply nested expressions under wholestage codegen

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449580#comment-16449580 ] Apache Spark commented on SPARK-22600: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-24051) Incorrect results for certain queries using Java and Python APIs on Spark 2.3.0

2018-04-24 Thread Emlyn Corrin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449513#comment-16449513 ] Emlyn Corrin commented on SPARK-24051: -- I've reshuffled the pyspark version to make it even clearer:

[jira] [Assigned] (SPARK-24066) Add a window exchange rule to eliminate redundant physical plan SortExec

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24066: Assignee: Apache Spark > Add a window exchange rule to eliminate redundant physical plan

[jira] [Assigned] (SPARK-24066) Add a window exchange rule to eliminate redundant physical plan SortExec

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24066: Assignee: (was: Apache Spark) > Add a window exchange rule to eliminate redundant

[jira] [Commented] (SPARK-24066) Add a window exchange rule to eliminate redundant physical plan SortExec

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449512#comment-16449512 ] Apache Spark commented on SPARK-24066: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Updated] (SPARK-24064) [Spark SQL] Create table using csv does not support binary column Type

2018-04-24 Thread ABHISHEK KUMAR GUPTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-24064: - Target Version/s: 2.3.1 (was: 2.3.0) > [Spark SQL] Create table using csv does

[jira] [Updated] (SPARK-24064) [Spark SQL] Create table using csv does not support binary column Type

2018-04-24 Thread ABHISHEK KUMAR GUPTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-24064: - Component/s: (was: Deploy) SQL > [Spark SQL] Create table

[jira] [Created] (SPARK-24066) Add a window exchange rule to eliminate redundant physical plan SortExec

2018-04-24 Thread caoxuewen (JIRA)
caoxuewen created SPARK-24066: - Summary: Add a window exchange rule to eliminate redundant physical plan SortExec Key: SPARK-24066 URL: https://issues.apache.org/jira/browse/SPARK-24066 Project: Spark

[jira] [Updated] (SPARK-24065) Issue with the property IgnoreLeadingWhiteSpace

2018-04-24 Thread Varsha Chandrashekar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varsha Chandrashekar updated SPARK-24065: - Attachment: spark-shell-result.PNG > Issue with the property

[jira] [Commented] (SPARK-24065) Issue with the property IgnoreLeadingWhiteSpace

2018-04-24 Thread Varsha Chandrashekar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449504#comment-16449504 ] Varsha Chandrashekar commented on SPARK-24065: -- Refer the attachment for the input file used

[jira] [Updated] (SPARK-24065) Issue with the property IgnoreLeadingWhiteSpace

2018-04-24 Thread Varsha Chandrashekar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varsha Chandrashekar updated SPARK-24065: - Attachment: lds1.txt > Issue with the property IgnoreLeadingWhiteSpace >

[jira] [Updated] (SPARK-24065) Issue with the property IgnoreLeadingWhiteSpace

2018-04-24 Thread Varsha Chandrashekar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varsha Chandrashekar updated SPARK-24065: - Description: "IgnoreLeadingWhiteSpace" property is not working properly for a

[jira] [Updated] (SPARK-24065) Issue with the property IgnoreLeadingWhiteSpace

2018-04-24 Thread Varsha Chandrashekar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varsha Chandrashekar updated SPARK-24065: - Description: "IgnoreLeadingWhiteSpace" property is not working properly for a

[jira] [Created] (SPARK-24065) Issue with the property IgnoreLeadingWhiteSpace

2018-04-24 Thread Varsha Chandrashekar (JIRA)
Varsha Chandrashekar created SPARK-24065: Summary: Issue with the property IgnoreLeadingWhiteSpace Key: SPARK-24065 URL: https://issues.apache.org/jira/browse/SPARK-24065 Project: Spark

[jira] [Created] (SPARK-24064) [Spark SQL] Create table using csv does not support binary column Type

2018-04-24 Thread ABHISHEK KUMAR GUPTA (JIRA)
ABHISHEK KUMAR GUPTA created SPARK-24064: Summary: [Spark SQL] Create table using csv does not support binary column Type Key: SPARK-24064 URL: https://issues.apache.org/jira/browse/SPARK-24064

[jira] [Assigned] (SPARK-24062) SASL encryption cannot be worked in ThriftServer

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24062: Assignee: Apache Spark > SASL encryption cannot be worked in ThriftServer >

[jira] [Commented] (SPARK-24062) SASL encryption cannot be worked in ThriftServer

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449466#comment-16449466 ] Apache Spark commented on SPARK-24062: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24062) SASL encryption cannot be worked in ThriftServer

2018-04-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24062: Assignee: (was: Apache Spark) > SASL encryption cannot be worked in ThriftServer >

[jira] [Assigned] (SPARK-24054) Add array_position function / element_at functions

2018-04-24 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24054: Assignee: Hyukjin Kwon > Add array_position function / element_at functions >

[jira] [Resolved] (SPARK-24054) Add array_position function / element_at functions

2018-04-24 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24054. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21130

[jira] [Created] (SPARK-24063) Control maximum epoch backlog

2018-04-24 Thread Efim Poberezkin (JIRA)
Efim Poberezkin created SPARK-24063: --- Summary: Control maximum epoch backlog Key: SPARK-24063 URL: https://issues.apache.org/jira/browse/SPARK-24063 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-24062) SASL encryption cannot be worked in ThriftServer

2018-04-24 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-24062: --- Summary: SASL encryption cannot be worked in ThriftServer Key: SPARK-24062 URL: https://issues.apache.org/jira/browse/SPARK-24062 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24043) InterpretedPredicate.eval fails if expression tree contains Nondeterministic expressions

2018-04-24 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449428#comment-16449428 ] Takeshi Yamamuro commented on SPARK-24043: -- Aha, I gotcha. ya, we currently have no

[jira] [Commented] (SPARK-24043) InterpretedPredicate.eval fails if expression tree contains Nondeterministic expressions

2018-04-24 Thread Bruce Robbins (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449352#comment-16449352 ] Bruce Robbins commented on SPARK-24043: --- You're half-way there. When whole-stage codegen is off

<    1   2