[jira] [Commented] (SPARK-23033) disable task-level retry for continuous execution

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376471#comment-16376471 ] Apache Spark commented on SPARK-23033: -- User 'xuanyuanking' has created a pull request for this

[jira] [Commented] (SPARK-23492) Application shows up as running in history server even when latest attempt has completed

2018-02-25 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376458#comment-16376458 ] guoxiaolongzte commented on SPARK-23492: I tested with the latest environment, but I did not

[jira] [Commented] (SPARK-23465) Dataset.withAllColumnsRenamed should map all column names to a new one

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376436#comment-16376436 ] Apache Spark commented on SPARK-23465: -- User 'misutoth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23465) Dataset.withAllColumnsRenamed should map all column names to a new one

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23465: Assignee: (was: Apache Spark) > Dataset.withAllColumnsRenamed should map all column

[jira] [Assigned] (SPARK-23465) Dataset.withAllColumnsRenamed should map all column names to a new one

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23465: Assignee: Apache Spark > Dataset.withAllColumnsRenamed should map all column names to a

[jira] [Updated] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

2018-02-25 Thread PandaMonkey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PandaMonkey updated SPARK-23509: Attachment: spark.txt > Upgrade commons-net from 2.2 to 3.1 > ---

[jira] [Updated] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

2018-02-25 Thread PandaMonkey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PandaMonkey updated SPARK-23509: Attachment: (was: spark.txt) > Upgrade commons-net from 2.2 to 3.1 >

[jira] [Assigned] (SPARK-23515) JsonProtocol.sparkEventToJson can OOM when jsonifying an event

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23515: Assignee: Apache Spark (was: Burak Yavuz) > JsonProtocol.sparkEventToJson can OOM when

[jira] [Commented] (SPARK-23515) JsonProtocol.sparkEventToJson can OOM when jsonifying an event

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376306#comment-16376306 ] Apache Spark commented on SPARK-23515: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23515) JsonProtocol.sparkEventToJson can OOM when jsonifying an event

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23515: Assignee: Burak Yavuz (was: Apache Spark) > JsonProtocol.sparkEventToJson can OOM when

[jira] [Created] (SPARK-23515) JsonProtocol.sparkEventToJson can OOM when jsonifying an event

2018-02-25 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-23515: --- Summary: JsonProtocol.sparkEventToJson can OOM when jsonifying an event Key: SPARK-23515 URL: https://issues.apache.org/jira/browse/SPARK-23515 Project: Spark

[jira] [Assigned] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23509: Assignee: Apache Spark > Upgrade commons-net from 2.2 to 3.1 >

[jira] [Assigned] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23509: Assignee: (was: Apache Spark) > Upgrade commons-net from 2.2 to 3.1 >

[jira] [Commented] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376207#comment-16376207 ] Apache Spark commented on SPARK-23509: -- User 'kiszk' has created a pull request for this issue:

[jira] [Commented] (SPARK-23509) Upgrade commons-net from 2.2 to 3.1

2018-02-25 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376198#comment-16376198 ] Kazuaki Ishizaki commented on SPARK-23509: -- During the build using sbt, we are seeing the

[jira] [Commented] (SPARK-23510) Support read data from Hive 2.2 and Hive 2.3 metastore

2018-02-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376189#comment-16376189 ] Apache Spark commented on SPARK-23510: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-23512) Complex operations on Dataframe corrupts data

2018-02-25 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376171#comment-16376171 ] Kazuaki Ishizaki commented on SPARK-23512: -- This problem can be reproduced with master using the

[jira] [Commented] (SPARK-23498) Accuracy problem in comparison with string and integer

2018-02-25 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376137#comment-16376137 ] Kazuaki Ishizaki commented on SPARK-23498: -- SPARK implicitly casts {{String}} to type of another

[jira] [Assigned] (SPARK-22886) ML test for StructuredStreaming: spark.ml.recommendation

2018-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22886: - Assignee: Gabor Somogyi > ML test for StructuredStreaming: spark.ml.recommendation >

[jira] [Resolved] (SPARK-22886) ML test for StructuredStreaming: spark.ml.recommendation

2018-02-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22886. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20362

[jira] [Commented] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2018-02-25 Thread Arman Yazdani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375995#comment-16375995 ] Arman Yazdani commented on SPARK-21177: --- I configured spark with hive. in my case when i want to

[jira] [Comment Edited] (SPARK-23405) The task will hang up when a small table left semi join a big table

2018-02-25 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375985#comment-16375985 ] KaiXinXIaoLei edited comment on SPARK-23405 at 2/25/18 8:32 AM: i run

[jira] [Commented] (SPARK-23405) The task will hang up when a small table left semi join a big table

2018-02-25 Thread KaiXinXIaoLei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375985#comment-16375985 ] KaiXinXIaoLei commented on SPARK-23405: --- i run `select ls.cs_order_number from ls left semi join