[jira] [Resolved] (SPARK-26023) Dumping truncated plans to a file

2018-11-13 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26023. --- Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 3.0.0 > Dumpin

[jira] [Commented] (SPARK-26024) Dataset API: repartitionByRange(...) has inconsistent behaviour

2018-11-13 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685192#comment-16685192 ] Marco Gaido commented on SPARK-26024: - I am not sure about that [~JulienPeloton]. In

[jira] [Commented] (SPARK-26024) Dataset API: repartitionByRange(...) has inconsistent behaviour

2018-11-13 Thread Julien Peloton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685181#comment-16685181 ] Julien Peloton commented on SPARK-26024: Hi Marco and thanks for your quick repl

[jira] [Commented] (SPARK-26024) Dataset API: repartitionByRange(...) has inconsistent behaviour

2018-11-13 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685131#comment-16685131 ] Marco Gaido commented on SPARK-26024: - I think this is the expected behavior, as Spa

[jira] [Assigned] (SPARK-26038) Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long

2018-11-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26038: Assignee: (was: Apache Spark) > Decimal toScalaBigInt/toJavaBigInteger not work for d

[jira] [Commented] (SPARK-26038) Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long

2018-11-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685045#comment-16685045 ] Apache Spark commented on SPARK-26038: -- User 'juliuszsompolski' has created a pull

[jira] [Assigned] (SPARK-26038) Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long

2018-11-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26038: Assignee: Apache Spark > Decimal toScalaBigInt/toJavaBigInteger not work for decimals not

[jira] [Updated] (SPARK-26028) Design sketch for SPIP: Property Graphs, Cypher Queries, and Algorithms

2018-11-13 Thread Martin Junghanns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Junghanns updated SPARK-26028: - Summary: Design sketch for SPIP: Property Graphs, Cypher Queries, and Algorithms (was:

[jira] [Resolved] (SPARK-26037) ./dev/make-distribution.sh fails for Scala 2.12

2018-11-13 Thread Damian Momot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Momot resolved SPARK-26037. -- Resolution: Not A Problem > ./dev/make-distribution.sh fails for Scala 2.12 >

[jira] [Commented] (SPARK-26037) ./dev/make-distribution.sh fails for Scala 2.12

2018-11-13 Thread Damian Momot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16685010#comment-16685010 ] Damian Momot commented on SPARK-26037: -- Oh nevermind... it should be "-Pscala-2.12"

[jira] [Created] (SPARK-26038) Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long

2018-11-13 Thread Juliusz Sompolski (JIRA)
Juliusz Sompolski created SPARK-26038: - Summary: Decimal toScalaBigInt/toJavaBigInteger not work for decimals not fitting in long Key: SPARK-26038 URL: https://issues.apache.org/jira/browse/SPARK-26038

[jira] [Issue Comment Deleted] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

2018-11-13 Thread Martin Junghanns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Junghanns updated SPARK-25994: - Comment: was deleted (was: SPIP document: https://docs.google.com/document/d/1ljqVsAh2w

[jira] [Commented] (SPARK-25994) SPIP: DataFrame-based graph queries and algorithms

2018-11-13 Thread Martin Junghanns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684986#comment-16684986 ] Martin Junghanns commented on SPARK-25994: -- SPIP document: https://docs.google

[jira] [Updated] (SPARK-25994) SPIP: Property Graphs, Cypher Queries, and Algorithms

2018-11-13 Thread Martin Junghanns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Junghanns updated SPARK-25994: - Summary: SPIP: Property Graphs, Cypher Queries, and Algorithms (was: SPIP: DataFrame-ba

[jira] [Updated] (SPARK-25994) SPIP: DataFrame-based graph queries and algorithms

2018-11-13 Thread Martin Junghanns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Junghanns updated SPARK-25994: - External issue URL: (was: https://docs.google.com/document/d/1ljqVsAh2wxTZS8XqwDQgRT6i

[jira] [Updated] (SPARK-25994) SPIP: DataFrame-based graph queries and algorithms

2018-11-13 Thread Martin Junghanns (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Junghanns updated SPARK-25994: - External issue URL: https://docs.google.com/document/d/1ljqVsAh2wxTZS8XqwDQgRT6i_mania3f

[jira] [Commented] (SPARK-26037) ./dev/make-distribution.sh fails for Scala 2.12

2018-11-13 Thread Damian Momot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684982#comment-16684982 ] Damian Momot commented on SPARK-26037: -- [~srowen] you might be interested :) > ./d

[jira] [Created] (SPARK-26037) ./dev/make-distribution.sh fails for Scala 2.12

2018-11-13 Thread Damian Momot (JIRA)
Damian Momot created SPARK-26037: Summary: ./dev/make-distribution.sh fails for Scala 2.12 Key: SPARK-26037 URL: https://issues.apache.org/jira/browse/SPARK-26037 Project: Spark Issue Type: B

[jira] [Assigned] (SPARK-26032) Break large sql/tests.py files into smaller files

2018-11-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26032: Assignee: Apache Spark > Break large sql/tests.py files into smaller files >

[jira] [Assigned] (SPARK-26032) Break large sql/tests.py files into smaller files

2018-11-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26032: Assignee: (was: Apache Spark) > Break large sql/tests.py files into smaller files > -

[jira] [Commented] (SPARK-26032) Break large sql/tests.py files into smaller files

2018-11-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684971#comment-16684971 ] Apache Spark commented on SPARK-26032: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-25921) Python worker reuse causes Barrier tasks to run without BarrierTaskContext

2018-11-13 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25921: --- Assignee: Yuanjian Li (was: Wenchen Fan) > Python worker reuse causes Barrier tasks to run

[jira] [Created] (SPARK-26033) Break large ml/tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-26033: Summary: Break large ml/tests.py files into smaller files Key: SPARK-26033 URL: https://issues.apache.org/jira/browse/SPARK-26033 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-25921) Python worker reuse causes Barrier tasks to run without BarrierTaskContext

2018-11-13 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25921: --- Assignee: Wenchen Fan > Python worker reuse causes Barrier tasks to run without BarrierTask

[jira] [Resolved] (SPARK-25921) Python worker reuse causes Barrier tasks to run without BarrierTaskContext

2018-11-13 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25921. - Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 Issue resolved by pull re

[jira] [Updated] (SPARK-25344) Break large PySpark unittests into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25344: - Description: We've got a ton of tests in one humongous tests.py file, rather than breaking it o

[jira] [Commented] (SPARK-25344) Break large PySpark unittests into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684910#comment-16684910 ] Hyukjin Kwon commented on SPARK-25344: -- [~irashid] and [~bryanc], let me open a PR

[jira] [Updated] (SPARK-26033) Break large ml/tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26033: - Component/s: PySpark > Break large ml/tests.py files into smaller files > --

[jira] [Updated] (SPARK-26032) Break large sql/tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-26032: - Component/s: PySpark > Break large sql/tests.py files into smaller files > -

[jira] [Updated] (SPARK-25344) Break large PySpark unittests into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25344: - Summary: Break large PySpark unittests into smaller files (was: Break large tests.py files into

[jira] [Created] (SPARK-26035) Break large streaming/tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-26035: Summary: Break large streaming/tests.py files into smaller files Key: SPARK-26035 URL: https://issues.apache.org/jira/browse/SPARK-26035 Project: Spark Issue

[jira] [Created] (SPARK-26036) Break large tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-26036: Summary: Break large tests.py files into smaller files Key: SPARK-26036 URL: https://issues.apache.org/jira/browse/SPARK-26036 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-26034) Break large mllib/tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-26034: Summary: Break large mllib/tests.py files into smaller files Key: SPARK-26034 URL: https://issues.apache.org/jira/browse/SPARK-26034 Project: Spark Issue Typ

[jira] [Updated] (SPARK-25344) Break large tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25344: - Target Version/s: 3.0.0 > Break large tests.py files into smaller files > --

[jira] [Created] (SPARK-26032) Break large sql/tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-26032: Summary: Break large sql/tests.py files into smaller files Key: SPARK-26032 URL: https://issues.apache.org/jira/browse/SPARK-26032 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-25344) Break large tests.py files into smaller files

2018-11-13 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25344: Assignee: Hyukjin Kwon > Break large tests.py files into smaller files >

<    1   2