[jira] [Assigned] (SPARK-12455) Add ExpressionDescription to window functions

[ https://issues.apache.org/jira/browse/SPARK-12455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12455: Assignee: Apache Spark (was: Herman van Hovell) > Add ExpressionDescription to window

[jira] [Assigned] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12465: Assignee: Apache Spark > Remove spark.deploy.mesos.zookeeper.dir and use

[jira] [Assigned] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12465: Assignee: (was: Apache Spark) > Remove spark.deploy.mesos.zookeeper.dir and use

[jira] [Assigned] (SPARK-12457) Add ExpressionDescription to collection functions

[ https://issues.apache.org/jira/browse/SPARK-12457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12457: Assignee: (was: Apache Spark) > Add ExpressionDescription to collection functions >

[jira] [Assigned] (SPARK-12457) Add ExpressionDescription to collection functions

[ https://issues.apache.org/jira/browse/SPARK-12457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12457: Assignee: Apache Spark > Add ExpressionDescription to collection functions >

[jira] [Commented] (SPARK-12464) Remove spark.deploy.mesos.zookeeper.url and use spark.deploy.zookeeper.url

[ https://issues.apache.org/jira/browse/SPARK-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067045#comment-15067045 ] Apache Spark commented on SPARK-12464: -- User 'tnachen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12463) Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode

[ https://issues.apache.org/jira/browse/SPARK-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12463: Assignee: (was: Apache Spark) > Remove spark.deploy.mesos.recoveryMode and use

[jira] [Assigned] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12465: Assignee: Apache Spark > Remove spark.deploy.mesos.zookeeper.dir and use

[jira] [Resolved] (SPARK-12321) JSON format for logical/physical execution plans

[ https://issues.apache.org/jira/browse/SPARK-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12321. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10311

[jira] [Resolved] (SPARK-12398) Smart truncation of DataFrame / Dataset toString

[ https://issues.apache.org/jira/browse/SPARK-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12398. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10373

[jira] [Assigned] (SPARK-12463) Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode

[ https://issues.apache.org/jira/browse/SPARK-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12463: Assignee: Apache Spark > Remove spark.deploy.mesos.recoveryMode and use

[jira] [Commented] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067059#comment-15067059 ] Apache Spark commented on SPARK-12465: -- User 'tnachen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12468: Assignee: (was: Apache Spark) > getParamMap in Pyspark ML API returns empty

[jira] [Created] (SPARK-12454) Add ExpressionDescription to expressions are registered in FunctionRegistry

Yin Huai created SPARK-12454: Summary: Add ExpressionDescription to expressions are registered in FunctionRegistry Key: SPARK-12454 URL: https://issues.apache.org/jira/browse/SPARK-12454 Project: Spark

[jira] [Created] (SPARK-12455) Add ExpressionDescription to window functions

Yin Huai created SPARK-12455: Summary: Add ExpressionDescription to window functions Key: SPARK-12455 URL: https://issues.apache.org/jira/browse/SPARK-12455 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-12362) Create a full-fledged built-in SQL parser

[ https://issues.apache.org/jira/browse/SPARK-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066864#comment-15066864 ] Nong Li commented on SPARK-12362: - I think it makes sense to inline the hive ql parser into spark sql.

[jira] [Commented] (SPARK-12457) Add ExpressionDescription to collection functions

[ https://issues.apache.org/jira/browse/SPARK-12457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066892#comment-15066892 ] Xiao Li commented on SPARK-12457: - Let me pick this one? : ) > Add ExpressionDescription to collection

[jira] [Commented] (SPARK-12396) Once driver client registered successfully,it still retry to connected to master.

[ https://issues.apache.org/jira/browse/SPARK-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067023#comment-15067023 ] Apache Spark commented on SPARK-12396: -- User 'echoTomei' has created a pull request for this issue:

[jira] [Updated] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fede Bar updated SPARK-12430: - Component/s: Spark Core > Temporary folders do not get deleted after Task completes causing problems >

[jira] [Updated] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fede Bar updated SPARK-12430: - Fix Version/s: (was: 1.4.1) > Temporary folders do not get deleted after Task completes causing

[jira] [Resolved] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12453. --- Resolution: Duplicate > Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version >

[jira] [Created] (SPARK-12462) Add ExpressionDescription to misc non-aggregate functions

Yin Huai created SPARK-12462: Summary: Add ExpressionDescription to misc non-aggregate functions Key: SPARK-12462 URL: https://issues.apache.org/jira/browse/SPARK-12462 Project: Spark Issue

[jira] [Updated] (SPARK-12430) Temporary folders do not get deleted after Task completes causing problems with disk space.

[ https://issues.apache.org/jira/browse/SPARK-12430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fede Bar updated SPARK-12430: - Component/s: (was: Spark Submit) (was: Shuffle) (was: Block

[jira] [Commented] (SPARK-12464) Remove spark.deploy.mesos.zookeeper.url and use spark.deploy.zookeeper.url

[ https://issues.apache.org/jira/browse/SPARK-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067062#comment-15067062 ] Andrew Or commented on SPARK-12464: --- By the way for future reference you probably don't need a separate

[jira] [Created] (SPARK-12457) Add ExpressionDescription to collection functions

Yin Huai created SPARK-12457: Summary: Add ExpressionDescription to collection functions Key: SPARK-12457 URL: https://issues.apache.org/jira/browse/SPARK-12457 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12464) Remove spark.deploy.mesos.zookeeper.url and use spark.deploy.zookeeper.url

[ https://issues.apache.org/jira/browse/SPARK-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12464: Assignee: Apache Spark > Remove spark.deploy.mesos.zookeeper.url and use

[jira] [Commented] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066857#comment-15066857 ] Timothy Hunter commented on SPARK-12247: Thanks for working on it, [~BenFradet]! > Documentation

[jira] [Commented] (SPARK-12362) Create a full-fledged built-in SQL parser

[ https://issues.apache.org/jira/browse/SPARK-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066883#comment-15066883 ] Reynold Xin commented on SPARK-12362: - +1 > Create a full-fledged built-in SQL parser >

[jira] [Assigned] (SPARK-12455) Add ExpressionDescription to window functions

[ https://issues.apache.org/jira/browse/SPARK-12455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12455: Assignee: Apache Spark (was: Herman van Hovell) > Add ExpressionDescription to window

[jira] [Created] (SPARK-12458) Add ExpressionDescription to datetime functions

Yin Huai created SPARK-12458: Summary: Add ExpressionDescription to datetime functions Key: SPARK-12458 URL: https://issues.apache.org/jira/browse/SPARK-12458 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12459) Add ExpressionDescription to string functions

Yin Huai created SPARK-12459: Summary: Add ExpressionDescription to string functions Key: SPARK-12459 URL: https://issues.apache.org/jira/browse/SPARK-12459 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-12429) Update documentation to show how to use accumulators and broadcasts with Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-12429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12429: Assignee: Apache Spark (was: Shixiong Zhu) > Update documentation to show how to use

[jira] [Created] (SPARK-12461) Add ExpressionDescription to math functions

Yin Huai created SPARK-12461: Summary: Add ExpressionDescription to math functions Key: SPARK-12461 URL: https://issues.apache.org/jira/browse/SPARK-12461 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12460) Add ExpressionDescription to aggregate functions

Yin Huai created SPARK-12460: Summary: Add ExpressionDescription to aggregate functions Key: SPARK-12460 URL: https://issues.apache.org/jira/browse/SPARK-12460 Project: Spark Issue Type:

[jira] [Created] (SPARK-12467) Get rid of sorting in Row's constructor in pyspark

Irakli Machabeli created SPARK-12467: Summary: Get rid of sorting in Row's constructor in pyspark Key: SPARK-12467 URL: https://issues.apache.org/jira/browse/SPARK-12467 Project: Spark

[jira] [Commented] (SPARK-12231) Failed to generate predicate Error when using dropna

[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067033#comment-15067033 ] Apache Spark commented on SPARK-12231: -- User 'kevinyu98' has created a pull request for this issue:

[jira] [Created] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

Zachary Brown created SPARK-12468: - Summary: getParamMap in Pyspark ML API returns empty dictionary in example for Documentation Key: SPARK-12468 URL: https://issues.apache.org/jira/browse/SPARK-12468

[jira] [Assigned] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12465: Assignee: Apache Spark > Remove spark.deploy.mesos.zookeeper.dir and use

[jira] [Assigned] (SPARK-12463) Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode

[ https://issues.apache.org/jira/browse/SPARK-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12463: Assignee: (was: Apache Spark) > Remove spark.deploy.mesos.recoveryMode and use

[jira] [Assigned] (SPARK-12463) Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode

[ https://issues.apache.org/jira/browse/SPARK-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12463: Assignee: Apache Spark > Remove spark.deploy.mesos.recoveryMode and use

[jira] [Assigned] (SPARK-12455) Add ExpressionDescription to window functions

[ https://issues.apache.org/jira/browse/SPARK-12455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12455: Assignee: Herman van Hovell (was: Apache Spark) > Add ExpressionDescription to window

[jira] [Created] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

Timothy Chen created SPARK-12465: Summary: Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir Key: SPARK-12465 URL: https://issues.apache.org/jira/browse/SPARK-12465 Project:

[jira] [Created] (SPARK-12464) Remove spark.deploy.mesos.zookeeper.url and use spark.deploy.zookeeper.url

Timothy Chen created SPARK-12464: Summary: Remove spark.deploy.mesos.zookeeper.url and use spark.deploy.zookeeper.url Key: SPARK-12464 URL: https://issues.apache.org/jira/browse/SPARK-12464 Project:

[jira] [Assigned] (SPARK-12331) R^2 for regression through the origin

[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12331: Assignee: Apache Spark > R^2 for regression through the origin >

[jira] [Assigned] (SPARK-12331) R^2 for regression through the origin

[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12331: Assignee: (was: Apache Spark) > R^2 for regression through the origin >

[jira] [Updated] (SPARK-12394) Support writing out pre-hash-partitioned data and exploit that in join optimizations to avoid shuffle (i.e. bucketing in Hive)

[ https://issues.apache.org/jira/browse/SPARK-12394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nong Li updated SPARK-12394: Attachment: BucketedTables.pdf Here is a design for how we can supported bucketed tables. > Support

[jira] [Commented] (SPARK-12279) Requesting a HBase table with kerberos is not working

[ https://issues.apache.org/jira/browse/SPARK-12279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067020#comment-15067020 ] Y Bodnar commented on SPARK-12279: -- Hi [~pbeauvois] It's weird there's no messages related to HBase

[jira] [Commented] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067021#comment-15067021 ] Benjamin Fradet commented on SPARK-12247: - Ok thanks, I'll rework the examples accordingly. >

[jira] [Commented] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067080#comment-15067080 ] Zachary Brown commented on SPARK-12468: --- Found a possible fix for this by modifying the `_fit()`

[jira] [Updated] (SPARK-12452) Add exception details to TaskCompletionListener/TaskContext

[ https://issues.apache.org/jira/browse/SPARK-12452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Shastry updated SPARK-12452: Component/s: (was: Streaming) Spark Core > Add exception details to

[jira] [Created] (SPARK-12463) Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode

Timothy Chen created SPARK-12463: Summary: Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode Key: SPARK-12463 URL: https://issues.apache.org/jira/browse/SPARK-12463 Project:

[jira] [Assigned] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12453: Assignee: Apache Spark > Spark Streaming Kinesis Example broken due to wrong AWS Java SDK

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066852#comment-15066852 ] Apache Spark commented on SPARK-12453: -- User 'Schadix' has created a pull request for this issue:

[jira] [Commented] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066854#comment-15066854 ] Timothy Hunter commented on SPARK-12247: If we could import all the code that builds the ratings

[jira] [Assigned] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12453: Assignee: (was: Apache Spark) > Spark Streaming Kinesis Example broken due to wrong

[jira] [Assigned] (SPARK-12466) Harmless Master NPE in tests

[ https://issues.apache.org/jira/browse/SPARK-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12466: Assignee: Apache Spark (was: Andrew Or) > Harmless Master NPE in tests >

[jira] [Assigned] (SPARK-12396) Once driver client registered successfully,it still retry to connected to master.

[ https://issues.apache.org/jira/browse/SPARK-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12396: Assignee: Apache Spark > Once driver client registered successfully,it still retry to

[jira] [Assigned] (SPARK-12396) Once driver client registered successfully,it still retry to connected to master.

[ https://issues.apache.org/jira/browse/SPARK-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12396: Assignee: (was: Apache Spark) > Once driver client registered successfully,it still

[jira] [Assigned] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12465: Assignee: Apache Spark > Remove spark.deploy.mesos.zookeeper.dir and use

[jira] [Commented] (SPARK-12463) Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode

[ https://issues.apache.org/jira/browse/SPARK-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067065#comment-15067065 ] Apache Spark commented on SPARK-12463: -- User 'tnachen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12465: Assignee: (was: Apache Spark) > Remove spark.deploy.mesos.zookeeper.dir and use

[jira] [Created] (SPARK-12456) Add ExpressionDescription to misc functions

Yin Huai created SPARK-12456: Summary: Add ExpressionDescription to misc functions Key: SPARK-12456 URL: https://issues.apache.org/jira/browse/SPARK-12456 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-12454) Add ExpressionDescription to expressions are registered in FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12454: - Description: ExpressionDescription is a annotation that contains doc of a function and when users use

[jira] [Commented] (SPARK-12331) R^2 for regression through the origin

[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066898#comment-15066898 ] Apache Spark commented on SPARK-12331: -- User 'iyounus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12466) Harmless Master NPE in tests

[ https://issues.apache.org/jira/browse/SPARK-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12466: Assignee: Andrew Or (was: Apache Spark) > Harmless Master NPE in tests >

[jira] [Updated] (SPARK-12321) JSON format for logical/physical execution plans

[ https://issues.apache.org/jira/browse/SPARK-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12321: - Assignee: Wenchen Fan > JSON format for logical/physical execution plans >

[jira] [Assigned] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12465: Assignee: (was: Apache Spark) > Remove spark.deploy.mesos.zookeeper.dir and use

[jira] [Created] (SPARK-12469) Consistent Accumulators for Spark

holdenk created SPARK-12469: --- Summary: Consistent Accumulators for Spark Key: SPARK-12469 URL: https://issues.apache.org/jira/browse/SPARK-12469 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12451) Regexp functions don't support patterns containing '*/'

[ https://issues.apache.org/jira/browse/SPARK-12451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066840#comment-15066840 ] Xiao Li commented on SPARK-12451: - This is a duplicate of

[jira] [Assigned] (SPARK-12455) Add ExpressionDescription to window functions

[ https://issues.apache.org/jira/browse/SPARK-12455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12455: Assignee: Herman van Hovell (was: Apache Spark) > Add ExpressionDescription to window

[jira] [Created] (SPARK-12466) Harmless Master NPE in tests

Andrew Or created SPARK-12466: - Summary: Harmless Master NPE in tests Key: SPARK-12466 URL: https://issues.apache.org/jira/browse/SPARK-12466 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-12457) Add ExpressionDescription to collection functions

[ https://issues.apache.org/jira/browse/SPARK-12457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067022#comment-15067022 ] Apache Spark commented on SPARK-12457: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12247: Assignee: (was: Apache Spark) > Documentation for spark.ml's ALS and collaborative

[jira] [Assigned] (SPARK-12247) Documentation for spark.ml's ALS and collaborative filtering in general

[ https://issues.apache.org/jira/browse/SPARK-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12247: Assignee: Apache Spark > Documentation for spark.ml's ALS and collaborative filtering in

[jira] [Assigned] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12468: Assignee: Apache Spark > getParamMap in Pyspark ML API returns empty dictionary in

[jira] [Resolved] (SPARK-5882) Add a test for GraphLoader.edgeListFile

[ https://issues.apache.org/jira/browse/SPARK-5882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-5882. -- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Robbins updated SPARK-12470: - Component/s: SQL Summary: Incorrect calculation of row size in

[jira] [Commented] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067314#comment-15067314 ] Josh Rosen commented on SPARK-11823: It looks like this has caused a huge number of timeouts in the

[jira] [Updated] (SPARK-12414) Remove closure serializer

[ https://issues.apache.org/jira/browse/SPARK-12414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12414: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-11806 > Remove closure serializer >

[jira] [Resolved] (SPARK-12374) Improve performance of Range APIs via adding logical/physical operators

[ https://issues.apache.org/jira/browse/SPARK-12374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12374. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10335

[jira] [Resolved] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

[ https://issues.apache.org/jira/browse/SPARK-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12150. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10335

[jira] [Assigned] (SPARK-12363) PowerIterationClustering test case failed if we deprecated KMeans.setRuns

[ https://issues.apache.org/jira/browse/SPARK-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12363: Assignee: Apache Spark > PowerIterationClustering test case failed if we deprecated

[jira] [Commented] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067345#comment-15067345 ] Josh Rosen commented on SPARK-11823: I think I spotted the problem; it may be a bad use of

[jira] [Updated] (SPARK-12473) Reuse serializer instances for performance

[ https://issues.apache.org/jira/browse/SPARK-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12473: -- Description: After commit de02782 of page rank regressed from 242s to 260s, about 7%. Although

[jira] [Updated] (SPARK-12440) Avoid setCheckpointDir warning when filesystem is not local

[ https://issues.apache.org/jira/browse/SPARK-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12440: -- Priority: Trivial (was: Major) > Avoid setCheckpointDir warning when filesystem is not local >

[jira] [Updated] (SPARK-12440) Avoid setCheckpointDir warning when filesystem is not local

[ https://issues.apache.org/jira/browse/SPARK-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12440: -- Summary: Avoid setCheckpointDir warning when filesystem is not local (was: [CORE] Avoid

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067125#comment-15067125 ] Martin Schade commented on SPARK-12453: --- Make sense, thank you. Ideally it should be 1.9.37 instead

[jira] [Updated] (SPARK-12440) [CORE] Avoid setCheckpointDir warning when filesystem is not local

[ https://issues.apache.org/jira/browse/SPARK-12440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12440: -- Component/s: Spark Core > [CORE] Avoid setCheckpointDir warning when filesystem is not local >

[jira] [Commented] (SPARK-12339) NullPointerException on stage kill from web UI

[ https://issues.apache.org/jira/browse/SPARK-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067154#comment-15067154 ] Andrew Or commented on SPARK-12339: --- I've updated the affected version to 2.0 since SPARK-11206 was

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067156#comment-15067156 ] Sean Owen commented on SPARK-12453: --- Ah, I misread the PR and it already just removes

[jira] [Updated] (SPARK-12339) NullPointerException on stage kill from web UI

[ https://issues.apache.org/jira/browse/SPARK-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12339: -- Affects Version/s: (was: 1.6.0) 2.0.0 > NullPointerException on stage kill

[jira] [Resolved] (SPARK-12392) Optimize a location order of broadcast blocks by considering preferred local hosts

[ https://issues.apache.org/jira/browse/SPARK-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12392. --- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.0.0 Target

[jira] [Assigned] (SPARK-12456) Add ExpressionDescription to misc functions

[ https://issues.apache.org/jira/browse/SPARK-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12456: Assignee: Apache Spark > Add ExpressionDescription to misc functions >

[jira] [Assigned] (SPARK-12456) Add ExpressionDescription to misc functions

[ https://issues.apache.org/jira/browse/SPARK-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12456: Assignee: (was: Apache Spark) > Add ExpressionDescription to misc functions >

[jira] [Updated] (SPARK-12473) Reuse serializer instances for performance

[ https://issues.apache.org/jira/browse/SPARK-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12473: -- Description: After commit de02782 of page rank regressed from 242s to 260s, about 7%. Although

[jira] [Assigned] (SPARK-12471) Spark daemons should log their pid in the log file

[ https://issues.apache.org/jira/browse/SPARK-12471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12471: Assignee: (was: Apache Spark) > Spark daemons should log their pid in the log file >

[jira] [Assigned] (SPARK-12471) Spark daemons should log their pid in the log file

[ https://issues.apache.org/jira/browse/SPARK-12471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12471: Assignee: Apache Spark > Spark daemons should log their pid in the log file >

[jira] [Commented] (SPARK-12458) Add ExpressionDescription to datetime functions

[ https://issues.apache.org/jira/browse/SPARK-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067278#comment-15067278 ] Dilip Biswal commented on SPARK-12458: -- I would like to work on this one. > Add

[jira] [Commented] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version

[ https://issues.apache.org/jira/browse/SPARK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067115#comment-15067115 ] Sean Owen commented on SPARK-12453: --- OK, I see what happened here:

[jira] [Updated] (SPARK-12463) Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode

[ https://issues.apache.org/jira/browse/SPARK-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12463: -- Component/s: Mesos > Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode >

  1   2   >