[jira] [Issue Comment Deleted] (SPARK-6724) Model import/export for FPGrowth

[ https://issues.apache.org/jira/browse/SPARK-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hujiayin updated SPARK-6724: Comment: was deleted (was: ok, : )) > Model import/export for FPGrowth >

[jira] [Resolved] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap backed UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10351. - Resolution: Fixed Assignee: Feynman Liang Fix Version/s: 1.6.0 >

[jira] [Commented] (SPARK-10259) Add @Since annotation to ml.classification

[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723027#comment-14723027 ] Hiroshi Takahashi commented on SPARK-10259: --- Becasue this is a 'starter' issue and I'm new, I'd

[jira] [Commented] (SPARK-10354) First cost RDD shouldn't be cached in k-means|| and the following cost RDD should use MEMORY_AND_DISK

[ https://issues.apache.org/jira/browse/SPARK-10354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723031#comment-14723031 ] Apache Spark commented on SPARK-10354: -- User 'mengxr' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10354) First cost RDD shouldn't be cached in k-means|| and the following cost RDD should use MEMORY_AND_DISK

[ https://issues.apache.org/jira/browse/SPARK-10354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10354: Assignee: Xiangrui Meng (was: Apache Spark) > First cost RDD shouldn't be cached in

[jira] [Assigned] (SPARK-10354) First cost RDD shouldn't be cached in k-means|| and the following cost RDD should use MEMORY_AND_DISK

[ https://issues.apache.org/jira/browse/SPARK-10354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10354: Assignee: Apache Spark (was: Xiangrui Meng) > First cost RDD shouldn't be cached in

[jira] [Resolved] (SPARK-10354) First cost RDD shouldn't be cached in k-means|| and the following cost RDD should use MEMORY_AND_DISK

[ https://issues.apache.org/jira/browse/SPARK-10354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10354. --- Resolution: Fixed Fix Version/s: 1.5.1 1.4.2

[jira] [Created] (SPARK-10360) Real time analytics using SparkR and Apache Kafka

Niharika created SPARK-10360: Summary: Real time analytics using SparkR and Apache Kafka Key: SPARK-10360 URL: https://issues.apache.org/jira/browse/SPARK-10360 Project: Spark Issue Type:

[jira] [Created] (SPARK-10361) model.predictAll() fails at user_product.first()

Velu nambi created SPARK-10361: -- Summary: model.predictAll() fails at user_product.first() Key: SPARK-10361 URL: https://issues.apache.org/jira/browse/SPARK-10361 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-10149) Locality Level is ANY on "Details for Stage" WebUI page

[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10149: Assignee: (was: Apache Spark) > Locality Level is ANY on "Details for Stage" WebUI

[jira] [Assigned] (SPARK-10149) Locality Level is ANY on "Details for Stage" WebUI page

[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10149: Assignee: Apache Spark > Locality Level is ANY on "Details for Stage" WebUI page >

[jira] [Commented] (SPARK-10149) Locality Level is ANY on "Details for Stage" WebUI page

[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723073#comment-14723073 ] Apache Spark commented on SPARK-10149: -- User 'wulei-bj-cn' has created a pull request for this

[jira] [Closed] (SPARK-6839) BlockManager.dataDeserialize leaks resources on user exceptions

[ https://issues.apache.org/jira/browse/SPARK-6839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid closed SPARK-6839. --- Resolution: Won't Fix > BlockManager.dataDeserialize leaks resources on user exceptions >

[jira] [Commented] (SPARK-8426) Add blacklist mechanism for YARN container allocation

[ https://issues.apache.org/jira/browse/SPARK-8426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724616#comment-14724616 ] Mao, Wei commented on SPARK-8426: - post the design doc under related JIRA (both 8425 and 8426)

[jira] [Comment Edited] (SPARK-8426) Add blacklist mechanism for YARN container allocation

[ https://issues.apache.org/jira/browse/SPARK-8426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724616#comment-14724616 ] Mao, Wei edited comment on SPARK-8426 at 9/1/15 2:29 AM: - post the design doc

[jira] [Commented] (SPARK-10377) Cassandra connector affected by backport change

[ https://issues.apache.org/jira/browse/SPARK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724612#comment-14724612 ] Yin Huai commented on SPARK-10377: -- [~frodeso] Is

[jira] [Commented] (SPARK-10377) Cassandra connector affected by backport change

[ https://issues.apache.org/jira/browse/SPARK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724620#comment-14724620 ] Apache Spark commented on SPARK-10377: -- User 'yhuai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10377) Cassandra connector affected by backport change

[ https://issues.apache.org/jira/browse/SPARK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10377: Assignee: Yin Huai (was: Apache Spark) > Cassandra connector affected by backport change

[jira] [Assigned] (SPARK-10377) Cassandra connector affected by backport change

[ https://issues.apache.org/jira/browse/SPARK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10377: Assignee: Apache Spark (was: Yin Huai) > Cassandra connector affected by backport change

[jira] [Commented] (SPARK-10329) Cost RDD in k-means|| initialization is not storage-efficient

[ https://issues.apache.org/jira/browse/SPARK-10329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724701#comment-14724701 ] Apache Spark commented on SPARK-10329: -- User 'HuJiayin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10329) Cost RDD in k-means|| initialization is not storage-efficient

[ https://issues.apache.org/jira/browse/SPARK-10329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10329: Assignee: hujiayin (was: Apache Spark) > Cost RDD in k-means|| initialization is not

[jira] [Assigned] (SPARK-10329) Cost RDD in k-means|| initialization is not storage-efficient

[ https://issues.apache.org/jira/browse/SPARK-10329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10329: Assignee: Apache Spark (was: hujiayin) > Cost RDD in k-means|| initialization is not

[jira] [Updated] (SPARK-10368) "Could not parse Master URL" leaves spark-shell unusable

[ https://issues.apache.org/jira/browse/SPARK-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10368: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) I'm not sure it's a bug; the

[jira] [Created] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

Shixiong Zhu created SPARK-10369: Summary: Fix a bug that Receiver could not be started after deregistering Key: SPARK-10369 URL: https://issues.apache.org/jira/browse/SPARK-10369 Project: Spark

[jira] [Created] (SPARK-10370) After a stages map outputs are registered, all running attempts should be marked as zombies

Imran Rashid created SPARK-10370: Summary: After a stages map outputs are registered, all running attempts should be marked as zombies Key: SPARK-10370 URL: https://issues.apache.org/jira/browse/SPARK-10370

[jira] [Assigned] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10369: Assignee: (was: Apache Spark) > Fix a bug that Receiver could not be started after

[jira] [Assigned] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10369: Assignee: Apache Spark > Fix a bug that Receiver could not be started after deregistering

[jira] [Commented] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723537#comment-14723537 ] Apache Spark commented on SPARK-10369: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-9642) LinearRegression should supported weighted data

[ https://issues.apache.org/jira/browse/SPARK-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723562#comment-14723562 ] Seth Hendrickson commented on SPARK-9642: - NP, thanks for responding! > LinearRegression should

[jira] [Created] (SPARK-10371) Optimize sequential projections

Xiangrui Meng created SPARK-10371: - Summary: Optimize sequential projections Key: SPARK-10371 URL: https://issues.apache.org/jira/browse/SPARK-10371 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-10371) Optimize sequential projections

[ https://issues.apache.org/jira/browse/SPARK-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723585#comment-14723585 ] Xiangrui Meng commented on SPARK-10371: --- ping [~yhuai] > Optimize sequential projections >

[jira] [Created] (SPARK-10372) Tests for entire scheduler

Imran Rashid created SPARK-10372: Summary: Tests for entire scheduler Key: SPARK-10372 URL: https://issues.apache.org/jira/browse/SPARK-10372 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-10361) model.predictAll() fails at user_product.first()

[ https://issues.apache.org/jira/browse/SPARK-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723621#comment-14723621 ] Velu nambi commented on SPARK-10361: Thanks [~srowen]. Is this a known issue, any suggestions ? >

[jira] [Commented] (SPARK-10360) Real time analytics using SparkR and Apache Kafka

[ https://issues.apache.org/jira/browse/SPARK-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723625#comment-14723625 ] Shivaram Venkataraman commented on SPARK-10360: --- There is no way to do this right now as

[jira] [Commented] (SPARK-10360) Real time analytics using SparkR and Apache Kafka

[ https://issues.apache.org/jira/browse/SPARK-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723652#comment-14723652 ] Niharika commented on SPARK-10360: -- Thank you Shivaram for the reply, it is indeed helpful. I will close

[jira] [Closed] (SPARK-10360) Real time analytics using SparkR and Apache Kafka

[ https://issues.apache.org/jira/browse/SPARK-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niharika closed SPARK-10360. Resolution: Fixed > Real time analytics using SparkR and Apache Kafka >

[jira] [Commented] (SPARK-7454) Perf test for power iteration clustering (PIC)

[ https://issues.apache.org/jira/browse/SPARK-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723666#comment-14723666 ] Feynman Liang commented on SPARK-7454: -- [~mengxr] [~josephkb] can we close this since PR 86 was

[jira] [Commented] (SPARK-10361) model.predictAll() fails at user_product.first()

[ https://issues.apache.org/jira/browse/SPARK-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723668#comment-14723668 ] Sean Owen commented on SPARK-10361: --- The tests are passing and I haven't heard anything like this. It

[jira] [Updated] (SPARK-10264) Add @Since annotation to ml.recoomendation

[ https://issues.apache.org/jira/browse/SPARK-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10264: -- Assignee: Tijo Thomas > Add @Since annotation to ml.recoomendation >

[jira] [Updated] (SPARK-10264) Add @Since annotation to ml.recoomendation

[ https://issues.apache.org/jira/browse/SPARK-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10264: -- Target Version/s: 1.6.0 > Add @Since annotation to ml.recoomendation >

[jira] [Created] (SPARK-10373) Move @since annotator to pyspark to be shared by all components

Xiangrui Meng created SPARK-10373: - Summary: Move @since annotator to pyspark to be shared by all components Key: SPARK-10373 URL: https://issues.apache.org/jira/browse/SPARK-10373 Project: Spark

[jira] [Updated] (SPARK-10258) Add @Since annotation to ml.feature

[ https://issues.apache.org/jira/browse/SPARK-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10258: -- Assignee: Martin Brown > Add @Since annotation to ml.feature >

[jira] [Updated] (SPARK-10259) Add @Since annotation to ml.classification

[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10259: -- Assignee: Hiroshi Takahashi > Add @Since annotation to ml.classification >

[jira] [Updated] (SPARK-10259) Add @Since annotation to ml.classification

[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10259: -- Target Version/s: 1.6.0 > Add @Since annotation to ml.classification >

[jira] [Commented] (SPARK-10358) Spark-sql throws IOException on exit when using HDFS to store event log.

[ https://issues.apache.org/jira/browse/SPARK-10358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723705#comment-14723705 ] Marcelo Vanzin commented on SPARK-10358: This is fixed in 1.4 and later, I doubt we'll accept

[jira] [Commented] (SPARK-10358) Spark-sql throws IOException on exit when using HDFS to store event log.

[ https://issues.apache.org/jira/browse/SPARK-10358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723757#comment-14723757 ] Marcelo Vanzin commented on SPARK-10358: Original issue: SPARK-6014 > Spark-sql throws

[jira] [Created] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

Matt Cheah created SPARK-10374: -- Summary: Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4 Key: SPARK-10374 URL: https://issues.apache.org/jira/browse/SPARK-10374

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723768#comment-14723768 ] Matt Cheah commented on SPARK-10374: I intend to create a smaller standalone program that reproduces

[jira] [Updated] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10374: -- Priority: Major (was: Blocker) Fix Version/s: (was: 1.5.0) ([~mcheah] don't set Fix

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723792#comment-14723792 ] Patrick Wendell commented on SPARK-10374: - Hey Matt, I think the only thing that could have

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723797#comment-14723797 ] Marcelo Vanzin commented on SPARK-10374: This is actually caused by the akka version change. In

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723802#comment-14723802 ] Marcelo Vanzin commented on SPARK-10374: BTW since akka depends on protobuf, one cannot simply

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723817#comment-14723817 ] Marcelo Vanzin commented on SPARK-10374: nevermind, Patrick pointed out that the hadoop-1

[jira] [Resolved] (SPARK-8730) Deser primitive class with Java serialization

[ https://issues.apache.org/jira/browse/SPARK-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-8730. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 7122

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723826#comment-14723826 ] Matt Cheah commented on SPARK-10374: I'll try switching the Akka version pulled in by Spark and see

[jira] [Commented] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723844#comment-14723844 ] Patrick Wendell commented on SPARK-10359: - The approach in SPARK-4123 was a bit different, but

[jira] [Resolved] (SPARK-4123) Show dependency changes in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4123. Resolution: Duplicate I've proposed a slightly different approach in SPARK-10359, so I'm

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is valid

[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723851#comment-14723851 ] Zhan Zhang commented on SPARK-10304: [~yhuai] I tried to reproduce the problem with the same

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is valid

[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723858#comment-14723858 ] Yin Huai commented on SPARK-10304: -- The dir struct I have is something like the following. {code}

[jira] [Created] (SPARK-10375) Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work

Thomas created SPARK-10375: -- Summary: Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work Key: SPARK-10375 URL: https://issues.apache.org/jira/browse/SPARK-10375

[jira] [Created] (SPARK-10376) Once/When YARN permits it, only use POST for kill action

Steve Loughran created SPARK-10376: -- Summary: Once/When YARN permits it, only use POST for kill action Key: SPARK-10376 URL: https://issues.apache.org/jira/browse/SPARK-10376 Project: Spark

[jira] [Updated] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-10369: -- Fix Version/s: 1.5.0 > Fix a bug that Receiver could not be started after deregistering >

[jira] [Resolved] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-10369. --- Resolution: Fixed Assignee: Shixiong Zhu > Fix a bug that Receiver could not be

[jira] [Resolved] (SPARK-10375) Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work

[ https://issues.apache.org/jira/browse/SPARK-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10375. Resolution: Not A Problem You can't set the driver memory after the driver has already

[jira] [Comment Edited] (SPARK-10375) Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work

[ https://issues.apache.org/jira/browse/SPARK-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723902#comment-14723902 ] Marcelo Vanzin edited comment on SPARK-10375 at 8/31/15 7:27 PM: - You

[jira] [Updated] (SPARK-10370) After a stages map outputs are registered, all running attempts should be marked as zombies

[ https://issues.apache.org/jira/browse/SPARK-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-10370: - Assignee: (was: Imran Rashid) > After a stages map outputs are registered, all running

[jira] [Updated] (SPARK-10372) Tests for entire scheduler

[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-10372: - Fix Version/s: 1.6.0 > Tests for entire scheduler > -- > >

[jira] [Resolved] (SPARK-10170) Add DB2 JDBC dialect support

[ https://issues.apache.org/jira/browse/SPARK-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10170. - Resolution: Fixed Assignee: Suresh Thalamati Fix Version/s: 1.6.0 > Add DB2 JDBC

[jira] [Updated] (SPARK-10170) Add DB2 JDBC dialect support

[ https://issues.apache.org/jira/browse/SPARK-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10170: Summary: Add DB2 JDBC dialect support (was: Writing from data frame into db2 database using jdbc

[jira] [Created] (SPARK-10377) Backported refactor cause

Frode Sormo created SPARK-10377: --- Summary: Backported refactor cause Key: SPARK-10377 URL: https://issues.apache.org/jira/browse/SPARK-10377 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10377) Cassandra connector affected by backport change

[ https://issues.apache.org/jira/browse/SPARK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frode Sormo updated SPARK-10377: Summary: Cassandra connector affected by backport change (was: Backported refactor cause) >

[jira] [Commented] (SPARK-6961) Cannot save data to parquet files when executing from Windows from a Maven Project

[ https://issues.apache.org/jira/browse/SPARK-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723933#comment-14723933 ] matt hoffman commented on SPARK-6961: - How is that an installation-side issue? There is no requirement

[jira] [Assigned] (SPARK-10291) Add statsByKey method to compute StatCounters for each key in an RDD

[ https://issues.apache.org/jira/browse/SPARK-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10291: Assignee: (was: Apache Spark) > Add statsByKey method to compute StatCounters for

[jira] [Commented] (SPARK-10291) Add statsByKey method to compute StatCounters for each key in an RDD

[ https://issues.apache.org/jira/browse/SPARK-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723944#comment-14723944 ] Apache Spark commented on SPARK-10291: -- User 'eshilts' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10291) Add statsByKey method to compute StatCounters for each key in an RDD

[ https://issues.apache.org/jira/browse/SPARK-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10291: Assignee: Apache Spark > Add statsByKey method to compute StatCounters for each key in an

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is valid

[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14723994#comment-14723994 ] Zhan Zhang commented on SPARK-10304: [~yhuai] I think the NPE is caused by the directory has multiple

[jira] [Commented] (SPARK-10373) Move @since annotator to pyspark to be shared by all components

[ https://issues.apache.org/jira/browse/SPARK-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724009#comment-14724009 ] Davies Liu commented on SPARK-10373: [~mengxr] Do we want to add @since for the MLLib APIs in 1.5

[jira] [Commented] (SPARK-10320) Support new topic subscriptions without requiring restart of the streaming context

[ https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724038#comment-14724038 ] Sudarshan Kadambi commented on SPARK-10320: --- Good questions Cody. When adding a topic after

[jira] [Assigned] (SPARK-9957) Spark ML trees should filter out 1-category features

[ https://issues.apache.org/jira/browse/SPARK-9957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9957: --- Assignee: Apache Spark > Spark ML trees should filter out 1-category features >

[jira] [Assigned] (SPARK-9957) Spark ML trees should filter out 1-category features

[ https://issues.apache.org/jira/browse/SPARK-9957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9957: --- Assignee: (was: Apache Spark) > Spark ML trees should filter out 1-category features >

[jira] [Commented] (SPARK-9957) Spark ML trees should filter out 1-category features

[ https://issues.apache.org/jira/browse/SPARK-9957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724067#comment-14724067 ] Apache Spark commented on SPARK-9957: - User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-10320) Support new topic subscriptions without requiring restart of the streaming context

[ https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724074#comment-14724074 ] Cody Koeninger commented on SPARK-10320: " If you restart the job and specify a new offset, that

[jira] [Updated] (SPARK-10320) Kafka Support new topic subscriptions without requiring restart of the streaming context

[ https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cody Koeninger updated SPARK-10320: --- Summary: Kafka Support new topic subscriptions without requiring restart of the streaming

[jira] [Assigned] (SPARK-9962) Decision Tree training: prevNodeIdsForInstances.unpersist() at end of training

[ https://issues.apache.org/jira/browse/SPARK-9962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9962: --- Assignee: Apache Spark > Decision Tree training: prevNodeIdsForInstances.unpersist() at end

[jira] [Assigned] (SPARK-9962) Decision Tree training: prevNodeIdsForInstances.unpersist() at end of training

[ https://issues.apache.org/jira/browse/SPARK-9962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9962: --- Assignee: (was: Apache Spark) > Decision Tree training:

[jira] [Commented] (SPARK-9962) Decision Tree training: prevNodeIdsForInstances.unpersist() at end of training

[ https://issues.apache.org/jira/browse/SPARK-9962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724096#comment-14724096 ] Apache Spark commented on SPARK-9962: - User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-10320) Kafka Support new topic subscriptions without requiring restart of the streaming context

[ https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724113#comment-14724113 ] Cody Koeninger commented on SPARK-10320: It's possible this might be solvable with a

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is valid

[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724122#comment-14724122 ] Zhan Zhang commented on SPARK-10304: [~lian cheng] forget about my question. From the code, it is not

[jira] [Commented] (SPARK-10199) Avoid using reflections for parquet model save

[ https://issues.apache.org/jira/browse/SPARK-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724138#comment-14724138 ] Feynman Liang commented on SPARK-10199: --- CC [~mengxr] [~josephkb] > Avoid using reflections for

[jira] [Created] (SPARK-10378) Remove HashJoinCompatibilitySuite

Reynold Xin created SPARK-10378: --- Summary: Remove HashJoinCompatibilitySuite Key: SPARK-10378 URL: https://issues.apache.org/jira/browse/SPARK-10378 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-10378) Remove HashJoinCompatibilitySuite

[ https://issues.apache.org/jira/browse/SPARK-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10378: Assignee: Apache Spark (was: Reynold Xin) > Remove HashJoinCompatibilitySuite >

[jira] [Assigned] (SPARK-10378) Remove HashJoinCompatibilitySuite

[ https://issues.apache.org/jira/browse/SPARK-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10378: Assignee: Reynold Xin (was: Apache Spark) > Remove HashJoinCompatibilitySuite >

[jira] [Commented] (SPARK-10378) Remove HashJoinCompatibilitySuite

[ https://issues.apache.org/jira/browse/SPARK-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724159#comment-14724159 ] Apache Spark commented on SPARK-10378: -- User 'rxin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-9954) Vector.hashCode should use nonzeros

[ https://issues.apache.org/jira/browse/SPARK-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9954. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8182

[jira] [Updated] (SPARK-10378) Remove HashJoinCompatibilitySuite

[ https://issues.apache.org/jira/browse/SPARK-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10378: Description: They don't bring much value since we now have better unit test coverage for hash

[jira] [Updated] (SPARK-8472) Python API for DCT

[ https://issues.apache.org/jira/browse/SPARK-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8472: - Assignee: Yanbo Liang > Python API for DCT > -- > > Key:

[jira] [Resolved] (SPARK-8472) Python API for DCT

[ https://issues.apache.org/jira/browse/SPARK-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8472. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8485

[jira] [Assigned] (SPARK-3976) Detect block matrix partitioning schemes

[ https://issues.apache.org/jira/browse/SPARK-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3976: --- Assignee: (was: Apache Spark) > Detect block matrix partitioning schemes >

[jira] [Resolved] (SPARK-10341) SMJ fail with unable to acquire memory

[ https://issues.apache.org/jira/browse/SPARK-10341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10341. - Resolution: Fixed Fix Version/s: 1.5.0 > SMJ fail with unable to acquire memory >

[jira] [Assigned] (SPARK-3976) Detect block matrix partitioning schemes

[ https://issues.apache.org/jira/browse/SPARK-3976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3976: --- Assignee: Apache Spark > Detect block matrix partitioning schemes >

  1   2   >