[jira] [Updated] (SPARK-8486) SIFT Feature Transformer

2015-06-19 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-8486: - Priority: Minor (was: Major) SIFT Feature Transformer

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594281#comment-14594281 ] Yu Ishikawa commented on SPARK-6813: That's sounds good! I created an issue to add a

[jira] [Commented] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594186#comment-14594186 ] Tathagata Das commented on SPARK-8389: -- Yeah, that is harder to do. Let at least get

[jira] [Commented] (SPARK-4849) Pass partitioning information (distribute by) to In-memory caching

2015-06-19 Thread Eric Pederson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594193#comment-14594193 ] Eric Pederson commented on SPARK-4849: -- Does this also apply to in-memory tables

[jira] [Commented] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-19 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594196#comment-14594196 ] Cody Koeninger commented on SPARK-8389: --- Have you guys been looking at SPARK-8337 ,

[jira] [Commented] (SPARK-8420) Inconsistent behavior with Dataframe Timestamp between 1.3.1 and 1.4.0

2015-06-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594214#comment-14594214 ] Yin Huai commented on SPARK-8420: - Master has been fixed by

[jira] [Updated] (SPARK-8420) Inconsistent behavior with Dataframe Timestamp between 1.3.1 and 1.4.0

2015-06-19 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8420: Fix Version/s: 1.5.0 Inconsistent behavior with Dataframe Timestamp between 1.3.1 and 1.4.0

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594263#comment-14594263 ] Shivaram Venkataraman commented on SPARK-6813: -- The list looks good to me.

[jira] [Updated] (SPARK-8399) Overlap between histograms and axis' name in Spark Streaming UI

2015-06-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8399: - Target Version/s: 1.4.1, 1.5.0 Overlap between histograms and axis' name in Spark Streaming UI

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594250#comment-14594250 ] Yu Ishikawa commented on SPARK-6813: Sounds great! h3. TODO Please let me know if

[jira] [Updated] (SPARK-8488) HOG Feature Transformer

2015-06-19 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-8488: - Priority: Minor (was: Major) HOG Feature Transformer ---

[jira] [Updated] (SPARK-8491) DAISY Feature Transformer

2015-06-19 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-8491: - Priority: Minor (was: Major) DAISY Feature Transformer -

[jira] [Updated] (SPARK-8127) KafkaRDD optimize count() take() isEmpty()

2015-06-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8127: - Fix Version/s: 1.5.0 KafkaRDD optimize count() take() isEmpty()

[jira] [Created] (SPARK-8496) Do not run slow tests for every PR

2015-06-19 Thread Andrew Or (JIRA)
Andrew Or created SPARK-8496: Summary: Do not run slow tests for every PR Key: SPARK-8496 URL: https://issues.apache.org/jira/browse/SPARK-8496 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

2015-06-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7292: --- Assignee: Andrew Or Provide operator to truncate lineage without persisting RDD's

[jira] [Updated] (SPARK-8127) KafkaRDD optimize count() take() isEmpty()

2015-06-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8127: - Target Version/s: 1.5.0 KafkaRDD optimize count() take() isEmpty()

[jira] [Updated] (SPARK-8127) KafkaRDD optimize count() take() isEmpty()

2015-06-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8127: - Assignee: Cody Koeninger KafkaRDD optimize count() take() isEmpty()

[jira] [Updated] (SPARK-8483) Remove commons-lang3 depedency from flume-sink

2015-06-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8483: - Target Version/s: 1.5.0 (was: 1.4.1) Remove commons-lang3 depedency from flume-sink

[jira] [Updated] (SPARK-8483) Remove commons-lang3 depedency from flume-sink

2015-06-19 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8483: - Assignee: Hari Shreedharan Remove commons-lang3 depedency from flume-sink

[jira] [Commented] (SPARK-8477) Add in operator to DataFrame Column in Python

2015-06-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594305#comment-14594305 ] Reynold Xin commented on SPARK-8477: I'm glad we are at least consistent w.r.t. naming

[jira] [Assigned] (SPARK-8496) Do not run slow tests for every PR

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8496: --- Assignee: Apache Spark (was: Andrew Or) Do not run slow tests for every PR

[jira] [Commented] (SPARK-8496) Do not run slow tests for every PR

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594399#comment-14594399 ] Apache Spark commented on SPARK-8496: - User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-8496) Do not run slow tests for every PR

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8496: --- Assignee: Andrew Or (was: Apache Spark) Do not run slow tests for every PR

[jira] [Commented] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594415#comment-14594415 ] Yu Ishikawa commented on SPARK-7105: Please assign this issue to me. Support model

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594419#comment-14594419 ] Yu Ishikawa commented on SPARK-6813: JUST INFORMATION: I have asked a question about

[jira] [Resolved] (SPARK-8348) Add in operator to DataFrame Column

2015-06-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8348. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Yu Ishikawa Add in operator to

[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column

2015-06-19 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593086#comment-14593086 ] Reynold Xin commented on SPARK-8348: [~yuu.ishik...@gmail.com] can you also add the

[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column

2015-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593109#comment-14593109 ] Yu Ishikawa commented on SPARK-8348: will do Add in operator to DataFrame Column

[jira] [Resolved] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8339. --- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-8444) Add Python example in streaming for queueStream usage

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8444: - Assignee: Bryan Cutler Add Python example in streaming for queueStream usage

[jira] [Created] (SPARK-8477) Add in operator to DataFrame Column in Python

2015-06-19 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-8477: -- Summary: Add in operator to DataFrame Column in Python Key: SPARK-8477 URL: https://issues.apache.org/jira/browse/SPARK-8477 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-8469) Application timeline view unreadable with many executors

2015-06-19 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593128#comment-14593128 ] Kousuke Saruta commented on SPARK-8469: --- Thank you for reporting this issue,

[jira] [Updated] (SPARK-8053) ElementwiseProduct scalingVec param name should match between ml,mllib

2015-06-19 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8053: - Fix Version/s: (was: 1.4.1) (was: 1.5.0) 1.4.0

[jira] [Updated] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-19 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8368: Shepherd: Andrew Or ClassNotFoundException in closure for map

[jira] [Resolved] (SPARK-8444) Add Python example in streaming for queueStream usage

2015-06-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8444. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6884

[jira] [Assigned] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8461: --- Assignee: (was: Apache Spark) ClassNotFoundException when code generation is enabled

[jira] [Assigned] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8461: --- Assignee: Apache Spark ClassNotFoundException when code generation is enabled

[jira] [Commented] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593124#comment-14593124 ] Apache Spark commented on SPARK-8461: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-6813) SparkR style guide

2015-06-19 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593090#comment-14593090 ] Yu Ishikawa commented on SPARK-6813: [~shivaram] sounds interesting! I created a

[jira] [Assigned] (SPARK-8461) ClassNotFoundException when code generation is enabled

2015-06-19 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-8461: - Assignee: Davies Liu ClassNotFoundException when code generation is enabled

[jira] [Assigned] (SPARK-3188) Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3188: --- Assignee: Fan Jiang (was: Apache Spark) Add Robust Regression Algorithm with Tukey

[jira] [Created] (SPARK-8479) Add numNonzeros and numActives to linalg.Matrices

2015-06-19 Thread Manoj Kumar (JIRA)
Manoj Kumar created SPARK-8479: -- Summary: Add numNonzeros and numActives to linalg.Matrices Key: SPARK-8479 URL: https://issues.apache.org/jira/browse/SPARK-8479 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-4950) Delete obsolete mapReduceTripelets used in Pregel

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4950. -- Resolution: Won't Fix Delete obsolete mapReduceTripelets used in Pregel

[jira] [Resolved] (SPARK-8388) The script docs/_plugins/copy_api_dirs.rb should be run anywhere

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8388. -- Resolution: Won't Fix The script docs/_plugins/copy_api_dirs.rb should be run anywhere

[jira] [Commented] (SPARK-8474) [STREAMING] Kafka DirectStream API stops receiving messages if collective size of the messages specified in spark.streaming.kafka.maxRatePerPartition exceeds the defaul

2015-06-19 Thread Dibyendu Bhattacharya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593171#comment-14593171 ] Dibyendu Bhattacharya commented on SPARK-8474: --

[jira] [Commented] (SPARK-5754) Spark AM not launching on Windows

2015-06-19 Thread Changming Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593230#comment-14593230 ] Changming Sun commented on SPARK-5754: -- Still exist in spark 1.4. Spark AM not

[jira] [Created] (SPARK-8480) Add setName for Dataframe

2015-06-19 Thread Peter Rudenko (JIRA)
Peter Rudenko created SPARK-8480: Summary: Add setName for Dataframe Key: SPARK-8480 URL: https://issues.apache.org/jira/browse/SPARK-8480 Project: Spark Issue Type: Wish

[jira] [Assigned] (SPARK-8468) Cross-validation with RegressionEvaluator prefers higher RMSE

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8468: --- Assignee: (was: Apache Spark) Cross-validation with RegressionEvaluator prefers higher

[jira] [Assigned] (SPARK-8468) Cross-validation with RegressionEvaluator prefers higher RMSE

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8468: --- Assignee: Apache Spark Cross-validation with RegressionEvaluator prefers higher RMSE

[jira] [Commented] (SPARK-8468) Cross-validation with RegressionEvaluator prefers higher RMSE

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593438#comment-14593438 ] Apache Spark commented on SPARK-8468: - User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-8479) Add numNonzeros and numActives to linalg.Matrices

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593437#comment-14593437 ] Apache Spark commented on SPARK-8479: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-8479) Add numNonzeros and numActives to linalg.Matrices

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8479: --- Assignee: (was: Apache Spark) Add numNonzeros and numActives to linalg.Matrices

[jira] [Assigned] (SPARK-8479) Add numNonzeros and numActives to linalg.Matrices

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8479: --- Assignee: Apache Spark Add numNonzeros and numActives to linalg.Matrices

[jira] [Resolved] (SPARK-3188) Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3188. -- Resolution: Won't Fix Target Version/s: (was: 1.5.0) The PR hasn't been updated and this

[jira] [Assigned] (SPARK-3188) Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3188: --- Assignee: Apache Spark (was: Fan Jiang) Add Robust Regression Algorithm with Tukey

[jira] [Assigned] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7944: --- Assignee: (was: Apache Spark) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class

[jira] [Commented] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593434#comment-14593434 ] Apache Spark commented on SPARK-7944: - User 'dragos' has created a pull request for

[jira] [Assigned] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7944: --- Assignee: Apache Spark Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

[jira] [Commented] (SPARK-8410) Hive VersionsSuite RuntimeException

2015-06-19 Thread Josiah Samuel Sathiadass (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593453#comment-14593453 ] Josiah Samuel Sathiadass commented on SPARK-8410: - My findings so far,

[jira] [Updated] (SPARK-8480) Add setName for Dataframe

2015-06-19 Thread Peter Rudenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Rudenko updated SPARK-8480: - Description: Rdd has a method setName, so in spark UI, it's more easily to understand what's this

[jira] [Updated] (SPARK-5205) Inconsistent behaviour between Streaming job and others, when click kill link in WebUI

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5205: - Target Version/s: (was: 1.4.0) Inconsistent behaviour between Streaming job and others, when click

[jira] [Updated] (SPARK-8077) Optimisation of TreeNode for large number of children

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8077: - Assignee: Mick Davies Optimisation of TreeNode for large number of children

[jira] [Updated] (SPARK-8010) Implict promote Numeric type to String type in HiveTypeCoercion

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8010: - Assignee: Li Sheng Implict promote Numeric type to String type in HiveTypeCoercion

[jira] [Updated] (SPARK-7563) OutputCommitCoordinator.stop() should only be executed in driver

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7563: - Target Version/s: (was: 1.3.2, 1.4.0) OutputCommitCoordinator.stop() should only be executed in driver

[jira] [Updated] (SPARK-8339) Itertools islice requires an integer for the stop argument.

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8339: - Assignee: Kevin Conor Itertools islice requires an integer for the stop argument.

[jira] [Updated] (SPARK-6701) Flaky test: o.a.s.deploy.yarn.YarnClusterSuite Python application

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6701: - Target Version/s: 1.5.0 (was: 1.4.0) Flaky test: o.a.s.deploy.yarn.YarnClusterSuite Python application

[jira] [Updated] (SPARK-7670) Failure when building with scala 2.11 (after 1.3.1

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7670: - Fix Version/s: (was: SPARK-7726) Failure when building with scala 2.11 (after 1.3.1

[jira] [Updated] (SPARK-7597) Make default doc build avoid search engine indexing

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7597: - Target Version/s: 1.5.0 (was: 1.4.0) Make default doc build avoid search engine indexing

[jira] [Updated] (SPARK-7497) test_count_by_value_and_window is flaky

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7497: - Target Version/s: 1.5.0 (was: 1.4.0) test_count_by_value_and_window is flaky

[jira] [Updated] (SPARK-5689) Document what can be run in different YARN modes

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5689: - Target Version/s: 1.5.0 (was: 1.4.0) Document what can be run in different YARN modes

[jira] [Updated] (SPARK-5901) [PySpark] pickle classes in main module

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5901: - Target Version/s: 1.5.0 (was: 1.4.0) [PySpark] pickle classes in main module

[jira] [Updated] (SPARK-7360) Compare Pyrolite performance affected by useMemo

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7360: - Target Version/s: 1.5.0 (was: 1.4.0) Compare Pyrolite performance affected by useMemo

[jira] [Updated] (SPARK-6484) Ganglia metrics xml reporter doesn't escape correctly

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6484: - Target Version/s: 1.5.0 (was: 1.4.0) Ganglia metrics xml reporter doesn't escape correctly

[jira] [Updated] (SPARK-5544) wholeTextFiles should recognize multiple input paths delimited by ,

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5544: - Target Version/s: 1.5.0 (was: 1.4.0) wholeTextFiles should recognize multiple input paths delimited by

[jira] [Updated] (SPARK-2004) Automate QA of Spark Build/Deploy Matrix

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2004: - Target Version/s: 1.5.0 (was: 1.4.0) Automate QA of Spark Build/Deploy Matrix

[jira] [Updated] (SPARK-6728) Improve performance of py4j for large bytearray

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6728: - Target Version/s: 1.5.0 (was: 1.4.0) Improve performance of py4j for large bytearray

[jira] [Assigned] (SPARK-8356) Reconcile callUDF and callUdf

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8356: --- Assignee: (was: Apache Spark) Reconcile callUDF and callUdf

[jira] [Commented] (SPARK-8478) Harmonize UDF-related code to use uniformly UDF instead of Udf

2015-06-19 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593368#comment-14593368 ] Benjamin Fradet commented on SPARK-8478: As discussed on

[jira] [Commented] (SPARK-8356) Reconcile callUDF and callUdf

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593365#comment-14593365 ] Apache Spark commented on SPARK-8356: - User 'BenFradet' has created a pull request for

[jira] [Assigned] (SPARK-8356) Reconcile callUDF and callUdf

2015-06-19 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8356: --- Assignee: Apache Spark Reconcile callUDF and callUdf -

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7332: - Target Version/s: (was: 1.4.0) RpcCallContext.sender has a different name from the original sender's

[jira] [Updated] (SPARK-6378) srcAttr in graph.triplets don't update when the size of graph is huge

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6378: - Target Version/s: (was: 1.4.0) srcAttr in graph.triplets don't update when the size of graph is huge

[jira] [Updated] (SPARK-7820) Java8-tests suite compile error under SBT

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7820: - Target Version/s: (was: 1.4.0) Java8-tests suite compile error under SBT

[jira] [Updated] (SPARK-7650) Move streaming css and js files to the streaming project

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7650: - Target Version/s: (was: 1.4.0) Move streaming css and js files to the streaming project

[jira] [Updated] (SPARK-6931) python: struct.pack('!q', value) in write_long(value, stream) in serializers.py require int(but doesn't raise exceptions in common cases)

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6931: - Target Version/s: (was: 1.4.0) python: struct.pack('!q', value) in write_long(value, stream) in

[jira] [Updated] (SPARK-6639) Create a new script to start multiple masters

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6639: - Target Version/s: (was: 1.4.0) Create a new script to start multiple masters

[jira] [Updated] (SPARK-3789) [GRAPHX] Python bindings for GraphX

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3789: - Target Version/s: (was: 1.4.0) [GRAPHX] Python bindings for GraphX

[jira] [Resolved] (SPARK-4605) Proposed Contribution: Spark Kernel to enable interactive Spark applications

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4605. -- Resolution: Won't Fix Proposed Contribution: Spark Kernel to enable interactive Spark applications

[jira] [Updated] (SPARK-7420) Flaky test: o.a.s.streaming.JobGeneratorSuite Do not clear received block data too soon

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7420: - Target Version/s: 1.5.0 (was: 1.4.0) Flaky test: o.a.s.streaming.JobGeneratorSuite Do not clear

[jira] [Updated] (SPARK-4246) Add testsuite with end-to-end testing of driver failure

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4246: - Target Version/s: 1.5.0 (was: 1.4.0) Add testsuite with end-to-end testing of driver failure

[jira] [Updated] (SPARK-7761) Flaky PySpark test: test_kafka_stream

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7761: - Target Version/s: 1.5.0 (was: 1.4.0) Flaky PySpark test: test_kafka_stream

[jira] [Updated] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5659: - Target Version/s: 1.5.0 (was: 1.4.0) Flaky test: o.a.s.streaming.ReceiverSuite.block

[jira] [Updated] (SPARK-7419) Flaky test: o.a.s.streaming.CheckpointSuite

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7419: - Target Version/s: 1.5.0 (was: 1.4.0) Flaky test: o.a.s.streaming.CheckpointSuite

[jira] [Commented] (SPARK-8356) Reconcile callUDF and callUdf

2015-06-19 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593362#comment-14593362 ] Benjamin Fradet commented on SPARK-8356: I'll create a separate JIRA for

[jira] [Updated] (SPARK-7265) Improving documentation for Spark SQL Hive support

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7265: - Priority: Trivial (was: Minor) Improving documentation for Spark SQL Hive support

[jira] [Resolved] (SPARK-7265) Improving documentation for Spark SQL Hive support

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7265. -- Resolution: Fixed Fix Version/s: 1.5.0 Improving documentation for Spark SQL Hive support

[jira] [Commented] (SPARK-8474) [STREAMING] Kafka DirectStream API stops receiving messages if collective size of the messages specified in spark.streaming.kafka.maxRatePerPartition exceeds the defaul

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593159#comment-14593159 ] Sean Owen commented on SPARK-8474: -- The max fetch size is per message. It would not

[jira] [Updated] (SPARK-7169) Allow to specify metrics configuration more flexibly

2015-06-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7169: - Fix Version/s: (was: 1.4.0) 1.5.0 Yes, looks like it only went in for 1.5 Allow

[jira] [Commented] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-06-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593265#comment-14593265 ] Yanbo Liang commented on SPARK-7148: parquet.block.size if one of the configuration of

[jira] [Comment Edited] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-06-19 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593265#comment-14593265 ] Yanbo Liang edited comment on SPARK-7148 at 6/19/15 9:39 AM: -

<    1   2   3   4   >