[jira] [Updated] (SPARK-6566) Update Spark to use the latest version of Parquet libraries

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6566: - Assignee: Yash Datta Update Spark to use the latest version of Parquet libraries

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588064#comment-14588064 ] Juan Rodríguez Hortalá commented on SPARK-8337: --- Hi, I've made some

[jira] [Created] (SPARK-8395) spark-submit documentation is incorrect

2015-06-16 Thread Dev Lakhani (JIRA)
Dev Lakhani created SPARK-8395: -- Summary: spark-submit documentation is incorrect Key: SPARK-8395 URL: https://issues.apache.org/jira/browse/SPARK-8395 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8333: --- Assignee: Apache Spark Spark failed to delete temp directory created by HiveContext

[jira] [Assigned] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8333: --- Assignee: (was: Apache Spark) Spark failed to delete temp directory created by

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587937#comment-14587937 ] Apache Spark commented on SPARK-8333: - User 'navis' has created a pull request for

[jira] [Updated] (SPARK-8396) GraphLoader.edgeListFile does not populate Graph.vertices.

2015-06-16 Thread Matthew Barrett (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Barrett updated SPARK-8396: --- Summary: GraphLoader.edgeListFile does not populate Graph.vertices. (was:

[jira] [Resolved] (SPARK-8143) Spark application history cannot be found even for finished jobs

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8143. -- Resolution: Duplicate Fix Version/s: (was: 1.4.0) Spark application history cannot be found

[jira] [Reopened] (SPARK-8143) Spark application history cannot be found even for finished jobs

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-8143: -- Spark application history cannot be found even for finished jobs

[jira] [Assigned] (SPARK-7799) Move StreamingContext.actorStream to a separate project and deprecate it in StreamingContext

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7799: --- Assignee: Apache Spark Move StreamingContext.actorStream to a separate project and

[jira] [Commented] (SPARK-7799) Move StreamingContext.actorStream to a separate project and deprecate it in StreamingContext

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588036#comment-14588036 ] Apache Spark commented on SPARK-7799: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-7799) Move StreamingContext.actorStream to a separate project and deprecate it in StreamingContext

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7799: --- Assignee: (was: Apache Spark) Move StreamingContext.actorStream to a separate project

[jira] [Updated] (SPARK-8393) JavaStreamingContext#awaitTermination() throws non-declared InterruptedException

2015-06-16 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaromir Vanek updated SPARK-8393: - Description: Call to {{JavaStreamingContext#awaitTermination()}} can throw InterruptedException

[jira] [Commented] (SPARK-8393) JavaStreamingContext#awaitTermination() throws non-declared InterruptedException

2015-06-16 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588013#comment-14588013 ] Jaromir Vanek commented on SPARK-8393: -- It's not a big problem in Java. But I took me

[jira] [Updated] (SPARK-8393) JavaStreamingContext#awaitTermination() throws non-declared InterruptedException

2015-06-16 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaromir Vanek updated SPARK-8393: - Description: Call to {{JavaStreamingContext#awaitTermination()}} can throw

[jira] [Updated] (SPARK-8393) JavaStreamingContext#awaitTermination() throws non-declared InterruptedException

2015-06-16 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaromir Vanek updated SPARK-8393: - Description: Call to {{JavaStreamingContext#awaitTermination()}} can throw InterruptedException

[jira] [Commented] (SPARK-7580) Driver out of memory

2015-06-16 Thread Yuance Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588086#comment-14588086 ] Yuance Li commented on SPARK-7580: -- Hey, how did you solve the problem? I also met this

[jira] [Commented] (SPARK-7515) Update documentation for PySpark on YARN with cluster mode

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588098#comment-14588098 ] Apache Spark commented on SPARK-7515: - User 'punya' has created a pull request for

[jira] [Created] (SPARK-8396) GraphLoader.edgeListFile does not population Graph.vertices.

2015-06-16 Thread Matthew Barrett (JIRA)
Matthew Barrett created SPARK-8396: -- Summary: GraphLoader.edgeListFile does not population Graph.vertices. Key: SPARK-8396 URL: https://issues.apache.org/jira/browse/SPARK-8396 Project: Spark

[jira] [Commented] (SPARK-7443) MLlib 1.4 QA plan

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587941#comment-14587941 ] Sean Owen commented on SPARK-7443: -- [~mengxr] This contains 6 subtasks that aren't

[jira] [Updated] (SPARK-8392) the process is hang on when getting cachedNodes

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8392: - Priority: Minor (was: Major) This is not major. the process is hang on when getting cachedNodes

[jira] [Resolved] (SPARK-7715) Update MLlib Programming Guide for 1.4

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7715. -- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Joseph K. Bradley Assuming the

[jira] [Updated] (SPARK-7515) Update documentation for PySpark on YARN with cluster mode

2015-06-16 Thread Punya Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punya Biswal updated SPARK-7515: Fix Version/s: 1.4.1 Update documentation for PySpark on YARN with cluster mode

[jira] [Commented] (SPARK-5680) Sum function on all null values, should return zero

2015-06-16 Thread Holman Lan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588163#comment-14588163 ] Holman Lan commented on SPARK-5680: --- Hello Venkata. Thanks very much for looking into

[jira] [Created] (SPARK-8397) Allow custom configuration for TestHive

2015-06-16 Thread Punya Biswal (JIRA)
Punya Biswal created SPARK-8397: --- Summary: Allow custom configuration for TestHive Key: SPARK-8397 URL: https://issues.apache.org/jira/browse/SPARK-8397 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7443) MLlib 1.4 QA plan

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588265#comment-14588265 ] Joseph K. Bradley commented on SPARK-7443: -- [~srowen] Most of the QA items are

[jira] [Commented] (SPARK-8268) string function: unbase64

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588120#comment-14588120 ] Apache Spark commented on SPARK-8268: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-8243) string function: encode

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588118#comment-14588118 ] Apache Spark commented on SPARK-8243: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-16 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588202#comment-14588202 ] Cody Koeninger commented on SPARK-8389: --- There's already a ticket for the Python

[jira] [Commented] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

2015-06-16 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588211#comment-14588211 ] Cody Koeninger commented on SPARK-7122: --- It's certainly your prerogative to wait for

[jira] [Assigned] (SPARK-8397) Allow custom configuration for TestHive

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8397: --- Assignee: (was: Apache Spark) Allow custom configuration for TestHive

[jira] [Commented] (SPARK-8397) Allow custom configuration for TestHive

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588161#comment-14588161 ] Apache Spark commented on SPARK-8397: - User 'punya' has created a pull request for

[jira] [Assigned] (SPARK-8397) Allow custom configuration for TestHive

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8397: --- Assignee: Apache Spark Allow custom configuration for TestHive

[jira] [Assigned] (SPARK-8239) string function: base64

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8239: --- Assignee: Cheng Hao (was: Apache Spark) string function: base64 ---

[jira] [Assigned] (SPARK-8239) string function: base64

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8239: --- Assignee: Apache Spark (was: Cheng Hao) string function: base64 ---

[jira] [Commented] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

2015-06-16 Thread Peter Haumer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588330#comment-14588330 ] Peter Haumer commented on SPARK-8385: - Sean, I see the class in the big assembly file

[jira] [Assigned] (SPARK-8242) string function: decode

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8242: --- Assignee: Apache Spark (was: Cheng Hao) string function: decode ---

[jira] [Assigned] (SPARK-8268) string function: unbase64

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8268: --- Assignee: Apache Spark (was: Cheng Hao) string function: unbase64

[jira] [Assigned] (SPARK-8268) string function: unbase64

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8268: --- Assignee: Cheng Hao (was: Apache Spark) string function: unbase64

[jira] [Assigned] (SPARK-8238) string function: ascii

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8238: --- Assignee: Cheng Hao (was: Apache Spark) string function: ascii --

[jira] [Assigned] (SPARK-8243) string function: encode

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8243: --- Assignee: Cheng Hao (was: Apache Spark) string function: encode ---

[jira] [Commented] (SPARK-8238) string function: ascii

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588115#comment-14588115 ] Apache Spark commented on SPARK-8238: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-8242) string function: decode

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588117#comment-14588117 ] Apache Spark commented on SPARK-8242: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-8242) string function: decode

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8242: --- Assignee: Cheng Hao (was: Apache Spark) string function: decode ---

[jira] [Commented] (SPARK-8239) string function: base64

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588116#comment-14588116 ] Apache Spark commented on SPARK-8239: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-8238) string function: ascii

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8238: --- Assignee: Apache Spark (was: Cheng Hao) string function: ascii --

[jira] [Assigned] (SPARK-8243) string function: encode

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8243: --- Assignee: Apache Spark (was: Cheng Hao) string function: encode ---

[jira] [Commented] (SPARK-8380) SparkR mis-counts

2015-06-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588196#comment-14588196 ] Shivaram Venkataraman commented on SPARK-8380: -- Thanks for the update. I'm

[jira] [Created] (SPARK-8398) Consistently expose Hadoop Configuration/JobConf parameters for Hadoop input/output formats

2015-06-16 Thread koert kuipers (JIRA)
koert kuipers created SPARK-8398: Summary: Consistently expose Hadoop Configuration/JobConf parameters for Hadoop input/output formats Key: SPARK-8398 URL: https://issues.apache.org/jira/browse/SPARK-8398

[jira] [Commented] (SPARK-6816) Add SparkConf API to configure SparkR

2015-06-16 Thread Rick Moritz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588271#comment-14588271 ] Rick Moritz commented on SPARK-6816: Apparently this work-around is no longer needed

[jira] [Assigned] (SPARK-8398) Consistently expose Hadoop Configuration/JobConf parameters for Hadoop input/output formats

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8398: --- Assignee: Apache Spark Consistently expose Hadoop Configuration/JobConf parameters for

[jira] [Commented] (SPARK-8398) Consistently expose Hadoop Configuration/JobConf parameters for Hadoop input/output formats

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588424#comment-14588424 ] Apache Spark commented on SPARK-8398: - User 'koertkuipers' has created a pull request

[jira] [Assigned] (SPARK-8398) Consistently expose Hadoop Configuration/JobConf parameters for Hadoop input/output formats

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8398: --- Assignee: (was: Apache Spark) Consistently expose Hadoop Configuration/JobConf

[jira] [Commented] (SPARK-8385) java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588540#comment-14588540 ] Sean Owen commented on SPARK-8385: -- Oh, is TFS Tachyon? Not sure what the status is on

[jira] [Commented] (SPARK-8384) Can not set checkpointDuration or Interval in spark 1.3 and later

2015-06-16 Thread Norman He (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588363#comment-14588363 ] Norman He commented on SPARK-8384: -- It seems that if checkpoint interval is the same as

[jira] [Assigned] (SPARK-8399) Overlap between histograms and axis' name in Spark Streaming UI

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8399: --- Assignee: Apache Spark Overlap between histograms and axis' name in Spark Streaming UI

[jira] [Commented] (SPARK-8393) JavaStreamingContext#awaitTermination() throws non-declared InterruptedException

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588546#comment-14588546 ] Sean Owen commented on SPARK-8393: -- {{awaitTerminationOrTimeout}} will return a

[jira] [Commented] (SPARK-8395) spark-submit documentation is incorrect

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588551#comment-14588551 ] Sean Owen commented on SPARK-8395: -- I think that's right. This looks like a hold-over

[jira] [Created] (SPARK-8399) Overlap between histograms and axis' name in Spark Streaming UI

2015-06-16 Thread Benjamin Fradet (JIRA)
Benjamin Fradet created SPARK-8399: -- Summary: Overlap between histograms and axis' name in Spark Streaming UI Key: SPARK-8399 URL: https://issues.apache.org/jira/browse/SPARK-8399 Project: Spark

[jira] [Commented] (SPARK-8399) Overlap between histograms and axis' name in Spark Streaming UI

2015-06-16 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588358#comment-14588358 ] Benjamin Fradet commented on SPARK-8399: I'll submit a patch shortly. Overlap

[jira] [Commented] (SPARK-8399) Overlap between histograms and axis' name in Spark Streaming UI

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588379#comment-14588379 ] Apache Spark commented on SPARK-8399: - User 'BenFradet' has created a pull request for

[jira] [Assigned] (SPARK-8399) Overlap between histograms and axis' name in Spark Streaming UI

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8399: --- Assignee: (was: Apache Spark) Overlap between histograms and axis' name in Spark

[jira] [Assigned] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8389: --- Assignee: Apache Spark (was: Cody Koeninger) Expose KafkaRDDs offsetRange in Java and

[jira] [Assigned] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8389: --- Assignee: Cody Koeninger (was: Apache Spark) Expose KafkaRDDs offsetRange in Java and

[jira] [Commented] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588397#comment-14588397 ] Apache Spark commented on SPARK-8389: - User 'koeninger' has created a pull request for

[jira] [Commented] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-16 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588451#comment-14588451 ] Tathagata Das commented on SPARK-8389: -- Then lets atleast add it to the examples and

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-16 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588517#comment-14588517 ] Cody Koeninger commented on SPARK-8337: --- So one thing to keep in mind is that if the

[jira] [Commented] (SPARK-8356) Reconcile callUDF and callUdf

2015-06-16 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588579#comment-14588579 ] Benjamin Fradet commented on SPARK-8356: I've started working on this issue.

[jira] [Updated] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-06-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6910: Target Version/s: 1.5.0 Support for pushing predicates down to metastore for partition

[jira] [Updated] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-06-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6910: Priority: Critical (was: Major) Support for pushing predicates down to metastore for

[jira] [Commented] (SPARK-7665) MLlib Python API breaking changes check between 1.3 1.4

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588777#comment-14588777 ] Joseph K. Bradley commented on SPARK-7665: -- I'm making a final pass before I

[jira] [Resolved] (SPARK-7665) MLlib Python API breaking changes check between 1.3 1.4

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7665. -- Resolution: Done Assignee: Joseph K. Bradley MLlib Python API breaking changes

[jira] [Commented] (SPARK-7665) MLlib Python API breaking changes check between 1.3 1.4

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588804#comment-14588804 ] Joseph K. Bradley commented on SPARK-7665: -- I believe everything checks out, so

[jira] [Resolved] (SPARK-7916) MLlib Python doc parity check for classification and regression.

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7916. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 Issue resolved

[jira] [Commented] (SPARK-7667) MLlib Python API consistency check

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588852#comment-14588852 ] Joseph K. Bradley commented on SPARK-7667: -- [~yanboliang] What have you checked

[jira] [Commented] (SPARK-7674) R-like stats for ML models

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588914#comment-14588914 ] Joseph K. Bradley commented on SPARK-7674: -- Definitely. I think the next items

[jira] [Commented] (SPARK-8389) Expose KafkaRDDs offsetRange in Java and Python

2015-06-16 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588404#comment-14588404 ] Cody Koeninger commented on SPARK-8389: --- So on the java side, just so I'm clear, are

[jira] [Commented] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

2015-06-16 Thread Amit Ramesh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588439#comment-14588439 ] Amit Ramesh commented on SPARK-8337: [~juanrh] this looks pretty good to me. And from

[jira] [Commented] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-06-16 Thread Alex Baretta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588506#comment-14588506 ] Alex Baretta commented on SPARK-7944: - Bug confirmed on Spark 1.4.0 with Scala 2.11.6.

[jira] [Reopened] (SPARK-7715) Update MLlib Programming Guide for 1.4

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-7715: -- This should not actually be closed yet. We need to update the programming guide still,

[jira] [Resolved] (SPARK-7666) MLlib Python doc parity check

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7666. -- Resolution: Fixed Fix Version/s: 1.5.0 1.4.1

[jira] [Commented] (SPARK-7580) Driver out of memory

2015-06-16 Thread Andrew Rothstein (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588855#comment-14588855 ] Andrew Rothstein commented on SPARK-7580: - Haven't heard any solutions. We

[jira] [Updated] (SPARK-7916) MLlib Python doc parity check for classification and regression.

2015-06-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7916: - Assignee: Yanbo Liang MLlib Python doc parity check for classification and regression.

[jira] [Created] (SPARK-8400) ml.ALS doesn't handle -1 block size

2015-06-16 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-8400: Summary: ml.ALS doesn't handle -1 block size Key: SPARK-8400 URL: https://issues.apache.org/jira/browse/SPARK-8400 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-06-16 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588740#comment-14588740 ] Iulian Dragos commented on SPARK-7944: -- I'll have a look tomorrow, I vaguely remember

[jira] [Updated] (SPARK-8379) LeaseExpiredException when using dynamic partition with speculative execution

2015-06-16 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8379: Target Version/s: 1.5.0 Shepherd: Cheng Lian Assignee: jeanlyn

[jira] [Assigned] (SPARK-3258) Python API for streaming MLlib algorithms

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3258: --- Assignee: (was: Apache Spark) Python API for streaming MLlib algorithms

[jira] [Assigned] (SPARK-3258) Python API for streaming MLlib algorithms

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3258: --- Assignee: Apache Spark Python API for streaming MLlib algorithms

[jira] [Commented] (SPARK-3258) Python API for streaming MLlib algorithms

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588585#comment-14588585 ] Apache Spark commented on SPARK-3258: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

2015-06-16 Thread Vincent Ohprecio (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588588#comment-14588588 ] Vincent Ohprecio commented on SPARK-7944: - just compiled version 1.5.0-SNAPSHOT

[jira] [Assigned] (SPARK-7633) Streaming Logistic Regression- Python bindings

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7633: --- Assignee: (was: Apache Spark) Streaming Logistic Regression- Python bindings

[jira] [Assigned] (SPARK-7633) Streaming Logistic Regression- Python bindings

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7633: --- Assignee: Apache Spark Streaming Logistic Regression- Python bindings

[jira] [Commented] (SPARK-7633) Streaming Logistic Regression- Python bindings

2015-06-16 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588600#comment-14588600 ] Manoj Kumar commented on SPARK-7633: I'm extremely sorry. I was halfway through when

[jira] [Commented] (SPARK-7633) Streaming Logistic Regression- Python bindings

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588595#comment-14588595 ] Apache Spark commented on SPARK-7633: - User 'MechCoder' has created a pull request for

[jira] [Resolved] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8387. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6834

[jira] [Updated] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

2015-06-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8387: - Assignee: SuYan [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

[jira] [Assigned] (SPARK-3665) Java API for GraphX

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3665: --- Assignee: Ankur Dave (was: Apache Spark) Java API for GraphX ---

[jira] [Assigned] (SPARK-3665) Java API for GraphX

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3665: --- Assignee: Apache Spark (was: Ankur Dave) Java API for GraphX ---

[jira] [Assigned] (SPARK-5362) Gradient and Optimizer to support generic output (instead of label) and data batches

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5362: --- Assignee: (was: Apache Spark) Gradient and Optimizer to support generic output (instead

[jira] [Assigned] (SPARK-5362) Gradient and Optimizer to support generic output (instead of label) and data batches

2015-06-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5362: --- Assignee: Apache Spark Gradient and Optimizer to support generic output (instead of label)

  1   2   >