[jira] [Commented] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951926#comment-14951926 ] Dibyendu Bhattacharya commented on SPARK-11045: --- I agree Sean. this space is already

[jira] [Commented] (SPARK-10759) Missing Python code example in ML Programming guide

[ https://issues.apache.org/jira/browse/SPARK-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951985#comment-14951985 ] Bhargav Mangipudi commented on SPARK-10759: --- I can take this up if its still Open. > Missing

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951880#comment-14951880 ] Sean Owen commented on SPARK-10977: --- If it's simple, quoting sounds good. This isn't really a SQL

[jira] [Created] (SPARK-11049) If a single executor fails to allocate memory, entire job fails

Brian created SPARK-11049: - Summary: If a single executor fails to allocate memory, entire job fails Key: SPARK-11049 URL: https://issues.apache.org/jira/browse/SPARK-11049 Project: Spark Issue

[jira] [Updated] (SPARK-6725) Model export/import for Pipeline API

[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6725: - Description: This is an umbrella JIRA for adding model export/import to the spark.ml API.

[jira] [Commented] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951930#comment-14951930 ] Apache Spark commented on SPARK-10973: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951931#comment-14951931 ] Apache Spark commented on SPARK-10973: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951927#comment-14951927 ] Apache Spark commented on SPARK-10973: -- User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951915#comment-14951915 ] Dibyendu Bhattacharya commented on SPARK-11045: --- Hi Cody, thanks for your comments. My

[jira] [Comment Edited] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951926#comment-14951926 ] Dibyendu Bhattacharya edited comment on SPARK-11045 at 10/10/15 4:58 PM:

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951865#comment-14951865 ] Rick Hillegas commented on SPARK-10977: --- Hi Sean, Yes, I hope to post some patches soon. Thanks.

[jira] [Commented] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951877#comment-14951877 ] Cody Koeninger commented on SPARK-11045: The comments regarding parallelism are not accurate.

[jira] [Commented] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951921#comment-14951921 ] Sean Owen commented on SPARK-11045: --- Without commenting on the code itself, why does it need to move

[jira] [Commented] (SPARK-11049) If a single executor fails to allocate memory, entire job fails

[ https://issues.apache.org/jira/browse/SPARK-11049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951923#comment-14951923 ] Sean Owen commented on SPARK-11049: --- Hm, what's the context here though: you have set up a worker that

[jira] [Commented] (SPARK-6726) Model export/import for spark.ml: LogisticRegression

[ https://issues.apache.org/jira/browse/SPARK-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951988#comment-14951988 ] Joseph K. Bradley commented on SPARK-6726: -- I just posted a design doc on the parent JIRA. It

[jira] [Created] (SPARK-11050) PySpark SparseVector can return wrong index in error message

Joseph K. Bradley created SPARK-11050: - Summary: PySpark SparseVector can return wrong index in error message Key: SPARK-11050 URL: https://issues.apache.org/jira/browse/SPARK-11050 Project:

[jira] [Created] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

Trystan Leftwich created SPARK-11052: Summary: Spaces in the build dir causes failures in the build/mvn script Key: SPARK-11052 URL: https://issues.apache.org/jira/browse/SPARK-11052 Project:

[jira] [Updated] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

[ https://issues.apache.org/jira/browse/SPARK-11051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-11051: Environment: Spark version 1.6.0-SNAPSHOT built from the sources as of today - Oct, 10th

[jira] [Assigned] (SPARK-11053) Remove use of KVIterator in SortBasedAggregationIterator

[ https://issues.apache.org/jira/browse/SPARK-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11053: Assignee: Josh Rosen (was: Apache Spark) > Remove use of KVIterator in

[jira] [Commented] (SPARK-11053) Remove use of KVIterator in SortBasedAggregationIterator

[ https://issues.apache.org/jira/browse/SPARK-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952150#comment-14952150 ] Apache Spark commented on SPARK-11053: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11053) Remove use of KVIterator in SortBasedAggregationIterator

[ https://issues.apache.org/jira/browse/SPARK-11053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11053: Assignee: Apache Spark (was: Josh Rosen) > Remove use of KVIterator in

[jira] [Comment Edited] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951915#comment-14951915 ] Dibyendu Bhattacharya edited comment on SPARK-11045 at 10/11/15 4:45 AM:

[jira] [Comment Edited] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951926#comment-14951926 ] Dibyendu Bhattacharya edited comment on SPARK-11045 at 10/11/15 4:47 AM:

[jira] [Created] (SPARK-11051) NullPointerException when action called on localCheckpointed RDD (that was checkpointed before)

Jacek Laskowski created SPARK-11051: --- Summary: NullPointerException when action called on localCheckpointed RDD (that was checkpointed before) Key: SPARK-11051 URL:

[jira] [Assigned] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11052: Assignee: Apache Spark > Spaces in the build dir causes failures in the build/mvn script

[jira] [Assigned] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11052: Assignee: (was: Apache Spark) > Spaces in the build dir causes failures in the

[jira] [Commented] (SPARK-11052) Spaces in the build dir causes failures in the build/mvn script

[ https://issues.apache.org/jira/browse/SPARK-11052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952147#comment-14952147 ] Apache Spark commented on SPARK-11052: -- User 'trystanleftwich' has created a pull request for this

[jira] [Commented] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951696#comment-14951696 ] Sun Rui commented on SPARK-10971: - I agree that it is more flexible to allow configuration of location of

[jira] [Updated] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-11045: -- Affects Version/s: 1.5.1 > Contributing Receiver based Low Level Kafka

[jira] [Commented] (SPARK-11048) Use ForkJoinPool as executorService

[ https://issues.apache.org/jira/browse/SPARK-11048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951721#comment-14951721 ] Apache Spark commented on SPARK-11048: -- User 'tedyu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11048) Use ForkJoinPool as executorService

[ https://issues.apache.org/jira/browse/SPARK-11048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11048: Assignee: (was: Apache Spark) > Use ForkJoinPool as executorService >

[jira] [Assigned] (SPARK-11048) Use ForkJoinPool as executorService

[ https://issues.apache.org/jira/browse/SPARK-11048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11048: Assignee: Apache Spark > Use ForkJoinPool as executorService >

[jira] [Created] (SPARK-11048) Use ForkJoinPool as executorService

Ted Yu created SPARK-11048: -- Summary: Use ForkJoinPool as executorService Key: SPARK-11048 URL: https://issues.apache.org/jira/browse/SPARK-11048 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2309) Generalize the binary logistic regression into multinomial logistic regression

[ https://issues.apache.org/jira/browse/SPARK-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951744#comment-14951744 ] Sean Owen commented on SPARK-2309: -- Yeah, I also don't get it. In multinomial LR you still have the same

[jira] [Resolved] (SPARK-11025) Exception key can't be empty at getSystemProperties function in utils

[ https://issues.apache.org/jira/browse/SPARK-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11025. --- Resolution: Not A Problem Personally I would rather not change the behavior, since it's a change,

[jira] [Updated] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-11045: -- Description: This JIRA is to track the progress of making the Receiver based

[jira] [Assigned] (SPARK-11044) Parquet writer version fixed as version1

[ https://issues.apache.org/jira/browse/SPARK-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11044: Assignee: (was: Apache Spark) > Parquet writer version fixed as version1 >

[jira] [Commented] (SPARK-11044) Parquet writer version fixed as version1

[ https://issues.apache.org/jira/browse/SPARK-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951660#comment-14951660 ] Apache Spark commented on SPARK-11044: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-11044) Parquet writer version fixed as version1

[ https://issues.apache.org/jira/browse/SPARK-11044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11044: Assignee: Apache Spark > Parquet writer version fixed as version1 >

[jira] [Assigned] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

[ https://issues.apache.org/jira/browse/SPARK-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11047: Assignee: (was: Apache Spark) > Internal accumulators miss the internal flag when

[jira] [Commented] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

[ https://issues.apache.org/jira/browse/SPARK-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951679#comment-14951679 ] Apache Spark commented on SPARK-11047: -- User 'carsonwang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

[ https://issues.apache.org/jira/browse/SPARK-11047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11047: Assignee: Apache Spark > Internal accumulators miss the internal flag when replaying

[jira] [Resolved] (SPARK-10968) Incorrect Join behavior in filter conditions

[ https://issues.apache.org/jira/browse/SPARK-10968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10968. --- Resolution: Not A Problem FWIW I also agree that this does not look like a problem. The values being

[jira] [Commented] (SPARK-10977) SQL injection bugs in JdbcUtils and DataFrameWriter

[ https://issues.apache.org/jira/browse/SPARK-10977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951752#comment-14951752 ] Sean Owen commented on SPARK-10977: --- Cool, are you working on a PR? > SQL injection bugs in JdbcUtils

[jira] [Created] (SPARK-11047) Internal accumulators miss the internal flag when replaying events in the history server

Carson Wang created SPARK-11047: --- Summary: Internal accumulators miss the internal flag when replaying events in the history server Key: SPARK-11047 URL: https://issues.apache.org/jira/browse/SPARK-11047

[jira] [Created] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

Dibyendu Bhattacharya created SPARK-11045: - Summary: Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project Key: SPARK-11045 URL:

[jira] [Created] (SPARK-11046) Pass schema from R to JVM using JSON format

Sun Rui created SPARK-11046: --- Summary: Pass schema from R to JVM using JSON format Key: SPARK-11046 URL: https://issues.apache.org/jira/browse/SPARK-11046 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951663#comment-14951663 ] Naden Franciscus commented on SPARK-4226: - Is there a reason this pull request can't be merged in

[jira] [Commented] (SPARK-7099) Floating point literals cannot be specified using exponent

[ https://issues.apache.org/jira/browse/SPARK-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951661#comment-14951661 ] kevin yu commented on SPARK-7099: - Hello Ryan: I tried the similar query with exponent format on

[jira] [Resolved] (SPARK-10079) Make `column` and `col` functions be S4 functions

[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10079. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10079) Make `column` and `col` functions be S4 functions

[ https://issues.apache.org/jira/browse/SPARK-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10079: -- Assignee: Sun Rui > Make `column` and `col` functions be S4 functions >

[jira] [Assigned] (SPARK-10876) display total application time in spark history UI

[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10876: Assignee: (was: Apache Spark) > display total application time in spark history UI >

[jira] [Commented] (SPARK-10876) display total application time in spark history UI

[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951650#comment-14951650 ] Apache Spark commented on SPARK-10876: -- User 'jbonofre' has created a pull request for this issue:

[jira] [Assigned] (SPARK-10876) display total application time in spark history UI

[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10876: Assignee: Apache Spark > display total application time in spark history UI >

[jira] [Commented] (SPARK-6726) Model export/import for spark.ml: LogisticRegression

[ https://issues.apache.org/jira/browse/SPARK-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951769#comment-14951769 ] Wenjian Huang commented on SPARK-6726: -- I have a question: I noticed that there is a

[jira] [Updated] (SPARK-10772) NullPointerException when transform function in DStream returns NULL

[ https://issues.apache.org/jira/browse/SPARK-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10772: -- Assignee: Jack Hu > NullPointerException when transform function in DStream returns NULL >

[jira] [Resolved] (SPARK-10772) NullPointerException when transform function in DStream returns NULL

[ https://issues.apache.org/jira/browse/SPARK-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10772. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8881

[jira] [Updated] (SPARK-11045) Contributing Receiver based Low Level Kafka Consumer from Spark-Packages to Apache Spark Project

[ https://issues.apache.org/jira/browse/SPARK-11045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dibyendu Bhattacharya updated SPARK-11045: -- Affects Version/s: (was: 1.5.1) > Contributing Receiver based Low Level

[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951772#comment-14951772 ] Sean Owen commented on SPARK-11016: --- Yes, I get that roaringbitmap has a particular serialization