[jira] [Created] (SPARK-10361) model.predictAll() fails at user_product.first()

2015-08-31 Thread Velu nambi (JIRA)
Velu nambi created SPARK-10361: -- Summary: model.predictAll() fails at user_product.first() Key: SPARK-10361 URL: https://issues.apache.org/jira/browse/SPARK-10361 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-10149) Locality Level is ANY on "Details for Stage" WebUI page

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10149: Assignee: Apache Spark > Locality Level is ANY on "Details for Stage" WebUI page > ---

[jira] [Assigned] (SPARK-10149) Locality Level is ANY on "Details for Stage" WebUI page

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10149: Assignee: (was: Apache Spark) > Locality Level is ANY on "Details for Stage" WebUI pag

[jira] [Commented] (SPARK-10149) Locality Level is ANY on "Details for Stage" WebUI page

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723073#comment-14723073 ] Apache Spark commented on SPARK-10149: -- User 'wulei-bj-cn' has created a pull reques

[jira] [Commented] (SPARK-10361) model.predictAll() fails at user_product.first()

2015-08-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723141#comment-14723141 ] Sean Owen commented on SPARK-10361: --- Doesn't this just appear to be a network problem o

[jira] [Commented] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

2015-08-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723150#comment-14723150 ] Sean Owen commented on SPARK-10359: --- Is SPARK-4123 a dupe of this or vice versa then?

[jira] [Commented] (SPARK-10361) model.predictAll() fails at user_product.first()

2015-08-31 Thread Velu nambi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723162#comment-14723162 ] Velu nambi commented on SPARK-10361: [~srowen] I'm running a standalone version of sp

[jira] [Commented] (SPARK-10039) Resetting REPL state does not work

2015-08-31 Thread Kevin Jung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723180#comment-14723180 ] Kevin Jung commented on SPARK-10039: I quickly look over scala github to investigate

[jira] [Closed] (SPARK-10039) Resetting REPL state does not work

2015-08-31 Thread Kevin Jung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Jung closed SPARK-10039. -- Resolution: Invalid > Resetting REPL state does not work > -- > >

[jira] [Commented] (SPARK-10361) model.predictAll() fails at user_product.first()

2015-08-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723193#comment-14723193 ] Sean Owen commented on SPARK-10361: --- The error is right here though -- your Python and

[jira] [Commented] (SPARK-10039) Resetting REPL state does not work

2015-08-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723195#comment-14723195 ] Sean Owen commented on SPARK-10039: --- OK, if you can take it up with the Scala project a

[jira] [Commented] (SPARK-10259) Add @Since annotation to ml.classification

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723237#comment-14723237 ] Apache Spark commented on SPARK-10259: -- User 'taishi-oss' has created a pull request

[jira] [Assigned] (SPARK-10259) Add @Since annotation to ml.classification

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10259: Assignee: (was: Apache Spark) > Add @Since annotation to ml.classification > -

[jira] [Assigned] (SPARK-10259) Add @Since annotation to ml.classification

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10259: Assignee: Apache Spark > Add @Since annotation to ml.classification >

[jira] [Created] (SPARK-10362) Cannot create DataFrame from large pandas.DataFrame

2015-08-31 Thread Hsueh-Min Chen (JIRA)
Hsueh-Min Chen created SPARK-10362: -- Summary: Cannot create DataFrame from large pandas.DataFrame Key: SPARK-10362 URL: https://issues.apache.org/jira/browse/SPARK-10362 Project: Spark Issue

[jira] [Updated] (SPARK-10362) Cannot create DataFrame from large pandas.DataFrame

2015-08-31 Thread Hsueh-Min Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hsueh-Min Chen updated SPARK-10362: --- Description: I tried to convert a pandas.DataFrame object to pyspark's DataFrame. It works f

[jira] [Created] (SPARK-10363) DataframeWriter write failed when multi applications write the same partitioned directory

2015-08-31 Thread Peng Zhen (JIRA)
Peng Zhen created SPARK-10363: - Summary: DataframeWriter write failed when multi applications write the same partitioned directory Key: SPARK-10363 URL: https://issues.apache.org/jira/browse/SPARK-10363 P

[jira] [Updated] (SPARK-10023) Unified DecisionTreeParams "checkpointInterval" between Scala and Python API.

2015-08-31 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10023: Description: "checkpointInterval" is member of DecisionTreeParams in Scala API which is inconsiste

[jira] [Issue Comment Deleted] (SPARK-10289) A direct write API for testing Parquet compatibility

2015-08-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10289: --- Comment: was deleted (was: User 'liancheng' has created a pull request for this issue: https://github

[jira] [Updated] (SPARK-10289) A direct write API for testing Parquet compatibility

2015-08-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10289: --- Fix Version/s: 1.6.0 > A direct write API for testing Parquet compatibility > ---

[jira] [Resolved] (SPARK-10289) A direct write API for testing Parquet compatibility

2015-08-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-10289. Resolution: Fixed Resolved by https://github.com/apache/spark/pull/8454 > A direct write API for t

[jira] [Commented] (SPARK-9990) Create local hash join operator

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723321#comment-14723321 ] Apache Spark commented on SPARK-9990: - User 'zsxwing' has created a pull request for t

[jira] [Assigned] (SPARK-9990) Create local hash join operator

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9990: --- Assignee: Apache Spark > Create local hash join operator > --- >

[jira] [Assigned] (SPARK-9990) Create local hash join operator

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9990: --- Assignee: (was: Apache Spark) > Create local hash join operator > ---

[jira] [Assigned] (SPARK-10162) PySpark filters with datetimes mess up when datetimes have timezones.

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10162: Assignee: Apache Spark > PySpark filters with datetimes mess up when datetimes have timezo

[jira] [Assigned] (SPARK-10162) PySpark filters with datetimes mess up when datetimes have timezones.

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10162: Assignee: (was: Apache Spark) > PySpark filters with datetimes mess up when datetimes

[jira] [Commented] (SPARK-10162) PySpark filters with datetimes mess up when datetimes have timezones.

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723356#comment-14723356 ] Apache Spark commented on SPARK-10162: -- User '0x0FFF' has created a pull request for

[jira] [Created] (SPARK-10364) Support Parquet logical type TIMESTAMP_MILLIS

2015-08-31 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10364: -- Summary: Support Parquet logical type TIMESTAMP_MILLIS Key: SPARK-10364 URL: https://issues.apache.org/jira/browse/SPARK-10364 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-8824) Support Parquet time related logical types

2015-08-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8824: -- Summary: Support Parquet time related logical types (was: Support Parquet logical types TIMESTAMP_MILLI

[jira] [Created] (SPARK-10365) Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS

2015-08-31 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10365: -- Summary: Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS Key: SPARK-10365 URL: https://issues.apache.org/jira/browse/SPARK-10365 Project: Spark

[jira] [Created] (SPARK-10366) Support Parquet logical type DATE

2015-08-31 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10366: -- Summary: Support Parquet logical type DATE Key: SPARK-10366 URL: https://issues.apache.org/jira/browse/SPARK-10366 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-10367) Support Parquet logical type INTERVAL

2015-08-31 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-10367: -- Summary: Support Parquet logical type INTERVAL Key: SPARK-10367 URL: https://issues.apache.org/jira/browse/SPARK-10367 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS

2015-08-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10365: --- Summary: Support Parquet logical type TIMESTAMP_MICROS (was: Support Parquet logical types TIMESTAMP

[jira] [Updated] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS

2015-08-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10365: --- Target Version/s: (was: 1.6.0) > Support Parquet logical type TIMESTAMP_MICROS > --

[jira] [Updated] (SPARK-10365) Support Parquet logical type TIMESTAMP_MICROS

2015-08-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10365: --- Description: Didn't assign target version for this ticket because neither the most recent parquet-mr

[jira] [Created] (SPARK-10368) "Could not parse Master URL" leaves spark-shell unusable

2015-08-31 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-10368: --- Summary: "Could not parse Master URL" leaves spark-shell unusable Key: SPARK-10368 URL: https://issues.apache.org/jira/browse/SPARK-10368 Project: Spark

[jira] [Assigned] (SPARK-10117) Implement SQL data source API for reading LIBSVM data

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10117: Assignee: Apache Spark (was: Kai Sasaki) > Implement SQL data source API for reading LIBS

[jira] [Assigned] (SPARK-10117) Implement SQL data source API for reading LIBSVM data

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10117: Assignee: Kai Sasaki (was: Apache Spark) > Implement SQL data source API for reading LIBS

[jira] [Commented] (SPARK-10117) Implement SQL data source API for reading LIBSVM data

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723386#comment-14723386 ] Apache Spark commented on SPARK-10117: -- User 'Lewuathe' has created a pull request f

[jira] [Updated] (SPARK-10368) "Could not parse Master URL" leaves spark-shell unusable

2015-08-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10368: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) I'm not sure it's a bug; the er

[jira] [Created] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

2015-08-31 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-10369: Summary: Fix a bug that Receiver could not be started after deregistering Key: SPARK-10369 URL: https://issues.apache.org/jira/browse/SPARK-10369 Project: Spark

[jira] [Created] (SPARK-10370) After a stages map outputs are registered, all running attempts should be marked as zombies

2015-08-31 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-10370: Summary: After a stages map outputs are registered, all running attempts should be marked as zombies Key: SPARK-10370 URL: https://issues.apache.org/jira/browse/SPARK-10370

[jira] [Assigned] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10369: Assignee: (was: Apache Spark) > Fix a bug that Receiver could not be started after der

[jira] [Assigned] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10369: Assignee: Apache Spark > Fix a bug that Receiver could not be started after deregistering

[jira] [Commented] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723537#comment-14723537 ] Apache Spark commented on SPARK-10369: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-9642) LinearRegression should supported weighted data

2015-08-31 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723562#comment-14723562 ] Seth Hendrickson commented on SPARK-9642: - NP, thanks for responding! > LinearReg

[jira] [Created] (SPARK-10371) Optimize sequential projections

2015-08-31 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10371: - Summary: Optimize sequential projections Key: SPARK-10371 URL: https://issues.apache.org/jira/browse/SPARK-10371 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-10371) Optimize sequential projections

2015-08-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723585#comment-14723585 ] Xiangrui Meng commented on SPARK-10371: --- ping [~yhuai] > Optimize sequential proje

[jira] [Created] (SPARK-10372) Tests for entire scheduler

2015-08-31 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-10372: Summary: Tests for entire scheduler Key: SPARK-10372 URL: https://issues.apache.org/jira/browse/SPARK-10372 Project: Spark Issue Type: Test Compone

[jira] [Commented] (SPARK-10361) model.predictAll() fails at user_product.first()

2015-08-31 Thread Velu nambi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723621#comment-14723621 ] Velu nambi commented on SPARK-10361: Thanks [~srowen]. Is this a known issue, any su

[jira] [Commented] (SPARK-10360) Real time analytics using SparkR and Apache Kafka

2015-08-31 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723625#comment-14723625 ] Shivaram Venkataraman commented on SPARK-10360: --- There is no way to do this

[jira] [Commented] (SPARK-10360) Real time analytics using SparkR and Apache Kafka

2015-08-31 Thread Niharika (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723652#comment-14723652 ] Niharika commented on SPARK-10360: -- Thank you Shivaram for the reply, it is indeed helpf

[jira] [Closed] (SPARK-10360) Real time analytics using SparkR and Apache Kafka

2015-08-31 Thread Niharika (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niharika closed SPARK-10360. Resolution: Fixed > Real time analytics using SparkR and Apache Kafka > ---

[jira] [Commented] (SPARK-7454) Perf test for power iteration clustering (PIC)

2015-08-31 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723666#comment-14723666 ] Feynman Liang commented on SPARK-7454: -- [~mengxr] [~josephkb] can we close this since

[jira] [Commented] (SPARK-10361) model.predictAll() fails at user_product.first()

2015-08-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723668#comment-14723668 ] Sean Owen commented on SPARK-10361: --- The tests are passing and I haven't heard anything

[jira] [Updated] (SPARK-10264) Add @Since annotation to ml.recoomendation

2015-08-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10264: -- Assignee: Tijo Thomas > Add @Since annotation to ml.recoomendation > --

[jira] [Updated] (SPARK-10264) Add @Since annotation to ml.recoomendation

2015-08-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10264: -- Target Version/s: 1.6.0 > Add @Since annotation to ml.recoomendation >

[jira] [Created] (SPARK-10373) Move @since annotator to pyspark to be shared by all components

2015-08-31 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10373: - Summary: Move @since annotator to pyspark to be shared by all components Key: SPARK-10373 URL: https://issues.apache.org/jira/browse/SPARK-10373 Project: Spark

[jira] [Updated] (SPARK-10258) Add @Since annotation to ml.feature

2015-08-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10258: -- Assignee: Martin Brown > Add @Since annotation to ml.feature >

[jira] [Updated] (SPARK-10259) Add @Since annotation to ml.classification

2015-08-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10259: -- Assignee: Hiroshi Takahashi > Add @Since annotation to ml.classification >

[jira] [Updated] (SPARK-10259) Add @Since annotation to ml.classification

2015-08-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10259: -- Target Version/s: 1.6.0 > Add @Since annotation to ml.classification >

[jira] [Commented] (SPARK-10358) Spark-sql throws IOException on exit when using HDFS to store event log.

2015-08-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723705#comment-14723705 ] Marcelo Vanzin commented on SPARK-10358: This is fixed in 1.4 and later, I doubt

[jira] [Commented] (SPARK-10358) Spark-sql throws IOException on exit when using HDFS to store event log.

2015-08-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723757#comment-14723757 ] Marcelo Vanzin commented on SPARK-10358: Original issue: SPARK-6014 > Spark-sql

[jira] [Created] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-08-31 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-10374: -- Summary: Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4 Key: SPARK-10374 URL: https://issues.apache.org/jira/browse/SPARK-10374 Pro

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-08-31 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723768#comment-14723768 ] Matt Cheah commented on SPARK-10374: I intend to create a smaller standalone program

[jira] [Updated] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-08-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10374: -- Priority: Major (was: Blocker) Fix Version/s: (was: 1.5.0) ([~mcheah] don't set Fix versi

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-08-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723792#comment-14723792 ] Patrick Wendell commented on SPARK-10374: - Hey Matt, I think the only thing that

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-08-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723797#comment-14723797 ] Marcelo Vanzin commented on SPARK-10374: This is actually caused by the akka vers

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-08-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723802#comment-14723802 ] Marcelo Vanzin commented on SPARK-10374: BTW since akka depends on protobuf, one

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-08-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723817#comment-14723817 ] Marcelo Vanzin commented on SPARK-10374: nevermind, Patrick pointed out that the

[jira] [Resolved] (SPARK-8730) Deser primitive class with Java serialization

2015-08-31 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-8730. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 7122 [https://github.

[jira] [Commented] (SPARK-10374) Spark-core 1.5.0-RC2 can create version conflicts with apps depending on protobuf-2.4

2015-08-31 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723826#comment-14723826 ] Matt Cheah commented on SPARK-10374: I'll try switching the Akka version pulled in by

[jira] [Commented] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

2015-08-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723844#comment-14723844 ] Patrick Wendell commented on SPARK-10359: - The approach in SPARK-4123 was a bit d

[jira] [Resolved] (SPARK-4123) Show dependency changes in pull requests

2015-08-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4123. Resolution: Duplicate I've proposed a slightly different approach in SPARK-10359, so I'm clo

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is valid

2015-08-31 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723851#comment-14723851 ] Zhan Zhang commented on SPARK-10304: [~yhuai] I tried to reproduce the problem with t

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is valid

2015-08-31 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723858#comment-14723858 ] Yin Huai commented on SPARK-10304: -- The dir struct I have is something like the followin

[jira] [Created] (SPARK-10375) Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work

2015-08-31 Thread Thomas (JIRA)
Thomas created SPARK-10375: -- Summary: Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work Key: SPARK-10375 URL: https://issues.apache.org/jira/browse/SPARK-10375 Project:

[jira] [Created] (SPARK-10376) Once/When YARN permits it, only use POST for kill action

2015-08-31 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-10376: -- Summary: Once/When YARN permits it, only use POST for kill action Key: SPARK-10376 URL: https://issues.apache.org/jira/browse/SPARK-10376 Project: Spark

[jira] [Updated] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

2015-08-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-10369: -- Fix Version/s: 1.5.0 > Fix a bug that Receiver could not be started after deregistering > -

[jira] [Resolved] (SPARK-10369) Fix a bug that Receiver could not be started after deregistering

2015-08-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-10369. --- Resolution: Fixed Assignee: Shixiong Zhu > Fix a bug that Receiver could not be started

[jira] [Resolved] (SPARK-10375) Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work

2015-08-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10375. Resolution: Not A Problem You can't set the driver memory after the driver has already star

[jira] [Comment Edited] (SPARK-10375) Setting the driver memory with SparkConf().set("spark.driver.memory","1g") does not work

2015-08-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723902#comment-14723902 ] Marcelo Vanzin edited comment on SPARK-10375 at 8/31/15 7:27 PM: --

[jira] [Updated] (SPARK-10370) After a stages map outputs are registered, all running attempts should be marked as zombies

2015-08-31 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-10370: - Assignee: (was: Imran Rashid) > After a stages map outputs are registered, all running attemp

[jira] [Updated] (SPARK-10372) Tests for entire scheduler

2015-08-31 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-10372: - Fix Version/s: 1.6.0 > Tests for entire scheduler > -- > >

[jira] [Resolved] (SPARK-10170) Add DB2 JDBC dialect support

2015-08-31 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10170. - Resolution: Fixed Assignee: Suresh Thalamati Fix Version/s: 1.6.0 > Add DB2 JDBC

[jira] [Updated] (SPARK-10170) Add DB2 JDBC dialect support

2015-08-31 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10170: Summary: Add DB2 JDBC dialect support (was: Writing from data frame into db2 database using jdbc d

[jira] [Created] (SPARK-10377) Backported refactor cause

2015-08-31 Thread Frode Sormo (JIRA)
Frode Sormo created SPARK-10377: --- Summary: Backported refactor cause Key: SPARK-10377 URL: https://issues.apache.org/jira/browse/SPARK-10377 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-10377) Cassandra connector affected by backport change

2015-08-31 Thread Frode Sormo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frode Sormo updated SPARK-10377: Summary: Cassandra connector affected by backport change (was: Backported refactor cause) > Cassa

[jira] [Commented] (SPARK-6961) Cannot save data to parquet files when executing from Windows from a Maven Project

2015-08-31 Thread matt hoffman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723933#comment-14723933 ] matt hoffman commented on SPARK-6961: - How is that an installation-side issue? There i

[jira] [Assigned] (SPARK-10291) Add statsByKey method to compute StatCounters for each key in an RDD

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10291: Assignee: (was: Apache Spark) > Add statsByKey method to compute StatCounters for each

[jira] [Commented] (SPARK-10291) Add statsByKey method to compute StatCounters for each key in an RDD

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723944#comment-14723944 ] Apache Spark commented on SPARK-10291: -- User 'eshilts' has created a pull request fo

[jira] [Assigned] (SPARK-10291) Add statsByKey method to compute StatCounters for each key in an RDD

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10291: Assignee: Apache Spark > Add statsByKey method to compute StatCounters for each key in an

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is valid

2015-08-31 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723994#comment-14723994 ] Zhan Zhang commented on SPARK-10304: [~yhuai] I think the NPE is caused by the direct

[jira] [Commented] (SPARK-10373) Move @since annotator to pyspark to be shared by all components

2015-08-31 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724009#comment-14724009 ] Davies Liu commented on SPARK-10373: [~mengxr] Do we want to add @since for the MLLib

[jira] [Commented] (SPARK-10320) Support new topic subscriptions without requiring restart of the streaming context

2015-08-31 Thread Sudarshan Kadambi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724038#comment-14724038 ] Sudarshan Kadambi commented on SPARK-10320: --- Good questions Cody. When adding

[jira] [Assigned] (SPARK-9957) Spark ML trees should filter out 1-category features

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9957: --- Assignee: Apache Spark > Spark ML trees should filter out 1-category features > -

[jira] [Assigned] (SPARK-9957) Spark ML trees should filter out 1-category features

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9957: --- Assignee: (was: Apache Spark) > Spark ML trees should filter out 1-category features > --

[jira] [Commented] (SPARK-9957) Spark ML trees should filter out 1-category features

2015-08-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724067#comment-14724067 ] Apache Spark commented on SPARK-9957: - User 'holdenk' has created a pull request for t

[jira] [Commented] (SPARK-10320) Support new topic subscriptions without requiring restart of the streaming context

2015-08-31 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14724074#comment-14724074 ] Cody Koeninger commented on SPARK-10320: " If you restart the job and specify a n

[jira] [Updated] (SPARK-10320) Kafka Support new topic subscriptions without requiring restart of the streaming context

2015-08-31 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cody Koeninger updated SPARK-10320: --- Summary: Kafka Support new topic subscriptions without requiring restart of the streaming con

  1   2   >