[jira] [Commented] (SPARK-12944) CrossValidator doesn't accept a Pipeline as an estimator

2016-01-27 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119976#comment-15119976 ] Seth Hendrickson commented on SPARK-12944: -- Based on what I have seen, I think t

[jira] [Commented] (SPARK-13004) Support Non-Volatile Data and Operations

2016-01-27 Thread Wang, Gang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119970#comment-15119970 ] Wang, Gang commented on SPARK-13004: I have closed it according to your advice, Thank

[jira] [Updated] (SPARK-13044) saveAsTextFile() failed to save file to AWS S3 EU-Frankfort

2016-01-27 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Ren updated SPARK-13044: Description: I have two clusters deployed: US and EU-Frankfort with the same configs on AWS. And the appl

[jira] [Commented] (SPARK-13034) PySpark ml.classification support export/import

2016-01-27 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119959#comment-15119959 ] Miao Wang commented on SPARK-13034: --- Hi Yanbo, I saw you opened several of these sub-t

[jira] [Created] (SPARK-13044) saveAsTextFile() failed to save file to AWS S3 EU-Frankfort

2016-01-27 Thread Xin Ren (JIRA)
Xin Ren created SPARK-13044: --- Summary: saveAsTextFile() failed to save file to AWS S3 EU-Frankfort Key: SPARK-13044 URL: https://issues.apache.org/jira/browse/SPARK-13044 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-01-27 Thread Lin Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119907#comment-15119907 ] Lin Zhao edited comment on SPARK-12591 at 1/27/16 6:11 PM: --- I'm

[jira] [Commented] (SPARK-12780) Inconsistency returning value of ML python models' properties

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119912#comment-15119912 ] Apache Spark commented on SPARK-12780: -- User 'jkbradley' has created a pull request

[jira] [Issue Comment Deleted] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-01-27 Thread Lin Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Zhao updated SPARK-12591: - Comment: was deleted (was: Failed batches with mapWithState) > NullPointerException using checkpointed m

[jira] [Updated] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-01-27 Thread Lin Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Zhao updated SPARK-12591: - Attachment: Screen Shot 2016-01-27 at 10.09.18 AM.png Failed batches with mapWithState > NullPointerExce

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-01-27 Thread Lin Zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119907#comment-15119907 ] Lin Zhao commented on SPARK-12591: -- I'm not sure of the timing of the checkpointing. The

[jira] [Updated] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2016-01-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10847: - Assignee: Jason C Lee > Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure > --

[jira] [Commented] (SPARK-12591) NullPointerException using checkpointed mapWithState with KryoSerializer

2016-01-27 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119888#comment-15119888 ] Shixiong Zhu commented on SPARK-12591: -- By the way, just want to confirm that: the e

[jira] [Resolved] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2016-01-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10847. -- Resolution: Fixed Fix Version/s: 1.6.1 1.5.3 2.0.0 Issue r

[jira] [Created] (SPARK-13043) Support remaining types in ColumnarBatch

2016-01-27 Thread Nong Li (JIRA)
Nong Li created SPARK-13043: --- Summary: Support remaining types in ColumnarBatch Key: SPARK-13043 URL: https://issues.apache.org/jira/browse/SPARK-13043 Project: Spark Issue Type: Sub-task

[jira] [Issue Comment Deleted] (SPARK-13004) Support Non-Volatile Data and Operations

2016-01-27 Thread Yanping Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanping Wang updated SPARK-13004: - Comment: was deleted (was: Hi, Sean, in order for this model to work, we also developed a memory

[jira] [Closed] (SPARK-13004) Support Non-Volatile Data and Operations

2016-01-27 Thread Wang, Gang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wang, Gang closed SPARK-13004. -- Resolution: Later Preparing actionable items so close it temporarily as Sean Owen suggested. > Support

[jira] [Assigned] (SPARK-13023) Check for presence of 'root' module after computing test_modules, not changed_modules

2016-01-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-13023: -- Assignee: Josh Rosen > Check for presence of 'root' module after computing test_modules, not

[jira] [Resolved] (SPARK-13023) Check for presence of 'root' module after computing test_modules, not changed_modules

2016-01-27 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-13023. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10933 [https://github.

[jira] [Commented] (SPARK-13042) Adding Specificity metric (= true negative rate) to MulticlassMetrics.scala

2016-01-27 Thread Daniel Marcous (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119706#comment-15119706 ] Daniel Marcous commented on SPARK-13042: [~srowen] Forgive me for my ignorance, r

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2016-01-27 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119673#comment-15119673 ] Yin Huai commented on SPARK-9740: - Thank you! > first/last aggregate NULL behavior >

[jira] [Commented] (SPARK-12832) spark on mesos dispacher need a constraints

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119327#comment-15119327 ] Apache Spark commented on SPARK-12832: -- User 'atongen' has created a pull request fo

[jira] [Commented] (SPARK-12940) Partition field in Spark SQL WHERE clause causing Exception

2016-01-27 Thread Brian Wheeler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119242#comment-15119242 ] Brian Wheeler commented on SPARK-12940: --- I tried this on the binary build of spark-

[jira] [Commented] (SPARK-9740) first/last aggregate NULL behavior

2016-01-27 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119240#comment-15119240 ] Herman van Hovell commented on SPARK-9740: -- [~yhuai] I'll have a look. > first/l

[jira] [Commented] (SPARK-13033) PySpark ml.regression support export/import

2016-01-27 Thread Tommy Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119233#comment-15119233 ] Tommy Yu commented on SPARK-13033: -- I can take this one, but may need 13032 merged at fi

[jira] [Commented] (SPARK-5189) Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master

2016-01-27 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119220#comment-15119220 ] Nicholas Chammas commented on SPARK-5189: - FWIW, I found this issue to be practica

[jira] [Updated] (SPARK-13042) Adding Specificity metric (= true negative rate) to MulticlassMetrics.scala

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13042: -- Target Version/s: (was: 1.6.0) Fix Version/s: (was: 1.6.0) [~dmarc...@gmail.com] this is a

[jira] [Issue Comment Deleted] (SPARK-13040) JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

2016-01-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastián Ramírez updated SPARK-13040: -- Comment: was deleted (was: I submitted a PR with the parameters that ended up working f

[jira] [Commented] (SPARK-13040) JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

2016-01-27 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119198#comment-15119198 ] Sebastián Ramírez commented on SPARK-13040: --- I submitted a PR with the paramete

[jira] [Assigned] (SPARK-13040) JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13040: Assignee: (was: Apache Spark) > JDBC using SPARK_CLASSPATH is deprecated but is the on

[jira] [Commented] (SPARK-13040) JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119197#comment-15119197 ] Apache Spark commented on SPARK-13040: -- User 'tiangolo' has created a pull request f

[jira] [Assigned] (SPARK-13040) JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13040: Assignee: Apache Spark > JDBC using SPARK_CLASSPATH is deprecated but is the only way docu

[jira] [Commented] (SPARK-13042) Adding Specificity metric (= true negative rate) to MulticlassMetrics.scala

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119186#comment-15119186 ] Apache Spark commented on SPARK-13042: -- User 'dmarcous' has created a pull request f

[jira] [Assigned] (SPARK-13042) Adding Specificity metric (= true negative rate) to MulticlassMetrics.scala

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13042: Assignee: (was: Apache Spark) > Adding Specificity metric (= true negative rate) to Mu

[jira] [Assigned] (SPARK-13042) Adding Specificity metric (= true negative rate) to MulticlassMetrics.scala

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13042: Assignee: Apache Spark > Adding Specificity metric (= true negative rate) to MulticlassMet

[jira] [Created] (SPARK-13042) Adding Specificity metric (= true negative rate) to MulticlassMetrics.scala

2016-01-27 Thread Daniel Marcous (JIRA)
Daniel Marcous created SPARK-13042: -- Summary: Adding Specificity metric (= true negative rate) to MulticlassMetrics.scala Key: SPARK-13042 URL: https://issues.apache.org/jira/browse/SPARK-13042 Proje

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119167#comment-15119167 ] Apache Spark commented on SPARK-10945: -- User 'dmarcous' has created a pull request f

[jira] [Assigned] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10945: Assignee: (was: Apache Spark) > GraphX computes Pagerank with NaN (with some datasets)

[jira] [Assigned] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10945: Assignee: Apache Spark > GraphX computes Pagerank with NaN (with some datasets) >

[jira] [Assigned] (SPARK-12792) Refactor RRDD to support R UDF

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12792: Assignee: (was: Apache Spark) > Refactor RRDD to support R UDF > -

[jira] [Commented] (SPARK-12792) Refactor RRDD to support R UDF

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119162#comment-15119162 ] Apache Spark commented on SPARK-12792: -- User 'sun-rui' has created a pull request fo

[jira] [Assigned] (SPARK-12792) Refactor RRDD to support R UDF

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12792: Assignee: Apache Spark > Refactor RRDD to support R UDF > -- >

[jira] [Comment Edited] (SPARK-13010) Survival analysis in SparkR

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119054#comment-15119054 ] Yanbo Liang edited comment on SPARK-13010 at 1/27/16 11:09 AM:

[jira] [Comment Edited] (SPARK-13010) Survival analysis in SparkR

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119054#comment-15119054 ] Yanbo Liang edited comment on SPARK-13010 at 1/27/16 11:09 AM:

[jira] [Commented] (SPARK-13010) Survival analysis in SparkR

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15119054#comment-15119054 ] Yanbo Liang commented on SPARK-13010: - There are two issues that we should discuss: 1

[jira] [Updated] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-13041: Description: It would be convenient to have the uri of the driver's ui and the driv

[jira] [Updated] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-13041: Description: It would be convenient to have the uri of the driver's ui and the driv

[jira] [Updated] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-13041: Description: It would be convenient to have the uri of the driver's ui and the driv

[jira] [Updated] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-13041: Description: It would be convenient to have the uri of the driver's ui and the driv

[jira] [Updated] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-13041: Description: It would be convenient to have the uri of the driver's ui and the driv

[jira] [Updated] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-13041: Description: It would be convenient to have the uri of the driver's ui and the driv

[jira] [Updated] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-13041: Description: It would be convenient to have the uri of the driver's ui and the driv

[jira] [Updated] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-13041: Description: It would be convenient to have the uri of the driver's ui and the driv

[jira] [Created] (SPARK-13041) Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver

2016-01-27 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created SPARK-13041: --- Summary: Add a driver ui link and a mesos sandbox link on the dispatcher's ui page for each driver Key: SPARK-13041 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Created] (SPARK-13040) JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

2016-01-27 Thread JIRA
Sebastián Ramírez created SPARK-13040: - Summary: JDBC using SPARK_CLASSPATH is deprecated but is the only way documented Key: SPARK-13040 URL: https://issues.apache.org/jira/browse/SPARK-13040 Pro

[jira] [Created] (SPARK-13039) Spark Streaming with Mesos shutdown without any reason on logs

2016-01-27 Thread Luis Alves (JIRA)
Luis Alves created SPARK-13039: -- Summary: Spark Streaming with Mesos shutdown without any reason on logs Key: SPARK-13039 URL: https://issues.apache.org/jira/browse/SPARK-13039 Project: Spark I

[jira] [Resolved] (SPARK-5398) Support the eu-central-1 region for spark-ec2

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5398. -- Resolution: Won't Fix > Support the eu-central-1 region for spark-ec2 >

[jira] [Resolved] (SPARK-6403) Launch master as spot instance on EC2

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6403. -- Resolution: Won't Fix > Launch master as spot instance on EC2 > - >

[jira] [Resolved] (SPARK-5189) Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5189. -- Resolution: Won't Fix > Reorganize EC2 scripts so that nodes can be provisioned independent of Spark >

[jira] [Resolved] (SPARK-6516) Coupling between default Hadoop versions in Spark build vs. ec2 scripts

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6516. -- Resolution: Won't Fix > Coupling between default Hadoop versions in Spark build vs. ec2 scripts > --

[jira] [Resolved] (SPARK-6474) Replace image.run with connection.run_instances in spark_ec2.py

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6474. -- Resolution: Won't Fix > Replace image.run with connection.run_instances in spark_ec2.py > --

[jira] [Resolved] (SPARK-5209) Jobs fail with "unexpected value" exception in certain environments

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5209. -- Resolution: Not A Problem > Jobs fail with "unexpected value" exception in certain environments > --

[jira] [Resolved] (SPARK-5851) spark_ec2.py ssh failure retry handling not always appropriate

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5851. -- Resolution: Won't Fix > spark_ec2.py ssh failure retry handling not always appropriate > ---

[jira] [Resolved] (SPARK-5433) Spark EC2 doesn't mount local disks for all instance types

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5433. -- Resolution: Won't Fix > Spark EC2 doesn't mount local disks for all instance types > ---

[jira] [Resolved] (SPARK-1079) EC2 scripts should allow mounting as XFS or EXT4

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1079. -- Resolution: Won't Fix > EC2 scripts should allow mounting as XFS or EXT4 > -

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118972#comment-15118972 ] Sean Owen commented on SPARK-5629: -- OK, I'm not sure how to implement that. There are lot

[jira] [Resolved] (SPARK-5149) Type mismatch when defining classes in Spark REPL

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5149. -- Resolution: Duplicate No doubt a slightly different manifestation but yes the same cause and therefore

[jira] [Updated] (SPARK-12105) Add a DataFrame.show() with argument for output PrintStream

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12105: -- Fix Version/s: (was: 2.0.0) > Add a DataFrame.show() with argument for output PrintStream > ---

[jira] [Commented] (SPARK-11560) Optimize KMeans implementation

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118937#comment-15118937 ] Yanbo Liang commented on SPARK-11560: - [~yuhaoyan] I think the first step is to use B

[jira] [Updated] (SPARK-12983) Correct metrics.properties.template

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12983: -- Assignee: Benjamin Fradet > Correct metrics.properties.template > --- >

[jira] [Resolved] (SPARK-12983) Correct metrics.properties.template

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12983. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10902 [https://github.co

[jira] [Resolved] (SPARK-12958) Map accumulator in spark

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12958. --- Resolution: Won't Fix > Map accumulator in spark > > > Key:

[jira] [Commented] (SPARK-12684) Matrix.toString should take a format for how each cell should be printed

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118918#comment-15118918 ] Sean Owen commented on SPARK-12684: --- toString is more for utility and debugging purpose

[jira] [Commented] (SPARK-13004) Support Non-Volatile Data and Operations

2016-01-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118916#comment-15118916 ] Sean Owen commented on SPARK-13004: --- OK, I don't think this JIRA itself is actionable t

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

2016-01-27 Thread Shuo Xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-13029: --- Description: This is a bug that appears while fitting a Logistic Regression model with `.setStandard

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

2016-01-27 Thread Shuo Xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-13029: --- Description: This is a bug that appears while fitting a Logistic Regression model with `.setStandard

[jira] [Commented] (SPARK-12854) Vectorize Parquet reader

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118912#comment-15118912 ] Apache Spark commented on SPARK-12854: -- User 'jaceklaskowski' has created a pull req

[jira] [Updated] (SPARK-13029) Logistic regression returns inaccurate results when there is a column with identical value, and fit_intercept=false

2016-01-27 Thread Shuo Xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Xiang updated SPARK-13029: --- Description: This is a bug that appears while fitting a Logistic Regression model with `.setStandard

[jira] [Created] (SPARK-13038) PySpark ml.pipeline support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13038: --- Summary: PySpark ml.pipeline support export/import Key: SPARK-13038 URL: https://issues.apache.org/jira/browse/SPARK-13038 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13037) PySpark ml.recommendation support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13037: --- Summary: PySpark ml.recommendation support export/import Key: SPARK-13037 URL: https://issues.apache.org/jira/browse/SPARK-13037 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-13036) PySpark ml.feature support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13036: --- Summary: PySpark ml.feature support export/import Key: SPARK-13036 URL: https://issues.apache.org/jira/browse/SPARK-13036 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-12834) Use type conversion instead of Ser/De of Pickle to transform JavaArray and JavaList

2016-01-27 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12834: -- Fix Version/s: 1.6.1 > Use type conversion instead of Ser/De of Pickle to transform Jav

[jira] [Created] (SPARK-13035) PySpark ml.clustering support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13035: --- Summary: PySpark ml.clustering support export/import Key: SPARK-13035 URL: https://issues.apache.org/jira/browse/SPARK-13035 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-13033) PySpark ml.regression support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13033: Summary: PySpark ml.regression support export/import (was: PySpark regression support export/impor

[jira] [Created] (SPARK-13034) PySpark ml.classification support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13034: --- Summary: PySpark ml.classification support export/import Key: SPARK-13034 URL: https://issues.apache.org/jira/browse/SPARK-13034 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-13033) PySpark regression support export/import

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13033: --- Summary: PySpark regression support export/import Key: SPARK-13033 URL: https://issues.apache.org/jira/browse/SPARK-13033 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

2016-01-27 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118840#comment-15118840 ] Hyukjin Kwon commented on SPARK-12890: -- [~rxin] Could you confirm if this is an issu

[jira] [Assigned] (SPARK-13032) Basic ML Pipeline export/import functions for PySpark

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13032: Assignee: Apache Spark > Basic ML Pipeline export/import functions for PySpark > -

[jira] [Assigned] (SPARK-13032) Basic ML Pipeline export/import functions for PySpark

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13032: Assignee: (was: Apache Spark) > Basic ML Pipeline export/import functions for PySpark

[jira] [Commented] (SPARK-13032) Basic ML Pipeline export/import functions for PySpark

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118839#comment-15118839 ] Apache Spark commented on SPARK-13032: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-13031) Improve test coverage for whole stage codegen

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13031: Assignee: Apache Spark (was: Davies Liu) > Improve test coverage for whole stage codegen

[jira] [Assigned] (SPARK-13031) Improve test coverage for whole stage codegen

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13031: Assignee: Davies Liu (was: Apache Spark) > Improve test coverage for whole stage codegen

[jira] [Commented] (SPARK-13031) Improve test coverage for whole stage codegen

2016-01-27 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15118838#comment-15118838 ] Apache Spark commented on SPARK-13031: -- User 'davies' has created a pull request for

[jira] [Created] (SPARK-13032) Basic ML Pipeline export/import functions for PySpark

2016-01-27 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13032: --- Summary: Basic ML Pipeline export/import functions for PySpark Key: SPARK-13032 URL: https://issues.apache.org/jira/browse/SPARK-13032 Project: Spark Issue Typ

[jira] [Created] (SPARK-13031) Improve test coverage for whole stage codegen

2016-01-27 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13031: -- Summary: Improve test coverage for whole stage codegen Key: SPARK-13031 URL: https://issues.apache.org/jira/browse/SPARK-13031 Project: Spark Issue Type: Improve

<    1   2