[jira] [Assigned] (SPARK-13245) ShuffleBlockFetcherIterator should not use shuffleMetrics in multiple threads

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13245: Assignee: (was: Apache Spark) > ShuffleBlockFetcherIterator should not use

[jira] [Assigned] (SPARK-13245) ShuffleBlockFetcherIterator should not use shuffleMetrics in multiple threads

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13245: Assignee: Apache Spark > ShuffleBlockFetcherIterator should not use shuffleMetrics in

[jira] [Commented] (SPARK-13245) ShuffleBlockFetcherIterator should not use shuffleMetrics in multiple threads

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139475#comment-15139475 ] Apache Spark commented on SPARK-13245: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-13247) REST API ignores spark.jars property

2016-02-09 Thread Adam Westerman (JIRA)
Adam Westerman created SPARK-13247: -- Summary: REST API ignores spark.jars property Key: SPARK-13247 URL: https://issues.apache.org/jira/browse/SPARK-13247 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-13248) Remove depecrated Streaming APIs

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13248: Assignee: (was: Apache Spark) > Remove depecrated Streaming APIs >

[jira] [Commented] (SPARK-13248) Remove depecrated Streaming APIs

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139479#comment-15139479 ] Apache Spark commented on SPARK-13248: -- User 'lresende' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13248) Remove depecrated Streaming APIs

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13248: Assignee: Apache Spark > Remove depecrated Streaming APIs >

[jira] [Created] (SPARK-13248) Remove depecrated Streaming APIs

2016-02-09 Thread Luciano Resende (JIRA)
Luciano Resende created SPARK-13248: --- Summary: Remove depecrated Streaming APIs Key: SPARK-13248 URL: https://issues.apache.org/jira/browse/SPARK-13248 Project: Spark Issue Type:

[jira] [Created] (SPARK-13249) Filter null keys for inner join

2016-02-09 Thread Davies Liu (JIRA)
Davies Liu created SPARK-13249: -- Summary: Filter null keys for inner join Key: SPARK-13249 URL: https://issues.apache.org/jira/browse/SPARK-13249 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13246) Avro 1.7.7 Schema.parse race condition hangs task

2016-02-09 Thread koert kuipers (JIRA)
koert kuipers created SPARK-13246: - Summary: Avro 1.7.7 Schema.parse race condition hangs task Key: SPARK-13246 URL: https://issues.apache.org/jira/browse/SPARK-13246 Project: Spark Issue

[jira] [Commented] (SPARK-13243) jersey WADL generator complains about Seq[] type in REST APIs

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139438#comment-15139438 ] Sean Owen commented on SPARK-13243: --- In theory we pipe j.u.l logging through log4j via slf4j, so in

[jira] [Commented] (SPARK-11316) isEmpty before coalesce seems to cause huge performance issue in setupGroups

2016-02-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139658#comment-15139658 ] Thomas Graves commented on SPARK-11316: --- So we ran into this again, here is the scenario and what

[jira] [Created] (SPARK-13240) Having print in assigments (Python 3) causes SyntaxError

2016-02-09 Thread JIRA
Sándor Kazi created SPARK-13240: --- Summary: Having print in assigments (Python 3) causes SyntaxError Key: SPARK-13240 URL: https://issues.apache.org/jira/browse/SPARK-13240 Project: Spark Issue

[jira] [Updated] (SPARK-13040) JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13040: -- Assignee: Sebastián Ramírez > JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

[jira] [Comment Edited] (SPARK-10413) Model should support prediction on single instance

2016-02-09 Thread Rares Mirica (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138756#comment-15138756 ] Rares Mirica edited comment on SPARK-10413 at 2/9/16 10:35 AM: --- I don't

[jira] [Updated] (SPARK-13165) Replace deprecated synchronizedBuffer in streaming

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13165: -- Assignee: holdenk > Replace deprecated synchronizedBuffer in streaming >

[jira] [Resolved] (SPARK-13151) Investigate replacing SynchronizedBuffer as it is deprecated/unreliable

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13151. --- Resolution: Done > Investigate replacing SynchronizedBuffer as it is deprecated/unreliable >

[jira] [Updated] (SPARK-13086) Spark Shell for 2.11 does not allow loading files via '-i'

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13086: -- Assignee: Iulian Dragos > Spark Shell for 2.11 does not allow loading files via '-i' >

[jira] [Resolved] (SPARK-13086) Spark Shell for 2.11 does not allow loading files via '-i'

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13086. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10984

[jira] [Updated] (SPARK-13086) Spark Shell for 2.11 does not allow loading files via '-i'

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13086: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > Spark Shell for 2.11 does

[jira] [Resolved] (SPARK-10139) java.util.NoSuchElementException

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10139. --- Resolution: Won't Fix Not sure if this is actually a reproducible Spark issue, but if it's related

[jira] [Resolved] (SPARK-12110) spark-1.5.1-bin-hadoop2.6; pyspark.ml.feature Exception: ("You must build Spark with Hive

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12110. --- Resolution: Won't Fix Given it's a spark-ec2 issue, marking WontFix here >

[jira] [Assigned] (SPARK-12921) Use SparkHadoopUtil reflection to access TaskAttemptContext in SpecificParquetRecordReaderBase

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12921: Assignee: Josh Rosen (was: Apache Spark) > Use SparkHadoopUtil reflection to access

[jira] [Commented] (SPARK-13240) Having print in assigments (Python 3) causes SyntaxError

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138544#comment-15138544 ] Sean Owen commented on SPARK-13240: --- Is this a problem in Spark, or are you just stating something that

[jira] [Resolved] (SPARK-13177) Update ActorWordCount example to not directly use low level linked list as it is deprecated.

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13177. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 3

[jira] [Commented] (SPARK-9314) spark-ec2 cannot specify root EBS configuration

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138584#comment-15138584 ] Sean Owen commented on SPARK-9314: -- I'm bulk closing some EC2 issues as the ones that are still live can

[jira] [Resolved] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6218. -- Resolution: Won't Fix > Upgrade spark-ec2 from optparse to argparse >

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138586#comment-15138586 ] Sean Owen commented on SPARK-8684: -- I'm bulk closing some EC2 issues as the ones that are still live can

[jira] [Commented] (SPARK-10191) spark-ec2 cannot stop running cluster

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138581#comment-15138581 ] Sean Owen commented on SPARK-10191: --- I'm bulk closing some EC2 issues as the ones that are still live

[jira] [Resolved] (SPARK-10191) spark-ec2 cannot stop running cluster

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10191. --- Resolution: Won't Fix > spark-ec2 cannot stop running cluster >

[jira] [Commented] (SPARK-12022) spark-shell cannot run on master created with spark-ec2

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138582#comment-15138582 ] Sean Owen commented on SPARK-12022: --- I'm bulk closing some EC2 issues as the ones that are still live

[jira] [Commented] (SPARK-5971) Add Mesos support to spark-ec2

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138579#comment-15138579 ] Sean Owen commented on SPARK-5971: -- I'm bulk closing some EC2 issues as the ones that are still live can

[jira] [Commented] (SPARK-10002) SSH problem during Setup of Spark(1.3.0) cluster on EC2

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138587#comment-15138587 ] Sean Owen commented on SPARK-10002: --- I'm bulk closing some EC2 issues as the ones that are still live

[jira] [Resolved] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5629. -- Resolution: Won't Fix > Add spark-ec2 action to return info about an existing cluster >

[jira] [Resolved] (SPARK-10002) SSH problem during Setup of Spark(1.3.0) cluster on EC2

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10002. --- Resolution: Won't Fix > SSH problem during Setup of Spark(1.3.0) cluster on EC2 >

[jira] [Resolved] (SPARK-12121) Remote Spark init.sh called from spark_ec2.py points to incorrect prebuilt image URL

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12121. --- Resolution: Won't Fix > Remote Spark init.sh called from spark_ec2.py points to incorrect prebuilt

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138590#comment-15138590 ] Sean Owen commented on SPARK-5629: -- I'm bulk closing some EC2 issues as the ones that are still live can

[jira] [Resolved] (SPARK-5971) Add Mesos support to spark-ec2

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5971. -- Resolution: Won't Fix > Add Mesos support to spark-ec2 > -- > >

[jira] [Resolved] (SPARK-12022) spark-shell cannot run on master created with spark-ec2

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12022. --- Resolution: Won't Fix > spark-shell cannot run on master created with spark-ec2 >

[jira] [Closed] (SPARK-13240) Having print in assigments (Python 3) causes SyntaxError

2016-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sándor Kazi closed SPARK-13240. --- Resolution: Invalid There were incorrect path variables for PYSPARK_PYTHON (although there were no

[jira] [Updated] (SPARK-13176) Ignore deprecation warning for ProcessBuilder lines_!

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13176: -- Assignee: Jakob Odersky > Ignore deprecation warning for ProcessBuilder lines_! >

[jira] [Resolved] (SPARK-13165) Replace deprecated synchronizedBuffer in streaming

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13165. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11067

[jira] [Resolved] (SPARK-13176) Ignore deprecation warning for ProcessBuilder lines_!

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13176. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11098

[jira] [Updated] (SPARK-13186) Migrate away from SynchronizedMap which is deprecated

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13186: -- Summary: Migrate away from SynchronizedMap which is deprecated (was: Migrate away from

[jira] [Resolved] (SPARK-8960) Style cleanup of spark_ec2.py

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8960. -- Resolution: Won't Fix > Style cleanup of spark_ec2.py > - > >

[jira] [Resolved] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4888. -- Resolution: Won't Fix > Spark EC2 doesn't mount local disks for i2.8xlarge instances >

[jira] [Commented] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138588#comment-15138588 ] Sean Owen commented on SPARK-6218: -- I'm bulk closing some EC2 issues as the ones that are still live can

[jira] [Resolved] (SPARK-9314) spark-ec2 cannot specify root EBS configuration

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9314. -- Resolution: Won't Fix > spark-ec2 cannot specify root EBS configuration >

[jira] [Commented] (SPARK-12121) Remote Spark init.sh called from spark_ec2.py points to incorrect prebuilt image URL

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138583#comment-15138583 ] Sean Owen commented on SPARK-12121: --- I'm bulk closing some EC2 issues as the ones that are still live

[jira] [Resolved] (SPARK-9884) Submission scripts are broken on ec2 clusters started with spark-ec2 with private IP's

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9884. -- Resolution: Won't Fix > Submission scripts are broken on ec2 clusters started with spark-ec2 with >

[jira] [Commented] (SPARK-8960) Style cleanup of spark_ec2.py

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138585#comment-15138585 ] Sean Owen commented on SPARK-8960: -- I'm bulk closing some EC2 issues as the ones that are still live can

[jira] [Resolved] (SPARK-8684) Update R version in Spark EC2 AMI

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8684. -- Resolution: Won't Fix > Update R version in Spark EC2 AMI > - > >

[jira] [Commented] (SPARK-9884) Submission scripts are broken on ec2 clusters started with spark-ec2 with private IP's

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138580#comment-15138580 ] Sean Owen commented on SPARK-9884: -- I'm bulk closing some EC2 issues as the ones that are still live can

[jira] [Commented] (SPARK-4888) Spark EC2 doesn't mount local disks for i2.8xlarge instances

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138578#comment-15138578 ] Sean Owen commented on SPARK-4888: -- I'm bulk closing some EC2 issues as the ones that are still live can

[jira] [Created] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-09 Thread Steve Loughran (JIRA)
Steve Loughran created SPARK-13241: -- Summary: add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo Key: SPARK-13241 URL: https://issues.apache.org/jira/browse/SPARK-13241

[jira] [Commented] (SPARK-12921) Use SparkHadoopUtil reflection to access TaskAttemptContext in SpecificParquetRecordReaderBase

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138507#comment-15138507 ] Apache Spark commented on SPARK-12921: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12921) Use SparkHadoopUtil reflection to access TaskAttemptContext in SpecificParquetRecordReaderBase

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12921: Assignee: Apache Spark (was: Josh Rosen) > Use SparkHadoopUtil reflection to access

[jira] [Resolved] (SPARK-13040) JDBC using SPARK_CLASSPATH is deprecated but is the only way documented

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13040. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10948

[jira] [Updated] (SPARK-8964) Use Exchange in limit operations (per partition limit -> exchange to one partition -> per partition limit)

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8964: - Assignee: Josh Rosen > Use Exchange in limit operations (per partition limit -> exchange to one >

[jira] [Commented] (SPARK-13173) Fail to load CSV file with NPE

2016-02-09 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138744#comment-15138744 ] Liang-Chi Hsieh commented on SPARK-13173: - With latest build, I can't reproduce this bug. > Fail

[jira] [Commented] (SPARK-10413) Model should support prediction on single instance

2016-02-09 Thread Rares Mirica (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138756#comment-15138756 ] Rares Mirica commented on SPARK-10413: -- I don't know if I am reading this right but many times the

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-09 Thread sachin aggarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138498#comment-15138498 ] sachin aggarwal commented on SPARK-13172: - Now the question is where should I add this function

[jira] [Resolved] (SPARK-13200) Investigate math.round on integer number in MFDataGenerator.scala:109

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13200. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 2

[jira] [Updated] (SPARK-13201) Make a private non-deprecated version of setRuns

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13201: -- Assignee: holdenk > Make a private non-deprecated version of setRuns >

[jira] [Updated] (SPARK-13200) Investigate math.round on integer number in MFDataGenerator.scala:109

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13200: -- Assignee: holdenk > Investigate math.round on integer number in MFDataGenerator.scala:109 >

[jira] [Resolved] (SPARK-13201) Make a private non-deprecated version of setRuns

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13201. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 2

[jira] [Resolved] (SPARK-8869) DataFrameWriter save action makes DataFrameReader load failed

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8869. -- Resolution: Duplicate I think this is the same as several other "jets3t hangs" JIRAs. >

[jira] [Resolved] (SPARK-11509) ipython notebooks do not work on clusters created using spark-1.5.1-bin-hadoop2.6/ec2/spark-ec2 script

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11509. --- Resolution: Not A Problem > ipython notebooks do not work on clusters created using >

[jira] [Resolved] (SPARK-2563) Re-open sockets to handle connect timeouts

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2563. -- Resolution: Won't Fix > Re-open sockets to handle connect timeouts >

[jira] [Commented] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2016-02-09 Thread Rishabh Bhardwaj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138798#comment-15138798 ] Rishabh Bhardwaj commented on SPARK-12329: -- [~ashwinshankar77],[~marmbrus] I think we should

[jira] [Updated] (SPARK-13177) Update ActorWordCount example to not directly use low level linked list as it is deprecated.

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13177: -- Assignee: sachin aggarwal > Update ActorWordCount example to not directly use low level linked list as

[jira] [Commented] (SPARK-13172) Stop using RichException.getStackTrace it is deprecated

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138559#comment-15138559 ] Sean Owen commented on SPARK-13172: --- [~sachin aggarwal] [~jodersky] we already have

[jira] [Resolved] (SPARK-8898) Jets3t hangs with more than 1 core

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8898. -- Resolution: Not A Problem ... or perhaps obviated by the Hadoop 2.2 upgrade at this stage > Jets3t

[jira] [Resolved] (SPARK-9711) Unable to run spark after restarting cluster with spark-ec2

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9711. -- Resolution: Won't Fix > Unable to run spark after restarting cluster with spark-ec2 >

[jira] [Assigned] (SPARK-13016) Replace example code in mllib-dimensionality-reduction.md using include_example

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13016: Assignee: (was: Apache Spark) > Replace example code in

[jira] [Assigned] (SPARK-13016) Replace example code in mllib-dimensionality-reduction.md using include_example

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13016: Assignee: Apache Spark > Replace example code in mllib-dimensionality-reduction.md using

[jira] [Commented] (SPARK-13016) Replace example code in mllib-dimensionality-reduction.md using include_example

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138679#comment-15138679 ] Apache Spark commented on SPARK-13016: -- User 'devaraj-kavali' has created a pull request for this

[jira] [Updated] (SPARK-13170) Investigate replacing SynchronizedQueue as it is deprecated

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13170: -- Assignee: Sean Owen > Investigate replacing SynchronizedQueue as it is deprecated >

[jira] [Resolved] (SPARK-13170) Investigate replacing SynchronizedQueue as it is deprecated

2016-02-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13170. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 1

[jira] [Assigned] (SPARK-13142) Problem accessing Web UI /logPage/ on Microsoft Windows

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13142: Assignee: (was: Apache Spark) > Problem accessing Web UI /logPage/ on Microsoft

[jira] [Assigned] (SPARK-13142) Problem accessing Web UI /logPage/ on Microsoft Windows

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13142: Assignee: Apache Spark > Problem accessing Web UI /logPage/ on Microsoft Windows >

[jira] [Assigned] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13117: Assignee: Apache Spark > WebUI should use the local ip not 0.0.0.0 >

[jira] [Commented] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138846#comment-15138846 ] Apache Spark commented on SPARK-13117: -- User 'devaraj-kavali' has created a pull request for this

[jira] [Assigned] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13117: Assignee: (was: Apache Spark) > WebUI should use the local ip not 0.0.0.0 >

[jira] [Commented] (SPARK-12727) SQL generation support for distinct aggregation patterns that fit DistinctAggregationRewriter analysis rule

2016-02-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138930#comment-15138930 ] Xiao Li commented on SPARK-12727: - {code} Aggregate [a#16L], [a#16L,(count(if ((gid#23 = 2)) b#25L

[jira] [Commented] (SPARK-13203) Add scalastyle rule banning use of mutable.SynchronizedBuffer

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138951#comment-15138951 ] Apache Spark commented on SPARK-13203: -- User 'tedyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-13142) Problem accessing Web UI /logPage/ on Microsoft Windows

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139066#comment-15139066 ] Apache Spark commented on SPARK-13142: -- User 'markpavey' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12811) Estimator interface for generalized linear models (GLMs)

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12811: Assignee: Apache Spark (was: Yanbo Liang) > Estimator interface for generalized linear

[jira] [Assigned] (SPARK-12811) Estimator interface for generalized linear models (GLMs)

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12811: Assignee: Yanbo Liang (was: Apache Spark) > Estimator interface for generalized linear

[jira] [Commented] (SPARK-12811) Estimator interface for generalized linear models (GLMs)

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139084#comment-15139084 ] Apache Spark commented on SPARK-12811: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Created] (SPARK-13242) Moderately complex `when` expression causes code generation failure

2016-02-09 Thread Joe Halliwell (JIRA)
Joe Halliwell created SPARK-13242: - Summary: Moderately complex `when` expression causes code generation failure Key: SPARK-13242 URL: https://issues.apache.org/jira/browse/SPARK-13242 Project: Spark

[jira] [Commented] (SPARK-3146) Improve the flexibility of Spark Streaming Kafka API to offer user the ability to process message before storing into BM

2016-02-09 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139250#comment-15139250 ] Cody Koeninger commented on SPARK-3146: --- I think this can be safely closed, given the messageHandler

[jira] [Commented] (SPARK-13106) KafkaUtils.createDirectStream method with messageHandler and topics

2016-02-09 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139242#comment-15139242 ] Cody Koeninger commented on SPARK-13106: https://issues.apache.org/jira/browse/SPARK-10963 was

[jira] [Commented] (SPARK-7827) kafka streaming NotLeaderForPartition Exception could not be handled normally

2016-02-09 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139252#comment-15139252 ] Cody Koeninger commented on SPARK-7827: --- If there is no more information available on this, can we

[jira] [Assigned] (SPARK-12729) phantom references to replace the finalize call in python broadcast

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12729: Assignee: (was: Apache Spark) > phantom references to replace the finalize call in

[jira] [Assigned] (SPARK-12729) phantom references to replace the finalize call in python broadcast

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12729: Assignee: Apache Spark > phantom references to replace the finalize call in python

[jira] [Commented] (SPARK-13250) Make vectorized parquet reader work as the build side of a broadcast join

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139815#comment-15139815 ] Apache Spark commented on SPARK-13250: -- User 'nongli' has created a pull request for this issue:

[jira] [Created] (SPARK-13250) Make vectorized parquet reader work as the build side of a broadcast join

2016-02-09 Thread Nong Li (JIRA)
Nong Li created SPARK-13250: --- Summary: Make vectorized parquet reader work as the build side of a broadcast join Key: SPARK-13250 URL: https://issues.apache.org/jira/browse/SPARK-13250 Project: Spark

[jira] [Commented] (SPARK-13252) Bump up Kafka to 0.9.0.0

2016-02-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139916#comment-15139916 ] Apache Spark commented on SPARK-13252: -- User 'markgrover' has created a pull request for this issue:

[jira] [Commented] (SPARK-13174) Add API and options for csv data sources

2016-02-09 Thread Gayathri Murali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139900#comment-15139900 ] Gayathri Murali commented on SPARK-13174: - There is already a way to read CSV files by specifying

  1   2   3   >