[jira] [Resolved] (SPARK-5108) Need to make jackson dependency version consistent with hadoop-2.6.0.

[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5108. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3938

[jira] [Updated] (SPARK-5108) Need to make jackson dependency version consistent with hadoop-2.6.0.

[ https://issues.apache.org/jira/browse/SPARK-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5108: - Assignee: Zhan Zhang Need to make jackson dependency version consistent with hadoop-2.6.0.

[jira] [Created] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS

Sean Owen created SPARK-5669: Summary: Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS Key: SPARK-5669 URL: https://issues.apache.org/jira/browse/SPARK-5669 Project:

[jira] [Updated] (SPARK-2451) Enable to load config file for Akka

[ https://issues.apache.org/jira/browse/SPARK-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2451: - Component/s: Spark Core Priority: Minor (was: Major) Issue Type: Improvement (was: Bug)

[jira] [Updated] (SPARK-4617) Fix spark.yarn.applicationMaster.waitTries doc

[ https://issues.apache.org/jira/browse/SPARK-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4617: - Priority: Minor (was: Major) Is the change here to remove the doc for this property? the current code

[jira] [Updated] (SPARK-1061) allow Hadoop RDDs to be read w/ a partitioner

[ https://issues.apache.org/jira/browse/SPARK-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1061: Component/s: Spark Core allow Hadoop RDDs to be read w/ a partitioner

[jira] [Updated] (SPARK-5664) Restore stty settings when exiting for launching spark-shell from SBT

[ https://issues.apache.org/jira/browse/SPARK-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5664: Component/s: Build Restore stty settings when exiting for launching spark-shell from SBT

[jira] [Commented] (SPARK-4820) Spark build encounters File name too long on some encrypted filesystems

[ https://issues.apache.org/jira/browse/SPARK-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311061#comment-14311061 ] Jian Zhou commented on SPARK-4820: -- Encountered this issue in encfs, and this workaround

[jira] [Updated] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5524: --- Component/s: Spark Core Remove messy dependencies to log4j

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1430#comment-1430 ] Patrick Wendell commented on SPARK-5524: [~nchammas] I don't think this is related

[jira] [Updated] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5524: --- Component/s: (was: Build) Remove messy dependencies to log4j

[jira] [Created] (SPARK-5673) Implement Streaming wrapper for all linear methos

Kirill A. Korinskiy created SPARK-5673: -- Summary: Implement Streaming wrapper for all linear methos Key: SPARK-5673 URL: https://issues.apache.org/jira/browse/SPARK-5673 Project: Spark

[jira] [Resolved] (SPARK-4647) yarn-client mode reports success even though job fails

[ https://issues.apache.org/jira/browse/SPARK-4647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4647. -- Resolution: Duplicate Also duplicates SPARK-3293 yarn-client mode reports success even though job

[jira] [Resolved] (SPARK-5670) Spark artifacts compiled with Hadoop 1.x

[ https://issues.apache.org/jira/browse/SPARK-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5670. -- Resolution: Not a Problem This is another question that should be asked at user@, please. The

[jira] [Closed] (SPARK-3760) Add Twitter4j FilterQuery to spark streaming twitter API

[ https://issues.apache.org/jira/browse/SPARK-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Zhulenev closed SPARK-3760. -- Resolution: Won't Fix Add Twitter4j FilterQuery to spark streaming twitter API

[jira] [Updated] (SPARK-5080) Expose more cluster resource information to user

[ https://issues.apache.org/jira/browse/SPARK-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5080: Component/s: Spark Core Expose more cluster resource information to user

[jira] [Updated] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5524: Component/s: Build Remove messy dependencies to log4j --

[jira] [Resolved] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5671. --- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4454

[jira] [Updated] (SPARK-5156) Priority queue for cross application scheduling

[ https://issues.apache.org/jira/browse/SPARK-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5156: Component/s: Scheduler Priority queue for cross application scheduling

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311122#comment-14311122 ] Nicholas Chammas commented on SPARK-5524: - Oh my bad. Thanks for the correction.

[jira] [Commented] (SPARK-5669) Spark assembly includes incompatibly licensed libgfortran, libgcc code via JBLAS

[ https://issues.apache.org/jira/browse/SPARK-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310931#comment-14310931 ] Apache Spark commented on SPARK-5669: - User 'srowen' has created a pull request for

[jira] [Updated] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5626: - Component/s: Tests Spurious test failures due to NullPointerException in EasyMock test code

[jira] [Updated] (SPARK-4442) Move common unit test utilities into their own package / module

[ https://issues.apache.org/jira/browse/SPARK-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4442: - Component/s: Tests Move common unit test utilities into their own package / module

[jira] [Updated] (SPARK-4424) Clean up all SparkContexts in unit tests so that spark.driver.allowMultipleContexts can be false

[ https://issues.apache.org/jira/browse/SPARK-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4424: - Component/s: Tests Clean up all SparkContexts in unit tests so that spark.driver.allowMultipleContexts

[jira] [Updated] (SPARK-4746) integration tests should be separated from faster unit tests

[ https://issues.apache.org/jira/browse/SPARK-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4746: - Component/s: Tests integration tests should be separated from faster unit tests

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311012#comment-14311012 ] DeepakVohra commented on SPARK-5625: Spark artifacts are not in the Spark

[jira] [Commented] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

[ https://issues.apache.org/jira/browse/SPARK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311054#comment-14311054 ] Nicholas Chammas commented on SPARK-5668: - This sounds good to me, Miguel. I've

[jira] [Commented] (SPARK-5672) Don't return `ERROR 500` when have missing args

[ https://issues.apache.org/jira/browse/SPARK-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311059#comment-14311059 ] Apache Spark commented on SPARK-5672: - User 'catap' has created a pull request for

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311076#comment-14311076 ] DeepakVohra commented on SPARK-5625: The

[jira] [Resolved] (SPARK-5053) Test maintenance branches on Jenkins using SBT

[ https://issues.apache.org/jira/browse/SPARK-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5053. --- Resolution: Fixed Assignee: Josh Rosen I'm going to resolve this as fixed, since the scope of

[jira] [Created] (SPARK-5672) Don't return `ERROR 500` when have missing args

Kirill A. Korinskiy created SPARK-5672: -- Summary: Don't return `ERROR 500` when have missing args Key: SPARK-5672 URL: https://issues.apache.org/jira/browse/SPARK-5672 Project: Spark

[jira] [Updated] (SPARK-578) Fix interpreter code generation to only capture needed dependencies

[ https://issues.apache.org/jira/browse/SPARK-578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-578: Priority: Major Fix interpreter code generation to only capture needed dependencies

[jira] [Updated] (SPARK-540) Add API to customize in-memory representation of RDDs

[ https://issues.apache.org/jira/browse/SPARK-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-540: Priority: Minor Add API to customize in-memory representation of RDDs

[jira] [Updated] (SPARK-573) Clarify semantics of the parallelized closures

[ https://issues.apache.org/jira/browse/SPARK-573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-573: Priority: Minor Clarify semantics of the parallelized closures

[jira] [Resolved] (SPARK-5191) Pyspark: scheduler hangs when importing a standalone pyspark app

[ https://issues.apache.org/jira/browse/SPARK-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5191. --- Resolution: Not a Problem I'm going to resolve this as Not a Problem since the problem here lies with

[jira] [Created] (SPARK-5670) Spark artifacts compiled with Hadoop 1.x

DeepakVohra created SPARK-5670: -- Summary: Spark artifacts compiled with Hadoop 1.x Key: SPARK-5670 URL: https://issues.apache.org/jira/browse/SPARK-5670 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5670) Spark artifacts compiled with Hadoop 1.x

[ https://issues.apache.org/jira/browse/SPARK-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311031#comment-14311031 ] DeepakVohra commented on SPARK-5670: Not using Maven to run the Spark application to

[jira] [Updated] (SPARK-1142) Allow adding jars on app submission, outside of code

[ https://issues.apache.org/jira/browse/SPARK-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1142: Component/s: Spark Submit Allow adding jars on app submission, outside of code

[jira] [Updated] (SPARK-4383) Delay scheduling doesn't work right when jobs have tasks with different locality levels

[ https://issues.apache.org/jira/browse/SPARK-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4383: Component/s: Scheduler Delay scheduling doesn't work right when jobs have tasks with

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311121#comment-14311121 ] Nicholas Chammas commented on SPARK-5524: - Oh my bad. Thanks for the correction.

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311022#comment-14311022 ] Sean Owen commented on SPARK-5625: -- The assembly jar is not extracted. It's a jar file

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311029#comment-14311029 ] DeepakVohra commented on SPARK-5625: Thanks, yes the assembly jar has the Spark

[jira] [Updated] (SPARK-4808) Spark fails to spill with small number of large objects

[ https://issues.apache.org/jira/browse/SPARK-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4808: Component/s: Spark Core Spark fails to spill with small number of large objects

[jira] [Commented] (SPARK-5363) Spark 1.2 freeze without error notification

[ https://issues.apache.org/jira/browse/SPARK-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311050#comment-14311050 ] Nicholas Chammas commented on SPARK-5363: - [~TJKlein] - Can you provide more

[jira] [Commented] (SPARK-5628) Add option to return spark-ec2 version

[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311055#comment-14311055 ] Nicholas Chammas commented on SPARK-5628: - We still need a backport to 1.2.2 for

[jira] [Commented] (SPARK-5625) Spark binaries do not incude Spark Core

[ https://issues.apache.org/jira/browse/SPARK-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311073#comment-14311073 ] DeepakVohra commented on SPARK-5625: The

[jira] [Commented] (SPARK-3431) Parallelize Scala/Java test execution

[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311135#comment-14311135 ] Nicholas Chammas commented on SPARK-3431: - [~srowen] - Have you tried anything

[jira] [Resolved] (SPARK-1967) Using parallelize method to create RDD, wordcount app just hanging there without errors or warnings

[ https://issues.apache.org/jira/browse/SPARK-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1967. -- Resolution: Cannot Reproduce Using parallelize method to create RDD, wordcount app just hanging there

[jira] [Resolved] (SPARK-625) Client hangs when connecting to standalone cluster using wrong address

[ https://issues.apache.org/jira/browse/SPARK-625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-625. -- Resolution: Fixed Let's resolve this as Fixed for now. Reducing Akka's sensitivity to hostnames is a

[jira] [Commented] (SPARK-3760) Add Twitter4j FilterQuery to spark streaming twitter API

[ https://issues.apache.org/jira/browse/SPARK-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311010#comment-14311010 ] Sean Owen commented on SPARK-3760: -- The PR was abandoned. Is this WontFix? It kind of

[jira] [Commented] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.2 in hadoop-2.3 and hadoop-2.4 profiles

[ https://issues.apache.org/jira/browse/SPARK-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311017#comment-14311017 ] Apache Spark commented on SPARK-5671: - User 'JoshRosen' has created a pull request for

[jira] [Resolved] (SPARK-4383) Delay scheduling doesn't work right when jobs have tasks with different locality levels

[ https://issues.apache.org/jira/browse/SPARK-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-4383. --- Resolution: Fixed Fix Version/s: 1.3.0 Delay scheduling doesn't work right when jobs

[jira] [Updated] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

[ https://issues.apache.org/jira/browse/SPARK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5668: Labels: starter (was: ) spark_ec2.py region parameter could be either mandatory or its

[jira] [Resolved] (SPARK-5425) ConcurrentModificationException during SparkConf creation

[ https://issues.apache.org/jira/browse/SPARK-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5425. --- Resolution: Fixed Fix Version/s: 1.2.2 Target Version/s: (was: 1.2.2) I've merged

[jira] [Resolved] (SPARK-985) Support Job Cancellation on Mesos Scheduler

[ https://issues.apache.org/jira/browse/SPARK-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-985. -- Resolution: Fixed Fix Version/s: 1.1.1 1.2.0 I'm pretty sure that this was

[jira] [Created] (SPARK-5671) Bump jets3t version from 0.9.0 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles

Josh Rosen created SPARK-5671: - Summary: Bump jets3t version from 0.9.0 to 0.9.3 in hadoop-2.3 and hadoop-2.4 profiles Key: SPARK-5671 URL: https://issues.apache.org/jira/browse/SPARK-5671 Project: Spark

[jira] [Updated] (SPARK-5363) Spark 1.2 freeze without error notification

[ https://issues.apache.org/jira/browse/SPARK-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5363: Component/s: PySpark Spark 1.2 freeze without error notification

[jira] [Updated] (SPARK-5175) bug in updating counters when starting multiple workers/supervisors in actor-based receiver

[ https://issues.apache.org/jira/browse/SPARK-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5175: Component/s: (was: Spark Core) Streaming bug in updating counters

[jira] [Updated] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5259: Component/s: Spark Core Fix endless retry stage by add task equal() and hashcode() to

[jira] [Updated] (SPARK-5175) bug in updating counters when starting multiple workers/supervisors in actor-based receiver

[ https://issues.apache.org/jira/browse/SPARK-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5175: Component/s: Spark Core bug in updating counters when starting multiple

[jira] [Issue Comment Deleted] (SPARK-5524) Remove messy dependencies to log4j

[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5524: Comment: was deleted (was: Oh my bad. Thanks for the correction.) Remove messy

[jira] [Updated] (SPARK-5673) Implement Streaming wrapper for all linear methos

[ https://issues.apache.org/jira/browse/SPARK-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirill A. Korinskiy updated SPARK-5673: --- Description: Now spark had streaming wrapper for Logistic and Linear regressions

<    1   2