[jira] [Commented] (SPARK-1605) Improve mllib.linalg.Vector

2014-04-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979380#comment-13979380 ] Sean Owen commented on SPARK-1605: -- I think this was on purpose, to try to hide breeze as

[jira] [Resolved] (SPARK-1540) Investigate whether we should require keys in PairRDD to be Comparable

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1540. -- Resolution: Fixed Resolved here: https://github.com/apache/spark/pull/487/files. We were able

[jira] [Commented] (SPARK-1540) Investigate whether we should require keys in PairRDD to be Comparable

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979393#comment-13979393 ] Matei Zaharia commented on SPARK-1540: -- Note that it will remain to add this to the

[jira] [Reopened] (SPARK-1494) Hive Dependencies being checked by MIMA

2014-04-24 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-1494: - Hive Dependencies being checked by MIMA ---

[jira] [Commented] (SPARK-1590) Recommend to use FindBugs

2014-04-24 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979505#comment-13979505 ] Shixiong Zhu commented on SPARK-1590: - Agree that a period scanning is better then

[jira] [Commented] (SPARK-1593) Add status command to Spark Daemons(master/worker)

2014-04-24 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979541#comment-13979541 ] Sandeep Singh commented on SPARK-1593: -- Make a pull request. Add status command to

[jira] [Commented] (SPARK-1608) Cast.nullable should be true when cast from StringType to NumericType/TimestampType

2014-04-24 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979559#comment-13979559 ] Takuya Ueshin commented on SPARK-1608: -- Pull-requested:

[jira] [Created] (SPARK-1609) Executor fails to start

2014-04-24 Thread witgo (JIRA)
witgo created SPARK-1609: Summary: Executor fails to start Key: SPARK-1609 URL: https://issues.apache.org/jira/browse/SPARK-1609 Project: Spark Issue Type: Bug Components: Spark Core

[jira] [Updated] (SPARK-1609) Executor fails to start when use spark-submit

2014-04-24 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] witgo updated SPARK-1609: - Summary: Executor fails to start when use spark-submit (was: Executor fails to start) Executor fails to start

[jira] [Updated] (SPARK-1600) flaky test case in streaming.CheckpointSuite

2014-04-24 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1600: --- Component/s: Streaming Affects Version/s: 0.9.1 1.0.0

[jira] [Commented] (SPARK-1610) Cast from BooleanType to NumericType should use exact type value.

2014-04-24 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979618#comment-13979618 ] Takuya Ueshin commented on SPARK-1610: -- Pull-requested:

[jira] [Commented] (SPARK-1604) YARN cluster mode broken

2014-04-24 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979624#comment-13979624 ] Kan Zhang commented on SPARK-1604: -- I doubt it, since when I ran it in YARN client mode,

[jira] [Created] (SPARK-1611) Incorrect initialization order in AppendOnlyMap

2014-04-24 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-1611: --- Summary: Incorrect initialization order in AppendOnlyMap Key: SPARK-1611 URL: https://issues.apache.org/jira/browse/SPARK-1611 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-1583) Use java.util.HashMap.remove by mistake in BlockManagerMasterActor.removeBlockManager

2014-04-24 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-1583. - Resolution: Fixed Fix Version/s: 1.0.0 Use java.util.HashMap.remove by mistake in

[jira] [Updated] (SPARK-1609) Executor fails to start when use spark-submit

2014-04-24 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] witgo updated SPARK-1609: - Attachment: (was: spark.log) Executor fails to start when use spark-submit

[jira] [Created] (SPARK-1612) Potential resource leaks in Utils.copyStream and Utils.offsetBytes

2014-04-24 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-1612: --- Summary: Potential resource leaks in Utils.copyStream and Utils.offsetBytes Key: SPARK-1612 URL: https://issues.apache.org/jira/browse/SPARK-1612 Project: Spark

[jira] [Updated] (SPARK-1612) Potential resource leaks in Utils.copyStream and Utils.offsetBytes

2014-04-24 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-1612: Labels: easyfix (was: ) Potential resource leaks in Utils.copyStream and Utils.offsetBytes

[jira] [Commented] (SPARK-1612) Potential resource leaks in Utils.copyStream and Utils.offsetBytes

2014-04-24 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979752#comment-13979752 ] Shixiong Zhu commented on SPARK-1612: - PR: https://github.com/apache/spark/pull/535

[jira] [Created] (SPARK-1613) Difficulty starting up cluster on Amazon EC2

2014-04-24 Thread Johnny King (JIRA)
Johnny King created SPARK-1613: -- Summary: Difficulty starting up cluster on Amazon EC2 Key: SPARK-1613 URL: https://issues.apache.org/jira/browse/SPARK-1613 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-1614) Move Mesos protobufs out of TaskState

2014-04-24 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-1614: Summary: Move Mesos protobufs out of TaskState Key: SPARK-1614 URL: https://issues.apache.org/jira/browse/SPARK-1614 Project: Spark Issue

[jira] [Updated] (SPARK-1609) Executor fails to start when use spark-submit

2014-04-24 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] witgo updated SPARK-1609: - Attachment: (was: spark.log) Executor fails to start when use spark-submit

[jira] [Created] (SPARK-1615) Very subtle race condition in SparkListenerSuite

2014-04-24 Thread Andrew Or (JIRA)
Andrew Or created SPARK-1615: Summary: Very subtle race condition in SparkListenerSuite Key: SPARK-1615 URL: https://issues.apache.org/jira/browse/SPARK-1615 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1604) YARN cluster mode broken

2014-04-24 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-1604: - Component/s: (was: YARN) Build YARN cluster mode broken

[jira] [Updated] (SPARK-1615) Very subtle race condition in SparkListenerSuite

2014-04-24 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-1615: - Description: Much of SparkListenerSuite relies on LiveListenerBus's waitUntilEmpty() method. As the

[jira] [Comment Edited] (SPARK-1604) Couldn't run spark-submit with yarn cluster mode when using deps jar

2014-04-24 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979994#comment-13979994 ] Kan Zhang edited comment on SPARK-1604 at 4/24/14 5:38 PM: --- Ah,

[jira] [Commented] (SPARK-1604) Couldn't run spark-submit with yarn cluster mode when using deps jar

2014-04-24 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1398#comment-1398 ] Thomas Graves commented on SPARK-1604: -- if its just in that particular sequence of

[jira] [Updated] (SPARK-1604) Couldn't run spark-submit with yarn cluster mode when using deps jar

2014-04-24 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated SPARK-1604: - Priority: Major (was: Blocker) Couldn't run spark-submit with yarn cluster mode when using deps jar

[jira] [Commented] (SPARK-1604) Couldn't run spark-submit with yarn cluster mode when using deps jar

2014-04-24 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980003#comment-13980003 ] Kan Zhang commented on SPARK-1604: -- Sure, lowered it to Major. Couldn't run

[jira] [Commented] (SPARK-1573) slight modification with regards to sbt/sbt test

2014-04-24 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980015#comment-13980015 ] Nishkam Ravi commented on SPARK-1573: - In the documentation at the bottom of this

[jira] [Updated] (SPARK-1575) failing tests with master branch

2014-04-24 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1575: Priority: Blocker (was: Major) failing tests with master branch

[jira] [Commented] (SPARK-1571) UnresolvedException when running JavaSparkSQL example

2014-04-24 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980034#comment-13980034 ] Kan Zhang commented on SPARK-1571: -- Thanks, it worked. UnresolvedException when running

[jira] [Updated] (SPARK-1548) Add Partial Random Forest algorithm to MLlib

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1548: - Assignee: Jason Day Add Partial Random Forest algorithm to MLlib

[jira] [Resolved] (SPARK-1527) rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, rootDir1

2014-04-24 Thread Niraj Suthar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niraj Suthar resolved SPARK-1527. - Resolution: Fixed rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0,

[jira] [Updated] (SPARK-1616) input file not found issue

2014-04-24 Thread prasad potipireddi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] prasad potipireddi updated SPARK-1616: -- Summary: input file not found issue (was: input availability) input file not found

[jira] [Commented] (SPARK-1616) input availability

2014-04-24 Thread prasad potipireddi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980164#comment-13980164 ] prasad potipireddi commented on SPARK-1616: --- Env: I have setup spark

[jira] [Commented] (SPARK-1527) rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, rootDir1

2014-04-24 Thread Niraj Suthar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980185#comment-13980185 ] Niraj Suthar commented on SPARK-1527: - Sure Ye Xianjin, I am more thn happy to do so.

[jira] [Commented] (SPARK-1557) Set permissions on event log files/directories

2014-04-24 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980213#comment-13980213 ] Thomas Graves commented on SPARK-1557: -- https://github.com/apache/spark/pull/538

[jira] [Resolved] (SPARK-1490) Add kerberos support to the HistoryServer

2014-04-24 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-1490. -- Resolution: Fixed Fix Version/s: 1.0.0 Add kerberos support to the HistoryServer

[jira] [Created] (SPARK-1618) Socket receiver not restarting properly when connection is refused

2014-04-24 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-1618: Summary: Socket receiver not restarting properly when connection is refused Key: SPARK-1618 URL: https://issues.apache.org/jira/browse/SPARK-1618 Project: Spark

[jira] [Assigned] (SPARK-1619) Spark shell should use spark-submit

2014-04-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1619: -- Assignee: Patrick Wendell Spark shell should use spark-submit

[jira] [Updated] (SPARK-1619) Spark shell should use spark-submit

2014-04-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1619: --- Priority: Blocker (was: Major) Spark shell should use spark-submit

[jira] [Created] (SPARK-1619) Spark shell should use spark-submit

2014-04-24 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1619: -- Summary: Spark shell should use spark-submit Key: SPARK-1619 URL: https://issues.apache.org/jira/browse/SPARK-1619 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-928: Priority: Major (was: Minor) Add support for Unsafe-based serializer in Kryo 2.22

[jira] [Created] (SPARK-1620) Uncaught exception from Akka scheduler

2014-04-24 Thread Mark Hamstra (JIRA)
Mark Hamstra created SPARK-1620: --- Summary: Uncaught exception from Akka scheduler Key: SPARK-1620 URL: https://issues.apache.org/jira/browse/SPARK-1620 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-928: Priority: Minor (was: Major) Add support for Unsafe-based serializer in Kryo 2.22

[jira] [Resolved] (SPARK-1104) Worker should not block while killing executors

2014-04-24 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-1104. --- Resolution: Fixed Fix Version/s: 1.0.0 Worker should not block while killing

[jira] [Assigned] (SPARK-1621) Update Chill to 0.3.6

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia reassigned SPARK-1621: Assignee: Matei Zaharia Update Chill to 0.3.6 -

[jira] [Created] (SPARK-1621) Update Chill to 0.3.6

2014-04-24 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-1621: Summary: Update Chill to 0.3.6 Key: SPARK-1621 URL: https://issues.apache.org/jira/browse/SPARK-1621 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980471#comment-13980471 ] Matei Zaharia commented on SPARK-928: - This probably can't be fixed in 1.0.0 because no

[jira] [Updated] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-1438: - Assignee: Arun Ramakrishnan Update RDD.sample() API to make seed parameter optional

[jira] [Resolved] (SPARK-1438) Update RDD.sample() API to make seed parameter optional

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1438. -- Resolution: Fixed Update RDD.sample() API to make seed parameter optional

[jira] [Commented] (SPARK-1340) Some Spark Streaming receivers are not restarted when worker fails

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980595#comment-13980595 ] Tathagata Das commented on SPARK-1340: -- I havent explicitly tested this, but this

[jira] [Comment Edited] (SPARK-1340) Some Spark Streaming receivers are not restarted when worker fails

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980595#comment-13980595 ] Tathagata Das edited comment on SPARK-1340 at 4/25/14 1:34 AM:

[jira] [Resolved] (SPARK-1489) Fix the HistoryServer view acls

2014-04-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1489. Resolution: Fixed Fix Version/s: 1.0.0 Fix the HistoryServer view acls

[jira] [Commented] (SPARK-1609) Executor fails to start when use spark-submit

2014-04-24 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980637#comment-13980637 ] witgo commented on SPARK-1609: -- Spark Executor Command: /opt/jdk1.8.0/bin/java -cp

[jira] [Created] (SPARK-1623) Broadcast cleaner should use getCononicalPath when deleting files by name

2014-04-24 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1623: -- Summary: Broadcast cleaner should use getCononicalPath when deleting files by name Key: SPARK-1623 URL: https://issues.apache.org/jira/browse/SPARK-1623 Project:

[jira] [Updated] (SPARK-1609) Executor fails to start when Command.extraJavaOptions contains multiple Java options

2014-04-24 Thread witgo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] witgo updated SPARK-1609: - Summary: Executor fails to start when Command.extraJavaOptions contains multiple Java options (was: Executor

[jira] [Resolved] (SPARK-986) Add job cancellation to PySpark

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-986. - Resolution: Fixed Add job cancellation to PySpark ---

[jira] [Updated] (SPARK-986) Add job cancellation to PySpark

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-986: Affects Version/s: (was: 0.9.0) Add job cancellation to PySpark

[jira] [Updated] (SPARK-986) Add job cancellation to PySpark

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-986: Fix Version/s: 1.0.0 Add job cancellation to PySpark ---

[jira] [Updated] (SPARK-986) Add job cancellation to PySpark

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-986: Assignee: Ahir Reddy Add job cancellation to PySpark ---

[jira] [Resolved] (SPARK-1586) Fix issues with spark development under windows

2014-04-24 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1586. -- Resolution: Fixed Fix Version/s: 1.0.0 Fix issues with spark development under windows

[jira] [Resolved] (SPARK-1584) Upgrade Flume dependency to 1.4.0

2014-04-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1584. Resolution: Fixed Assignee: Ted Malaska (was: Sandy Ryza) Upgrade Flume dependency

[jira] [Commented] (SPARK-1617) Exposing receiver state and errors in the streaming UI

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980681#comment-13980681 ] Tathagata Das commented on SPARK-1617: -- https://github.com/apache/spark/pull/540/

[jira] [Resolved] (SPARK-1618) Socket receiver not restarting properly when connection is refused

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1618. -- Resolution: Fixed Socket receiver not restarting properly when connection is refused

[jira] [Updated] (SPARK-1618) Socket receiver not restarting properly when connection is refused

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1618: - Fix Version/s: 1.0.0 Socket receiver not restarting properly when connection is refused

[jira] [Resolved] (SPARK-1617) Exposing receiver state and errors in the streaming UI

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1617. -- Resolution: Fixed Exposing receiver state and errors in the streaming UI

[jira] [Updated] (SPARK-1592) Old streaming input blocks not removed automatically from the BlockManagers

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-1592: - Fix Version/s: 1.0.0 Old streaming input blocks not removed automatically from the

[jira] [Resolved] (SPARK-1510) Add Spark Streaming metrics source for metrics system

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1510. -- Resolution: Fixed Fix Version/s: 1.0.0 https://github.com/apache/spark/pull/545 Add

[jira] [Resolved] (SPARK-1592) Old streaming input blocks not removed automatically from the BlockManagers

2014-04-24 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-1592. -- Resolution: Fixed https://github.com/apache/spark/pull/512 Old streaming input blocks not

[jira] [Created] (SPARK-1624) addShutdownHook in DiskBlockManager Doesn't work the way it is supposed to work

2014-04-24 Thread Sandeep Singh (JIRA)
Sandeep Singh created SPARK-1624: Summary: addShutdownHook in DiskBlockManager Doesn't work the way it is supposed to work Key: SPARK-1624 URL: https://issues.apache.org/jira/browse/SPARK-1624

[jira] [Commented] (SPARK-1624) addShutdownHook in DiskBlockManager Doesn't work the way it is supposed to work

2014-04-24 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980706#comment-13980706 ] Sandeep Singh commented on SPARK-1624: -- https://github.com/apache/spark/pull/527

[jira] [Closed] (SPARK-1624) addShutdownHook in DiskBlockManager Doesn't work the way it is supposed to work

2014-04-24 Thread Sandeep Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh closed SPARK-1624. Resolution: Not a Problem addShutdownHook in DiskBlockManager Doesn't work the way it is supposed

[jira] [Assigned] (SPARK-1623) Broadcast cleaner should use getCononicalPath when deleting files by name

2014-04-24 Thread Niraj Suthar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niraj Suthar reassigned SPARK-1623: --- Assignee: Niraj Suthar Broadcast cleaner should use getCononicalPath when deleting files by

[jira] [Updated] (SPARK-1623) SPARK-1623. Broadcast cleaner should use getCanonicalPath when deleting files by name

2014-04-24 Thread Niraj Suthar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niraj Suthar updated SPARK-1623: Summary: SPARK-1623. Broadcast cleaner should use getCanonicalPath when deleting files by name