[jira] [Resolved] (SPARK-12081) Make unified memory management work with small heaps

[ https://issues.apache.org/jira/browse/SPARK-12081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12081. --- Resolution: Fixed Fix Version/s: 1.6.0 > Make unified memory management work with small heaps

[jira] [Commented] (SPARK-12081) Make unified memory management work with small heaps

[ https://issues.apache.org/jira/browse/SPARK-12081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035219#comment-15035219 ] Andrew Or commented on SPARK-12081: --- The patch took approach (1) > Make unified memory management work

[jira] [Resolved] (SPARK-5106) Make Web UI automatically refresh/update displayed data

[ https://issues.apache.org/jira/browse/SPARK-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-5106. -- Resolution: Won't Fix > Make Web UI automatically refresh/update displayed data >

[jira] [Commented] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034405#comment-15034405 ] Andrew Or commented on SPARK-12062: --- Great, I've assigned it to you > Master rebuilding historical

[jira] [Updated] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12062: -- Assignee: Bryan Cutler > Master rebuilding historical SparkUI should be asynchronous >

[jira] [Commented] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034447#comment-15034447 ] Andrew Or commented on SPARK-8414: -- I'll submit a patch today. > Ensure ContextCleaner actually triggers

[jira] [Updated] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8414: - Target Version/s: 1.6.0 > Ensure ContextCleaner actually triggers clean ups >

[jira] [Updated] (SPARK-12059) Standalone Master assertion error

[ https://issues.apache.org/jira/browse/SPARK-12059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12059: -- Description: {code} 15/11/30 09:55:04 ERROR Inbox: Ignoring error java.lang.AssertionError: assertion

[jira] [Resolved] (SPARK-12037) Executors use heartbeatReceiverRef to report heartbeats and task metrics that might not be initialized and leads to NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12037. --- Resolution: Fixed Assignee: Nan Zhu Fix Version/s: 1.6.0 Target

[jira] [Resolved] (SPARK-12035) Add more debug information in include_example tag of Jekyll

[ https://issues.apache.org/jira/browse/SPARK-12035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12035. --- Resolution: Fixed Assignee: Xusen Yin Fix Version/s: 1.6.0 Target

[jira] [Resolved] (SPARK-12007) Network library's RPC layer requires a lot of copying

[ https://issues.apache.org/jira/browse/SPARK-12007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12007. --- Resolution: Fixed Fix Version/s: 1.6.0 > Network library's RPC layer requires a lot of

[jira] [Updated] (SPARK-12060) Avoid memory copy in JavaSerializerInstance.serialize

[ https://issues.apache.org/jira/browse/SPARK-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12060: -- Assignee: Shixiong Zhu > Avoid memory copy in JavaSerializerInstance.serialize >

[jira] [Updated] (SPARK-12007) Network library's RPC layer requires a lot of copying

[ https://issues.apache.org/jira/browse/SPARK-12007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12007: -- Affects Version/s: 1.6.0 Target Version/s: 1.6.0 > Network library's RPC layer requires a lot of

[jira] [Updated] (SPARK-12007) Network library's RPC layer requires a lot of copying

[ https://issues.apache.org/jira/browse/SPARK-12007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12007: -- Assignee: Marcelo Vanzin > Network library's RPC layer requires a lot of copying >

[jira] [Created] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

Andrew Or created SPARK-12062: - Summary: Master rebuilding historical SparkUI should be asynchronous Key: SPARK-12062 URL: https://issues.apache.org/jira/browse/SPARK-12062 Project: Spark Issue

[jira] [Updated] (SPARK-12060) Avoid memory copy in JavaSerializerInstance.serialize

[ https://issues.apache.org/jira/browse/SPARK-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12060: -- Target Version/s: 1.6.0 Component/s: Spark Core > Avoid memory copy in

[jira] [Created] (SPARK-12059) Standalone Master assertion error

Andrew Or created SPARK-12059: - Summary: Standalone Master assertion error Key: SPARK-12059 URL: https://issues.apache.org/jira/browse/SPARK-12059 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11999) ThreadUtils.newDaemonCachedThreadPool(prefix, maxThreadNumber) has unexpected behavior

[ https://issues.apache.org/jira/browse/SPARK-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11999: -- Assignee: Shixiong Zhu > ThreadUtils.newDaemonCachedThreadPool(prefix, maxThreadNumber) has >

[jira] [Resolved] (SPARK-10864) SparkUI: app name is hidden if window is resized

[ https://issues.apache.org/jira/browse/SPARK-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10864. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > SparkUI: app name

[jira] [Resolved] (SPARK-10558) Wrong executor state in standalone master because of wrong state transition

[ https://issues.apache.org/jira/browse/SPARK-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10558. --- Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 1.6.0 Target

[jira] [Updated] (SPARK-11880) On Windows spark-env.cmd is not loaded.

[ https://issues.apache.org/jira/browse/SPARK-11880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11880: -- Assignee: tawan > On Windows spark-env.cmd is not loaded. > --- >

[jira] [Resolved] (SPARK-11880) On Windows spark-env.cmd is not loaded.

[ https://issues.apache.org/jira/browse/SPARK-11880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11880. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > On Windows

[jira] [Updated] (SPARK-10864) SparkUI: app name is hidden if window is resized

[ https://issues.apache.org/jira/browse/SPARK-10864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10864: -- Assignee: Alexander Bozarth > SparkUI: app name is hidden if window is resized >

[jira] [Updated] (SPARK-11866) RpcEnv RPC timeouts can lead to errors, leak in transport library.

[ https://issues.apache.org/jira/browse/SPARK-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11866: -- Priority: Major (was: Minor) > RpcEnv RPC timeouts can lead to errors, leak in transport library. >

[jira] [Updated] (SPARK-11866) RpcEnv RPC timeouts can lead to errors, leak in transport library.

[ https://issues.apache.org/jira/browse/SPARK-11866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11866: -- Target Version/s: 1.6.0 > RpcEnv RPC timeouts can lead to errors, leak in transport library. >

[jira] [Updated] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11831: -- Target Version/s: 1.5.3, 1.6.0 > AkkaRpcEnvSuite is prone to port-contention-related flakiness >

[jira] [Updated] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11831: -- Labels: flaky-test (was: ) > AkkaRpcEnvSuite is prone to port-contention-related flakiness >

[jira] [Updated] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11831: -- Assignee: Shixiong Zhu > AkkaRpcEnvSuite is prone to port-contention-related flakiness >

[jira] [Updated] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11831: -- Component/s: Tests > AkkaRpcEnvSuite is prone to port-contention-related flakiness >

[jira] [Resolved] (SPARK-11845) Add unit tests to verify correct checkpointing of TrackStateRDD

[ https://issues.apache.org/jira/browse/SPARK-11845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11845. --- Resolution: Fixed Fix Version/s: 1.6.0 > Add unit tests to verify correct checkpointing of

[jira] [Commented] (SPARK-11843) Isolate staging directory across applications on same YARN cluster

[ https://issues.apache.org/jira/browse/SPARK-11843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014994#comment-15014994 ] Andrew Or commented on SPARK-11843: --- Oops, that seems to be the case. I'm closing this. > Isolate

[jira] [Resolved] (SPARK-11843) Isolate staging directory across applications on same YARN cluster

[ https://issues.apache.org/jira/browse/SPARK-11843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11843. --- Resolution: Won't Fix > Isolate staging directory across applications on same YARN cluster >

[jira] [Updated] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11831: -- Fix Version/s: 1.5.3 > AkkaRpcEnvSuite is prone to port-contention-related flakiness >

[jira] [Updated] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11831: -- Target Version/s: 1.5.3, 1.6.0 (was: 1.6.0) > AkkaRpcEnvSuite is prone to port-contention-related

[jira] [Commented] (SPARK-11278) PageRank fails with unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014892#comment-15014892 ] Andrew Or commented on SPARK-11278: --- thanks [~nravi] that's very helpful. > PageRank fails with

[jira] [Updated] (SPARK-11746) Use cache-aware method 'dependencies' to instead of 'getDependencies'

[ https://issues.apache.org/jira/browse/SPARK-11746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11746: -- Assignee: SuYan > Use cache-aware method 'dependencies' to instead of 'getDependencies' >

[jira] [Updated] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11831: -- Fix Version/s: 1.6.0 > AkkaRpcEnvSuite is prone to port-contention-related flakiness >

[jira] [Resolved] (SPARK-11828) DAGScheduler source registered too early with MetricsSystem

[ https://issues.apache.org/jira/browse/SPARK-11828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11828. --- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 Target

[jira] [Updated] (SPARK-11746) Use checkpoint-aware method 'dependencies' to instead of 'getDependencies'

[ https://issues.apache.org/jira/browse/SPARK-11746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11746: -- Summary: Use checkpoint-aware method 'dependencies' to instead of 'getDependencies' (was: Use

[jira] [Commented] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014648#comment-15014648 ] Andrew Or commented on SPARK-11831: --- do we need to backport this into 1.5? > AkkaRpcEnvSuite is prone

[jira] [Resolved] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11831. --- Resolution: Fixed > AkkaRpcEnvSuite is prone to port-contention-related flakiness >

[jira] [Updated] (SPARK-11831) AkkaRpcEnvSuite is prone to port-contention-related flakiness

[ https://issues.apache.org/jira/browse/SPARK-11831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11831: -- Target Version/s: 1.6.0 (was: 1.5.3, 1.6.0) > AkkaRpcEnvSuite is prone to port-contention-related

[jira] [Updated] (SPARK-11799) Make it explicit in executor logs that uncaught exceptions are thrown during executor shutdown

[ https://issues.apache.org/jira/browse/SPARK-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11799: -- Assignee: Srinivasa Reddy Vundela > Make it explicit in executor logs that uncaught exceptions are

[jira] [Resolved] (SPARK-11799) Make it explicit in executor logs that uncaught exceptions are thrown during executor shutdown

[ https://issues.apache.org/jira/browse/SPARK-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11799. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Make it explicit

[jira] [Resolved] (SPARK-11746) Use cache-aware method 'dependencies' to instead of 'getDependencies'

[ https://issues.apache.org/jira/browse/SPARK-11746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11746. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Use cache-aware

[jira] [Updated] (SPARK-4134) Dynamic allocation: tone down scary executor lost messages when killing on purpose

[ https://issues.apache.org/jira/browse/SPARK-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4134: - Assignee: Marcelo Vanzin (was: Andrew Or) > Dynamic allocation: tone down scary executor lost messages

[jira] [Updated] (SPARK-11809) Switch the default Mesos mode to coarse-grained mode

[ https://issues.apache.org/jira/browse/SPARK-11809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11809: -- Component/s: (was: SQL) Mesos > Switch the default Mesos mode to coarse-grained

[jira] [Closed] (SPARK-7471) DAG visualization: show call site information

[ https://issues.apache.org/jira/browse/SPARK-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7471. Resolution: Duplicate Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > DAG visualization:

[jira] [Updated] (SPARK-11700) Memory leak at SparkContext jobProgressListener stageIdToData map

[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11700: -- Assignee: Shixiong Zhu > Memory leak at SparkContext jobProgressListener stageIdToData map >

[jira] [Created] (SPARK-11843) Isolate staging directory across applications on same YARN cluster

Andrew Or created SPARK-11843: - Summary: Isolate staging directory across applications on same YARN cluster Key: SPARK-11843 URL: https://issues.apache.org/jira/browse/SPARK-11843 Project: Spark

[jira] [Commented] (SPARK-11278) PageRank fails with unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012638#comment-15012638 ] Andrew Or commented on SPARK-11278: --- also, when you said 6 nodes what kind of nodes are they? How much

[jira] [Commented] (SPARK-11649) "SparkListenerSuite.onTaskGettingResult() called when result fetched remotely" test is very slow

[ https://issues.apache.org/jira/browse/SPARK-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012601#comment-15012601 ] Andrew Or commented on SPARK-11649: --- I back ported it into 1.5. >

[jira] [Updated] (SPARK-11649) "SparkListenerSuite.onTaskGettingResult() called when result fetched remotely" test is very slow

[ https://issues.apache.org/jira/browse/SPARK-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11649: -- Target Version/s: 1.5.3, 1.6.0 (was: 1.6.0) > "SparkListenerSuite.onTaskGettingResult() called when

[jira] [Updated] (SPARK-11649) "SparkListenerSuite.onTaskGettingResult() called when result fetched remotely" test is very slow

[ https://issues.apache.org/jira/browse/SPARK-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11649: -- Fix Version/s: 1.5.3 > "SparkListenerSuite.onTaskGettingResult() called when result fetched >

[jira] [Commented] (SPARK-11649) "SparkListenerSuite.onTaskGettingResult() called when result fetched remotely" test is very slow

[ https://issues.apache.org/jira/browse/SPARK-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012598#comment-15012598 ] Andrew Or commented on SPARK-11649: --- oh I didn't realize, does the new RPC system have the same problem

[jira] [Commented] (SPARK-11278) PageRank fails with unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012632#comment-15012632 ] Andrew Or commented on SPARK-11278: --- [~nravi] can you try again with the latest 1.6 branch to see if

[jira] [Assigned] (SPARK-11278) PageRank fails with unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-11278: - Assignee: Andrew Or > PageRank fails with unified memory manager >

[jira] [Updated] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10985: -- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-1) > Avoid passing evicted blocks

[jira] [Updated] (SPARK-11309) Clean up hacky use of MemoryManager inside of HashedRelation

[ https://issues.apache.org/jira/browse/SPARK-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11309: -- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-1) > Clean up hacky use of

[jira] [Updated] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10985: -- Issue Type: Improvement (was: Bug) > Avoid passing evicted blocks throughout BlockManager /

[jira] [Updated] (SPARK-10985) Avoid passing evicted blocks throughout BlockManager / CacheManager

[ https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10985: -- Target Version/s: (was: 1.6.0) > Avoid passing evicted blocks throughout BlockManager / CacheManager

[jira] [Updated] (SPARK-11700) Memory leak at SparkContext jobProgressListener stageIdToData map

[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11700: -- Priority: Critical (was: Minor) > Memory leak at SparkContext jobProgressListener stageIdToData map >

[jira] [Updated] (SPARK-11700) Memory leak at SparkContext jobProgressListener stageIdToData map

[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11700: -- Target Version/s: 1.6.0 > Memory leak at SparkContext jobProgressListener stageIdToData map >

[jira] [Updated] (SPARK-11309) Clean up hacky use of MemoryManager inside of HashedRelation

[ https://issues.apache.org/jira/browse/SPARK-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11309: -- Issue Type: Improvement (was: Bug) > Clean up hacky use of MemoryManager inside of HashedRelation >

[jira] [Resolved] (SPARK-10930) History "Stages" page "duration" can be confusing

[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10930. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > History "Stages"

[jira] [Closed] (SPARK-7628) DAG visualization: position graphs with semantic awareness

[ https://issues.apache.org/jira/browse/SPARK-7628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7628. Resolution: Won't Fix > DAG visualization: position graphs with semantic awareness >

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7348: - Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-7463) > DAG visualization: add

[jira] [Resolved] (SPARK-7463) DAG visualization improvements

[ https://issues.apache.org/jira/browse/SPARK-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-7463. -- Resolution: Fixed Fix Version/s: 1.6.0 > DAG visualization improvements >

[jira] [Resolved] (SPARK-11649) "SparkListenerSuite.onTaskGettingResult() called when result fetched remotely" test is very slow

[ https://issues.apache.org/jira/browse/SPARK-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11649. --- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 >

[jira] [Closed] (SPARK-7349) DAG visualization: add legend to explain the content

[ https://issues.apache.org/jira/browse/SPARK-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7349. Resolution: Won't Fix > DAG visualization: add legend to explain the content >

[jira] [Closed] (SPARK-7465) DAG visualization: RDD dependencies not always shown

[ https://issues.apache.org/jira/browse/SPARK-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7465. Resolution: Won't Fix > DAG visualization: RDD dependencies not always shown >

[jira] [Updated] (SPARK-8716) Write tests for executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8716: - Target Version/s: (was: 1.6.0) > Write tests for executor shared cache feature >

[jira] [Resolved] (SPARK-9552) Dynamic allocation kills busy executors on race condition

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9552. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Dynamic allocation

[jira] [Resolved] (SPARK-11790) Flaky test: KafkaStreamTests.test_kafka_direct_stream_foreach_get_offsetRanges

[ https://issues.apache.org/jira/browse/SPARK-11790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11790. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 Target

[jira] [Resolved] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

[ https://issues.apache.org/jira/browse/SPARK-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11726. --- Resolution: Fixed Assignee: Jacek Laskowski Fix Version/s: 1.6.0 Target

[jira] [Resolved] (SPARK-11771) Maximum memory is determined by two params but error message only lists one.

[ https://issues.apache.org/jira/browse/SPARK-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11771. --- Resolution: Fixed Assignee: holdenk Fix Version/s: 1.6.0 Target

[jira] [Commented] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

[ https://issues.apache.org/jira/browse/SPARK-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010288#comment-15010288 ] Andrew Or commented on SPARK-11726: --- oops, fixed > Legacy Netty-RPC based submission in standalone

[jira] [Updated] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

[ https://issues.apache.org/jira/browse/SPARK-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11726: -- Assignee: Jacek Lewandowski (was: Jacek Laskowski) > Legacy Netty-RPC based submission in standalone

[jira] [Updated] (SPARK-11732) MiMa excludes miss private classes

[ https://issues.apache.org/jira/browse/SPARK-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11732: -- Target Version/s: 1.6.0 > MiMa excludes miss private classes > -- > >

[jira] [Updated] (SPARK-11732) MiMa excludes miss private classes

[ https://issues.apache.org/jira/browse/SPARK-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11732: -- Assignee: Tim Hunter > MiMa excludes miss private classes > -- > >

[jira] [Resolved] (SPARK-11480) Wrong callsite is displayed when using AsyncRDDActions#takeAsync

[ https://issues.apache.org/jira/browse/SPARK-11480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11480. --- Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 1.6.0 > Wrong callsite is

[jira] [Resolved] (SPARK-11710) Document new memory management model

[ https://issues.apache.org/jira/browse/SPARK-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11710. --- Resolution: Fixed Fix Version/s: 1.6.0 > Document new memory management model >

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8029: - Target Version/s: 1.5.3, 1.6.0 (was: 1.5.2, 1.6.0) > ShuffleMapTasks must be robust to concurrent

[jira] [Updated] (SPARK-7308) Should there be multiple concurrent attempts for one stage?

[ https://issues.apache.org/jira/browse/SPARK-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7308: - Assignee: Davies Liu > Should there be multiple concurrent attempts for one stage? >

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8029: - Description: When stages get retried, a task may have more than one attempt running at the same time, on

[jira] [Resolved] (SPARK-7829) SortShuffleWriter writes inconsistent data & index files on stage retry

[ https://issues.apache.org/jira/browse/SPARK-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-7829. -- Resolution: Fixed Assignee: Davies Liu (was: Imran Rashid) Fix Version/s:

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8029: - Description: When stages get retried, a task may have more than one attempt running at the same time, on

[jira] [Commented] (SPARK-7829) SortShuffleWriter writes inconsistent data & index files on stage retry

[ https://issues.apache.org/jira/browse/SPARK-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004780#comment-15004780 ] Andrew Or commented on SPARK-7829: -- I believe this is now fixed due to

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8029: - Fix Version/s: (was: 1.5.2) 1.5.3 > ShuffleMapTasks must be robust to concurrent

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8029: - Fix Version/s: 1.5.2 > ShuffleMapTasks must be robust to concurrent attempts on the same executor >

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004874#comment-15004874 ] Andrew Or commented on SPARK-8582: -- Hi everyone, I have bumped this to 1.7.0 because of the potential

[jira] [Updated] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8582: - Target Version/s: 1.7.0 (was: 1.6.0) > Optimize checkpointing to avoid computing an RDD twice >

[jira] [Commented] (SPARK-7308) Should there be multiple concurrent attempts for one stage?

[ https://issues.apache.org/jira/browse/SPARK-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004783#comment-15004783 ] Andrew Or commented on SPARK-7308: -- Should this still be open given that all associated JIRAs are closed?

[jira] [Resolved] (SPARK-7970) Optimize code for SQL queries fired on Union of RDDs (closure cleaner)

[ https://issues.apache.org/jira/browse/SPARK-7970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-7970. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Optimize code for SQL

[jira] [Created] (SPARK-11710) Document new memory management model

Andrew Or created SPARK-11710: - Summary: Document new memory management model Key: SPARK-11710 URL: https://issues.apache.org/jira/browse/SPARK-11710 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-11658) simplify documentation for PySpark combineByKey

[ https://issues.apache.org/jira/browse/SPARK-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11658. --- Resolution: Fixed Assignee: chris snow Fix Version/s: 1.7.0 Target

[jira] [Updated] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2533: - Assignee: Jean-Baptiste Onofré > Show summary of locality level of completed tasks in the each stage page

[jira] [Updated] (SPARK-11671) Example for sqlContext.createDataDrame from pandas.DataFrame has a typo

[ https://issues.apache.org/jira/browse/SPARK-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11671: -- Assignee: chris snow > Example for sqlContext.createDataDrame from pandas.DataFrame has a typo >

[jira] [Updated] (SPARK-11671) Example for sqlContext.createDataDrame from pandas.DataFrame has a typo

[ https://issues.apache.org/jira/browse/SPARK-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11671: -- Fix Version/s: (was: 1.7.0) 1.6.0 > Example for sqlContext.createDataDrame from

[jira] [Updated] (SPARK-11658) simplify documentation for PySpark combineByKey

[ https://issues.apache.org/jira/browse/SPARK-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11658: -- Fix Version/s: (was: 1.7.0) 1.6.0 > simplify documentation for PySpark

<    6   7   8   9   10   11   12   13   14   15   >