[
https://issues.apache.org/jira/browse/SPARK-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13298.
---
Resolution: Fixed
Fix Version/s: 2.0.0
1.6.1
> DAG visualization does not r
[
https://issues.apache.org/jira/browse/SPARK-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13298:
--
Target Version/s: 1.6.1, 2.0.0
> DAG visualization does not render correctly for jobs
> ---
[
https://issues.apache.org/jira/browse/SPARK-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12757:
--
Target Version/s: 2.0.0
> Use reference counting to prevent blocks from being evicted during reads
> --
[
https://issues.apache.org/jira/browse/SPARK-12583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12583:
--
Target Version/s: 2.0.0 (was: 1.6.1)
> spark shuffle fails with mesos after 2mins
> --
[
https://issues.apache.org/jira/browse/SPARK-10749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-10749.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Support multiple roles with Spark Mesos dispatcher
>
[
https://issues.apache.org/jira/browse/SPARK-13329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13329:
--
Summary: Considering output for statistics of logical plan (was:
Considering output for statistics of
[
https://issues.apache.org/jira/browse/SPARK-12864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12864:
--
Summary: Fetch failure from AM restart (was: initialize executorIdCounter
after ApplicationMaster kil
[
https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13054:
--
Comment: was deleted
(was: User 'andrewor14' has created a pull request for this issue:
https://github.
[
https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13371:
--
Assignee: Sean Owen
> TaskSetManager.dequeueSpeculativeTask compares Option[String] and String
> direc
[
https://issues.apache.org/jira/browse/SPARK-13371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13371.
---
Resolution: Fixed
Fix Version/s: 2.0.0
1.6.1
Target Version/s:
[
https://issues.apache.org/jira/browse/SPARK-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13344:
--
Summary: Tests have many "accumulator not found" exceptions (was:
SaveLoadSuite has many accumulator e
[
https://issues.apache.org/jira/browse/SPARK-13344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13344:
--
Description:
This is because SparkFunSuite clears all accumulators after every single test.
This suite
[
https://issues.apache.org/jira/browse/SPARK-13346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13346:
--
Summary: Using DataFrames iteratively leads to massive query plans, which
slows execution (was: DataFr
Andrew Or created SPARK-13344:
-
Summary: SaveLoadSuite has many accumulator exceptions
Key: SPARK-13344
URL: https://issues.apache.org/jira/browse/SPARK-13344
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147037#comment-15147037
]
Andrew Or commented on SPARK-13220:
---
I've assigned it to you
> Deprecate "yarn-client"
[
https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13220:
--
Target Version/s: 2.0.0
> Deprecate "yarn-client" and "yarn-cluster"
>
[
https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13220:
--
Assignee: Saisai Shao
> Deprecate "yarn-client" and "yarn-cluster"
> --
Andrew Or created SPARK-13269:
-
Summary: Expose more executor stats in stable status API
Key: SPARK-13269
URL: https://issues.apache.org/jira/browse/SPARK-13269
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13269:
--
Issue Type: Improvement (was: Bug)
> Expose more executor stats in stable status API
> ---
[
https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-5095.
--
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: 2.0.0
> Support launching mult
[
https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-9307:
-
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-11806
> Logging: Make it either stable or p
[
https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13220:
--
Description: We currently allow `\-\-master yarn-client`. Instead, the user
should do `\-\-master yarn
[
https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13220:
--
Description: We currently allow `\--master yarn-client`. Instead, the user
should do `--master yarn --d
[
https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-9307:
-
Assignee: Sean Owen
> Logging: Make it either stable or private[spark]
> -
[
https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13220:
--
Description: We currently allow `--master yarn-client`. Instead, the user
should do `--master yarn --de
[
https://issues.apache.org/jira/browse/SPARK-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-9307:
-
Affects Version/s: 1.0.0
Target Version/s: 2.0.0
> Logging: Make it either stable or private[spark]
>
[
https://issues.apache.org/jira/browse/SPARK-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13220:
--
Description: We currently allow `\-\-master yarn-client`. Instead, the user
should do `\-\-master yarn
[
https://issues.apache.org/jira/browse/SPARK-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or reassigned SPARK-13080:
-
Assignee: Andrew Or
> Implementation of the internal catalog API using Hive
> --
[
https://issues.apache.org/jira/browse/SPARK-13054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13054:
--
Comment: was deleted
(was: User 'andrewor14' has created a pull request for this issue:
https://github.
Andrew Or created SPARK-13220:
-
Summary: Deprecate "yarn-client" and "yarn-cluster"
Key: SPARK-13220
URL: https://issues.apache.org/jira/browse/SPARK-13220
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-13002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13002.
---
Resolution: Fixed
Assignee: Luc Bourlier
Fix Version/s: 2.0.0
> Mesos scheduler backe
[
https://issues.apache.org/jira/browse/SPARK-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13214:
--
Assignee: Bill Chambers
> Fix dynamic allocation docs
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13214.
---
Resolution: Fixed
Fix Version/s: 2.0.0
1.6.1
> Fix dynamic allocation docs
[
https://issues.apache.org/jira/browse/SPARK-13214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13214:
--
Affects Version/s: 1.6.0
Target Version/s: 1.6.1, 2.0.0
Component/s: Documentation
> Fix
[
https://issues.apache.org/jira/browse/SPARK-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13052:
--
Assignee: Raafat Akkad
> waitingApps metric doesn't show the number of apps currently in the WAITING
>
[
https://issues.apache.org/jira/browse/SPARK-13052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13052.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: 2.0.0
> waitingApps metric
[
https://issues.apache.org/jira/browse/SPARK-13168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13168.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Collapse adjacent Repartition operations
> --
[
https://issues.apache.org/jira/browse/SPARK-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13053.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Rectify ignored tests in InternalAccumulatorSuite
> -
[
https://issues.apache.org/jira/browse/SPARK-13162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13162.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Standalone mode does not respect `spark.dynamicAlloca
[
https://issues.apache.org/jira/browse/SPARK-13151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13151:
--
Target Version/s: 2.0.0
> Investigate replacing SynchronizedBuffer as it is deprecated/unreliable
> ---
[
https://issues.apache.org/jira/browse/SPARK-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13164.
---
Resolution: Fixed
Assignee: holdenk
Fix Version/s: 2.0.0
Target Version/s
[
https://issues.apache.org/jira/browse/SPARK-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12330.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: 2.0.0
> Mesos coarse execut
[
https://issues.apache.org/jira/browse/SPARK-13152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13152.
---
Resolution: Fixed
Assignee: holdenk
Fix Version/s: 2.0.0
Target Version/s
Andrew Or created SPARK-13162:
-
Summary: Standalone mode does not respect
`spark.dynamicAllocation.initialExecutors`
Key: SPARK-13162
URL: https://issues.apache.org/jira/browse/SPARK-13162
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13162:
--
Description: On the Master we always set `ApplicationInfo#executorLimit` to
infinity to start with.
>
[
https://issues.apache.org/jira/browse/SPARK-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13122.
---
Resolution: Fixed
Fix Version/s: 2.0.0
1.6.1
Target Version/s:
[
https://issues.apache.org/jira/browse/SPARK-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13122:
--
Assignee: Adam Budde
> Race condition in MemoryStore.unrollSafely() causes memory leak
> --
[
https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12790.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Remove HistoryServer old multiple files format
>
[
https://issues.apache.org/jira/browse/SPARK-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12637:
--
Assignee: Navis
> Print stage info of finished stages properly
> --
[
https://issues.apache.org/jira/browse/SPARK-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12637.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Print stage info of finished stages properly
> --
[
https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-11638:
--
Summary: Run Spark on Mesos with bridge networking (was: Apache Spark in
Docker with Bridge networking
[
https://issues.apache.org/jira/browse/SPARK-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15127083#comment-15127083
]
Andrew Or commented on SPARK-12423:
---
Is this resolved then now that its duplicate is re
[
https://issues.apache.org/jira/browse/SPARK-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12979.
---
Resolution: Fixed
Assignee: Iulian Dragos
Fix Version/s: 2.0.0
Target Ver
[
https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12265:
--
Assignee: Nilanjan Raychaudhuri (was: Iulian Dragos)
> Spark calls System.exit inside driver instead o
[
https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12265.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: 2.0.0
> Spark calls System.
[
https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12265:
--
Assignee: Iulian Dragos
> Spark calls System.exit inside driver instead of throwing exception
> ---
[
https://issues.apache.org/jira/browse/SPARK-10749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-10749:
--
Assignee: Timothy Chen
> Support multiple roles with Spark Mesos dispatcher
> -
[
https://issues.apache.org/jira/browse/SPARK-10749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-10749:
--
Target Version/s: 2.0.0
> Support multiple roles with Spark Mesos dispatcher
>
[
https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12465.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: 2.0.0
> Remove spark.deploy
[
https://issues.apache.org/jira/browse/SPARK-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12464.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: 2.0.0
> Remove spark.deploy
[
https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-10647.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: 2.0.0
> Mesos HA mode misus
[
https://issues.apache.org/jira/browse/SPARK-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12463.
---
Resolution: Fixed
Fix Version/s: 2.0.0
Target Version/s: 2.0.0
> Remove spark.deploy
[
https://issues.apache.org/jira/browse/SPARK-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12832:
--
Summary: Mesos cluster mode should handle constraints (was: spark on mesos
dispacher need a constraint
[
https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-6847:
-
Target Version/s: 2.0.0
> Stack overflow on updateStateByKey which followed by a dstream with
> checkpoin
[
https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-6847.
--
Resolution: Fixed
Fix Version/s: 2.0.0
> Stack overflow on updateStateByKey which followed by a d
[
https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13096.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Make AccumulatorSuite#verifyPeakExecutionMemorySet le
[
https://issues.apache.org/jira/browse/SPARK-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-13088.
---
Resolution: Fixed
Fix Version/s: 2.0.0
1.6.1
1.5.3
[
https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-10620.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Look into whether accumulator mechanism can replace T
[
https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13096:
--
Affects Version/s: 1.6.0
Target Version/s: 2.0.0
> Make AccumulatorSuite#verifyPeakExecutionMemory
Andrew Or created SPARK-13096:
-
Summary: Make AccumulatorSuite#verifyPeakExecutionMemorySet less
flaky
Key: SPARK-13096
URL: https://issues.apache.org/jira/browse/SPARK-13096
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13088:
--
Attachment: Screen Shot 2016-01-29 at 10.54.14 AM.png
> DAG viz does not work with latest version of ch
Andrew Or created SPARK-13088:
-
Summary: DAG viz does not work with latest version of chrome
Key: SPARK-13088
URL: https://issues.apache.org/jira/browse/SPARK-13088
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-13071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13071:
--
Description:
Currently if we do the following in Hadoop 2.5+:
{code}
sc.textFile(..., 4).coalesce(2).co
Andrew Or created SPARK-13071:
-
Summary: Coalescing HadoopRDD overwrites existing input metrics
Key: SPARK-13071
URL: https://issues.apache.org/jira/browse/SPARK-13071
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13055:
--
Component/s: SQL
> SQLHistoryListener throws ClassCastException
> -
Andrew Or created SPARK-13055:
-
Summary: SQLHistoryListener throws ClassCastException
Key: SPARK-13055
URL: https://issues.apache.org/jira/browse/SPARK-13055
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13053:
--
Target Version/s: 2.0.0
> Rectify ignored tests in InternalAccumulatorSuite
> -
[
https://issues.apache.org/jira/browse/SPARK-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13053:
--
Affects Version/s: 2.0.0
> Rectify ignored tests in InternalAccumulatorSuite
>
Andrew Or created SPARK-13054:
-
Summary: Always post TaskEnd event for tasks in cancelled stages
Key: SPARK-13054
URL: https://issues.apache.org/jira/browse/SPARK-13054
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-13053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-13053:
--
Description:
{code}
// TODO: these two tests are incorrect; they don't actually trigger stage
retries.
Andrew Or created SPARK-13053:
-
Summary: Rectify ignored tests in InternalAccumulatorSuite
Key: SPARK-13053
URL: https://issues.apache.org/jira/browse/SPARK-13053
Project: Spark
Issue Type: Bug
Andrew Or created SPARK-13051:
-
Summary: Do not maintain global singleton map for accumulators
Key: SPARK-13051
URL: https://issues.apache.org/jira/browse/SPARK-13051
Project: Spark
Issue Type: B
[
https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-10620:
--
Attachment: accums-and-task-metrics.pdf
> Look into whether accumulator mechanism can replace TaskMetri
[
https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-10620:
--
Attachment: (was: AccumulatorsandTaskMetricsinSpark2.0.pdf)
> Look into whether accumulator mechani
[
https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-10620:
--
Attachment: AccumulatorsandTaskMetricsinSpark2.0.pdf
> Look into whether accumulator mechanism can repl
[
https://issues.apache.org/jira/browse/SPARK-12887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-12887.
---
Resolution: Fixed
Fix Version/s: 2.0.0
> Do not expose var's in TaskMetrics
>
[
https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107169#comment-15107169
]
Andrew Or commented on SPARK-12790:
---
I've assigned this to you.
> Remove HistoryServer
[
https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12790:
--
Assignee: Felix Cheung
> Remove HistoryServer old multiple files format
> -
[
https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107167#comment-15107167
]
Andrew Or commented on SPARK-12790:
---
also updating all the tests that rely on the old f
[
https://issues.apache.org/jira/browse/SPARK-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107151#comment-15107151
]
Andrew Or commented on SPARK-12485:
---
[~srowen] to answer your question no I don't feel
[
https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12895:
--
Description:
We need to first do this before we can avoid sending TaskMetrics from the
executors to th
[
https://issues.apache.org/jira/browse/SPARK-12896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-12896:
--
Description:
Currently in Spark there are two different things that the executors send to
the driver,
Andrew Or created SPARK-12896:
-
Summary: Send only accumulator updates, not TaskMetrics, to the
driver
Key: SPARK-12896
URL: https://issues.apache.org/jira/browse/SPARK-12896
Project: Spark
Issu
Andrew Or created SPARK-12895:
-
Summary: Implement TaskMetrics using accumulators
Key: SPARK-12895
URL: https://issues.apache.org/jira/browse/SPARK-12895
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-10985.
---
Resolution: Fixed
Assignee: Josh Rosen
Fix Version/s: 2.0.0
Target Versio
[
https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-10620:
--
Comment: was deleted
(was: User 'andrewor14' has created a pull request for this issue:
https://github.
[
https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-10620:
--
Comment: was deleted
(was: User 'andrewor14' has created a pull request for this issue:
https://github.
Andrew Or created SPARK-12887:
-
Summary: Do not expose var's in TaskMetrics
Key: SPARK-12887
URL: https://issues.apache.org/jira/browse/SPARK-12887
Project: Spark
Issue Type: Sub-task
C
Andrew Or created SPARK-12885:
-
Summary: Rename 3 fields in ShuffleWriteMetrics
Key: SPARK-12885
URL: https://issues.apache.org/jira/browse/SPARK-12885
Project: Spark
Issue Type: Sub-task
Andrew Or created SPARK-12884:
-
Summary: Move *Metrics and *Accum* classes to their own files
Key: SPARK-12884
URL: https://issues.apache.org/jira/browse/SPARK-12884
Project: Spark
Issue Type: Su
401 - 500 of 3120 matches
Mail list logo
