[
https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236426#comment-15236426
]
Zhang, Liye commented on SPARK-13352:
-
[~davies], the last result for 500M should be 7.8 seconds, not
[
https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15234488#comment-15234488
]
Zhang, Liye edited comment on SPARK-13352 at 4/11/16 5:02 AM:
--
Hi [~davies],
[
https://issues.apache.org/jira/browse/SPARK-13352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15234488#comment-15234488
]
Zhang, Liye commented on SPARK-13352:
-
Hi [~davies], I think this JIRA is related with
[
https://issues.apache.org/jira/browse/SPARK-14290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-14290:
Description:
When netty transfer data that is not from *FileRegion*, data will be transfered
as
Zhang, Liye created SPARK-14290:
---
Summary: Fully utilize the network bandwidth for Netty RPC by
avoid significant underlying memory copy
Key: SPARK-14290
URL: https://issues.apache.org/jira/browse/SPARK-14290
Zhang, Liye created SPARK-14242:
---
Summary: avoid too many copies in network when a network frame is
large
Key: SPARK-14242
URL: https://issues.apache.org/jira/browse/SPARK-14242
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-12196:
Comment: was deleted
(was: I am out of office with limited email access from 12/21/2015 to
[
https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071354#comment-15071354
]
Zhang, Liye commented on SPARK-12196:
-
I am out of office with limited email access from 12/21/2015
[
https://issues.apache.org/jira/browse/SPARK-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye closed SPARK-10608.
---
Resolution: Later
> turn off reduce tasks locality as default to avoid bad cases
>
[
https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988674#comment-14988674
]
Zhang, Liye commented on SPARK-9103:
[~pwendell], [~andrewor14] would you please take a look at this
[
https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-9103:
---
Attachment: Tracking Spark Memory Usage - Phase 1.pdf
> Tracking spark's memory usage
>
[
https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-9103:
---
Attachment: (was: Tracking Spark Memory Usage - Phase 1.pdf)
> Tracking spark's memory usage
>
[
https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908404#comment-14908404
]
Zhang, Liye commented on SPARK-9103:
Hi @Imran Rashid, thanks for reviewing the doc.
{quote}
1) Will
[
https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908404#comment-14908404
]
Zhang, Liye edited comment on SPARK-9103 at 9/25/15 5:56 PM:
-
Hi [~irashid],
Zhang, Liye created SPARK-10609:
---
Summary: Improve task distribution strategy in taskSetManager
Key: SPARK-10609
URL: https://issues.apache.org/jira/browse/SPARK-10609
Project: Spark
Issue
Zhang, Liye created SPARK-10608:
---
Summary: turn off reduce tasks locality as default to avoid bad
cases
Key: SPARK-10608
URL: https://issues.apache.org/jira/browse/SPARK-10608
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-9212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-9212:
---
Description: In Netty version 4.0.29.Final, metrics for
PooledByteBufAllocator is exposed directly,
Zhang, Liye created SPARK-9212:
--
Summary: update Netty version to 4.0.29.Final for Netty Metrics
Key: SPARK-9212
URL: https://issues.apache.org/jira/browse/SPARK-9212
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-9044:
---
Comment: was deleted
(was: Well, I think the component is correct, still it's business of Web UI)
[
https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629704#comment-14629704
]
Zhang, Liye commented on SPARK-9044:
Well, I think the component is correct, still
[
https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629703#comment-14629703
]
Zhang, Liye commented on SPARK-9044:
Well, I think the component is correct, still
Zhang, Liye created SPARK-9104:
--
Summary: expose network layer memory usage in shuffle part
Key: SPARK-9104
URL: https://issues.apache.org/jira/browse/SPARK-9104
Project: Spark
Issue Type:
Zhang, Liye created SPARK-9105:
--
Summary: Add an additional WebUi Tab for Memory Usage
Key: SPARK-9105
URL: https://issues.apache.org/jira/browse/SPARK-9105
Project: Spark
Issue Type: Sub-task
Zhang, Liye created SPARK-9103:
--
Summary: Tracking spark's memory usage
Key: SPARK-9103
URL: https://issues.apache.org/jira/browse/SPARK-9103
Project: Spark
Issue Type: Umbrella
[
https://issues.apache.org/jira/browse/SPARK-9105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-9105:
---
Summary: Add an additional WebUI Tab for Memory Usage (was: Add an
additional WebUi Tab for Memory
Zhang, Liye created SPARK-9106:
--
Summary: Log the memory usage info into history server
Key: SPARK-9106
URL: https://issues.apache.org/jira/browse/SPARK-9106
Project: Spark
Issue Type: Sub-task
Zhang, Liye created SPARK-9107:
--
Summary: Add more information on Web UI for memory Usage
Key: SPARK-9107
URL: https://issues.apache.org/jira/browse/SPARK-9107
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-9103:
---
Description:
Currently spark only provides little memory usage information (RDD cache on
webUI) for
Zhang, Liye created SPARK-9108:
--
Summary: Expose Kryo serializer buffer size
Key: SPARK-9108
URL: https://issues.apache.org/jira/browse/SPARK-9108
Project: Spark
Issue Type: Sub-task
Zhang, Liye created SPARK-9111:
--
Summary: Dumping the memory info when an executor dies abnormally
Key: SPARK-9111
URL: https://issues.apache.org/jira/browse/SPARK-9111
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-9107:
---
Summary: Include memory usage for each job stage (was: Add more
information on Web UI for memory
[
https://issues.apache.org/jira/browse/SPARK-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-9107:
---
Component/s: Spark Core
Include memory usage for each job stage
[
https://issues.apache.org/jira/browse/SPARK-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630648#comment-14630648
]
Zhang, Liye commented on SPARK-9111:
Hi [~srowen], the memory dump mentioned here is
[
https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629119#comment-14629119
]
Zhang, Liye commented on SPARK-9044:
It doesn't matter where *RDDInfo* belongs to
[
https://issues.apache.org/jira/browse/SPARK-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627472#comment-14627472
]
Zhang, Liye commented on SPARK-9044:
It's a bug, since RDD is identified by rdd.id and
[
https://issues.apache.org/jira/browse/SPARK-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627487#comment-14627487
]
Zhang, Liye commented on SPARK-9025:
I cannot reproduce it either, the result is the
[
https://issues.apache.org/jira/browse/SPARK-6107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575538#comment-14575538
]
Zhang, Liye commented on SPARK-6107:
[~octavian], this is not in 1.3.1, it is fixed in
[
https://issues.apache.org/jira/browse/SPARK-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560266#comment-14560266
]
Zhang, Liye commented on SPARK-7865:
Thank [~vanzin]'s reply, I'm just thinking about
Zhang, Liye created SPARK-7865:
--
Summary: Hadoop Filesystem for eventlog closed before sparkContext
stopped
Key: SPARK-7865
URL: https://issues.apache.org/jira/browse/SPARK-7865
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558929#comment-14558929
]
Zhang, Liye commented on SPARK-7865:
@[~vanzin], @[~srowen]
Hadoop Filesystem for
[
https://issues.apache.org/jira/browse/SPARK-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-7865:
---
Description:
After [SPARK-3090|https://issues.apache.org/jira/browse/SPARK-3090] (patch
Zhang, Liye created SPARK-7854:
--
Summary: refine Kryo configuration limits test
Key: SPARK-7854
URL: https://issues.apache.org/jira/browse/SPARK-7854
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-6197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553600#comment-14553600
]
Zhang, Liye commented on SPARK-6197:
Hi [~Xia Hu], This Patch only solve the problem
Zhang, Liye created SPARK-7392:
--
Summary: Kryo buffer size can not be larger than 2M
Key: SPARK-7392
URL: https://issues.apache.org/jira/browse/SPARK-7392
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520694#comment-14520694
]
Zhang, Liye commented on SPARK-7189:
*=* is always need if we use timestamp as one of
[
https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520691#comment-14520691
]
Zhang, Liye commented on SPARK-7189:
Yes, we can use file size to monitor the file
[
https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520697#comment-14520697
]
Zhang, Liye commented on SPARK-7189:
Just redundant work, and we can leave it. And I
[
https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517136#comment-14517136
]
Zhang, Liye commented on SPARK-7189:
Yes, I think the current solution is a tradeoff,
[
https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518721#comment-14518721
]
Zhang, Liye commented on SPARK-7189:
Hi [~vanzin], I think using timestamp is not that
Zhang, Liye created SPARK-7189:
--
Summary: History server will always reload the same file if no log
file is updated
Key: SPARK-7189
URL: https://issues.apache.org/jira/browse/SPARK-7189
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-7189:
---
Summary: History server will always reload the same file even when no log
file is updated (was:
[
https://issues.apache.org/jira/browse/SPARK-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516436#comment-14516436
]
Zhang, Liye commented on SPARK-6314:
Hi [~srowen], this issue can be duplicate with
Zhang, Liye created SPARK-6676:
--
Summary: Add hadoop 2.4+ for profiles in POM.xml
Key: SPARK-6676
URL: https://issues.apache.org/jira/browse/SPARK-6676
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-6689:
---
Description:
when running unit test *YarnClusterSuite* with *hadoop-2.2*, exception will
throw
Zhang, Liye created SPARK-6689:
--
Summary: MiniYarnCLuster still test failed with hadoop-2.2
Key: SPARK-6689
URL: https://issues.apache.org/jira/browse/SPARK-6689
Project: Spark
Issue Type: Test
[
https://issues.apache.org/jira/browse/SPARK-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394000#comment-14394000
]
Zhang, Liye commented on SPARK-6689:
cc [~vanzin] [~srowen]
MiniYarnCLuster still
Zhang, Liye created SPARK-6197:
--
Summary: handle json parse exception for eventlog file not
finished writing
Key: SPARK-6197
URL: https://issues.apache.org/jira/browse/SPARK-6197
Project: Spark
Zhang, Liye created SPARK-6107:
--
Summary: event log file ends with .inprogress should be able to
display on webUI for standalone mode
Key: SPARK-6107
URL: https://issues.apache.org/jira/browse/SPARK-6107
[
https://issues.apache.org/jira/browse/SPARK-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-6078:
---
Description: when event log directory does not exists, spark just throw
IlleagalArgumentException and
Zhang, Liye created SPARK-6078:
--
Summary: create event log directory automatically if not exists
Key: SPARK-6078
URL: https://issues.apache.org/jira/browse/SPARK-6078
Project: Spark
Issue Type:
Zhang, Liye created SPARK-6036:
--
Summary: EventLog process logic has race condition with Akka actor
system
Key: SPARK-6036
URL: https://issues.apache.org/jira/browse/SPARK-6036
Project: Spark
Zhang, Liye created SPARK-4989:
--
Summary: wrong application configuration cause cluster down in
standalone mode
Key: SPARK-4989
URL: https://issues.apache.org/jira/browse/SPARK-4989
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4989:
---
Description:
when enabling eventlog in standalone mode, if give the wrong configuration, the
Zhang, Liye created SPARK-4991:
--
Summary: Worker should reconnect to Master when Master actor
restart
Key: SPARK-4991
URL: https://issues.apache.org/jira/browse/SPARK-4991
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259938#comment-14259938
]
Zhang, Liye commented on SPARK-4989:
An following JIRA is opened for resolving the
[
https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259938#comment-14259938
]
Zhang, Liye edited comment on SPARK-4989 at 12/29/14 2:39 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14259938#comment-14259938
]
Zhang, Liye edited comment on SPARK-4989 at 12/29/14 2:39 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260667#comment-14260667
]
Zhang, Liye commented on SPARK-4989:
Assume that we set
Zhang, Liye created SPARK-4954:
--
Summary: Add spark version information in log for standalone mode
Key: SPARK-4954
URL: https://issues.apache.org/jira/browse/SPARK-4954
Project: Spark
Issue
Zhang, Liye created SPARK-4933:
--
Summary: eventLog file not found after merging into a single file
Key: SPARK-4933
URL: https://issues.apache.org/jira/browse/SPARK-4933
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4933:
---
Description: enent log file not found exception will be thrown after making
eventLog into a single
[
https://issues.apache.org/jira/browse/SPARK-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4933:
---
Description: enent log file not found exception will be thrown after making
eventLog into a single
[
https://issues.apache.org/jira/browse/SPARK-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4933:
---
Description: enent log file not found exception will be thrown after making
eventLog into a single
[
https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256545#comment-14256545
]
Zhang, Liye commented on SPARK-4920:
Seems standalone mode is not with the version.
I
[
https://issues.apache.org/jira/browse/SPARK-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14256545#comment-14256545
]
Zhang, Liye edited comment on SPARK-4920 at 12/23/14 3:25 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4094:
---
Description:
rdd.checkpoint() must be called before any actions on this rdd, if there is any
other
[
https://issues.apache.org/jira/browse/SPARK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255367#comment-14255367
]
Zhang, Liye commented on SPARK-4094:
HI [~sowen], I'm also wondering why the original
[
https://issues.apache.org/jira/browse/SPARK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4094:
---
Description:
rdd.checkpoint() must be called before any actions on this rdd, if there is any
other
Zhang, Liye created SPARK-4870:
--
Summary: Add version information to driver log
Key: SPARK-4870
URL: https://issues.apache.org/jira/browse/SPARK-4870
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: repartition test.7z
Hi [~rxin], [~adav], I made several tests on HDDs and ramdisk with
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242656#comment-14242656
]
Zhang, Liye commented on SPARK-4740:
Hi [~adav], I missed there is another patch from
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241206#comment-14241206
]
Zhang, Liye commented on SPARK-4740:
Hi [~adav], [~rxin], I run the test with the
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: rxin_patch-on_4_node_cluster_48CoresPerNode(Unbalance).7z
Hi [~rxin], [~adav], I uploaded
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14238009#comment-14238009
]
Zhang, Liye edited comment on SPARK-4740 at 12/8/14 4:13 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237178#comment-14237178
]
Zhang, Liye commented on SPARK-4740:
[~pwendell], I have the same concern first, and I
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237178#comment-14237178
]
Zhang, Liye edited comment on SPARK-4740 at 12/7/14 3:32 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237179#comment-14237179
]
Zhang, Liye commented on SPARK-4740:
Hi [~adav], I kept speculation as default
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14236895#comment-14236895
]
Zhang, Liye commented on SPARK-4740:
Hi [~rxin], on my 4 node cluster, I just tested
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: (rxin patch normal executor)TestRunner sort-by-key - Thread
dump for executor 0
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: (rxin patch better executor)TestRunner sort-by-key - Thread
dump for executor
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237015#comment-14237015
]
Zhang, Liye commented on SPARK-4740:
Hi [~adav], I attached the jstack info for both
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14237019#comment-14237019
]
Zhang, Liye commented on SPARK-4740:
Hi [~adav],[~rxin] for the better executor, in
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: TestRunner sort-by-key - Thread dump for executor 1_files
(Nio-48 cores per node).zip
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: Spark-perf Test Report 16 Cores per Executor.pdf
Hi [~rxin] [~adav], the difference
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: Spark-perf Test Report.pdf
Netty's network bandwidth is much lower than NIO in
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234937#comment-14234937
]
Zhang, Liye commented on SPARK-4740:
We found this issue when we make the performance
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234941#comment-14234941
]
Zhang, Liye commented on SPARK-4740:
[~adav], I have tested by setting
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: TestRunner sort-by-key - Thread dump for executor 1_files (48
Cores per node).zip
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234983#comment-14234983
]
Zhang, Liye commented on SPARK-4740:
[~rxin] I attached the thread dump of one
[
https://issues.apache.org/jira/browse/SPARK-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhang, Liye updated SPARK-4740:
---
Attachment: (was: TestRunner sort-by-key - Thread dump for executor
1_files (48 Cores per
1 - 100 of 114 matches
Mail list logo
