[jira] [Assigned] (MAPREDUCE-6877) Assign map task preferentially to the data node where the split is on faster storage type

[ https://issues.apache.org/jira/browse/MAPREDUCE-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned MAPREDUCE-6877: Assignee: Tim Yao > Assign map task preferentially to the data node where the split is

[jira] [Updated] (MAPREDUCE-6877) Assign map task preferentially to the data node where the split is on faster storage type

[ https://issues.apache.org/jira/browse/MAPREDUCE-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6877: - Description: It would be good to use SSD in HDFS to improve reading/writing performance.

[jira] [Updated] (MAPREDUCE-6780) Add support for striping files in benchmarking of TeraGen and TeraSort

[ https://issues.apache.org/jira/browse/MAPREDUCE-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6780: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (MAPREDUCE-6780) Add support for striping files in benchmarking of TeraGen and TeraSort

[ https://issues.apache.org/jira/browse/MAPREDUCE-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6780: - Summary: Add support for striping files in benchmarking of TeraGen and TeraSort (was: Add

[jira] [Commented] (MAPREDUCE-6780) Add support for HDFS directory with erasure code policy to TeraGen and TeraSort

[ https://issues.apache.org/jira/browse/MAPREDUCE-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559673#comment-15559673 ] Kai Zheng commented on MAPREDUCE-6780: -- Thanks [~Sammi] for the update per our off-line reviewing

[jira] [Commented] (MAPREDUCE-6706) Update TaskUmbilicalProtocol to use ProtobufRPCEngine

[ https://issues.apache.org/jira/browse/MAPREDUCE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500842#comment-15500842 ] Kai Zheng commented on MAPREDUCE-6706: -- Hi [~djp], Thanks for your feedback in time and it's

[jira] [Updated] (MAPREDUCE-6706) Update TaskUmbilicalProtocol to use ProtobufRPCEngine

[ https://issues.apache.org/jira/browse/MAPREDUCE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6706: - Assignee: Wei Zhou (was: Kai Zheng) > Update TaskUmbilicalProtocol to use ProtobufRPCEngine

[jira] [Updated] (MAPREDUCE-6774) Add support for HDFS erasure code policy to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6774: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (MAPREDUCE-6706) Update TaskUmbilicalProtocol to use ProtobufRPCEngine

[ https://issues.apache.org/jira/browse/MAPREDUCE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497879#comment-15497879 ] Kai Zheng commented on MAPREDUCE-6706: -- Thank you Arun! > Update TaskUmbilicalProtocol to use

[jira] [Commented] (MAPREDUCE-6706) Update TaskUmbilicalProtocol to use ProtobufRPCEngine

[ https://issues.apache.org/jira/browse/MAPREDUCE-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497869#comment-15497869 ] Kai Zheng commented on MAPREDUCE-6706: -- Hi [~asuresh], Will you work on this? If you don't mind,

[jira] [Commented] (MAPREDUCE-6705) Task failing continuously on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497853#comment-15497853 ] Kai Zheng commented on MAPREDUCE-6705: -- Sorry for the late response, [~bibinchundatt]. Yes I

[jira] [Resolved] (MAPREDUCE-6705) Task failing continuously on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved MAPREDUCE-6705. -- Resolution: Duplicate Resolved this as a duplicate. > Task failing continuously on trunk >

[jira] [Commented] (MAPREDUCE-6774) Add support for HDFS erasure code policy to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491630#comment-15491630 ] Kai Zheng commented on MAPREDUCE-6774: -- Thanks Sammi for the update! The latest patch LGTM and

[jira] [Commented] (MAPREDUCE-6774) Add support for HDFS erasure code policy to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488709#comment-15488709 ] Kai Zheng commented on MAPREDUCE-6774: -- Thanks Sammi for the update! It looks good and only some

[jira] [Commented] (MAPREDUCE-6774) Add support for HDFS erasure code policy to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486603#comment-15486603 ] Kai Zheng commented on MAPREDUCE-6774: -- So given above, the following can then be: {code} +if

[jira] [Commented] (MAPREDUCE-6774) Add support for HDFS erasure code policy to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486600#comment-15486600 ] Kai Zheng commented on MAPREDUCE-6774: -- Thanks [~Sammi] for the work! It looks good overall.

[jira] [Updated] (MAPREDUCE-6775) Fix MapReduce failures caused by default RPC engine changing

[ https://issues.apache.org/jira/browse/MAPREDUCE-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6775: - Resolution: Invalid Status: Resolved (was: Patch Available) Resolved this as it will

[jira] [Updated] (MAPREDUCE-6775) Fix MapReduce failures caused by default RPC engine changing

[ https://issues.apache.org/jira/browse/MAPREDUCE-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6775: - Status: Patch Available (was: Open) > Fix MapReduce failures caused by default RPC engine

[jira] [Updated] (MAPREDUCE-6775) Fix MapReduce failures caused by default RPC engine changing

[ https://issues.apache.org/jira/browse/MAPREDUCE-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6775: - Attachment: MAPREDUCE-6775-v1.patch Provided a fix to change back the default RPC engine. >

[jira] [Created] (MAPREDUCE-6775) Fix MapReduce failures caused by default RPC engine changing

Kai Zheng created MAPREDUCE-6775: Summary: Fix MapReduce failures caused by default RPC engine changing Key: MAPREDUCE-6775 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6775 Project: Hadoop

[jira] [Updated] (MAPREDUCE-6774) Add support for HDFS erasure code policy to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6774: - Assignee: SammiChen > Add support for HDFS erasure code policy to TestDFSIO >

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435019#comment-15435019 ] Kai Zheng commented on MAPREDUCE-6578: -- Please ignore the above messy building message. It

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha1

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Attachment: MAPREDUCE-6578.04.patch This fixed the minor style. > Add support for HDFS

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434999#comment-15434999 ] Kai Zheng commented on MAPREDUCE-6578: -- +1 on the updated patch except the minor style. Will

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Attachment: MAPREDUCE-6578.03.patch Uploading the updated patch provided by [~Sammi]. Thanks!

[jira] [Commented] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434072#comment-15434072 ] Kai Zheng commented on MAPREDUCE-6578: -- Thanks [~zhouwei] for the work and [~Sammi] for the

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Attachment: MAPREDUCE-6578.02.patch [~Sammi] helped updating the patch. Uploading it for her.

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Status: Patch Available (was: Open) > Add support for HDFS heterogeneous storage testing to

[jira] [Updated] (MAPREDUCE-6578) Add support for HDFS heterogeneous storage testing to TestDFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6578: - Attachment: MAPREDUCE-6578.01.patch Rebased the patch. > Add support for HDFS heterogeneous

[jira] [Updated] (MAPREDUCE-6729) Accurately compute the test execute time in DFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6729: - Attachment: MAPREDUCE-6729.002.patch Re-uploaded the same patch to trigger the building. >

[jira] [Commented] (MAPREDUCE-6729) Accurately compute the test execute time in DFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366096#comment-15366096 ] Kai Zheng commented on MAPREDUCE-6729: -- [~mingleizhang], Would you please rename your patch like

[jira] [Updated] (MAPREDUCE-6729) Accurately compute the test execute time in DFSIO

[ https://issues.apache.org/jira/browse/MAPREDUCE-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6729: - Summary: Accurately compute the test execute time in DFSIO (was: Hitting performance and

[jira] [Commented] (MAPREDUCE-6729) Hitting performance and error when lots of files to write or read

[ https://issues.apache.org/jira/browse/MAPREDUCE-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366074#comment-15366074 ] Kai Zheng commented on MAPREDUCE-6729: -- Thanks [~mingleizhang] for the reporting and

[jira] [Updated] (MAPREDUCE-6729) Hitting performance and error when lots of files to write or read

[ https://issues.apache.org/jira/browse/MAPREDUCE-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6729: - Assignee: mingleizhang (was: mingleizhang) > Hitting performance and error when lots of

[jira] [Updated] (MAPREDUCE-6729) Hitting performance and error when lots of files to write or read

[ https://issues.apache.org/jira/browse/MAPREDUCE-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated MAPREDUCE-6729: - Assignee: mingleizhang > Hitting performance and error when lots of files to write or read >

[jira] [Commented] (MAPREDUCE-6705) Task failing continuously on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307061#comment-15307061 ] Kai Zheng commented on MAPREDUCE-6705: -- HADOOP-12579 was reverted to avoid this and

[jira] [Commented] (MAPREDUCE-6705) Task failing continuously on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306488#comment-15306488 ] Kai Zheng commented on MAPREDUCE-6705: -- YarnChild uses TaskUmbilicalProtocol which still relies

[jira] [Assigned] (MAPREDUCE-6705) Task failing continuously on trunk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned MAPREDUCE-6705: Assignee: Kai Zheng > Task failing continuously on trunk >