[jira] [Resolved] (MAPREDUCE-7371) DistributedCache alternative APIs should not use DistributedCache APIs internally
[ https://issues.apache.org/jira/browse/MAPREDUCE-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved MAPREDUCE-7371. - Fix Version/s: 3.4.0 Resolution: Fixed > DistributedCache alternative APIs should not use DistributedCache APIs > internally > - > > Key: MAPREDUCE-7371 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7371 > Project: Hadoop Map/Reduce > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 2h 10m > Remaining Estimate: 0h > > DistributedCache has been deprecated long back and it's still being used as > of today. However, all the alternative Job APIs (for deprecated > DistributedCache APIs) still internally use DistributedCache APIs only, this > is a deadlock and it leaves no room for removal of DistributedCache APIs in > future. We should move core logic to Job or JobContext as required and let > deprecated DistributedCache APIs point to the right alternatives internally. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Resolved] (MAPREDUCE-7354) Use empty array constants present in TaskCompletionEvent to avoid creating redundant objects
[ https://issues.apache.org/jira/browse/MAPREDUCE-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved MAPREDUCE-7354. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > Use empty array constants present in TaskCompletionEvent to avoid creating > redundant objects > > > Key: MAPREDUCE-7354 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7354 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.4.0, 3.3.2 > > Time Spent: 1h 20m > Remaining Estimate: 0h > > As per one of the suggestions over PR#3115 (HDFS-16075), we should use empty > array constant present in TaskCompletionEvent to avoid creating redundant > objects. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Resolved] (MAPREDUCE-7350) Replace Guava Lists usage by Hadoop's own Lists in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved MAPREDUCE-7350. - Fix Version/s: 3.4.0 Resolution: Fixed > Replace Guava Lists usage by Hadoop's own Lists in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7350 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7350 > Project: Hadoop Map/Reduce > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (MAPREDUCE-7184) TestJobCounters#getFileSize can ignore crc file
[
https://issues.apache.org/jira/browse/MAPREDUCE-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765950#comment-16765950
]
Takanobu Asanuma edited comment on MAPREDUCE-7184 at 2/12/19 11:33 AM:
---
[~Prabhu Joseph] Thanks for reporting the issue and uploading the patch.
The errors occur after HADOOP-15229 is merged. Looks like the BYTES_READ
counter considered length of crc files until then. I'm not sure whether
\{{TestJobCounters#getFileSize}} can ignore crc file.
[~ste...@apache.org] Could you take a look?
was (Author: tasanuma0829):
[~Prabhu Joseph] Thanks for reporting the issue and uploading the patch.
The errors occur after HADOOP-15229 is merged. Looks like the BYTES_READ
counter considered length of crc files until then. So I'm not sure the patch is
right.
[~ste...@apache.org] Could you take a look?
> TestJobCounters#getFileSize can ignore crc file
> ---
>
> Key: MAPREDUCE-7184
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7184
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
> Attachments: MAPREDUCE-7184-001.patch, MAPREDUCE-7184-002.patch,
> MAPREDUCE-7184-003.patch
>
>
> TestJobCounters test cases are failing in trunk while validating the input
> files size with BYTES_READ by the job. The crc files are considered in
> getFileSize whereas the job FileInputFormat ignores them.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7184) TestJobCounters#getFileSize can ignore crc file
[ https://issues.apache.org/jira/browse/MAPREDUCE-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765950#comment-16765950 ] Takanobu Asanuma commented on MAPREDUCE-7184: - [~Prabhu Joseph] Thanks for reporting the issue and uploading the patch. The errors occur after HADOOP-15229 is merged. Looks like the BYTES_READ counter considered length of crc files until then. So I'm not sure the patch is right. [~ste...@apache.org] Could you take a look? > TestJobCounters#getFileSize can ignore crc file > --- > > Key: MAPREDUCE-7184 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7184 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Attachments: MAPREDUCE-7184-001.patch, MAPREDUCE-7184-002.patch, > MAPREDUCE-7184-003.patch > > > TestJobCounters test cases are failing in trunk while validating the input > files size with BYTES_READ by the job. The crc files are considered in > getFileSize whereas the job FileInputFormat ignores them. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[
https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765947#comment-16765947
]
Takanobu Asanuma commented on MAPREDUCE-7099:
-
[~ste...@apache.org] The errors in your last comment are related to another
issue, MAPREDUCE-7184. Let's fix it first.
> Daily test result fails in MapReduce JobClient though there isn't any error
> ---
>
> Key: MAPREDUCE-7099
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build, test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
>
> Looks like the test result in MapReduce JobClient always fails lately. Please
> see the results of hadoop-qbt-trunk-java8-linux-x86:
>
> [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> {noformat}
> [INFO] Results:
> [INFO]
> [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
> [INFO]
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:06 h
> [INFO] Finished at: 2018-05-30T12:32:39+00:00
> [INFO] Final Memory: 25M/645M
> [INFO]
>
> [WARNING] The requested profile "parallel-tests" could not be activated
> because it does not exist.
> [WARNING] The requested profile "shelltest" could not be activated because it
> does not exist.
> [WARNING] The requested profile "native" could not be activated because it
> does not exist.
> [WARNING] The requested profile "yarn-ui" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
> project hadoop-mapreduce-client-jobclient: There was a timeout or other error
> in the fork -> [Help 1]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[
https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16762102#comment-16762102
]
Takanobu Asanuma commented on MAPREDUCE-7099:
-
Thanks for the investigation, [~ste...@apache.org]. I'm not very familiar with
timeout setting at the moment.
I don't have time this week. I will check it the next week.
> Daily test result fails in MapReduce JobClient though there isn't any error
> ---
>
> Key: MAPREDUCE-7099
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build, test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
>
> Looks like the test result in MapReduce JobClient always fails lately. Please
> see the results of hadoop-qbt-trunk-java8-linux-x86:
>
> [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> {noformat}
> [INFO] Results:
> [INFO]
> [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
> [INFO]
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:06 h
> [INFO] Finished at: 2018-05-30T12:32:39+00:00
> [INFO] Final Memory: 25M/645M
> [INFO]
>
> [WARNING] The requested profile "parallel-tests" could not be activated
> because it does not exist.
> [WARNING] The requested profile "shelltest" could not be activated because it
> does not exist.
> [WARNING] The requested profile "native" could not be activated because it
> does not exist.
> [WARNING] The requested profile "yarn-ui" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
> project hadoop-mapreduce-client-jobclient: There was a timeout or other error
> in the fork -> [Help 1]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[
https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745266#comment-16745266
]
Takanobu Asanuma commented on MAPREDUCE-7099:
-
Yes, the latest qbt result still reported the issue.
{noformat}
[WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
[INFO]
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 02:06 h
[INFO] Finished at: 2019-01-17T12:02:07+00:00
[INFO] Final Memory: 29M/610M
[INFO]
{noformat}
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1019/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> Daily test result fails in MapReduce JobClient though there isn't any error
> ---
>
> Key: MAPREDUCE-7099
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build, test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
>
> Looks like the test result in MapReduce JobClient always fails lately. Please
> see the results of hadoop-qbt-trunk-java8-linux-x86:
>
> [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> {noformat}
> [INFO] Results:
> [INFO]
> [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
> [INFO]
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:06 h
> [INFO] Finished at: 2018-05-30T12:32:39+00:00
> [INFO] Final Memory: 25M/645M
> [INFO]
>
> [WARNING] The requested profile "parallel-tests" could not be activated
> because it does not exist.
> [WARNING] The requested profile "shelltest" could not be activated because it
> does not exist.
> [WARNING] The requested profile "native" could not be activated because it
> does not exist.
> [WARNING] The requested profile "yarn-ui" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
> project hadoop-mapreduce-client-jobclient: There was a timeout or other error
> in the fork -> [Help 1]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[
https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499623#comment-16499623
]
Takanobu Asanuma commented on MAPREDUCE-7099:
-
Thanks for reporting it, [~miklos.szeg...@cloudera.com]. I haven't found the
cause yet. I will further investigate the tests you reported.
> Daily test result fails in MapReduce JobClient though there isn't any error
> ---
>
> Key: MAPREDUCE-7099
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build, test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
>
> Looks like the test result in MapReduce JobClient always fails lately. Please
> see the results of hadoop-qbt-trunk-java8-linux-x86:
>
> [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> {noformat}
> [INFO] Results:
> [INFO]
> [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
> [INFO]
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:06 h
> [INFO] Finished at: 2018-05-30T12:32:39+00:00
> [INFO] Final Memory: 25M/645M
> [INFO]
>
> [WARNING] The requested profile "parallel-tests" could not be activated
> because it does not exist.
> [WARNING] The requested profile "shelltest" could not be activated because it
> does not exist.
> [WARNING] The requested profile "native" could not be activated because it
> does not exist.
> [WARNING] The requested profile "yarn-ui" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
> project hadoop-mapreduce-client-jobclient: There was a timeout or other error
> in the fork -> [Help 1]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[
https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7099:
Summary: Daily test result fails in MapReduce JobClient though there isn't
any error (was: Daily tests fail in MapReduce JobClient though there isn't any
error)
> Daily test result fails in MapReduce JobClient though there isn't any error
> ---
>
> Key: MAPREDUCE-7099
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build, test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
>
> Looks like the test result in MapReduce JobClient always fails lately. Please
> see the results of hadoop-qbt-trunk-java8-linux-x86:
>
> [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> {noformat}
> [INFO] Results:
> [INFO]
> [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
> [INFO]
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:06 h
> [INFO] Finished at: 2018-05-30T12:32:39+00:00
> [INFO] Final Memory: 25M/645M
> [INFO]
>
> [WARNING] The requested profile "parallel-tests" could not be activated
> because it does not exist.
> [WARNING] The requested profile "shelltest" could not be activated because it
> does not exist.
> [WARNING] The requested profile "native" could not be activated because it
> does not exist.
> [WARNING] The requested profile "yarn-ui" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
> project hadoop-mapreduce-client-jobclient: There was a timeout or other error
> in the fork -> [Help 1]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7099) Daily tests fail in MapReduce JobClient though there isn't any error
[
https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7099:
Description:
Looks like the test result in MapReduce JobClient always fails lately. Please
see the results of hadoop-qbt-trunk-java8-linux-x86:
[https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
{noformat}
[INFO] Results:
[INFO]
[WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
[INFO]
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 02:06 h
[INFO] Finished at: 2018-05-30T12:32:39+00:00
[INFO] Final Memory: 25M/645M
[INFO]
[WARNING] The requested profile "parallel-tests" could not be activated because
it does not exist.
[WARNING] The requested profile "shelltest" could not be activated because it
does not exist.
[WARNING] The requested profile "native" could not be activated because it does
not exist.
[WARNING] The requested profile "yarn-ui" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
project hadoop-mapreduce-client-jobclient: There was a timeout or other error
in the fork -> [Help 1]
{noformat}
was:
Looks like the build always fails lately. Please see the results of
hadoop-qbt-trunk-java8-linux-x86:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86//artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
{noformat}
[INFO] Results:
[INFO]
[WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
[INFO]
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 02:06 h
[INFO] Finished at: 2018-05-30T12:32:39+00:00
[INFO] Final Memory: 25M/645M
[INFO]
[WARNING] The requested profile "parallel-tests" could not be activated because
it does not exist.
[WARNING] The requested profile "shelltest" could not be activated because it
does not exist.
[WARNING] The requested profile "native" could not be activated because it does
not exist.
[WARNING] The requested profile "yarn-ui" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
project hadoop-mapreduce-client-jobclient: There was a timeout or other error
in the fork -> [Help 1]
{noformat}
> Daily tests fail in MapReduce JobClient though there isn't any error
>
>
> Key: MAPREDUCE-7099
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build, test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
>
> Looks like the test result in MapReduce JobClient always fails lately. Please
> see the results of hadoop-qbt-trunk-java8-linux-x86:
>
> [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> {noformat}
> [INFO] Results:
> [INFO]
> [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
> [INFO]
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:06 h
> [INFO] Finished at: 2018-05-30T12:32:39+00:00
> [INFO] Final Memory: 25M/645M
> [INFO]
>
> [WARNING] The requested profile "parallel-tests" could not be activated
> because it does not exist.
> [WARNING] The requested profile "shelltest" could not be activated because it
> does not exist.
> [WARNING] The requested profile "native" could not be activated because it
> does not exist.
> [WARNING] The requested profile "yarn-ui" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
> project hadoop-mapreduce-client-jobclient: There was a timeout or other error
> in the fork -> [Help 1]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (MAPREDUCE-7099) Daily tests fail in MapReduce JobClient though there isn't any error
[
https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7099:
Summary: Daily tests fail in MapReduce JobClient though there isn't any
error (was: Daily build fails in MapReduce JobClient though there isn't any
error)
> Daily tests fail in MapReduce JobClient though there isn't any error
>
>
> Key: MAPREDUCE-7099
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build, test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
>
> Looks like the build always fails lately. Please see the results of
> hadoop-qbt-trunk-java8-linux-x86:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86//artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> {noformat}
> [INFO] Results:
> [INFO]
> [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
> [INFO]
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:06 h
> [INFO] Finished at: 2018-05-30T12:32:39+00:00
> [INFO] Final Memory: 25M/645M
> [INFO]
>
> [WARNING] The requested profile "parallel-tests" could not be activated
> because it does not exist.
> [WARNING] The requested profile "shelltest" could not be activated because it
> does not exist.
> [WARNING] The requested profile "native" could not be activated because it
> does not exist.
> [WARNING] The requested profile "yarn-ui" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
> project hadoop-mapreduce-client-jobclient: There was a timeout or other error
> in the fork -> [Help 1]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7099) Daily build fails in MapReduce JobClient though there isn't any error
[
https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7099:
Component/s: test
> Daily build fails in MapReduce JobClient though there isn't any error
> -
>
> Key: MAPREDUCE-7099
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: build, test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Critical
>
> Looks like the build always fails lately. Please see the results of
> hadoop-qbt-trunk-java8-linux-x86:
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86//artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
> {noformat}
> [INFO] Results:
> [INFO]
> [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
> [INFO]
> [INFO]
>
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:06 h
> [INFO] Finished at: 2018-05-30T12:32:39+00:00
> [INFO] Final Memory: 25M/645M
> [INFO]
>
> [WARNING] The requested profile "parallel-tests" could not be activated
> because it does not exist.
> [WARNING] The requested profile "shelltest" could not be activated because it
> does not exist.
> [WARNING] The requested profile "native" could not be activated because it
> does not exist.
> [WARNING] The requested profile "yarn-ui" could not be activated because it
> does not exist.
> [ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
> project hadoop-mapreduce-client-jobclient: There was a timeout or other error
> in the fork -> [Help 1]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496386#comment-16496386 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Filed it in MAPREDUCE-7099. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Fix For: 3.2.0 > > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7099) Daily build fails in MapReduce JobClient though there isn't any error
Takanobu Asanuma created MAPREDUCE-7099:
---
Summary: Daily build fails in MapReduce JobClient though there
isn't any error
Key: MAPREDUCE-7099
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: build
Reporter: Takanobu Asanuma
Assignee: Takanobu Asanuma
Looks like the build always fails lately. Please see the results of
hadoop-qbt-trunk-java8-linux-x86:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86//artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
{noformat}
[INFO] Results:
[INFO]
[WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10
[INFO]
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 02:06 h
[INFO] Finished at: 2018-05-30T12:32:39+00:00
[INFO] Final Memory: 25M/645M
[INFO]
[WARNING] The requested profile "parallel-tests" could not be activated because
it does not exist.
[WARNING] The requested profile "shelltest" could not be activated because it
does not exist.
[WARNING] The requested profile "native" could not be activated because it does
not exist.
[WARNING] The requested profile "yarn-ui" could not be activated because it
does not exist.
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
project hadoop-mapreduce-client-jobclient: There was a timeout or other error
in the fork -> [Help 1]
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496356#comment-16496356 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Thanks for reviewing and committing it, [~ajisakaa]! bq. would you create a separate jira to track the failure of jenkins job? Sure. I will file it soon. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Fix For: 3.2.0 > > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493101#comment-16493101 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Looks like the daily reports of hadoop-qbt-trunk-java8-linux-x86 show the same error lately. I don't know why the result is failed though there are no errors and no failers. https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/794/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Anyway, the patch in this jira is not related to the failed tests. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492582#comment-16492582 ] Takanobu Asanuma commented on MAPREDUCE-7098: - The tests failed again. I will investigate it further. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492208#comment-16492208 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Javac says that StringEscapeUtils becomes deprecated in commons-lang3. I will handle it in a following task. The result of the tests is failed, but I can't find it. I'd like to rerun Jenkins though I don't think it is related to the patch. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7098: Attachment: (was: MAPREDUCE-7098.1.patch) > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7098: Attachment: MAPREDUCE-7098.1.patch > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490580#comment-16490580 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Uploaded the 1st patch. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7098: Status: Patch Available (was: Open) > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7098: Attachment: MAPREDUCE-7098.1.patch > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
Takanobu Asanuma created MAPREDUCE-7098: --- Summary: Upgrade common-langs version to 3.7 in hadoop-mapreduce-project Key: MAPREDUCE-7098 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Takanobu Asanuma Assignee: Takanobu Asanuma commons-lang 2.6 is widely used. Let's upgrade to 3.6. This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7077) Pipe mapreduce job fails with Permission denied for jobTokenPassword
[
https://issues.apache.org/jira/browse/MAPREDUCE-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434806#comment-16434806
]
Takanobu Asanuma commented on MAPREDUCE-7077:
-
+1 (non-binding) pending Jenkins.
> Pipe mapreduce job fails with Permission denied for jobTokenPassword
>
>
> Key: MAPREDUCE-7077
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7077
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Affects Versions: 3.1.0
>Reporter: Yesha Vora
>Assignee: Akira Ajisaka
>Priority: Critical
> Attachments: MAPREDUCE-7077.01.patch
>
>
> Steps:
> Launch wordcount example with pipe
> {code}
> /usr/hdp/current/hadoop-client/bin/hadoop pipes
> "-Dhadoop.pipes.java.recordreader=true"
> "-Dhadoop.pipes.java.recordwriter=true" -input pipeInput -output pipeOutput
> -program bin/wordcount{code}
> The application fails with below stacktrace
> {code:title=AM}
> attempt_1517534613368_0041_r_00_2 is : 0.0
> 2018-02-02 02:40:51,071 ERROR [IPC Server handler 16 on 43391]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
> attempt_1517534613368_0041_r_00_2 - exited :
> java.io.FileNotFoundException:
> /grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1517534613368_0041/jobTokenPassword
> (Permission denied)
> at java.io.FileOutputStream.open0(Native Method)
> at java.io.FileOutputStream.open(FileOutputStream.java:270)
> at java.io.FileOutputStream.(FileOutputStream.java:213)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.(RawLocalFileSystem.java:236)
> at
> org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.(RawLocalFileSystem.java:219)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:318)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:307)
> at
> org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:338)
> at
> org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.(ChecksumFileSystem.java:401)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:464)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:443)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1169)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1149)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1038)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1026)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:703)
> at
> org.apache.hadoop.mapred.pipes.Application.writePasswordToLocalFile(Application.java:173)
> at org.apache.hadoop.mapred.pipes.Application.(Application.java:109)
> at
> org.apache.hadoop.mapred.pipes.PipesReducer.startApplication(PipesReducer.java:87)
> at org.apache.hadoop.mapred.pipes.PipesReducer.reduce(PipesReducer.java:65)
> at org.apache.hadoop.mapred.pipes.PipesReducer.reduce(PipesReducer.java:38)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:445)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:393)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1965)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434797#comment-16434797
]
Takanobu Asanuma commented on MAPREDUCE-7036:
-
Sorry for creating the bug, and thanks for catching it.
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Fix For: 3.1.0
>
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7066) TestQueue fails on Java9
[
https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404270#comment-16404270
]
Takanobu Asanuma commented on MAPREDUCE-7066:
-
Thank you very much, [~ajisakaa]!
> TestQueue fails on Java9
>
>
> Key: MAPREDUCE-7066
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
> Environment: Applied HADOOP-12760 and HDFS-11610
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Fix For: 3.2.0
>
> Attachments: MAPREDUCE-7066.1.patch
>
>
> {noformat}
> [INFO] Running org.apache.hadoop.mapred.TestQueue
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353
> s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue
> [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s
> <<< FAILURE!
> org.junit.ComparisonFailure:
> expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...>
> but
> was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...>
> at org.junit.Assert.assertEquals(Assert.java:115)
> at org.junit.Assert.assertEquals(Assert.java:144)
> at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7066) TestQueue fails on Java9
[
https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400060#comment-16400060
]
Takanobu Asanuma commented on MAPREDUCE-7066:
-
Uploaded the 1st patch.
Looks like the order of the elements of {{Properties}} is difference beteween
jdk8 and jdk9. Since {{Properties}} is {{Hashtable}}, we shouldn't assume the
order of the elements.
> TestQueue fails on Java9
>
>
> Key: MAPREDUCE-7066
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
> Environment: Applied HADOOP-12760 and HDFS-11610
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: MAPREDUCE-7066.1.patch
>
>
> {noformat}
> [INFO] Running org.apache.hadoop.mapred.TestQueue
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353
> s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue
> [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s
> <<< FAILURE!
> org.junit.ComparisonFailure:
> expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...>
> but
> was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...>
> at org.junit.Assert.assertEquals(Assert.java:115)
> at org.junit.Assert.assertEquals(Assert.java:144)
> at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7066) TestQueue fails on Java9
[
https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7066:
Status: Patch Available (was: Open)
> TestQueue fails on Java9
>
>
> Key: MAPREDUCE-7066
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
> Environment: Applied HADOOP-12760 and HDFS-11610
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: MAPREDUCE-7066.1.patch
>
>
> {noformat}
> [INFO] Running org.apache.hadoop.mapred.TestQueue
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353
> s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue
> [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s
> <<< FAILURE!
> org.junit.ComparisonFailure:
> expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...>
> but
> was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...>
> at org.junit.Assert.assertEquals(Assert.java:115)
> at org.junit.Assert.assertEquals(Assert.java:144)
> at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7066) TestQueue fails on Java9
[
https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7066:
Attachment: MAPREDUCE-7066.1.patch
> TestQueue fails on Java9
>
>
> Key: MAPREDUCE-7066
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
> Environment: Applied HADOOP-12760 and HDFS-11610
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: MAPREDUCE-7066.1.patch
>
>
> {noformat}
> [INFO] Running org.apache.hadoop.mapred.TestQueue
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353
> s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue
> [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s
> <<< FAILURE!
> org.junit.ComparisonFailure:
> expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...>
> but
> was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...>
> at org.junit.Assert.assertEquals(Assert.java:115)
> at org.junit.Assert.assertEquals(Assert.java:144)
> at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Moved] (MAPREDUCE-7066) TestQueue fails on Java9
[
https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma moved HADOOP-15318 to MAPREDUCE-7066:
--
Component/s: (was: test)
test
Key: MAPREDUCE-7066 (was: HADOOP-15318)
Project: Hadoop Map/Reduce (was: Hadoop Common)
> TestQueue fails on Java9
>
>
> Key: MAPREDUCE-7066
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
> Environment: Applied HADOOP-12760 and HDFS-11610
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
>
> {noformat}
> [INFO] Running org.apache.hadoop.mapred.TestQueue
> [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353
> s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue
> [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s
> <<< FAILURE!
> org.junit.ComparisonFailure:
> expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...>
> but
> was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...>
> at org.junit.Assert.assertEquals(Assert.java:115)
> at org.junit.Assert.assertEquals(Assert.java:144)
> at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:564)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344348#comment-16344348
]
Takanobu Asanuma commented on MAPREDUCE-7036:
-
Thank you very much, [~ajisakaa]!
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Fix For: 3.1.0
>
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340606#comment-16340606
]
Takanobu Asanuma commented on MAPREDUCE-7036:
-
The failed test is not related to the 1st patch.
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340487#comment-16340487
]
Takanobu Asanuma commented on MAPREDUCE-7036:
-
I reran Jenkins since MAPREDUCE-7041 is resolved now.
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7036:
Attachment: MAPREDUCE-7036.1.patch
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7036:
Attachment: (was: MAPREDUCE-7036.1.patch)
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
[
https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338542#comment-16338542
]
Takanobu Asanuma commented on MAPREDUCE-7041:
-
[~grepas] Thanks for the comment and the confirmation. I'll leave it up to you.
I would like to assign this jira to you.
> Several unit tests in hadoop-mapreduce-client-jobclient are failed
> --
>
> Key: MAPREDUCE-7041
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
>
> These tests fails in trunk now. MAPREDUCE-6984 may be related.
> {noformat}
> hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed
> hadoop.mapred.TestJobCleanup.testCustomAbort
> hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Assigned] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
[
https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma reassigned MAPREDUCE-7041:
---
Assignee: Gergo Repas (was: Takanobu Asanuma)
> Several unit tests in hadoop-mapreduce-client-jobclient are failed
> --
>
> Key: MAPREDUCE-7041
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Assignee: Gergo Repas
>Priority: Major
>
> These tests fails in trunk now. MAPREDUCE-6984 may be related.
> {noformat}
> hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed
> hadoop.mapred.TestJobCleanup.testCustomAbort
> hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337512#comment-16337512
]
Takanobu Asanuma edited comment on MAPREDUCE-7036 at 1/24/18 12:35 PM:
---
The TestUberAM failure is already filed MAPREDUCE-7020. The other failed tests
seem to be generated by MAPREDUCE-6984. I filed it in MAPREDUCE-7041.
I think MAPREDUCE-7036.1.patch would work fine for the license issue.
was (Author: tasanuma0829):
The failed tests seem to be generated by MAPREDUCE-6984. I filed it in
MAPREDUCE-7041.
I think MAPREDUCE-7036.1.patch would work fine for the license issue.
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337512#comment-16337512
]
Takanobu Asanuma commented on MAPREDUCE-7036:
-
The failed tests seem to be generated by MAPREDUCE-6984. I filed it in
MAPREDUCE-7041.
I think MAPREDUCE-7036.1.patch would work fine for the license issue.
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
[
https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7041:
Description:
These tests fails in trunk now. MAPREDUCE-6984 may be related.
{noformat}
hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed
hadoop.mapred.TestJobCleanup.testCustomAbort
hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort
{noformat}
> Several unit tests in hadoop-mapreduce-client-jobclient are failed
> --
>
> Key: MAPREDUCE-7041
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
>
> These tests fails in trunk now. MAPREDUCE-6984 may be related.
> {noformat}
> hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed
> hadoop.mapred.TestJobCleanup.testCustomAbort
> hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
[
https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7041:
Environment: (was: These tests fails in trunk now. MAPREDUCE-6984 may
be related.
{noformat}
hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed
hadoop.mapred.TestJobCleanup.testCustomAbort
hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort
{noformat})
> Several unit tests in hadoop-mapreduce-client-jobclient are failed
> --
>
> Key: MAPREDUCE-7041
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
Takanobu Asanuma created MAPREDUCE-7041:
---
Summary: Several unit tests in hadoop-mapreduce-client-jobclient
are failed
Key: MAPREDUCE-7041
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041
Project: Hadoop Map/Reduce
Issue Type: Bug
Environment: These tests fails in trunk now. MAPREDUCE-6984 may be
related.
{noformat}
hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed
hadoop.mapred.TestJobCleanup.testCustomAbort
hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort
{noformat}
Reporter: Takanobu Asanuma
Assignee: Takanobu Asanuma
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7036:
Attachment: MAPREDUCE-7036.1.patch
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7036:
Attachment: (was: MAPREDUCE-7036.1.patch)
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336706#comment-16336706
]
Takanobu Asanuma commented on MAPREDUCE-7036:
-
Some failed tests may be related. I will investigate it further.
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335474#comment-16335474
]
Takanobu Asanuma commented on MAPREDUCE-7036:
-
Uploaded the 1st patch.
Since {{Application.java}} makes a {{jobTokenPassword}} under the current
directory, it is generated under the root directory of
hadoop-mapreduce-client-jobclient module when {{TestPipeApplication}} runs. The
patch fixes the path.
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7036:
Status: Patch Available (was: Open)
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7036:
Attachment: MAPREDUCE-7036.1.patch
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7036:
Attachment: (was: MAPREDUCE-7034.1.patch)
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7036.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7036:
Attachment: MAPREDUCE-7034.1.patch
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
> Attachments: MAPREDUCE-7034.1.patch
>
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7021) Remove logger dependencies other than org.slf4j in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326134#comment-16326134 ] Takanobu Asanuma commented on MAPREDUCE-7021: - I filed the license error in MAPREDUCE-7036 and it is not related to this patch. +1 (non-binding) > Remove logger dependencies other than org.slf4j in hadoop-mapreduce > --- > > Key: MAPREDUCE-7021 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7021 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Akira Ajisaka >Assignee: Akira Ajisaka >Priority: Major > Attachments: MAPREDUCE-7021.001.patch > > > We moved logging APIs over to slf4j, however, the dependency is left. We need > to cut the dependency. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Moved] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[
https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma moved HADOOP-15174 to MAPREDUCE-7036:
--
Target Version/s: 3.1.0 (was: 3.1.0)
Component/s: (was: test)
test
Key: MAPREDUCE-7036 (was: HADOOP-15174)
Project: Hadoop Map/Reduce (was: Hadoop Common)
> ASF License warning in hadoop-mapreduce-client
> --
>
> Key: MAPREDUCE-7036
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036
> Project: Hadoop Map/Reduce
> Issue Type: Test
> Components: test
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Minor
>
> it occurred in MAPREDUCE-7021 and MAPREDUCE-7034.
> {noformat}
> Lines that start with ? in the ASF License report indicate files that do
> not have an Apache license header: !?
> /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325930#comment-16325930
]
Takanobu Asanuma commented on MAPREDUCE-7034:
-
Thanks for reviewing and committing it, [~ajisakaa]!
> Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
> -
>
> Key: MAPREDUCE-7034
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Fix For: 3.1.0
>
> Attachments: MAPREDUCE-7034.1.patch
>
>
> It seems there are some left.
> {noformat}
> find hadoop-mapreduce-project -name "*.java" | xargs grep "import
> org.apache.commons.logging.Log" | wc -l
>7
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325905#comment-16325905
]
Takanobu Asanuma commented on MAPREDUCE-7034:
-
The failed test is not related to this patch. I think we can apply
MAPREDUCE-7021 after closing this jira.
> Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
> -
>
> Key: MAPREDUCE-7034
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>Priority: Major
> Attachments: MAPREDUCE-7034.1.patch
>
>
> It seems there are some left.
> {noformat}
> find hadoop-mapreduce-project -name "*.java" | xargs grep "import
> org.apache.commons.logging.Log" | wc -l
>7
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7034:
Attachment: MAPREDUCE-7034.1.patch
Uploaded the 1st patch.
> Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
> -
>
> Key: MAPREDUCE-7034
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
> Attachments: MAPREDUCE-7034.1.patch
>
>
> It seems there are some left.
> {noformat}
> find hadoop-mapreduce-project -name "*.java" | xargs grep "import
> org.apache.commons.logging.Log" | wc -l
>7
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7034:
Status: Patch Available (was: Open)
> Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
> -
>
> Key: MAPREDUCE-7034
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
> Attachments: MAPREDUCE-7034.1.patch
>
>
> It seems there are some left.
> {noformat}
> find hadoop-mapreduce-project -name "*.java" | xargs grep "import
> org.apache.commons.logging.Log" | wc -l
>7
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323535#comment-16323535
]
Takanobu Asanuma commented on MAPREDUCE-7034:
-
Thanks!
> Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
> -
>
> Key: MAPREDUCE-7034
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
>Reporter: Takanobu Asanuma
>Assignee: Takanobu Asanuma
>
> It seems there are some left.
> {noformat}
> find hadoop-mapreduce-project -name "*.java" | xargs grep "import
> org.apache.commons.logging.Log" | wc -l
>7
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323419#comment-16323419
]
Takanobu Asanuma commented on MAPREDUCE-7034:
-
Hi [~ajisakaa], could you grant me the right of the MAPREDUCE project's
contribution?
> Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
> -
>
> Key: MAPREDUCE-7034
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
>Reporter: Takanobu Asanuma
>
> It seems there are some left.
> {noformat}
> find hadoop-mapreduce-project -name "*.java" | xargs grep "import
> org.apache.commons.logging.Log" | wc -l
>7
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-7034:
Issue Type: Sub-task (was: Improvement)
Parent: MAPREDUCE-6946
> Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
> -
>
> Key: MAPREDUCE-7034
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
>Reporter: Takanobu Asanuma
>
> It seems there are some left.
> {noformat}
> find hadoop-mapreduce-project -name "*.java" | xargs grep "import
> org.apache.commons.logging.Log" | wc -l
>7
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
Takanobu Asanuma created MAPREDUCE-7034:
---
Summary: Moving logging APIs over to slf4j the rest of all in
hadoop-mapreduce
Key: MAPREDUCE-7034
URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Takanobu Asanuma
It seems there are some left.
{noformat}
find hadoop-mapreduce-project -name "*.java" | xargs grep "import
org.apache.commons.logging.Log" | wc -l
7
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error (LocalJobRunner)
[
https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-6985:
Description:
Reported by Shingo Furuyama:
We confirmed that MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
mode: LocalJobRunner
was:
Reported by Shingo Furuyama:
We confirmed that MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
> MapReduce native optimization does not work properly due to a shuffle error
> (LocalJobRunner)
>
>
> Key: MAPREDUCE-6985
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Affects Versions: 3.0.0-beta1
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: mr_native_optimization_error.log
>
>
> Reported by Shingo Furuyama:
> We confirmed that MapReduce native optimization (MAPREDUCE-2841) of
> Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
> {noformat}
> 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> output/file.out in any of the configured local directories
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
> at
> org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
> at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
> at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
> at org.apache.hadoop.mapred.Task.done(Task.java:1174)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
> at
>
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error (LocalJobRunner)
[
https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-6985:
Summary: MapReduce native optimization does not work properly due to a
shuffle error (LocalJobRunner) (was: MapReduce native optimization does not
work properly due to a shuffle error)
> MapReduce native optimization does not work properly due to a shuffle error
> (LocalJobRunner)
>
>
> Key: MAPREDUCE-6985
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Affects Versions: 3.0.0-beta1
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: mr_native_optimization_error.log
>
>
> Reported by Shingo Furuyama:
> We confirmed that MapReduce native optimization (MAPREDUCE-2841) of
> Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
> {noformat}
> 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> output/file.out in any of the configured local directories
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
> at
> org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
> at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
> at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
> at org.apache.hadoop.mapred.Task.done(Task.java:1174)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:748)
> {noformat}
> My build and run environment is below:
> CentOS: 7.3
> cmake: 3.6.3
> Maven: 3.5.0
> Java: 1.8.0_131
> Hadoop: 3.0.0-beta1
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
[
https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-6985:
Description:
Reported by Shingo Furuyama:
We confirmed that MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
was:
Reported by Shingo Furuyama:
We confirmed MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
> MapReduce native optimization does not work properly due to a shuffle error
> ---
>
> Key: MAPREDUCE-6985
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Affects Versions: 3.0.0-beta1
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: mr_native_optimization_error.log
>
>
> Reported by Shingo Furuyama:
> We confirmed that MapReduce native optimization (MAPREDUCE-2841) of
> Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
> {noformat}
> 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> output/file.out in any of the configured local directories
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
> at
> org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
> at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
> at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
> at org.apache.hadoop.mapred.Task.done(Task.java:1174)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
> at
>
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
[
https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-6985:
Description:
Reported by Shingo Furuyama:
We confirmed MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
was:
Reported by Shingo Furuyama:
We confirmed MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
> MapReduce native optimization does not work properly due to a shuffle error
> ---
>
> Key: MAPREDUCE-6985
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Affects Versions: 3.0.0-beta1
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: mr_native_optimization_error.log
>
>
> Reported by Shingo Furuyama:
> We confirmed MapReduce native optimization (MAPREDUCE-2841) of
> Hadoop-3.0.0-beta1 does not work properly due to a shuffle error.
> {noformat}
> 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> output/file.out in any of the configured local directories
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
> at
> org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
> at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
> at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
> at org.apache.hadoop.mapred.Task.done(Task.java:1174)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
> at
>
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
[
https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-6985:
Description:
Reported by Shingo Furuyama:
We confirmed MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
was:
I confirmed MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
> MapReduce native optimization does not work properly due to a shuffle error
> ---
>
> Key: MAPREDUCE-6985
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Affects Versions: 3.0.0-beta1
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: mr_native_optimization_error.log
>
>
> Reported by Shingo Furuyama:
> We confirmed MapReduce native optimization (MAPREDUCE-2841) of
> Hadoop-3.0.0-beta1 does not work properly due to a shffle error.
> {noformat}
> 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> output/file.out in any of the configured local directories
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
> at
> org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
> at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
> at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
> at org.apache.hadoop.mapred.Task.done(Task.java:1174)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
> at
>
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
[
https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takanobu Asanuma updated MAPREDUCE-6985:
Attachment: mr_native_optimization_error.log
Attached the error log.
> MapReduce native optimization does not work properly due to a shuffle error
> ---
>
> Key: MAPREDUCE-6985
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985
> Project: Hadoop Map/Reduce
> Issue Type: Bug
>Affects Versions: 3.0.0-beta1
>Reporter: Takanobu Asanuma
>Priority: Critical
> Attachments: mr_native_optimization_error.log
>
>
> I confirmed MapReduce native optimization (MAPREDUCE-2841) of
> Hadoop-3.0.0-beta1 does not work properly due to a shffle error.
> {noformat}
> 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> output/file.out in any of the configured local directories
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
> at
> org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
> at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
> at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
> at org.apache.hadoop.mapred.Task.done(Task.java:1174)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:748)
> {noformat}
> My build and run environment is below:
> CentOS: 7.3
> cmake: 3.6.3
> Maven: 3.5.0
> Java: 1.8.0_131
> Hadoop: 3.0.0-beta1
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
Takanobu Asanuma created MAPREDUCE-6985:
---
Summary: MapReduce native optimization does not work properly due
to a shuffle error
Key: MAPREDUCE-6985
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 3.0.0-beta1
Reporter: Takanobu Asanuma
Priority: Critical
I confirmed MapReduce native optimization (MAPREDUCE-2841) of
Hadoop-3.0.0-beta1 does not work properly due to a shffle error.
{noformat}
2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
output/file.out in any of the configured local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166)
at
org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57)
at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248)
at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228)
at org.apache.hadoop.mapred.Task.done(Task.java:1174)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345)
at
org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
{noformat}
My build and run environment is below:
CentOS: 7.3
cmake: 3.6.3
Maven: 3.5.0
Java: 1.8.0_131
Hadoop: 3.0.0-beta1
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
