[jira] [Resolved] (MAPREDUCE-7371) DistributedCache alternative APIs should not use DistributedCache APIs internally
[ https://issues.apache.org/jira/browse/MAPREDUCE-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved MAPREDUCE-7371. - Fix Version/s: 3.4.0 Resolution: Fixed > DistributedCache alternative APIs should not use DistributedCache APIs > internally > - > > Key: MAPREDUCE-7371 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7371 > Project: Hadoop Map/Reduce > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 2h 10m > Remaining Estimate: 0h > > DistributedCache has been deprecated long back and it's still being used as > of today. However, all the alternative Job APIs (for deprecated > DistributedCache APIs) still internally use DistributedCache APIs only, this > is a deadlock and it leaves no room for removal of DistributedCache APIs in > future. We should move core logic to Job or JobContext as required and let > deprecated DistributedCache APIs point to the right alternatives internally. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Resolved] (MAPREDUCE-7354) Use empty array constants present in TaskCompletionEvent to avoid creating redundant objects
[ https://issues.apache.org/jira/browse/MAPREDUCE-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved MAPREDUCE-7354. - Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed > Use empty array constants present in TaskCompletionEvent to avoid creating > redundant objects > > > Key: MAPREDUCE-7354 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7354 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Minor > Labels: pull-request-available > Fix For: 3.4.0, 3.3.2 > > Time Spent: 1h 20m > Remaining Estimate: 0h > > As per one of the suggestions over PR#3115 (HDFS-16075), we should use empty > array constant present in TaskCompletionEvent to avoid creating redundant > objects. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Resolved] (MAPREDUCE-7350) Replace Guava Lists usage by Hadoop's own Lists in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved MAPREDUCE-7350. - Fix Version/s: 3.4.0 Resolution: Fixed > Replace Guava Lists usage by Hadoop's own Lists in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7350 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7350 > Project: Hadoop Map/Reduce > Issue Type: Task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (MAPREDUCE-7184) TestJobCounters#getFileSize can ignore crc file
[ https://issues.apache.org/jira/browse/MAPREDUCE-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765950#comment-16765950 ] Takanobu Asanuma edited comment on MAPREDUCE-7184 at 2/12/19 11:33 AM: --- [~Prabhu Joseph] Thanks for reporting the issue and uploading the patch. The errors occur after HADOOP-15229 is merged. Looks like the BYTES_READ counter considered length of crc files until then. I'm not sure whether \{{TestJobCounters#getFileSize}} can ignore crc file. [~ste...@apache.org] Could you take a look? was (Author: tasanuma0829): [~Prabhu Joseph] Thanks for reporting the issue and uploading the patch. The errors occur after HADOOP-15229 is merged. Looks like the BYTES_READ counter considered length of crc files until then. So I'm not sure the patch is right. [~ste...@apache.org] Could you take a look? > TestJobCounters#getFileSize can ignore crc file > --- > > Key: MAPREDUCE-7184 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7184 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Attachments: MAPREDUCE-7184-001.patch, MAPREDUCE-7184-002.patch, > MAPREDUCE-7184-003.patch > > > TestJobCounters test cases are failing in trunk while validating the input > files size with BYTES_READ by the job. The crc files are considered in > getFileSize whereas the job FileInputFormat ignores them. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7184) TestJobCounters#getFileSize can ignore crc file
[ https://issues.apache.org/jira/browse/MAPREDUCE-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765950#comment-16765950 ] Takanobu Asanuma commented on MAPREDUCE-7184: - [~Prabhu Joseph] Thanks for reporting the issue and uploading the patch. The errors occur after HADOOP-15229 is merged. Looks like the BYTES_READ counter considered length of crc files until then. So I'm not sure the patch is right. [~ste...@apache.org] Could you take a look? > TestJobCounters#getFileSize can ignore crc file > --- > > Key: MAPREDUCE-7184 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7184 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Prabhu Joseph >Assignee: Prabhu Joseph >Priority: Major > Attachments: MAPREDUCE-7184-001.patch, MAPREDUCE-7184-002.patch, > MAPREDUCE-7184-003.patch > > > TestJobCounters test cases are failing in trunk while validating the input > files size with BYTES_READ by the job. The crc files are considered in > getFileSize whereas the job FileInputFormat ignores them. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[ https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765947#comment-16765947 ] Takanobu Asanuma commented on MAPREDUCE-7099: - [~ste...@apache.org] The errors in your last comment are related to another issue, MAPREDUCE-7184. Let's fix it first. > Daily test result fails in MapReduce JobClient though there isn't any error > --- > > Key: MAPREDUCE-7099 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Critical > > Looks like the test result in MapReduce JobClient always fails lately. Please > see the results of hadoop-qbt-trunk-java8-linux-x86: > > [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > {noformat} > [INFO] Results: > [INFO] > [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 > [INFO] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:06 h > [INFO] Finished at: 2018-05-30T12:32:39+00:00 > [INFO] Final Memory: 25M/645M > [INFO] > > [WARNING] The requested profile "parallel-tests" could not be activated > because it does not exist. > [WARNING] The requested profile "shelltest" could not be activated because it > does not exist. > [WARNING] The requested profile "native" could not be activated because it > does not exist. > [WARNING] The requested profile "yarn-ui" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on > project hadoop-mapreduce-client-jobclient: There was a timeout or other error > in the fork -> [Help 1] > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[ https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16762102#comment-16762102 ] Takanobu Asanuma commented on MAPREDUCE-7099: - Thanks for the investigation, [~ste...@apache.org]. I'm not very familiar with timeout setting at the moment. I don't have time this week. I will check it the next week. > Daily test result fails in MapReduce JobClient though there isn't any error > --- > > Key: MAPREDUCE-7099 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Critical > > Looks like the test result in MapReduce JobClient always fails lately. Please > see the results of hadoop-qbt-trunk-java8-linux-x86: > > [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > {noformat} > [INFO] Results: > [INFO] > [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 > [INFO] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:06 h > [INFO] Finished at: 2018-05-30T12:32:39+00:00 > [INFO] Final Memory: 25M/645M > [INFO] > > [WARNING] The requested profile "parallel-tests" could not be activated > because it does not exist. > [WARNING] The requested profile "shelltest" could not be activated because it > does not exist. > [WARNING] The requested profile "native" could not be activated because it > does not exist. > [WARNING] The requested profile "yarn-ui" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on > project hadoop-mapreduce-client-jobclient: There was a timeout or other error > in the fork -> [Help 1] > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[ https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745266#comment-16745266 ] Takanobu Asanuma commented on MAPREDUCE-7099: - Yes, the latest qbt result still reported the issue. {noformat} [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 [INFO] [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:06 h [INFO] Finished at: 2019-01-17T12:02:07+00:00 [INFO] Final Memory: 29M/610M [INFO] {noformat} https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1019/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > Daily test result fails in MapReduce JobClient though there isn't any error > --- > > Key: MAPREDUCE-7099 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Critical > > Looks like the test result in MapReduce JobClient always fails lately. Please > see the results of hadoop-qbt-trunk-java8-linux-x86: > > [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > {noformat} > [INFO] Results: > [INFO] > [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 > [INFO] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:06 h > [INFO] Finished at: 2018-05-30T12:32:39+00:00 > [INFO] Final Memory: 25M/645M > [INFO] > > [WARNING] The requested profile "parallel-tests" could not be activated > because it does not exist. > [WARNING] The requested profile "shelltest" could not be activated because it > does not exist. > [WARNING] The requested profile "native" could not be activated because it > does not exist. > [WARNING] The requested profile "yarn-ui" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on > project hadoop-mapreduce-client-jobclient: There was a timeout or other error > in the fork -> [Help 1] > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[ https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499623#comment-16499623 ] Takanobu Asanuma commented on MAPREDUCE-7099: - Thanks for reporting it, [~miklos.szeg...@cloudera.com]. I haven't found the cause yet. I will further investigate the tests you reported. > Daily test result fails in MapReduce JobClient though there isn't any error > --- > > Key: MAPREDUCE-7099 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Critical > > Looks like the test result in MapReduce JobClient always fails lately. Please > see the results of hadoop-qbt-trunk-java8-linux-x86: > > [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > {noformat} > [INFO] Results: > [INFO] > [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 > [INFO] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:06 h > [INFO] Finished at: 2018-05-30T12:32:39+00:00 > [INFO] Final Memory: 25M/645M > [INFO] > > [WARNING] The requested profile "parallel-tests" could not be activated > because it does not exist. > [WARNING] The requested profile "shelltest" could not be activated because it > does not exist. > [WARNING] The requested profile "native" could not be activated because it > does not exist. > [WARNING] The requested profile "yarn-ui" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on > project hadoop-mapreduce-client-jobclient: There was a timeout or other error > in the fork -> [Help 1] > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7099) Daily test result fails in MapReduce JobClient though there isn't any error
[ https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7099: Summary: Daily test result fails in MapReduce JobClient though there isn't any error (was: Daily tests fail in MapReduce JobClient though there isn't any error) > Daily test result fails in MapReduce JobClient though there isn't any error > --- > > Key: MAPREDUCE-7099 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Critical > > Looks like the test result in MapReduce JobClient always fails lately. Please > see the results of hadoop-qbt-trunk-java8-linux-x86: > > [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > {noformat} > [INFO] Results: > [INFO] > [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 > [INFO] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:06 h > [INFO] Finished at: 2018-05-30T12:32:39+00:00 > [INFO] Final Memory: 25M/645M > [INFO] > > [WARNING] The requested profile "parallel-tests" could not be activated > because it does not exist. > [WARNING] The requested profile "shelltest" could not be activated because it > does not exist. > [WARNING] The requested profile "native" could not be activated because it > does not exist. > [WARNING] The requested profile "yarn-ui" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on > project hadoop-mapreduce-client-jobclient: There was a timeout or other error > in the fork -> [Help 1] > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7099) Daily tests fail in MapReduce JobClient though there isn't any error
[ https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7099: Description: Looks like the test result in MapReduce JobClient always fails lately. Please see the results of hadoop-qbt-trunk-java8-linux-x86: [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt {noformat} [INFO] Results: [INFO] [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 [INFO] [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:06 h [INFO] Finished at: 2018-05-30T12:32:39+00:00 [INFO] Final Memory: 25M/645M [INFO] [WARNING] The requested profile "parallel-tests" could not be activated because it does not exist. [WARNING] The requested profile "shelltest" could not be activated because it does not exist. [WARNING] The requested profile "native" could not be activated because it does not exist. [WARNING] The requested profile "yarn-ui" could not be activated because it does not exist. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on project hadoop-mapreduce-client-jobclient: There was a timeout or other error in the fork -> [Help 1] {noformat} was: Looks like the build always fails lately. Please see the results of hadoop-qbt-trunk-java8-linux-x86: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86//artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt {noformat} [INFO] Results: [INFO] [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 [INFO] [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:06 h [INFO] Finished at: 2018-05-30T12:32:39+00:00 [INFO] Final Memory: 25M/645M [INFO] [WARNING] The requested profile "parallel-tests" could not be activated because it does not exist. [WARNING] The requested profile "shelltest" could not be activated because it does not exist. [WARNING] The requested profile "native" could not be activated because it does not exist. [WARNING] The requested profile "yarn-ui" could not be activated because it does not exist. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on project hadoop-mapreduce-client-jobclient: There was a timeout or other error in the fork -> [Help 1] {noformat} > Daily tests fail in MapReduce JobClient though there isn't any error > > > Key: MAPREDUCE-7099 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Critical > > Looks like the test result in MapReduce JobClient always fails lately. Please > see the results of hadoop-qbt-trunk-java8-linux-x86: > > [https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/]/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > {noformat} > [INFO] Results: > [INFO] > [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 > [INFO] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:06 h > [INFO] Finished at: 2018-05-30T12:32:39+00:00 > [INFO] Final Memory: 25M/645M > [INFO] > > [WARNING] The requested profile "parallel-tests" could not be activated > because it does not exist. > [WARNING] The requested profile "shelltest" could not be activated because it > does not exist. > [WARNING] The requested profile "native" could not be activated because it > does not exist. > [WARNING] The requested profile "yarn-ui" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on > project hadoop-mapreduce-client-jobclient: There was a timeout or other error > in the fork -> [Help 1] > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (MAPREDUCE-7099) Daily tests fail in MapReduce JobClient though there isn't any error
[ https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7099: Summary: Daily tests fail in MapReduce JobClient though there isn't any error (was: Daily build fails in MapReduce JobClient though there isn't any error) > Daily tests fail in MapReduce JobClient though there isn't any error > > > Key: MAPREDUCE-7099 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Critical > > Looks like the build always fails lately. Please see the results of > hadoop-qbt-trunk-java8-linux-x86: > https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86//artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > {noformat} > [INFO] Results: > [INFO] > [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 > [INFO] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:06 h > [INFO] Finished at: 2018-05-30T12:32:39+00:00 > [INFO] Final Memory: 25M/645M > [INFO] > > [WARNING] The requested profile "parallel-tests" could not be activated > because it does not exist. > [WARNING] The requested profile "shelltest" could not be activated because it > does not exist. > [WARNING] The requested profile "native" could not be activated because it > does not exist. > [WARNING] The requested profile "yarn-ui" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on > project hadoop-mapreduce-client-jobclient: There was a timeout or other error > in the fork -> [Help 1] > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7099) Daily build fails in MapReduce JobClient though there isn't any error
[ https://issues.apache.org/jira/browse/MAPREDUCE-7099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7099: Component/s: test > Daily build fails in MapReduce JobClient though there isn't any error > - > > Key: MAPREDUCE-7099 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: build, test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Critical > > Looks like the build always fails lately. Please see the results of > hadoop-qbt-trunk-java8-linux-x86: > https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86//artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt > {noformat} > [INFO] Results: > [INFO] > [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 > [INFO] > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 02:06 h > [INFO] Finished at: 2018-05-30T12:32:39+00:00 > [INFO] Final Memory: 25M/645M > [INFO] > > [WARNING] The requested profile "parallel-tests" could not be activated > because it does not exist. > [WARNING] The requested profile "shelltest" could not be activated because it > does not exist. > [WARNING] The requested profile "native" could not be activated because it > does not exist. > [WARNING] The requested profile "yarn-ui" could not be activated because it > does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on > project hadoop-mapreduce-client-jobclient: There was a timeout or other error > in the fork -> [Help 1] > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16496386#comment-16496386 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Filed it in MAPREDUCE-7099. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Fix For: 3.2.0 > > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7099) Daily build fails in MapReduce JobClient though there isn't any error
Takanobu Asanuma created MAPREDUCE-7099: --- Summary: Daily build fails in MapReduce JobClient though there isn't any error Key: MAPREDUCE-7099 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7099 Project: Hadoop Map/Reduce Issue Type: Bug Components: build Reporter: Takanobu Asanuma Assignee: Takanobu Asanuma Looks like the build always fails lately. Please see the results of hadoop-qbt-trunk-java8-linux-x86: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86//artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt {noformat} [INFO] Results: [INFO] [WARNING] Tests run: 565, Failures: 0, Errors: 0, Skipped: 10 [INFO] [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 02:06 h [INFO] Finished at: 2018-05-30T12:32:39+00:00 [INFO] Final Memory: 25M/645M [INFO] [WARNING] The requested profile "parallel-tests" could not be activated because it does not exist. [WARNING] The requested profile "shelltest" could not be activated because it does not exist. [WARNING] The requested profile "native" could not be activated because it does not exist. [WARNING] The requested profile "yarn-ui" could not be activated because it does not exist. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on project hadoop-mapreduce-client-jobclient: There was a timeout or other error in the fork -> [Help 1] {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16496356#comment-16496356 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Thanks for reviewing and committing it, [~ajisakaa]! bq. would you create a separate jira to track the failure of jenkins job? Sure. I will file it soon. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Fix For: 3.2.0 > > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16493101#comment-16493101 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Looks like the daily reports of hadoop-qbt-trunk-java8-linux-x86 show the same error lately. I don't know why the result is failed though there are no errors and no failers. https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/794/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt Anyway, the patch in this jira is not related to the failed tests. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16492582#comment-16492582 ] Takanobu Asanuma commented on MAPREDUCE-7098: - The tests failed again. I will investigate it further. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16492208#comment-16492208 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Javac says that StringEscapeUtils becomes deprecated in commons-lang3. I will handle it in a following task. The result of the tests is failed, but I can't find it. I'd like to rerun Jenkins though I don't think it is related to the patch. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7098: Attachment: (was: MAPREDUCE-7098.1.patch) > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7098: Attachment: MAPREDUCE-7098.1.patch > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16490580#comment-16490580 ] Takanobu Asanuma commented on MAPREDUCE-7098: - Uploaded the 1st patch. > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7098: Status: Patch Available (was: Open) > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
[ https://issues.apache.org/jira/browse/MAPREDUCE-7098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7098: Attachment: MAPREDUCE-7098.1.patch > Upgrade common-langs version to 3.7 in hadoop-mapreduce-project > --- > > Key: MAPREDUCE-7098 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 > Project: Hadoop Map/Reduce > Issue Type: Improvement >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7098.1.patch > > > commons-lang 2.6 is widely used. Let's upgrade to 3.6. > This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7098) Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
Takanobu Asanuma created MAPREDUCE-7098: --- Summary: Upgrade common-langs version to 3.7 in hadoop-mapreduce-project Key: MAPREDUCE-7098 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7098 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Takanobu Asanuma Assignee: Takanobu Asanuma commons-lang 2.6 is widely used. Let's upgrade to 3.6. This jira is separated from HADOOP-10783. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7077) Pipe mapreduce job fails with Permission denied for jobTokenPassword
[ https://issues.apache.org/jira/browse/MAPREDUCE-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434806#comment-16434806 ] Takanobu Asanuma commented on MAPREDUCE-7077: - +1 (non-binding) pending Jenkins. > Pipe mapreduce job fails with Permission denied for jobTokenPassword > > > Key: MAPREDUCE-7077 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7077 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 3.1.0 >Reporter: Yesha Vora >Assignee: Akira Ajisaka >Priority: Critical > Attachments: MAPREDUCE-7077.01.patch > > > Steps: > Launch wordcount example with pipe > {code} > /usr/hdp/current/hadoop-client/bin/hadoop pipes > "-Dhadoop.pipes.java.recordreader=true" > "-Dhadoop.pipes.java.recordwriter=true" -input pipeInput -output pipeOutput > -program bin/wordcount{code} > The application fails with below stacktrace > {code:title=AM} > attempt_1517534613368_0041_r_00_2 is : 0.0 > 2018-02-02 02:40:51,071 ERROR [IPC Server handler 16 on 43391] > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: > attempt_1517534613368_0041_r_00_2 - exited : > java.io.FileNotFoundException: > /grid/0/hadoop/yarn/local/usercache/hrt_qa/appcache/application_1517534613368_0041/jobTokenPassword > (Permission denied) > at java.io.FileOutputStream.open0(Native Method) > at java.io.FileOutputStream.open(FileOutputStream.java:270) > at java.io.FileOutputStream.(FileOutputStream.java:213) > at > org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.(RawLocalFileSystem.java:236) > at > org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.(RawLocalFileSystem.java:219) > at > org.apache.hadoop.fs.RawLocalFileSystem.createOutputStreamWithMode(RawLocalFileSystem.java:318) > at > org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:307) > at > org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:338) > at > org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.(ChecksumFileSystem.java:401) > at > org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:464) > at > org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:443) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1169) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1149) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1038) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1026) > at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:703) > at > org.apache.hadoop.mapred.pipes.Application.writePasswordToLocalFile(Application.java:173) > at org.apache.hadoop.mapred.pipes.Application.(Application.java:109) > at > org.apache.hadoop.mapred.pipes.PipesReducer.startApplication(PipesReducer.java:87) > at org.apache.hadoop.mapred.pipes.PipesReducer.reduce(PipesReducer.java:65) > at org.apache.hadoop.mapred.pipes.PipesReducer.reduce(PipesReducer.java:38) > at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:445) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:393) > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1965) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434797#comment-16434797 ] Takanobu Asanuma commented on MAPREDUCE-7036: - Sorry for creating the bug, and thanks for catching it. > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Fix For: 3.1.0 > > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7066) TestQueue fails on Java9
[ https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16404270#comment-16404270 ] Takanobu Asanuma commented on MAPREDUCE-7066: - Thank you very much, [~ajisakaa]! > TestQueue fails on Java9 > > > Key: MAPREDUCE-7066 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test > Environment: Applied HADOOP-12760 and HDFS-11610 >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Fix For: 3.2.0 > > Attachments: MAPREDUCE-7066.1.patch > > > {noformat} > [INFO] Running org.apache.hadoop.mapred.TestQueue > [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353 > s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue > [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s > <<< FAILURE! > org.junit.ComparisonFailure: > expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...> > but > was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...> > at org.junit.Assert.assertEquals(Assert.java:115) > at org.junit.Assert.assertEquals(Assert.java:144) > at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:564) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at > org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7066) TestQueue fails on Java9
[ https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16400060#comment-16400060 ] Takanobu Asanuma commented on MAPREDUCE-7066: - Uploaded the 1st patch. Looks like the order of the elements of {{Properties}} is difference beteween jdk8 and jdk9. Since {{Properties}} is {{Hashtable}}, we shouldn't assume the order of the elements. > TestQueue fails on Java9 > > > Key: MAPREDUCE-7066 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test > Environment: Applied HADOOP-12760 and HDFS-11610 >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7066.1.patch > > > {noformat} > [INFO] Running org.apache.hadoop.mapred.TestQueue > [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353 > s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue > [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s > <<< FAILURE! > org.junit.ComparisonFailure: > expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...> > but > was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...> > at org.junit.Assert.assertEquals(Assert.java:115) > at org.junit.Assert.assertEquals(Assert.java:144) > at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:564) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at > org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7066) TestQueue fails on Java9
[ https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7066: Status: Patch Available (was: Open) > TestQueue fails on Java9 > > > Key: MAPREDUCE-7066 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test > Environment: Applied HADOOP-12760 and HDFS-11610 >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7066.1.patch > > > {noformat} > [INFO] Running org.apache.hadoop.mapred.TestQueue > [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353 > s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue > [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s > <<< FAILURE! > org.junit.ComparisonFailure: > expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...> > but > was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...> > at org.junit.Assert.assertEquals(Assert.java:115) > at org.junit.Assert.assertEquals(Assert.java:144) > at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:564) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at > org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7066) TestQueue fails on Java9
[ https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7066: Attachment: MAPREDUCE-7066.1.patch > TestQueue fails on Java9 > > > Key: MAPREDUCE-7066 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test > Environment: Applied HADOOP-12760 and HDFS-11610 >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7066.1.patch > > > {noformat} > [INFO] Running org.apache.hadoop.mapred.TestQueue > [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353 > s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue > [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s > <<< FAILURE! > org.junit.ComparisonFailure: > expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...> > but > was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...> > at org.junit.Assert.assertEquals(Assert.java:115) > at org.junit.Assert.assertEquals(Assert.java:144) > at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:564) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at > org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Moved] (MAPREDUCE-7066) TestQueue fails on Java9
[ https://issues.apache.org/jira/browse/MAPREDUCE-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma moved HADOOP-15318 to MAPREDUCE-7066: -- Component/s: (was: test) test Key: MAPREDUCE-7066 (was: HADOOP-15318) Project: Hadoop Map/Reduce (was: Hadoop Common) > TestQueue fails on Java9 > > > Key: MAPREDUCE-7066 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7066 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test > Environment: Applied HADOOP-12760 and HDFS-11610 >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > > {noformat} > [INFO] Running org.apache.hadoop.mapred.TestQueue > [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.353 > s <<< FAILURE! - in org.apache.hadoop.mapred.TestQueue > [ERROR] testQueue(org.apache.hadoop.mapred.TestQueue) Time elapsed: 1.186 s > <<< FAILURE! > org.junit.ComparisonFailure: > expected:<...roperties":[{"key":"[capacity","value":"20"},{"key":"user-limit","value":"3]0"}],"children":[]}]...> > but > was:<...roperties":[{"key":"[user-limit","value":"30"},{"key":"capacity","value":"2]0"}],"children":[]}]...> > at org.junit.Assert.assertEquals(Assert.java:115) > at org.junit.Assert.assertEquals(Assert.java:144) > at org.apache.hadoop.mapred.TestQueue.testQueue(TestQueue.java:156) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.base/java.lang.reflect.Method.invoke(Method.java:564) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at > org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16344348#comment-16344348 ] Takanobu Asanuma commented on MAPREDUCE-7036: - Thank you very much, [~ajisakaa]! > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Fix For: 3.1.0 > > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340606#comment-16340606 ] Takanobu Asanuma commented on MAPREDUCE-7036: - The failed test is not related to the 1st patch. > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340487#comment-16340487 ] Takanobu Asanuma commented on MAPREDUCE-7036: - I reran Jenkins since MAPREDUCE-7041 is resolved now. > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7036: Attachment: MAPREDUCE-7036.1.patch > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7036: Attachment: (was: MAPREDUCE-7036.1.patch) > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
[ https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16338542#comment-16338542 ] Takanobu Asanuma commented on MAPREDUCE-7041: - [~grepas] Thanks for the comment and the confirmation. I'll leave it up to you. I would like to assign this jira to you. > Several unit tests in hadoop-mapreduce-client-jobclient are failed > -- > > Key: MAPREDUCE-7041 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > > These tests fails in trunk now. MAPREDUCE-6984 may be related. > {noformat} > hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed > hadoop.mapred.TestJobCleanup.testCustomAbort > hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Assigned] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
[ https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned MAPREDUCE-7041: --- Assignee: Gergo Repas (was: Takanobu Asanuma) > Several unit tests in hadoop-mapreduce-client-jobclient are failed > -- > > Key: MAPREDUCE-7041 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Takanobu Asanuma >Assignee: Gergo Repas >Priority: Major > > These tests fails in trunk now. MAPREDUCE-6984 may be related. > {noformat} > hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed > hadoop.mapred.TestJobCleanup.testCustomAbort > hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337512#comment-16337512 ] Takanobu Asanuma edited comment on MAPREDUCE-7036 at 1/24/18 12:35 PM: --- The TestUberAM failure is already filed MAPREDUCE-7020. The other failed tests seem to be generated by MAPREDUCE-6984. I filed it in MAPREDUCE-7041. I think MAPREDUCE-7036.1.patch would work fine for the license issue. was (Author: tasanuma0829): The failed tests seem to be generated by MAPREDUCE-6984. I filed it in MAPREDUCE-7041. I think MAPREDUCE-7036.1.patch would work fine for the license issue. > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337512#comment-16337512 ] Takanobu Asanuma commented on MAPREDUCE-7036: - The failed tests seem to be generated by MAPREDUCE-6984. I filed it in MAPREDUCE-7041. I think MAPREDUCE-7036.1.patch would work fine for the license issue. > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
[ https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7041: Description: These tests fails in trunk now. MAPREDUCE-6984 may be related. {noformat} hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed hadoop.mapred.TestJobCleanup.testCustomAbort hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort {noformat} > Several unit tests in hadoop-mapreduce-client-jobclient are failed > -- > > Key: MAPREDUCE-7041 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > > These tests fails in trunk now. MAPREDUCE-6984 may be related. > {noformat} > hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed > hadoop.mapred.TestJobCleanup.testCustomAbort > hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
[ https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7041: Environment: (was: These tests fails in trunk now. MAPREDUCE-6984 may be related. {noformat} hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed hadoop.mapred.TestJobCleanup.testCustomAbort hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort {noformat}) > Several unit tests in hadoop-mapreduce-client-jobclient are failed > -- > > Key: MAPREDUCE-7041 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041 > Project: Hadoop Map/Reduce > Issue Type: Bug >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed
Takanobu Asanuma created MAPREDUCE-7041: --- Summary: Several unit tests in hadoop-mapreduce-client-jobclient are failed Key: MAPREDUCE-7041 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7041 Project: Hadoop Map/Reduce Issue Type: Bug Environment: These tests fails in trunk now. MAPREDUCE-6984 may be related. {noformat} hadoop.mapreduce.v2.TestMROldApiJobs.testJobSucceed hadoop.mapred.TestJobCleanup.testCustomAbort hadoop.mapreduce.lib.output.TestJobOutputCommitter.testCustomAbort {noformat} Reporter: Takanobu Asanuma Assignee: Takanobu Asanuma -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7036: Attachment: MAPREDUCE-7036.1.patch > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7036: Attachment: (was: MAPREDUCE-7036.1.patch) > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16336706#comment-16336706 ] Takanobu Asanuma commented on MAPREDUCE-7036: - Some failed tests may be related. I will investigate it further. > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16335474#comment-16335474 ] Takanobu Asanuma commented on MAPREDUCE-7036: - Uploaded the 1st patch. Since {{Application.java}} makes a {{jobTokenPassword}} under the current directory, it is generated under the root directory of hadoop-mapreduce-client-jobclient module when {{TestPipeApplication}} runs. The patch fixes the path. > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7036: Status: Patch Available (was: Open) > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7036: Attachment: MAPREDUCE-7036.1.patch > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7036: Attachment: (was: MAPREDUCE-7034.1.patch) > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7036.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7036: Attachment: MAPREDUCE-7034.1.patch > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > Attachments: MAPREDUCE-7034.1.patch > > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7021) Remove logger dependencies other than org.slf4j in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16326134#comment-16326134 ] Takanobu Asanuma commented on MAPREDUCE-7021: - I filed the license error in MAPREDUCE-7036 and it is not related to this patch. +1 (non-binding) > Remove logger dependencies other than org.slf4j in hadoop-mapreduce > --- > > Key: MAPREDUCE-7021 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7021 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Akira Ajisaka >Assignee: Akira Ajisaka >Priority: Major > Attachments: MAPREDUCE-7021.001.patch > > > We moved logging APIs over to slf4j, however, the dependency is left. We need > to cut the dependency. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Moved] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client
[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma moved HADOOP-15174 to MAPREDUCE-7036: -- Target Version/s: 3.1.0 (was: 3.1.0) Component/s: (was: test) test Key: MAPREDUCE-7036 (was: HADOOP-15174) Project: Hadoop Map/Reduce (was: Hadoop Common) > ASF License warning in hadoop-mapreduce-client > -- > > Key: MAPREDUCE-7036 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7036 > Project: Hadoop Map/Reduce > Issue Type: Test > Components: test >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Minor > > it occurred in MAPREDUCE-7021 and MAPREDUCE-7034. > {noformat} > Lines that start with ? in the ASF License report indicate files that do > not have an Apache license header: !? > /testptch/hadoop/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/jobTokenPassword > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16325930#comment-16325930 ] Takanobu Asanuma commented on MAPREDUCE-7034: - Thanks for reviewing and committing it, [~ajisakaa]! > Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce > - > > Key: MAPREDUCE-7034 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Fix For: 3.1.0 > > Attachments: MAPREDUCE-7034.1.patch > > > It seems there are some left. > {noformat} > find hadoop-mapreduce-project -name "*.java" | xargs grep "import > org.apache.commons.logging.Log" | wc -l >7 > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16325905#comment-16325905 ] Takanobu Asanuma commented on MAPREDUCE-7034: - The failed test is not related to this patch. I think we can apply MAPREDUCE-7021 after closing this jira. > Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce > - > > Key: MAPREDUCE-7034 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma >Priority: Major > Attachments: MAPREDUCE-7034.1.patch > > > It seems there are some left. > {noformat} > find hadoop-mapreduce-project -name "*.java" | xargs grep "import > org.apache.commons.logging.Log" | wc -l >7 > {noformat} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7034: Attachment: MAPREDUCE-7034.1.patch Uploaded the 1st patch. > Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce > - > > Key: MAPREDUCE-7034 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma > Attachments: MAPREDUCE-7034.1.patch > > > It seems there are some left. > {noformat} > find hadoop-mapreduce-project -name "*.java" | xargs grep "import > org.apache.commons.logging.Log" | wc -l >7 > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7034: Status: Patch Available (was: Open) > Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce > - > > Key: MAPREDUCE-7034 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma > Attachments: MAPREDUCE-7034.1.patch > > > It seems there are some left. > {noformat} > find hadoop-mapreduce-project -name "*.java" | xargs grep "import > org.apache.commons.logging.Log" | wc -l >7 > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16323535#comment-16323535 ] Takanobu Asanuma commented on MAPREDUCE-7034: - Thanks! > Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce > - > > Key: MAPREDUCE-7034 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Takanobu Asanuma >Assignee: Takanobu Asanuma > > It seems there are some left. > {noformat} > find hadoop-mapreduce-project -name "*.java" | xargs grep "import > org.apache.commons.logging.Log" | wc -l >7 > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Commented] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16323419#comment-16323419 ] Takanobu Asanuma commented on MAPREDUCE-7034: - Hi [~ajisakaa], could you grant me the right of the MAPREDUCE project's contribution? > Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce > - > > Key: MAPREDUCE-7034 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Takanobu Asanuma > > It seems there are some left. > {noformat} > find hadoop-mapreduce-project -name "*.java" | xargs grep "import > org.apache.commons.logging.Log" | wc -l >7 > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
[ https://issues.apache.org/jira/browse/MAPREDUCE-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-7034: Issue Type: Sub-task (was: Improvement) Parent: MAPREDUCE-6946 > Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce > - > > Key: MAPREDUCE-7034 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034 > Project: Hadoop Map/Reduce > Issue Type: Sub-task >Reporter: Takanobu Asanuma > > It seems there are some left. > {noformat} > find hadoop-mapreduce-project -name "*.java" | xargs grep "import > org.apache.commons.logging.Log" | wc -l >7 > {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-7034) Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
Takanobu Asanuma created MAPREDUCE-7034: --- Summary: Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce Key: MAPREDUCE-7034 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7034 Project: Hadoop Map/Reduce Issue Type: Improvement Reporter: Takanobu Asanuma It seems there are some left. {noformat} find hadoop-mapreduce-project -name "*.java" | xargs grep "import org.apache.commons.logging.Log" | wc -l 7 {noformat} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error (LocalJobRunner)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-6985: Description: Reported by Shingo Furuyama: We confirmed that MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 mode: LocalJobRunner was: Reported by Shingo Furuyama: We confirmed that MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 > MapReduce native optimization does not work properly due to a shuffle error > (LocalJobRunner) > > > Key: MAPREDUCE-6985 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 3.0.0-beta1 >Reporter: Takanobu Asanuma >Priority: Critical > Attachments: mr_native_optimization_error.log > > > Reported by Shingo Furuyama: > We confirmed that MapReduce native optimization (MAPREDUCE-2841) of > Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. > {noformat} > 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find > output/file.out in any of the configured local directories > at > org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) > at > org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) > at > org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) > at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) > at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) > at org.apache.hadoop.mapred.Task.done(Task.java:1174) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(Loc
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error (LocalJobRunner)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-6985: Summary: MapReduce native optimization does not work properly due to a shuffle error (LocalJobRunner) (was: MapReduce native optimization does not work properly due to a shuffle error) > MapReduce native optimization does not work properly due to a shuffle error > (LocalJobRunner) > > > Key: MAPREDUCE-6985 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 3.0.0-beta1 >Reporter: Takanobu Asanuma >Priority: Critical > Attachments: mr_native_optimization_error.log > > > Reported by Shingo Furuyama: > We confirmed that MapReduce native optimization (MAPREDUCE-2841) of > Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. > {noformat} > 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find > output/file.out in any of the configured local directories > at > org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) > at > org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) > at > org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) > at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) > at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) > at org.apache.hadoop.mapred.Task.done(Task.java:1174) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:748) > {noformat} > My build and run environment is below: > CentOS: 7.3 > cmake: 3.6.3 > Maven: 3.5.0 > Java: 1.8.0_131 > Hadoop: 3.0.0-beta1 -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
[ https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-6985: Description: Reported by Shingo Furuyama: We confirmed that MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 was: Reported by Shingo Furuyama: We confirmed MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 > MapReduce native optimization does not work properly due to a shuffle error > --- > > Key: MAPREDUCE-6985 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 3.0.0-beta1 >Reporter: Takanobu Asanuma >Priority: Critical > Attachments: mr_native_optimization_error.log > > > Reported by Shingo Furuyama: > We confirmed that MapReduce native optimization (MAPREDUCE-2841) of > Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. > {noformat} > 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find > output/file.out in any of the configured local directories > at > org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) > at > org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) > at > org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) > at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) > at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) > at org.apache.hadoop.mapred.Task.done(Task.java:1174) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Execut
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
[ https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-6985: Description: Reported by Shingo Furuyama: We confirmed MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 was: Reported by Shingo Furuyama: We confirmed MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 > MapReduce native optimization does not work properly due to a shuffle error > --- > > Key: MAPREDUCE-6985 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 3.0.0-beta1 >Reporter: Takanobu Asanuma >Priority: Critical > Attachments: mr_native_optimization_error.log > > > Reported by Shingo Furuyama: > We confirmed MapReduce native optimization (MAPREDUCE-2841) of > Hadoop-3.0.0-beta1 does not work properly due to a shuffle error. > {noformat} > 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find > output/file.out in any of the configured local directories > at > org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) > at > org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) > at > org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) > at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) > at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) > at org.apache.hadoop.mapred.Task.done(Task.java:1174) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$Runnabl
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
[ https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-6985: Description: Reported by Shingo Furuyama: We confirmed MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 was: I confirmed MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 > MapReduce native optimization does not work properly due to a shuffle error > --- > > Key: MAPREDUCE-6985 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 3.0.0-beta1 >Reporter: Takanobu Asanuma >Priority: Critical > Attachments: mr_native_optimization_error.log > > > Reported by Shingo Furuyama: > We confirmed MapReduce native optimization (MAPREDUCE-2841) of > Hadoop-3.0.0-beta1 does not work properly due to a shffle error. > {noformat} > 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find > output/file.out in any of the configured local directories > at > org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) > at > org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) > at > org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) > at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) > at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) > at org.apache.hadoop.mapred.Task.done(Task.java:1174) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[jira] [Updated] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
[ https://issues.apache.org/jira/browse/MAPREDUCE-6985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated MAPREDUCE-6985: Attachment: mr_native_optimization_error.log Attached the error log. > MapReduce native optimization does not work properly due to a shuffle error > --- > > Key: MAPREDUCE-6985 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 3.0.0-beta1 >Reporter: Takanobu Asanuma >Priority: Critical > Attachments: mr_native_optimization_error.log > > > I confirmed MapReduce native optimization (MAPREDUCE-2841) of > Hadoop-3.0.0-beta1 does not work properly due to a shffle error. > {noformat} > 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size > org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find > output/file.out in any of the configured local directories > at > org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) > at > org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) > at > org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) > at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) > at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) > at org.apache.hadoop.mapred.Task.done(Task.java:1174) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) > at > org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:748) > {noformat} > My build and run environment is below: > CentOS: 7.3 > cmake: 3.6.3 > Maven: 3.5.0 > Java: 1.8.0_131 > Hadoop: 3.0.0-beta1 -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org
[jira] [Created] (MAPREDUCE-6985) MapReduce native optimization does not work properly due to a shuffle error
Takanobu Asanuma created MAPREDUCE-6985: --- Summary: MapReduce native optimization does not work properly due to a shuffle error Key: MAPREDUCE-6985 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6985 Project: Hadoop Map/Reduce Issue Type: Bug Affects Versions: 3.0.0-beta1 Reporter: Takanobu Asanuma Priority: Critical I confirmed MapReduce native optimization (MAPREDUCE-2841) of Hadoop-3.0.0-beta1 does not work properly due to a shffle error. {noformat} 2017-10-19 11:59:40,513 WARN mapred.Task: Could not find output size org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/file.out in any of the configured local directories at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:489) at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:166) at org.apache.hadoop.mapred.MROutputFiles.getOutputFile(MROutputFiles.java:57) at org.apache.hadoop.mapred.Task.calculateOutputSize(Task.java:1248) at org.apache.hadoop.mapred.Task.sendLastUpdate(Task.java:1228) at org.apache.hadoop.mapred.Task.done(Task.java:1174) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:345) at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:271) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) {noformat} My build and run environment is below: CentOS: 7.3 cmake: 3.6.3 Maven: 3.5.0 Java: 1.8.0_131 Hadoop: 3.0.0-beta1 -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: mapreduce-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-issues-h...@hadoop.apache.org