[ https://issues.apache.org/jira/browse/BEAM-6047?focusedWorklogId=165581&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-165581 ]
ASF GitHub Bot logged work on BEAM-6047: ---------------------------------------- Author: ASF GitHub Bot Created on: 13/Nov/18 19:05 Start Date: 13/Nov/18 19:05 Worklog Time Spent: 10m Work Description: udim opened a new pull request #7025: [BEAM-6047] Try to fix HDFS DNS issues URL: https://github.com/apache/beam/pull/7025 **Please** add a meaningful description for your change here ------------------------ Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). It will help us expedite review of your Pull Request if you tag someone (e.g. `@username`) to look at it. Post-Commit Tests Status (on master branch) ------------------------------------------------------------------------------------------------ Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/) | --- | --- | --- | --- | --- | --- Java | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/) [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/) Python | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/) | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) </br> [![Build Status](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/lastCompletedBuild/) | --- | --- | --- ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 165581) Time Spent: 1.5h (was: 1h 20m) > hdfsIntegrationTest is failing due to DisallowedDatanodeException > ----------------------------------------------------------------- > > Key: BEAM-6047 > URL: https://issues.apache.org/jira/browse/BEAM-6047 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, test-failures > Reporter: Chamikara Jayalath > Assignee: Udi Meiri > Priority: Critical > Time Spent: 1.5h > Remaining Estimate: 0h > > beam_PostCommit_Python_Verify is perma red due to this. > > [https://scans.gradle.com/s/pqg3ent77c2pu/console-log?task=:beam-sdks-python:hdfsIntegrationTest#L1653] > > [36mnamenode_1_d5b2d221b2e2 |[0m > org.apache.hadoop.hdfs.server.protocol.DisallowedDatanodeException: Datanode > denied communication with > namenode because hostname cannot be resolved (ip=172.18.0.3, > hostname=172.18.0.3): DatanodeRegistration(0.0.0.0:50010, > datanodeUuid=717d9e8f-ff6b-449c-bc94-6deb57455f93, infoPort=50075, > infoSecurePort=0, ipcPort=50020, > storageInfo=lv=-57;cid=CID-ef5ccec9-8245-45cc-9cc1-b103684e8ce1;nsid=1522131886;c=1542034438259) > > > [33mdatanode_1_3ee1bc415f49 |[0m 18/11/10 18:03:06 ERROR datanode.DataNode: > Initialization failed for Block pool BP-15607 > 62326-172.18.0.2-1541872973618 (Datanode Uuid > 367ac165-40b3-437f-97dc-567cb8d15da5) service to namenode/172.18.0.2:8020 > Datanode denied communication with namenode because hostname cannot be > resolved (ip=172.18.0.3, hostname=172.18.0.3): > DatanodeRegistration(0.0.0.0:50010, > datanodeUuid=367ac165-40b3-437f-97dc-567cb8d15da5, infoPort=50075, > infoSecurePort=0, ipcPort=50020, > storageInfo=lv=-57;cid=CID-d00d4259-9d80-4952-85d1-a0012d91842d;nsid=1271723208;c=1541872973618) > > Udi, any idea ? > > cc: [~swegner] [~altay] -- This message was sent by Atlassian JIRA (v7.6.3#76005)