kennknowles opened a new issue, #18801:
URL: https://github.com/apache/beam/issues/18801
Currently the HCatalogIOIT test is working ****only**** with provided
infrastructure (e.g. DataProc). It is caused by lack of docker image which
would meet test requirements.
* First of all some of Hive images are custom made and does not contain
HCatalog.
* Secondly some of images are problematic in terms of network
configuration. It was impossible to make all components visible for each other
(datanodes, namenodes, etc.), what was observed with following error:
```
org.apache.hadoop.ipc.RemoteException(java.io.IOException): File could only
be replicated to 0 nodes
instead of minReplication (=1). There are 1 datanode(s) running and 1
node(s) are excluded in this operation.
```
Here is related stackoverflow issue:
[https://stackoverflow.com/questions/26743656/hadoop-2-5-0-failure-to-write-file-remotely](https://stackoverflow.com/questions/26743656/hadoop-2-5-0-failure-to-write-file-remotely)
For a moment there is no solution.
What seems to be a next reasonable point to check here is creating own
docker image, publish it and test it.
Imported from Jira
[BEAM-4413](https://issues.apache.org/jira/browse/BEAM-4413). Original Jira may
contain additional context.
Reported by: kasiak.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
