Philip Zeyliger has posted comments on this change. ( http://gerrit.cloudera.org:8080/9264 )
Change subject: Remove Yarn from minicluster. ...................................................................... Patch Set 1: > Patch Set 1: > > > > Patch Set 1: > > > > > > Did you also test data load and snapshot creation? > > > > The way I ran the core tests, I definitely tested data load. As far > > as I can tell, snapshot creation is largely pg_dump and tar. I'd be > > happy for pointers in terms of what else to test. > > This is a bit flaky, but I do use it occasionally to generate random data for > the query generator. > > https://github.com/apache/impala/blob/master/tests/comparison/data_generator.py > > I do not regenerate this data often, but it's a useful tool to have. I know > little about Yarn. If you know another way to get this to work, especially > one not flaky, I"m all ears. And no, this is not part of any CI that I know > of; just a tool. Does that work on miniclusters? I ran it and it's having trouble connecting over WebHDFS. I haven't tried very hard yet. I'm leaning towards backtracking to just controlling it with a variable the defaults off, but that approach leaves some cruft around. -- To view, visit http://gerrit.cloudera.org:8080/9264 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I5504cc40b89e3c6d53fac0b7aa4b395fa63e8d79 Gerrit-Change-Number: 9264 Gerrit-PatchSet: 1 Gerrit-Owner: Philip Zeyliger <[email protected]> Gerrit-Reviewer: Alex Behm <[email protected]> Gerrit-Reviewer: Michael Brown <[email protected]> Gerrit-Reviewer: Philip Zeyliger <[email protected]> Gerrit-Comment-Date: Fri, 09 Feb 2018 18:14:27 +0000 Gerrit-HasComments: No
