Philip Zeyliger has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/9264 )

Change subject: Remove Yarn from minicluster.
......................................................................


Patch Set 1:

> Patch Set 1:
>
> > > Patch Set 1:
>  > >
>  > > Did you also test data load and snapshot creation?
>  >
>  > The way I ran the core tests, I definitely tested data load. As far
>  > as I can tell, snapshot creation is largely pg_dump and tar. I'd be
>  > happy for pointers in terms of what else to test.
>
> This is a bit flaky, but I do use it occasionally to generate random data for 
> the query generator.
>
> https://github.com/apache/impala/blob/master/tests/comparison/data_generator.py
>
> I do not regenerate this data often, but it's a useful tool to have. I know 
> little about Yarn. If you know another way to get this to work, especially 
> one not flaky, I"m all ears. And no, this is not part of any CI that I know 
> of; just a tool.

Does that work on miniclusters? I ran it and it's having trouble connecting 
over WebHDFS. I haven't tried very hard yet.

I'm leaning towards backtracking to just controlling it with a variable the 
defaults off, but that approach leaves some cruft around.


--
To view, visit http://gerrit.cloudera.org:8080/9264
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: I5504cc40b89e3c6d53fac0b7aa4b395fa63e8d79
Gerrit-Change-Number: 9264
Gerrit-PatchSet: 1
Gerrit-Owner: Philip Zeyliger <phi...@cloudera.com>
Gerrit-Reviewer: Alex Behm <alex.b...@cloudera.com>
Gerrit-Reviewer: Michael Brown <mi...@cloudera.com>
Gerrit-Reviewer: Philip Zeyliger <phi...@cloudera.com>
Gerrit-Comment-Date: Fri, 09 Feb 2018 18:14:27 +0000
Gerrit-HasComments: No

Reply via email to