Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/11041 )
Change subject: IMPALA-7170: Update data_generator.py for Hadoop 3 ...................................................................... IMPALA-7170: Update data_generator.py for Hadoop 3 After the move to Hadoop 3, data_generator.py was broken. The issue seems to be that we rely on additional jars not in the classpath. The solution is to pass the location of these jars into the 'hadoop' command using the '-libjars' parameter. This patch also updates tests/comparison/README to add instructions for dealing with Yarn, since during the move to Hadoop 3 we switched to no longer running Yarn as part of the minicluster by default. Change-Id: I47b7d663174dbd38a5d9c98f1a88f0ebab726d5a Reviewed-on: http://gerrit.cloudera.org:8080/11041 Reviewed-by: Thomas Marshall <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M tests/comparison/README M tests/comparison/data_generator.py 2 files changed, 8 insertions(+), 2 deletions(-) Approvals: Thomas Marshall: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/11041 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I47b7d663174dbd38a5d9c98f1a88f0ebab726d5a Gerrit-Change-Number: 11041 Gerrit-PatchSet: 5 Gerrit-Owner: Thomas Marshall <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Thomas Marshall <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
