On Jul 22, 2008, at 11:33 AM, Marko Bauhardt wrote:
hi all,
we ran into performance problems by executing several pig-queries.
so in our case it is important to see how long needs a pig query.
is it possible to see in the logfiles how long needs a pig query to
execute? if no is the class "POMapreduce" in method "open()"
sorry i mean at "boolean success = mapReduceLauncher.launchPig(this);"
instead
at "pigServer.store(dbTable.getAlias(), storeFile.toString(),
storeStatement);"
e.g.
long startTime = System.currentTimeMillis();
boolean success = mapReduceLauncher.launchPig(this);
long endTime = System.currentTimeMillis();
long diff = (endTime - startTime) / 1000;
log.info("launched pig in " + diff + " sec.");
thanks for hints
marko