Re: Zip Exception since commit da4098b9

2016-10-01 Thread Sreenath Somarajapuram
m<mailto:m.rama...@ymail.com>> Date: Thursday, September 29, 2016 at 4:58 AM To: Hitesh Shah <hit...@apache.org<mailto:hit...@apache.org>> Cc: "user@tez.apache.org<mailto:user@tez.apache.org>" <user@tez.apache.org<mailto:user@tez.apache.org>> Subject: Re: Zip

Re: Zip Exception since commit da4098b9

2016-09-28 Thread Hitesh Shah
To pinpoint the issue, one approach would be to change the history logger to SimpleHistoryLogger . i.e comment out the property for tez.history.logging.service.class in the configs so that it falls back to the default value. This should generate a history log file as part of the application

Re: Zip Exception since commit da4098b9

2016-09-28 Thread Hitesh Shah
Hello Madhusudan, Thanks for the patience. Let us take this to a jira where once you attach more logs, we can root cause the issue. A few things to attach to the jira: - yarn-site.xml - tez-site.xml - hadoop version - timeline server log for the time period in question -

Re: Zip Exception since commit da4098b9

2016-09-24 Thread Hitesh Shah
tez-dist tar balls are not published to maven today - only the module specific jars are. But yes, you could just try a local build to see if you can reproduce the issue with the commit in question. — Hitesh > On Sep 23, 2016, at 6:23 PM, Madhusudan Ramanna wrote: > >

Re: Zip Exception since commit da4098b9

2016-09-23 Thread Madhusudan Ramanna
Hitesh and Zhiyuan, Apache snapshots doesn't seem to have tez-dist  http://repository.apache.org/content/groups/snapshots/org/apache/tez/tez-dist/ The last one seems to be 0.2.0-SNAPSHOT Should I just download based on the commit and recompile ?  thanks,Madhu On Friday, September 23, 2016

Re: Zip Exception since commit da4098b9

2016-09-23 Thread Hitesh Shah
Hello Madhusudan, If you look at the MANIFEST.MF inside any of the tez jars, it will provide the commit hash via the SCM-Revision field. The tez client and the DAGAppMaster also log this info at runtime. — Hitesh > On Sep 23, 2016, at 4:08 PM, Madhusudan Ramanna wrote:

Re: Zip Exception since commit da4098b9

2016-09-23 Thread Madhusudan Ramanna
Zhiyuan, We just pulled down the latest snapshot from Apache repository.   Question, is how can I figure out branch and commit information from the snapshot artifact ? thanks,Madhu On Friday, September 23, 2016 10:38 AM, zhiyuan yang wrote: Hi Madhu, It looks like

Re: Zip Exception since commit da4098b9

2016-09-23 Thread Hitesh Shah
Hello Madhusudan Thanks for reporting the issue. Would you mind filing a bug at https://issues.apache.org/jira/browse/tez with the application logs and tez configs attached? If you have a simple dag/job example that reproduces the behavior that would be great too. thanks — Hitesh > On Sep

Zip Exception since commit da4098b9

2016-09-23 Thread Madhusudan Ramanna
Hello, We're using the Apache snapshot repository to pull latest tez snapshots.  We've started seeing this exception: org.apache.tez.dag.api.TezUncheckedException: java.util.zip.ZipException: incorrect header check at