Re: Pig-Eclipse update - version 1.1.0

2015-03-30 Thread Jianfeng (Jeff) Zhang
Nice job Eyal, it¹s very helpful for the community Best Regard, Jeff Zhang On 3/31/15, 5:19 AM, Eyal Allweil eyal_allw...@yahoo.com.INVALID wrote: Hi all, I'm glad to announce a new version of Pig-Eclipse. We've been using it for a few weeks where I work (PayPal) and I think we've caught

Re: Error when writing totuple

2015-07-23 Thread Jianfeng (Jeff) Zhang
More context logs would be helpful Best Regard, Jeff Zhang On 7/23/15, 12:31 AM, sajid mohammed sajid.had...@gmail.com wrote: i am trying to create totuple but getting some parse errors

Re: Query | Join Internals

2015-07-14 Thread Jianfeng (Jeff) Zhang
This document should be helpful for you https://wiki.apache.org/pig/PigSkewedJoinSpec Best Regard, Jeff Zhang On 7/14/15, 4:56 AM, Gagan Juneja gagandeepjun...@gmail.com wrote: Hi Team, We are using Pig intensively in our various projects. We are doing optimizations for that we wanted

Re: NoClassDefFoundError: org/joda/time/ReadableInstant Server IPC version 9 cannot communicate with client version 4

2015-07-14 Thread Jianfeng (Jeff) Zhang
It should be classpath issue. Did you set the PIG_HOME ? Maybe you still point PIG_HOME to pig version 0.13 Best Regard, Jeff Zhang On 7/14/15, 12:00 PM, Antoine Lafleur antoine.lafl...@gmx.fr wrote: Evening, Sorry to bother, in case of anyone do have the same issue, it seems that

Re: Setup debug mode in eclipse for Java UDF and pig script

2015-07-13 Thread Jianfeng (Jeff) Zhang
: org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve com.pig.udf.PigUDF using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.] Where PigUDF is my UDF class . Thanks, On 10 July 2015 at 14:03, Jianfeng (Jeff) Zhang jzh...@hortonworks.commailto:jzh...@hortonworks.com

Re: Pig FS commands

2015-07-13 Thread Jianfeng (Jeff) Zhang
What¹s your purpose for that ? Best Regard, Jeff Zhang On 7/11/15, 9:29 AM, Andy Srine andy.sr...@gmail.com wrote: Folks, Is there an easy way to store the output of the FS commands to a variable in a pig script? Either native pig or even a solution using embedded Python will help.

Re: Java UDF Error: ERROR 1066: Unable to open iterator for alias

2015-07-13 Thread Jianfeng (Jeff) Zhang
Application application_1436453941326_0020 failed 2 times due to AM Container for appattempt_1436453941326_0020_02 exited with exitCode: 1 Could you check the yarn app log ? Best Regard, Jeff Zhang On 7/10/15, 5:38 PM, Divya Gehlot divya.htco...@gmail.com wrote: Hi My input

Re: Setup debug mode in eclipse for Java UDF and pig script

2015-07-10 Thread Jianfeng (Jeff) Zhang
You can use pig¹s java API to debug your script in eclipse. Here¹s one simple example. public static void main(String[] args) throws IOException { PigServer pig = new PigServer(ExecType.LOCAL); pig.registerScript(myscript.pig); } Best Regard, Jeff Zhang On 7/9/15,

Re: PigServer class and script execution

2016-01-11 Thread Jianfeng (Jeff) Zhang
e whole pig >script using PigServer class... that apparently doesnt support AvroStorage >or I can see it. > > >best, >john > >On Mon, Jan 11, 2016 at 6:27 PM, Jianfeng (Jeff) Zhang < >jzh...@hortonworks.com> wrote: > >> >> Of course, you can. AvroSt

Re: PigServer class and script execution

2016-01-11 Thread Jianfeng (Jeff) Zhang
Of course, you can. AvroStorage is a built-in UDF, you just need to put pig jar on the classpath Best Regard, Jeff Zhang On 1/11/16, 4:22 AM, "John Smith" wrote: >Hi, > >I have a java code that generates pig script. I am wondering if there is >option to execute that

Re: [ANNOUNCE] Welcome new Pig Committer - Liyun Zhang

2016-12-19 Thread Jianfeng (Jeff) Zhang
Congratulations Liyun! Best Regard, Jeff Zhang On 12/20/16, 11:29 AM, "Pallavi Rao" wrote: >Congratulations Liyun!

Re: Assigning resources to individual MR jobs of a Pig script

2017-03-19 Thread Jianfeng (Jeff) Zhang
=email_ >sig_campaign=chrome_ext> > > > > >[image: http://] > >Tariq, Mohammad >about.me/mti >[image: http://] ><http://about.me/mti> > > >On Fri, Mar 17, 2017 at 2:24 PM, Jianfeng (Jeff) Zhang < >jzh...@hortonworks.com> wrote: > >>

Re: Assigning resources to individual MR jobs of a Pig script

2017-03-17 Thread Jianfeng (Jeff) Zhang
I would suggest you to use tez which just launch one yarn app for one pig script. http://pig.apache.org/docs/r0.16.0/perf.html#enable-tez Best Regard, Jeff Zhang On 3/17/17, 3:24 AM, "Mohammad Tariq" wrote: >Hi group, > >In any real world pig script we end up with

Re: [ANNOUNCE] Apache Pig 0.17.0 released

2017-06-29 Thread Jianfeng (Jeff) Zhang
Awesome, I also have integrated spark engine in zeppelin notebook as well. https://github.com/zjffdu/zeppelin/tree/ZEPPELIN-2615 Best Regard, Jeff Zhang On 6/23/17, 5:09 AM, "Rohini Palaniswamy" wrote: >Thanks Adam for being the Release Manager and getting