Re: Any idea how to debug this?

, Rohini Palaniswamy <rohini.adi...@gmail.com> wrote: > Are the MR jobs succeeding or failing? Is there anything in the stderr logs > of the Oozie launcher? > > On Sun, Aug 6, 2017 at 4:36 AM, Ronald Green <green.ron...@gmail.com> > wrote: > > > Hi! > > >

Any idea how to debug this?

Hi! I have an HDP 1.3 (old, I know...) cluster that's running Pig 0.14 scripts through Oozie. There's a rare nuisance that's driving me crazy - the last few lines inin the oozie pig launcher log state that pig started a map reduce job (or several) and is keeping track of their progress and it

Re: How to run pig on spark ?

pache.org/r/45667/ > As for exact timelines Liyun / Rohini might be able to help you out. > > Adam > > On 21 December 2016 at 10:37, Ronald Green <green.ron...@gmail.com green.ron...@gmail.com>> wrote: > Adam, > > do you happen to know what's the status of t

Re: How to run pig on spark ?

Adam, do you happen to know what's the status of the spark branch, time line for it to be ready for merge with trunk? On Wed, Dec 21, 2016 at 10:37 AM, Adam Szita wrote: > Hi Canan, > > If you mean the trunk branch as https://github.com/apache/pig/tree/trunk/ > then no,

Re: Weird behaviour with string min/max

I can share demo data to go with the script. Anyone has any clue? On 24 March 2015 at 14:04, Ronald Green green.ron...@gmail.com wrote: Hi, I stumbled upon a case where MIN/MAX on strings results with values that are definitely not the minimum or the maximum: When executed on 1 million

Weird behaviour with string min/max

Hi, I stumbled upon a case where MIN/MAX on strings results with values that are definitely not the minimum or the maximum: When executed on 1 million records the following script results in wrong values for MIN/MAX: ``` src = LOAD 's3n://.../' USING PigStorage('\t','-noschema') AS (field1:int,

Re: Loading multiple files, each file as a record

...@hortonworks.com wrote: Didn¹t realize any, but it should be pretty easy to write a customized Loader/InputFormat for that. Daniel On 3/5/15, 6:18 AM, Ronald Green green.ron...@gmail.com wrote: Hi, I'm looking for a loader function that will let me read each file as a record on its own so

Re: DBStorage for loading data from mysql

using storage class. On Wed, May 21, 2014 at 5:07 PM, Ronald Green green.ron...@gmail.com wrote: You can use Apache Sqoop to move data from hdfs to relational databases and the other way around. On 21 May 2014 12:08, Mandeep Sihag mandyiit...@googlemail.com wrote: Hi, I want

Re: DBStorage for loading data from mysql

You can use Apache Sqoop to move data from hdfs to relational databases and the other way around. On 21 May 2014 12:08, Mandeep Sihag mandyiit...@googlemail.com wrote: Hi, I want to take input from mysql database, I can see that there is a DBStorage class for storing the output on database,

Re: rewrite equivalent pig script

What bug? Do you get an exception? It seems like you're trying to describe an alias that doesn't exist in your script. 'gpWeekRanked2' in store gpWeekRanked INTO 'gpWeekRanked2'; is actually a path (usually in HDFS) you store the data into. You can't describe it. On 13 March 2014 02:36, Suhas

Re: Assert doesn't work in Pig 0.12

is broken in 0.12.0. Here is the jira- https://issues.apache.org/jira/browse/PIG-3670 The fix will be included in 0.12.1 and onwards. In the meantime, can you apply the patch and rebuild Pig? Thanks, Cheolsoo On Mon, Feb 24, 2014 at 4:11 AM, Ronald Green green.ron...@gmail.com wrote: Hi

Assert doesn't work in Pig 0.12

Hi, It seems like ASSERT doesn't really work in Pig 0.12. I get the following message when I try to use ASSERT: [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1000: Error during parsing. Encountered IDENTIFIER assert at line 1, column 1. Was expecting one of: ... I also tried without