I want to play with PigPen, but although I can find the patches here: https://issues.apache.org/jira/browse/PIG-366
on the Jira, I cannot find the source in trunk/contrib/pigpen, or in
any path in any branch.
Where does the PigPen source reside? Does it exist only as a patch?
Russell
For 1.0 - complete Owl?
http://wiki.apache.org/pig/Metadata
Russell Jurney
rjur...@cloudstenography.com
On Jun 23, 2009, at 4:40 PM, Alan Gates wrote:
I don't believe there's a solid list of want to haves for 1.0. The
big issue I see is that there are too many interfaces that are still
Project: Pig
Issue Type: New Feature
Components: impl
Reporter: Russell Jurney
Assignee: Russell Jurney
Fix For: 0.7.0
Attachments: joda-mavenstuff.diff, pass.patch
Original Estimate: 168h
Remaining Estimate: 168h
Not sure if this is exactly the same, but when I've created tuples within
tuples in UDFs (to preserve order of pairs), from bag input, Pig has allowed
it - but I can't work with that data in subsequent steps.
On Fri, Apr 2, 2010 at 12:37 PM, hc busy hc.b...@gmail.com wrote:
Yeah, I'm sure it
How do you make a patch with git that hudson will eat? git diff/git diff -p
don't cut the mustard.
Russ
Have tried --no-prefix, and it still will not apply without -p1.
Strangeness. Anyone got any ideas?
Russ
On Tue, May 18, 2010 at 11:31 AM, Russell Jurney
russell.jur...@gmail.comwrote:
How do you make a patch with git that hudson will eat? git diff/git diff
-p don't cut the mustard.
Russ
,
if it doesn't work maybe post a (fragment of a) patch so that we can take
a look/compare?
ero
On 05/18/2010 12:36 PM, Russell Jurney wrote:
Have tried --no-prefix, and it still will not apply without -p1.
Strangeness. Anyone got any ideas?
Russ
On Tue, May 18, 2010 at 11:31 AM, Russell
Issue Type: Improvement
Components: impl
Affects Versions: 0.8.0
Reporter: Russell Jurney
Assignee: Russell Jurney
Fix For: 0.8.0
Attachments: addconcat2.patch
Original Estimate: 24h
Remaining Estimate: 24h
it, this patch is already in trunk.
-D
On Thu, May 27, 2010 at 11:22 AM, Russell Jurney
russell.jur...@gmail.comwrote:
Arg, I am terrible at making patches :(
On Thu, May 27, 2010 at 5:24 AM, Hadoop QA (JIRA) j...@apache.org
wrote:
[
https://issues.apache.org/jira/browse
Would it be possible, and not a ton of work to make the builtin SIZE() work
on a relation? Reason being, I frequently do this:
B = GROUP A ALL;
C = FOREACH B GENERATE SIZE(A) AS total;
DUMP C;
And I would rather do this:
DUMP SIZE(A);
Russ
.
There are obvious users-doing-dumb-stuff scenarios that arise though.
I guess the Pig philosophy is that the user is the optimizer, though.. so
maybe it's ok.
-D
On Fri, Jun 11, 2010 at 6:42 PM, Russell Jurney russell.jur...@gmail.com
wrote:
Would it be possible, and not a ton of work to make
I don't fully understand the repercussions of this, but I like it. We're
moving from our VoldemortStorage stuff to Avro and it would be great to pipe
Avro all the way through.
Russ
On Mon, Jun 28, 2010 at 5:51 PM, Dmitriy Ryaboy dvrya...@gmail.com wrote:
For what it's worth, I saw very
Project: Pig
Issue Type: Improvement
Components: impl
Affects Versions: 0.8.0
Reporter: Russell Jurney
Assignee: Russell Jurney
Fix For: 0.8.0
Attachments: addconcat2.patch, PIG-1420.2.patch
Original Estimate: 24h
Confirming Richard and I are attending.
On Wed, Aug 18, 2010 at 4:45 PM, Dmitriy Ryaboy dvrya...@gmail.com wrote:
Hi folks,
Please do RSVP so that we know how many people are coming.
Thanks,
-Dmitriy
On Tue, Aug 17, 2010 at 4:04 PM, Alan Gates ga...@yahoo-inc.com wrote:
All,
We
Not much of a contributor lately, but +1 from me. Seems reasonable.
On Wed, Aug 18, 2010 at 7:11 PM, Chaitanya Krishna
chaitanyavv.ii...@gmail.com wrote:
+1.
On Thu, Aug 19, 2010 at 7:33 AM, Santhosh Srinivasan s...@yahoo-inc.com
wrote:
+1
Kudos to Alan and Olga for this amazing
Oh, +2 more - Pete Skomoroch and Sam Shah will also attend, for a total of
4 LinkedIners.
On Wed, Aug 18, 2010 at 9:18 PM, Alan Gates ga...@yahoo-inc.com wrote:
Confirming Olga and I will be there.
Alan.
On Aug 18, 2010, at 4:45 PM, Dmitriy Ryaboy wrote:
Hi folks,
Please do RSVP so
Slides about Azkaban and Pig:
http://www.slideshare.net/rjurney/azkaban-pig-5057793
On Thu, Aug 26, 2010 at 12:55 AM, Jeff Zhang zjf...@gmail.com wrote:
Wonderful, Dmitriy, It's pity for me missing the contributor meeting.
And any ppt shared ?
On Wed, Aug 25, 2010 at 8:32 PM, Dmitriy
Pardon the cross-post: Does Pig ever re-use FileInputLoadFunc objects? We
suspect state is being retained between different stores, but we don't
actually know this. Figured I'd ask to verify the hunch.
Our load func for our in-house format works fine with Pig scripts
normally... but I have a
[
https://issues.apache.org/jira/browse/PIG-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12735729#action_12735729
]
Russell Jurney commented on PIG-896:
Not sure if you're able to get it running
/
Reporter: Russell Jurney
Fix For: 0.5.0
I've implemented a UDF in Pig 0.5 that implements Algebraic and calculates
variance in a distributed manner, based on the AVG() builtin. It works by
calculating the count, sum and sum of squares, as described here:
http://en.wikipedia.org/wiki
[
https://issues.apache.org/jira/browse/PIG-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1150:
Attachment: var.patch
This patch will not cut the mustard - it lacks Javadoc, and test cases and its
[
https://issues.apache.org/jira/browse/PIG-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12791582#action_12791582
]
Russell Jurney commented on PIG-1150:
-
Oh - one other thing - I've read that this naive
Reporter: Russell Jurney
Fix For: 0.7.0
I've written UDFs to handle loading unix times, datemonth values and ISO 8601
formatted date strings, and working with them as ISO datetimes using jodatime.
The working code is here:
http://github.com/rjurney/oink/tree/master/src/java/oink
[
https://issues.apache.org/jira/browse/PIG-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847600#action_12847600
]
Russell Jurney commented on PIG-1150:
-
Yes, this sounds like the thing to do :)
On Tue
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12847874#action_12847874
]
Russell Jurney commented on PIG-1310:
-
I'm thinking it would be good if DateTime
Add DateTime Support to Pig
---
Key: PIG-1314
URL: https://issues.apache.org/jira/browse/PIG-1314
Project: Pig
Issue Type: Bug
Components: data
Affects Versions: 0.8.0
Reporter: Russell
[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848356#action_12848356
]
Russell Jurney commented on PIG-1314:
-
Thanks, Alan. That is quite helpful. Let me look
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: (was: datetime.patch)
ISO Date UDFs: Conversion, Rounding and Date Math
[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848618#action_12848618
]
Russell Jurney commented on PIG-1314:
-
I would not say this blocks PIG-1310 at all
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12848958#action_12848958
]
Russell Jurney commented on PIG-1310:
-
Alan, yes jodatime is on a maven repo - I have
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: datetime2.patch
Added checks for null/ foo sized tuples. Added CustomFormatToISO class
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849528#action_12849528
]
Russell Jurney commented on PIG-1310:
-
Thanks, Alan, I'll add all those changes tonight
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: (was: datetime.patch)
ISO Date UDFs: Conversion, Rounding and Date Math
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: (was: datetime2.patch)
ISO Date UDFs: Conversion, Rounding and Date Math
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12849623#action_12849623
]
Russell Jurney commented on PIG-1310:
-
Oh, I'm allergic to XML. Seriously allergic. Can
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Summary: ISO Date UDFs: Conversion, Trucation and Date Math (was: ISO Date
UDFs: Conversion
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: tests.patch
Tests attached.
ISO Date UDFs: Conversion, Trucation and Date Math
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: (was: datetime3.patch)
ISO Date UDFs: Conversion, Trucation and Date Math
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: combined.patch
All inclusive patch from pig root, includes all classes and tests
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: (was: tests.patch)
ISO Date UDFs: Conversion, Trucation and Date Math
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: (was: combined.patch)
ISO Date UDFs: Conversion, Trucation and Date Math
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: deargod.patch
Last shot at a patch - this builds and tests ok against a fresh checkout
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: (was: deargod.patch)
ISO Date UDFs: Conversion, Trucation and Date Math
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1310:
Attachment: pass.patch
Ok, this patch works.
ISO Date UDFs: Conversion, Trucation and Date
[
https://issues.apache.org/jira/browse/PIG-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12851542#action_12851542
]
Russell Jurney commented on PIG-1310:
-
Cool - one thing though - Piggybank itself does
Project: Pig
Issue Type: Improvement
Components: impl
Affects Versions: 0.8.0
Reporter: Russell Jurney
Fix For: 0.7.0
org.apache.pig.builtin.CONCAT (which acts on DataByteArray's internally) and
org.apache.pig.builtin.StringConcat (which acts
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Attachment: concat.patch
Patch that adds:
1) CONCAT handles all fields in the supplied tuple
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Status: Patch Available (was: Open)
Release Note:
CONCAT handles all fields
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Status: Open (was: Patch Available)
Redoing CONCAT of DataByteArrays using java.nio.ByteBuffer
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Status: Patch Available (was: Open)
Re-submitting original, java.nio.ByteBuffer isn't very helpful
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Status: In Progress (was: Patch Available)
I don't know what resume progress does, but I'm about
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12868765#action_12868765
]
Russell Jurney commented on PIG-1420:
-
Dmitriy, it applies with -p1
Make CONCAT act
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Attachment: addconcat.patch
New, working patch made with git diff --no-prefix, applies with -p0
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Attachment: (was: concat.patch)
Make CONCAT act on all fields of a tuple, instead of just
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Patch Info: [Patch Available]
Make CONCAT act on all fields of a tuple, instead of just the first
[
https://issues.apache.org/jira/browse/PIG-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1420:
Attachment: addconcat2.patch
Fixed bad comment re: copying bytes.
Make CONCAT act on all fields
: Russell Jurney
Fix For: 0.8.0
Pig needs a Boolean data type. Pig-1097 is dependent on doing this.
I volunteer. Is there anything beyond the work in src/org/apache/pig/data/
plus unit tests to make this work?
--
This message is automatically generated by JIRA.
-
You can reply
Project: Pig
Issue Type: Improvement
Components: impl
Affects Versions: 0.7.0
Reporter: Russell Jurney
Fix For: 0.8.0
All functions in
contrib.piggybank.java.src.main.java.org.apache.pig.piggybank.evaluation.datetime
should
[
https://issues.apache.org/jira/browse/PIG-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12873217#action_12873217
]
Russell Jurney commented on PIG-1430:
-
Actually, I think it should interpret int as unix
: 0.7.0
Reporter: Russell Jurney
Fix For: 0.8.0
Need a NOW() for getting datetime diffs between now and a prior or future date.
Will use the system timezone. Will make one for ISO datetime and one for Unix
time.
--
This message is automatically generated by JIRA.
-
You
[
https://issues.apache.org/jira/browse/PIG-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12873233#action_12873233
]
Russell Jurney commented on PIG-1430:
-
Good idea, will do!
ISODateTime - DateTime
[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12873234#action_12873234
]
Russell Jurney commented on PIG-1314:
-
As a first pass, I am going to add Boolean, which
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1429:
Attachment: boolean.patch
Broken patch that adds boolean type.
Add Boolean Data Type to Pig
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12873363#action_12873363
]
Russell Jurney commented on PIG-1429:
-
Did the work I think is required based on Alan's
[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12873382#action_12873382
]
Russell Jurney commented on PIG-1314:
-
Ok, thinking about really doing this soon, after
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1429:
Attachment: boolean.patch
Add Boolean Data Type to Pig
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1429:
Attachment: (was: boolean.patch)
Add Boolean Data Type to Pig
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12873474#action_12873474
]
Russell Jurney commented on PIG-1429:
-
Did some more work, have a new patch... seems
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1429:
Attachment: working_boolean.patch
Attached patch can LOAD/DUMP a boolean type :D I'll work on more
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1429:
Attachment: (was: boolean.patch)
Add Boolean Data Type to Pig
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12873629#action_12873629
]
Russell Jurney commented on PIG-1429:
-
Some more work to be done with operators.
Add
[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12873664#action_12873664
]
Russell Jurney commented on PIG-1314:
-
Hmmm not sure if I should use durations or periods
Components: grunt
Affects Versions: 0.7.0
Reporter: Russell Jurney
Priority: Minor
Fix For: 0.8.0
I often run a script multiple times, or have to go and look through Hadoop task
logs, to figure out where I broke a long script in such a way that I get 0
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12877544#action_12877544
]
Russell Jurney commented on PIG-1429:
-
The patch needs more work. Should knock it out
[
https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12880731#action_12880731
]
Russell Jurney commented on PIG-1429:
-
I'll be able to wrap this up next weekend.
Add
Project: Pig
Issue Type: New Feature
Affects Versions: 0.7.0
Environment: sunny, 60% humidity with a chance of rain.
Reporter: Russell Jurney
Fix For: 0.8.0
After doing a JOIN or a GROUP/FOREACH, one often ends up with data looking like:
DESCRIBE
[
https://issues.apache.org/jira/browse/PIG-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1476:
Description:
After doing a JOIN or a GROUP/FOREACH, one often ends up with data looking like
[
https://issues.apache.org/jira/browse/PIG-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1476:
Description:
After doing a JOIN or a GROUP/FOREACH, one often ends up with data looking like
[
https://issues.apache.org/jira/browse/PIG-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12884557#action_12884557
]
Russell Jurney commented on PIG-1430:
-
I've been thinking about the feedback
[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12884558#action_12884558
]
Russell Jurney commented on PIG-1314:
-
Been thinking about this... I don't think we
[
https://issues.apache.org/jira/browse/PIG-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12884562#action_12884562
]
Russell Jurney commented on PIG-1314:
-
I suck at JIRA. See proposal in PIG-1430.
Add
[
https://issues.apache.org/jira/browse/PIG-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney resolved PIG-1476.
-
Resolution: Fixed
This is actually ok.
Add trailing flag to commands to prevent retention
Type: New Feature
Components: impl
Affects Versions: 0.7.0
Reporter: Russell Jurney
Fix For: 0.8.0
rjurney$ pig -q default
This sets the mapred.job.queue.name property in the execution engine from the
pig properties for MAPRED type jobs.
Patch attached
[
https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1495:
Status: Patch Available (was: Open)
Add -q command line option to set queue name for Pig jobs from
[
https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Jurney updated PIG-1495:
Status: Open (was: Patch Available)
Add -q command line option to set queue name for Pig jobs from
[
https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12887585#action_12887585
]
Russell Jurney commented on PIG-1495:
-
This doesn't work yet. Doh!
Add -q command line
86 matches
Mail list logo
