[jira] [Updated] (CRUNCH-181) UUID PType support for Writables

2013-03-19 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-181: -- Attachment: CRUNCH-181.patch Patch for adding in a simple UUIDWritable, simple test, and added

[jira] [Commented] (CRUNCH-181) UUID PType support for Writables

2013-03-20 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13608379#comment-13608379 ] Micah Whitacre commented on CRUNCH-181: --- +1. Is there value in a null check? I

[jira] [Commented] (CRUNCH-192) Document and enforce the semantics around reducer-based Iterables

2013-04-08 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13625844#comment-13625844 ] Micah Whitacre commented on CRUNCH-192: --- If this is dumping onto the bug I can log

[jira] [Created] (CRUNCH-194) Utilities and Documentation for handling values in reduce-Iterable

2013-04-08 Thread Micah Whitacre (JIRA)
Micah Whitacre created CRUNCH-194: - Summary: Utilities and Documentation for handling values in reduce-Iterable Key: CRUNCH-194 URL: https://issues.apache.org/jira/browse/CRUNCH-194 Project: Crunch

[jira] [Commented] (CRUNCH-192) Document and enforce the semantics around reducer-based Iterables

2013-04-08 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13625914#comment-13625914 ] Micah Whitacre commented on CRUNCH-192: --- Fair enough. Logged CRUNCH-194.

[jira] [Updated] (CRUNCH-198) CogroupIT Failure under hadoop-2 profile

2013-04-25 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-198: -- Attachment: org.apache.crunch.lib.CogroupIT.txt Here is the failsafe output from running with

[jira] [Created] (CRUNCH-198) CogroupIT Failure under hadoop-2 profile

2013-04-25 Thread Micah Whitacre (JIRA)
Micah Whitacre created CRUNCH-198: - Summary: CogroupIT Failure under hadoop-2 profile Key: CRUNCH-198 URL: https://issues.apache.org/jira/browse/CRUNCH-198 Project: Crunch Issue Type: Bug

[jira] [Commented] (CRUNCH-198) CogroupIT Failure under hadoop-2 profile

2013-04-25 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13642158#comment-13642158 ] Micah Whitacre commented on CRUNCH-198: --- +1 change fixed the tests for me.

[jira] [Created] (CRUNCH-199) Add Source and Target Support for AvroTrevniKey files

2013-04-26 Thread Micah Whitacre (JIRA)
Micah Whitacre created CRUNCH-199: - Summary: Add Source and Target Support for AvroTrevniKey files Key: CRUNCH-199 URL: https://issues.apache.org/jira/browse/CRUNCH-199 Project: Crunch Issue

[jira] [Updated] (CRUNCH-199) Add Source and Target Support for AvroTrevniKey files

2013-04-26 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-199: -- Attachment: CRUNCH-199.patch First pass at adding support for AvroTrevniKey support as a

[jira] [Commented] (CRUNCH-199) Add Source and Target Support for AvroTrevniKey files

2013-04-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13644459#comment-13644459 ] Micah Whitacre commented on CRUNCH-199: --- Yeah I only added the call:

[jira] [Commented] (CRUNCH-200) Move the logic for handling job outputs from CrunchJobHooks into the PathTarget objects

2013-04-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13645137#comment-13645137 ] Micah Whitacre commented on CRUNCH-200: --- Changes look good. One little tweak might

[jira] [Comment Edited] (CRUNCH-200) Move the logic for handling job outputs from CrunchJobHooks into the PathTarget objects

2013-04-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13645137#comment-13645137 ] Micah Whitacre edited comment on CRUNCH-200 at 4/30/13 1:48 AM:

[jira] [Commented] (CRUNCH-234) PCollectionGetSizeIT test failure with hadoop-2 profile

2013-07-03 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13699174#comment-13699174 ] Micah Whitacre commented on CRUNCH-234: --- I believe for Sequence files you can

[jira] [Commented] (CRUNCH-234) PCollectionGetSizeIT test failure with hadoop-2 profile

2013-07-08 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13702252#comment-13702252 ] Micah Whitacre commented on CRUNCH-234: --- +1. Change fixed the build for me locally

[jira] [Commented] (CRUNCH-205) Remove superfluous directory from source distribution

2013-07-16 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710637#comment-13710637 ] Micah Whitacre commented on CRUNCH-205: --- Is this bug indicating that the build

[jira] [Commented] (CRUNCH-212) Need target wrapper for HFileOuptutFormat

2013-07-16 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13710646#comment-13710646 ] Micah Whitacre commented on CRUNCH-212: --- Reading through the discussion on this bug

[jira] [Commented] (CRUNCH-205) Remove superfluous directory from source distribution

2013-07-17 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13711936#comment-13711936 ] Micah Whitacre commented on CRUNCH-205: --- Not sure I have a work around for this but

[jira] [Commented] (CRUNCH-212) Need target wrapper for HFileOuptutFormat

2013-07-17 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13711939#comment-13711939 ] Micah Whitacre commented on CRUNCH-212: --- bq. Micah. I'm working on 1) for a while

[jira] [Commented] (CRUNCH-205) Remove superfluous directory from source distribution

2013-07-18 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13712269#comment-13712269 ] Micah Whitacre commented on CRUNCH-205: --- Wouldn't another option be to add an

[jira] [Updated] (CRUNCH-205) Remove superfluous directory from source distribution

2013-07-18 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-205: -- Attachment: CRUNCH-205.patch Setup to delete the build directory in the After.

[jira] [Assigned] (CRUNCH-205) Remove superfluous directory from source distribution

2013-07-22 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre reassigned CRUNCH-205: - Assignee: Micah Whitacre Remove superfluous directory from source distribution

[jira] [Created] (CRUNCH-243) Support easily extensibility for custom reading of Avro Datum

2013-07-23 Thread Micah Whitacre (JIRA)
Micah Whitacre created CRUNCH-243: - Summary: Support easily extensibility for custom reading of Avro Datum Key: CRUNCH-243 URL: https://issues.apache.org/jira/browse/CRUNCH-243 Project: Crunch

[jira] [Commented] (CRUNCH-243) Support easily extensibility for custom reading of Avro Datum

2013-07-23 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13716660#comment-13716660 ] Micah Whitacre commented on CRUNCH-243: --- Only other change I was toying with would

[jira] [Updated] (CRUNCH-243) Support easily extensibility for custom reading of Avro Datum

2013-07-23 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-243: -- Attachment: CRUNCH-243_v2.patch Change with the constructors expanded.

[jira] [Resolved] (CRUNCH-243) Support easily extensibility for custom reading of Avro Datum

2013-07-23 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre resolved CRUNCH-243. --- Resolution: Fixed Fix Version/s: 0.7.0 Commit has been merged to master.

[jira] [Commented] (CRUNCH-244) Add support for hadoop1 and hadoop2 classifiers to the POM and release artifacts

2013-07-25 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13719619#comment-13719619 ] Micah Whitacre commented on CRUNCH-244: --- I'm not as well versed in how the projects

[jira] [Commented] (CRUNCH-245) hbase.zookeeper.quorum is overriden by hbase-default.xml

2013-08-02 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13727627#comment-13727627 ] Micah Whitacre commented on CRUNCH-245: --- +1 for removing. I would expect consumers

[jira] [Updated] (CRUNCH-245) hbase.zookeeper.quorum is overriden by hbase-default.xml

2013-08-02 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-245: -- Assignee: (was: Micah Whitacre) hbase.zookeeper.quorum is overriden by

[jira] [Updated] (CRUNCH-212) Need target wrapper for HFileOuptutFormat

2013-08-02 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-212: -- Fix Version/s: 0.8.0 Need target wrapper for HFileOuptutFormat

[jira] [Commented] (CRUNCH-246) HFileSource

2013-08-07 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13732071#comment-13732071 ] Micah Whitacre commented on CRUNCH-246: --- The mapreduce snapshotting bug in HBase is

[jira] [Commented] (CRUNCH-216) Transpose arguments in MapsideJoinStrategy.join

2013-08-18 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743381#comment-13743381 ] Micah Whitacre commented on CRUNCH-216: --- Did we miss getting this issue resolved in

[jira] [Updated] (CRUNCH-239) Add support for unions of PTypes

2013-08-18 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-239: -- Issue Type: Improvement (was: Bug) Add support for unions of PTypes

[jira] [Assigned] (CRUNCH-226) Switch to newer scala-maven-plugin

2013-08-18 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre reassigned CRUNCH-226: - Assignee: Micah Whitacre Switch to newer scala-maven-plugin

[jira] [Resolved] (CRUNCH-226) Switch to newer scala-maven-plugin

2013-08-18 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre resolved CRUNCH-226. --- Resolution: Fixed Thanks for the patch Jan. It looked good and has been merged into master.

[jira] [Commented] (CRUNCH-227) Write to sequence file ignores destination path.

2013-08-18 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743398#comment-13743398 ] Micah Whitacre commented on CRUNCH-227: --- [~florian_laws], to confirm the root cause

[jira] [Assigned] (CRUNCH-239) Add support for unions of PTypes

2013-08-19 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre reassigned CRUNCH-239: - Assignee: Micah Whitacre (was: Josh Wills) Add support for unions of PTypes

[jira] [Created] (CRUNCH-254) Add ID to StageResult

2013-08-19 Thread Micah Whitacre (JIRA)
Micah Whitacre created CRUNCH-254: - Summary: Add ID to StageResult Key: CRUNCH-254 URL: https://issues.apache.org/jira/browse/CRUNCH-254 Project: Crunch Issue Type: Improvement

[jira] [Work started] (CRUNCH-254) Add ID to StageResult

2013-08-19 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on CRUNCH-254 started by Micah Whitacre. Add ID to StageResult - Key: CRUNCH-254 URL:

[jira] [Updated] (CRUNCH-254) Add ID to StageResult

2013-08-19 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-254: -- Attachment: CRUNCH-254.patch Patch exposing the underlying stage ids. Add ID

[jira] [Commented] (CRUNCH-254) Add ID to StageResult

2013-08-20 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13745676#comment-13745676 ] Micah Whitacre commented on CRUNCH-254: --- It does. I will be committing to master

[jira] [Resolved] (CRUNCH-254) Add ID to StageResult

2013-08-20 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre resolved CRUNCH-254. --- Resolution: Fixed Pushed to master. Add ID to StageResult

[jira] [Updated] (CRUNCH-260) Some new files contain Cloudera copyright headers

2013-09-03 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-260: -- Attachment: CRUNCH-260.patch Patch to remove them. Some new files contain

[jira] [Assigned] (CRUNCH-260) Some new files contain Cloudera copyright headers

2013-09-03 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre reassigned CRUNCH-260: - Assignee: Micah Whitacre Some new files contain Cloudera copyright headers

[jira] [Resolved] (CRUNCH-260) Some new files contain Cloudera copyright headers

2013-09-03 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre resolved CRUNCH-260. --- Resolution: Fixed Pushed to master. Some new files contain Cloudera

[jira] [Commented] (CRUNCH-259) crunch-archetype problems

2013-09-03 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757018#comment-13757018 ] Micah Whitacre commented on CRUNCH-259: --- Ahh, I'm not running java 7 so that might

[jira] [Created] (CRUNCH-261) Make HBaseSourceTarget ReadableSource

2013-09-03 Thread Micah Whitacre (JIRA)
Micah Whitacre created CRUNCH-261: - Summary: Make HBaseSourceTarget ReadableSource Key: CRUNCH-261 URL: https://issues.apache.org/jira/browse/CRUNCH-261 Project: Crunch Issue Type:

[jira] [Commented] (CRUNCH-261) Make HBaseSourceTarget ReadableSource

2013-09-03 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757386#comment-13757386 ] Micah Whitacre commented on CRUNCH-261: --- It looks like HFileSource ReadableSource

[jira] [Updated] (CRUNCH-264) Writing to TextFileTarget map side does not show up in plan

2013-09-06 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-264: -- Attachment: CRUNCH-264.png CRUNCH-264.txt Here's the test I wrote to simulate

[jira] [Commented] (CRUNCH-264) Writing to TextFileTarget map side does not show up in plan

2013-09-07 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13761139#comment-13761139 ] Micah Whitacre commented on CRUNCH-264: --- The test I wrote is a little janky but was

[jira] [Commented] (CRUNCH-261) Make HBaseSourceTarget ReadableSource

2013-09-07 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13761142#comment-13761142 ] Micah Whitacre commented on CRUNCH-261: --- I started on this but didn't get as far as

[jira] [Commented] (CRUNCH-261) Make HBaseSourceTarget ReadableSource

2013-09-09 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13762080#comment-13762080 ] Micah Whitacre commented on CRUNCH-261: --- Close but you will still want to close the

[jira] [Commented] (CRUNCH-272) Unable to correlate crunch jobs within Oozie

2013-10-01 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13783430#comment-13783430 ] Micah Whitacre commented on CRUNCH-272: --- To which persona would you want this

[jira] [Commented] (CRUNCH-274) Add support for extra Configuration arguments to ParallelDoOptions

2013-10-06 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13787789#comment-13787789 ] Micah Whitacre commented on CRUNCH-274: --- +1 changes look good. A junit to verify

[jira] [Commented] (CRUNCH-275) Add support for extra Configuration options to Source, Target, and SourceTarget

2013-10-06 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13787848#comment-13787848 ] Micah Whitacre commented on CRUNCH-275: --- +1 code looks good and I can definitely see

[jira] [Commented] (CRUNCH-279) Allow DoFn.process to throw exceptions

2013-10-10 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791691#comment-13791691 ] Micah Whitacre commented on CRUNCH-279: --- I'm kind of curious why you chose to throw

[jira] [Commented] (CRUNCH-278) Improvements to MapsideJoin code

2013-10-13 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793879#comment-13793879 ] Micah Whitacre commented on CRUNCH-278: --- The MaterialzedPCollection seems nice

[jira] [Commented] (CRUNCH-270) crunch-core includes log4j.properties

2013-10-27 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13806504#comment-13806504 ] Micah Whitacre commented on CRUNCH-270: --- +1 for removing them. However I'm not sure

[jira] [Updated] (CRUNCH-270) crunch-core includes log4j.properties

2013-10-27 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-270: -- Attachment: CRUNCH-270.patch crunch-core includes log4j.properties

[jira] [Assigned] (CRUNCH-270) crunch-core includes log4j.properties

2013-10-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre reassigned CRUNCH-270: - Assignee: Micah Whitacre (was: Josh Wills) crunch-core includes log4j.properties

[jira] [Resolved] (CRUNCH-270) crunch-core includes log4j.properties

2013-10-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre resolved CRUNCH-270. --- Resolution: Fixed Fix Version/s: 0.8.0 Committed to master. crunch-core includes

[jira] [Updated] (CRUNCH-225) Scala 2.10 support

2013-11-12 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-225: -- Attachment: CRUNCH-225.patch Attached is a patch which adds a scala-2.10 and scala-2.9.2

[jira] [Comment Edited] (CRUNCH-225) Scala 2.10 support

2013-11-12 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13820901#comment-13820901 ] Micah Whitacre edited comment on CRUNCH-225 at 11/13/13 3:51 AM:

[jira] [Commented] (CRUNCH-225) Scala 2.10 support

2013-11-13 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13821567#comment-13821567 ] Micah Whitacre commented on CRUNCH-225: --- Regarding the deprecations, I figured I was

[jira] [Updated] (CRUNCH-293) Injection of reader into AvroRecordReader

2013-11-14 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-293: -- Attachment: CRUNCH-293.patch Here's a first pass at what I was thinking. I think it could be

[jira] [Updated] (CRUNCH-293) Injection of reader into AvroRecordReader

2013-11-17 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-293: -- Attachment: CRUNCH-293_v2.patch Here's a patch that combines the two factories. Altered the

[jira] [Commented] (CRUNCH-293) Injection of reader into AvroRecordReader

2013-11-18 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13826072#comment-13826072 ] Micah Whitacre commented on CRUNCH-293: --- The changes look good to me. The one part

[jira] [Updated] (CRUNCH-300) Support reflected Avro record writing from MemPipeline

2013-11-20 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-300: -- Component/s: Core Support reflected Avro record writing from MemPipeline

[jira] [Commented] (CRUNCH-300) Support reflected Avro record writing from MemPipeline

2013-11-20 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827944#comment-13827944 ] Micah Whitacre commented on CRUNCH-300: --- As an FYI, I think there is going to be a

[jira] [Commented] (CRUNCH-293) Injection of reader into AvroRecordReader

2013-11-20 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13827972#comment-13827972 ] Micah Whitacre commented on CRUNCH-293: --- +1 for a patch if you don't mind. The

[jira] [Resolved] (CRUNCH-293) Injection of reader into AvroRecordReader

2013-11-20 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre resolved CRUNCH-293. --- Resolution: Fixed Fix Version/s: 0.9.0 Patch looks good. Pushed to master.

[jira] [Commented] (CRUNCH-304) MRPipeline.plan() does not clear up the temporary hadoop-username folder it creates

2013-11-26 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832761#comment-13832761 ] Micah Whitacre commented on CRUNCH-304: --- Actually I kind of wonder if the cleanup is

[jira] [Commented] (CRUNCH-304) MRPipeline.plan() does not clear up the temporary hadoop-username folder it creates

2013-11-26 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832773#comment-13832773 ] Micah Whitacre commented on CRUNCH-304: --- Yeah the boolean force was probably the

[jira] [Updated] (CRUNCH-304) MRPipeline.plan() does not clear up the temporary hadoop-username folder it creates

2013-11-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-304: -- Attachment: CRUNCH-304.patch Patch exposing the cleanup method on Pipeline.

[jira] [Updated] (CRUNCH-304) MRPipeline.plan() does not clear up the temporary hadoop-username folder it creates

2013-11-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-304: -- Attachment: CRUNCH-304_v2.patch New patch with better formatting. I think the issue is I

[jira] [Commented] (CRUNCH-306) MultipleOutput Targets

2013-11-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835486#comment-13835486 ] Micah Whitacre commented on CRUNCH-306: --- So in trying to define the requirements for

[jira] [Assigned] (CRUNCH-304) MRPipeline.plan() does not clear up the temporary hadoop-username folder it creates

2013-11-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre reassigned CRUNCH-304: - Assignee: Micah Whitacre (was: Josh Wills) MRPipeline.plan() does not clear up the

[jira] [Resolved] (CRUNCH-304) MRPipeline.plan() does not clear up the temporary hadoop-username folder it creates

2013-11-29 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre resolved CRUNCH-304. --- Resolution: Fixed Change has been pushed to master. Also using emacs was just to be ornery.

[jira] [Updated] (CRUNCH-306) MultipleOutput Targets

2013-12-10 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-306: -- Issue Type: New Feature (was: Bug) MultipleOutput Targets --

[jira] [Commented] (CRUNCH-306) MultipleOutput Targets

2013-12-10 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845026#comment-13845026 ] Micah Whitacre commented on CRUNCH-306: --- I think my/Bryan's use case is slightly

[jira] [Commented] (CRUNCH-306) MultipleOutput Targets

2013-12-11 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845685#comment-13845685 ] Micah Whitacre commented on CRUNCH-306: --- +1 to this change. MultipleOutput Targets

[jira] [Created] (CRUNCH-311) Expose injection of FileNamingScheme into AvroPathPerKeyTarget

2013-12-11 Thread Micah Whitacre (JIRA)
Micah Whitacre created CRUNCH-311: - Summary: Expose injection of FileNamingScheme into AvroPathPerKeyTarget Key: CRUNCH-311 URL: https://issues.apache.org/jira/browse/CRUNCH-311 Project: Crunch

[jira] [Commented] (CRUNCH-311) Expose injection of FileNamingScheme into AvroPathPerKeyTarget

2013-12-11 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846050#comment-13846050 ] Micah Whitacre commented on CRUNCH-311: --- That's what I get for putting out the patch

[jira] [Commented] (CRUNCH-316) Data Corruption when DatumWriter.write() throws MapBufferTooSmallException when called by SafeAvroSerialization

2013-12-31 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13859749#comment-13859749 ] Micah Whitacre commented on CRUNCH-316: --- Would reusing the BinaryEncoder (e.g.

[jira] [Updated] (CRUNCH-316) Data Corruption when DatumWriter.write() throws MapBufferTooSmallException when called by SafeAvroSerialization

2014-01-01 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-316: -- Affects Version/s: 0.9.0 0.8.2 Data Corruption when

[jira] [Updated] (CRUNCH-316) Data Corruption when DatumWriter.write() throws MapBufferTooSmallException when called by SafeAvroSerialization

2014-01-01 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-316: -- Attachment: CRUNCH-316.patch Patch with the change to DirectBinaryEncoder. [~ben.roling] is

[jira] [Assigned] (CRUNCH-316) Data Corruption when DatumWriter.write() throws MapBufferTooSmallException when called by SafeAvroSerialization

2014-01-02 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre reassigned CRUNCH-316: - Assignee: Micah Whitacre (was: Josh Wills) Data Corruption when DatumWriter.write()

[jira] [Updated] (CRUNCH-316) Data Corruption when DatumWriter.write() throws MapBufferTooSmallException when called by SafeAvroSerialization

2014-01-02 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-316: -- Fix Version/s: 0.8.3 0.10.0 Data Corruption when DatumWriter.write()

[jira] [Resolved] (CRUNCH-316) Data Corruption when DatumWriter.write() throws MapBufferTooSmallException when called by SafeAvroSerialization

2014-01-02 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre resolved CRUNCH-316. --- Resolution: Fixed Patch has been pushed to master and cherry-picked to the apache-crunch-0.8

[jira] [Commented] (CRUNCH-316) Data Corruption when DatumWriter.write() throws MapBufferTooSmallException when called by SafeAvroSerialization

2014-01-02 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13861141#comment-13861141 ] Micah Whitacre commented on CRUNCH-316: --- Thanks for the test [~ben.roling]. I added

[jira] [Created] (CRUNCH-319) Expose protected scoped methods

2014-01-07 Thread Micah Whitacre (JIRA)
Micah Whitacre created CRUNCH-319: - Summary: Expose protected scoped methods Key: CRUNCH-319 URL: https://issues.apache.org/jira/browse/CRUNCH-319 Project: Crunch Issue Type: Improvement

[jira] [Updated] (CRUNCH-319) Expose protected scoped methods

2014-01-07 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-319: -- Attachment: CRUNCH-319.patch Patch that exposes protected methods. Expose protected scoped

[jira] [Commented] (CRUNCH-239) Add support for unions of PTypes

2014-01-07 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865005#comment-13865005 ] Micah Whitacre commented on CRUNCH-239: --- Thanks for the patch I kept trying to make

[jira] [Updated] (CRUNCH-333) Add From and At methods for reading Avro files from the on-disk schema

2014-01-27 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-333: -- Issue Type: Improvement (was: Bug) Add From and At methods for reading Avro files from the

[jira] [Commented] (CRUNCH-333) Add From and At methods for reading Avro files from the on-disk schema

2014-01-27 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13883695#comment-13883695 ] Micah Whitacre commented on CRUNCH-333: --- +1 Add From and At methods for reading

[jira] [Commented] (CRUNCH-331) Change default settings for CombineFileInputFormat

2014-02-03 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13889803#comment-13889803 ] Micah Whitacre commented on CRUNCH-331: --- I'm personally leaning towards disabling

[jira] [Commented] (CRUNCH-331) Change default settings for CombineFileInputFormat

2014-02-03 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13890019#comment-13890019 ] Micah Whitacre commented on CRUNCH-331: --- So that sounds like you are leaning towards

[jira] [Commented] (CRUNCH-337) Make it easier to use multiple input paths

2014-02-04 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13890784#comment-13890784 ] Micah Whitacre commented on CRUNCH-337: --- +1 to the changes. If we end up with too

[jira] [Updated] (CRUNCH-331) Change default settings for CombineFileInputFormat

2014-02-04 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-331: -- Issue Type: Improvement (was: Bug) Change default settings for CombineFileInputFormat

[jira] [Updated] (CRUNCH-331) Change default settings for CombineFileInputFormat

2014-02-04 Thread Micah Whitacre (JIRA)
[ https://issues.apache.org/jira/browse/CRUNCH-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Whitacre updated CRUNCH-331: -- Attachment: CRUNCH-331.patch Patch which: * disables combining files by default. * enables the

  1   2   3   4   5   >