[jira] [Resolved] (GOBBLIN-390) Allow child process to be launched with log4j options

2018-01-25 Thread Hung Tran (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hung Tran resolved GOBBLIN-390. --- Resolution: Fixed Fix Version/s: 0.13.0 Issue resolved by pull request #2266

[jira] [Created] (GOBBLIN-391) Use the DataPublisherFactory to allow sharing publishers in SafeDatasetCommit

2018-01-25 Thread Hung Tran (JIRA)
Hung Tran created GOBBLIN-391: - Summary: Use the DataPublisherFactory to allow sharing publishers in SafeDatasetCommit Key: GOBBLIN-391 URL: https://issues.apache.org/jira/browse/GOBBLIN-391 Project:

[jira] [Commented] (GOBBLIN-371) In gobblin_pr, Jira resolution fails if python jira package is not installed

2018-01-25 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339455#comment-16339455 ] Abhishek Tiwari commented on GOBBLIN-371: - [~jbaranick] Agree, we almost always have a Jira to

[jira] [Created] (GOBBLIN-389) Gobblin class resolution requires all classes to be in gobblin packages

2018-01-25 Thread Joel Baranick (JIRA)
Joel Baranick created GOBBLIN-389: - Summary: Gobblin class resolution requires all classes to be in gobblin packages Key: GOBBLIN-389 URL: https://issues.apache.org/jira/browse/GOBBLIN-389 Project:

[jira] [Commented] (GOBBLIN-371) In gobblin_pr, Jira resolution fails if python jira package is not installed

2018-01-25 Thread Joel Baranick (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16339425#comment-16339425 ] Joel Baranick commented on GOBBLIN-371: --- [~abti] Any feedback on this bug and the associated PR? >

RE: Compaction job output not compressed

2018-01-25 Thread Sushant Pandey
Please find the job file in the attach. I am using Gobblin 0.11.0. Gobblin build info- Have tried this on Gobblin build against hadoop versions 2.7.3.2.6.3.0-235 and 2.6.0-cdh5.9.0 Thanks sushant From: Abhishek Tiwari Sent: Thursday, January 25, 2018 4:38 PM To:

Re: Compaction job output not compressed

2018-01-25 Thread Abhishek Tiwari
This looks bit weird, all you generally need is: writer.output.format=AVRO writer.builder.class=gobblin.writer.AvroDataWriterBuilder and optionally, writer.codec.type=SNAPPY .. which if not specified defaults to deflate. I double checked our compaction pipeline output through avro-tools and it