Re: Podling Report Reminder - November 2016

2016-10-30 Thread Jean-Baptiste Onofré
Hi James, any update about the podling report ? Can I help you on this ? Thanks ! Regards JB On 10/27/2016 01:05 AM, James Malone wrote: Hello everyone! Unless anyone disagrees or wants to do it, I am happy to volunteer to draft this podling report for review before we submit it. I can get

Re: migrating gearpump-runner to new DoFn fails with NotSerializableException

2016-10-30 Thread Manu Zhang
Thanks Kenn. That is indeed the problem. Manu On Mon, Oct 31, 2016 at 12:12 PM Kenneth Knowles wrote: > Hi Manu, > > That class is generated by DoFnInvokers, which generates bytecode to > efficiently execute a DoFn. It should not be part of the serialized > payload,

Re: migrating gearpump-runner to new DoFn fails with NotSerializableException

2016-10-30 Thread Kenneth Knowles
Hi Manu, That class is generated by DoFnInvokers, which generates bytecode to efficiently execute a DoFn. It should not be part of the serialized payload, but should be instantiated on the service/worker/etc. If you are trying to serialize a DoFnInvoker, then my recommendation is to serialize

Re: Contributing for improvement of the Beam website

2016-10-30 Thread Frances Perry
And just FYI, there's a section on the website at the end of the contribution guide: http://beam.incubator.apache.org/contribute/contribution-guide/#website On Sat, Oct 29, 2016 at 9:46 AM, Minudika Malshan wrote: > Hi, > > Here is the PR[1] for BEAM-835. > Please review.

migrating gearpump-runner to new DoFn fails with NotSerializableException

2016-10-30 Thread Manu Zhang
Hi all, I'm migrating `OldDoFn` to `DoFn` in gearpump-runner. We serialize all the functions locally and ship to remote cluster. Hence, I try to make sure the functions are serializable. Unluckily, the integration-tests fail with `NotSerializableException` as follows. Anyone knows what that