Re: Spark TransformEvaluator Error

Hi There's a work in progress (on a branch) to support bounded/unbounded read and write. Amit did it and I'm testing/reviewing it (so far so good). Regards JB On Sep 19, 2016, 20:52, at 20:52, Lukasz Cwik wrote: >The Spark runner currently only supports a limited set of sources >because >th

Re: Spark TransformEvaluator Error

This is a WIP. I'm aware of Strata and will do my best to have this ready ASAP. Thanks, Amit. On Tue, Sep 20, 2016, 06:53 Frances Perry wrote: > +amits...@apache.org > > From https://issues.apache.org/jira/browse/BEAM-17, it looks like the > Spark runner doesn't support that yet. > > On Mon, Se

Re: Spark TransformEvaluator Error

+amits...@apache.org >From https://issues.apache.org/jira/browse/BEAM-17, it looks like the Spark runner doesn't support that yet. On Mon, Sep 19, 2016 at 5:39 PM, Jesse Anderson wrote: > I'm running this Beam program >

Re: Spark TransformEvaluator Error

The Spark runner currently only supports a limited set of sources because there is no support in the Spark runner implementation which handles the Read PTransform directly. They are able to support TextIO, AvroIO and a few others by manually providing a few direct implementations. The supported l

Spark TransformEvaluator Error

I'm running this Beam program . When I run it on Spark, it get this error: Exception in thread "main" java.lang.RuntimeException: java.lang.IllegalStateExcept