@cham thanks for bringing the conversation back to the list ( esp. for
anyone else searching/wondering in the future )!
>From what I understand/summary: Python should be able to call via X-Lang
the [ Java ] PubSubLite IO for use with any underlying runner ( well, that
utilizes portable runner,
On Thu, Aug 4, 2022 at 5:29 PM Daniel Collins wrote:
> Hello Drew,
>
> > I upgraded to apache-beam 2.40.0 and tried to access
> apache_beam.io.gcp.pubsublite.ReadFromPubSubLite
>
> You should ensure to import `apache_beam.io.gcp.pubsublite.*`. I have no
> idea why the specific import isn't
I believe this should be fully working. I'm not familiar with PyBeam
though. Is the execution mechanism the same as running a regular Beam
pipeline ? Also, note that for multi-language, you need to use a portable
Beam runner.
+Daniel Collins who implemented this.
Thanks,
Cham
On Thu, Aug 4,
Thank you for helping.
My thrift class conforms to Java beans, I will convert the outer class to
Java bean and try it.
-Binh
On Thu, Aug 4, 2022 at 2:55 PM Reuven Lax via user
wrote:
> That would be a nice feature, though maybe some work to implement.
>
> On Thu, Aug 4, 2022 at 2:49 PM Brian
That would be a nice feature, though maybe some work to implement.
On Thu, Aug 4, 2022 at 2:49 PM Brian Hulette wrote:
> In some places (e.g. in AutoValueSchema) we assume that nested
> schema-inferred types are of the same "class". I filed [1] to track this a
> while back - I think we should
In some places (e.g. in AutoValueSchema) we assume that nested
schema-inferred types are of the same "class". I filed [1] to track this a
while back - I think we should support mixing and matching SchemaProviders
for nested types.
[1] https://github.com/apache/beam/issues/20359
On Thu, Aug 4,
We do have JavaBeanSchema which might work, depending on whether your
thrift class conforms to java beans.
On Thu, Aug 4, 2022 at 2:06 PM Binh Nguyen Van wrote:
> Hi,
>
> I have an AutoValue class and it looks like this
>
> @AutoValue
> @DefaultSchema( AutoValueSchema.class )
> public abstract
Hi,
I have an AutoValue class and it looks like this
@AutoValue
@DefaultSchema( AutoValueSchema.class )
public abstract class MyClass {
public abstract String getField1();
public abstract MyThriftClass getField2();
public static Builder Builder() {
return new
Hi Users/Devs,
Drew, copied, reported having troubles with PubSub Lite:
"we just weren’t able to get PubSub Lite working with PyBeam. It’s been a
few weeks since we last tried, but we were just trying to use
`apache_beam.io.gcp.pubsublite.ReadFromPubSubLite` (here
