Hi Cham,

How much work would it be to add a MQTT unbounded source directly to the
Python SDK? I will look into the cross-language solution, but I'm wondering
if contributing directly to the Python SDK would be a lot more work or not
(keeping in mind that I have never contributed before, so there will be a
learning curve).

Best regards,
Carolyn

On 2019/09/16 20:07:14, Chamikara Jayalath <chamik...@google.com> wrote:
> Regarding cross-language transforms support, documentation is in flux at
> the moment since API is still being updated and runner support is in
> development.
>
> If you want to try out, I'd say cross-language wordcount example is a good
> starting point:
>
https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/wordcount_xlang.py
>
> Currently, we have basic support for Flink runner and support for Dataflow
> is in development.
>
> Another possible avenue is to add a MQTT unbounded source directly to
> Python SDK once we have Splittable DoFn source framework (which is also in
> development) if someone has cycles for that.
>
> Thanks,
> Cham
>
>
>
> On Mon, Sep 16, 2019 at 12:12 PM Jean-Baptiste Onofré <j...@nanthrax.net>
> wrote:
>
> > Regarding Java SDK, you have MqttIO available.
> >
> > Regards
> > JB
> >
> > On 16/09/2019 21:07, Lucas Magalhães wrote:
> > > Thanks Altay.. Do you know where I could find more about cross
language
> > > transforms? Documentation and examples as well.
> > >
> > > thanks again
> > >
> > > On Mon, Sep 16, 2019 at 4:00 PM Ahmet Altay <al...@google.com
> > > <mailto:al...@google.com>> wrote:
> > >
> > >     A framework for python sdk to use a native unbounded connector
does
> > >     not exist yet. You might be able to use the same connector from
Java
> > >     using cross language transforms.
> > >
> > >     /cc +Chamikara Jayalath <mailto:chamik...@google.com>
> > >
> > >     On Mon, Sep 16, 2019 at 11:00 AM Lucas Magalhães
> > >     <lucas.magalh...@paralelocs.com.br
> > >     <mailto:lucas.magalh...@paralelocs.com.br>> wrote:
> > >
> > >         Hello dears!
> > >
> > >         I'm starding a new project here and the mainly source is a
MQTT.
> > >
> > >         I could´n find any documentantion about to How to develeop a
> > >         unbounded connector.
> > >
> > >         Could anyone send me some instructions or guide line?
> > >
> > >         Thanks a lot
> > >
> > >         --
> > >         Lucas Magalhães,
> > >         CTO
> > >
> > >         Paralelo CS - Consultoria e Serviços
> > >         Tel: +55 (11) 3090-5557 <+55%2011%203090-5557>
> > <tel:+55%2011%203090-5557>
> > >         Cel: +55 (11) 99420-4667 <+55%2011%2099420-4667>
> > <tel:+55%2011%2099420-4667>
> > >         lucas.magalh...@paralelocs.com.br
> > >         <mailto:lucas.magalh...@paralelocs.com.br>
> > >
> > >         <http://www.inteligenciaemnegocios.com.br>
www.paralelocs.com.br
> > >         <http://www.paralelocs.com.br>
> > >
> > >
> > >
> > > --
> > > Lucas Magalhães,
> > > CTO
> > >
> > > Paralelo CS - Consultoria e Serviços
> > > Tel: +55 (11) 3090-5557 <+55%2011%203090-5557>
> > > Cel: +55 (11) 99420-4667 <+55%2011%2099420-4667>
> > > lucas.magalh...@paralelocs.com.br <mailto:
> > lucas.magalh...@paralelocs.com.br>
> > >
> > > <http://www.inteligenciaemnegocios.com.br>www.paralelocs.com.br
> > > <http://www.paralelocs.com.br>
> >
> > --
> > Jean-Baptiste Onofré
> > jbono...@apache.org
> > http://blog.nanthrax.net
> > Talend - http://www.talend.com
> >
>

Reply via email to