Sorry Romain, I did not get it right ... Are you saying so for now, develop from scratch the source Http?
Sorry I'm new to the group, what does PR mean? 2018-04-11 14:38 GMT-03:00 Romain Manni-Bucau <rmannibu...@gmail.com>: > I guess for now you can feth his fork or just refork it and pr on it > directly. > > Le 11 avr. 2018 19:21, "Daniel Salerno" <salerno....@gmail.com> a écrit : > >> Hello Romain, >> >> Thanks for the feedback. >> It sounds like a good idea! >> How could I get the rest IO from JB? >> >> Thank you. >> >> 2018-04-11 10:50 GMT-03:00 Romain Manni-Bucau <rmannibu...@gmail.com>: >> >>> Hi Daniel, >>> >>> I know JB has a started a RestIO, it is not yet complete and needs >>> some love but probably some opportunity for converge and collaboration >>> here >>> >>> Romain Manni-Bucau >>> @rmannibucau | Blog | Old Blog | Github | LinkedIn | Book >>> >>> >>> 2018-04-11 15:42 GMT+02:00 Daniel Salerno <salerno....@gmail.com>: >>> > Good morning, >>> > >>> > In my Big Data Google project we need to read batch data from the VTEX >>> > platform every 15 minutes and record json's return to our cloud storage >>> > datalake. >>> > It makes the data available through HTTP GET requests for its API: >>> > (https://documenter.getpostman.com/view/487146/vtex-oms-api/6tjSKqi) >>> > >>> > I have not found a good way to do this reading using standard Apache >>> Beam >>> > components, my idea is to develop an HttpIO component using Source >>> Sink to >>> > read the request and write a JSON file to Cloud Storage. After that >>> another >>> > pipeline will process the file and write to BigQuery. >>> > >>> > Can you please help me with this matter? Is that the best way to go? >>> Do you >>> > have any idea how to develop this new component? >>> > >>> > Thank you. >>> > >>> > Hugs, >>> > >>> > Daniel Salerno de Arruda >>> >> >>
