Jira for this is https://issues.apache.org/jira/browse/BEAM-3222
Also looking at https://github.com/json-path/JsonPath for providing the
json fetching.
On Fri, Nov 17, 2017 at 11:43 AM, NerdyNick <nerdyn...@gmail.com> wrote:
> So I'm looking to expand the ElasticSearchIO writer t
being the same until time window endings.
I'm aiming for the simplest change in design here. To not impact the work
Chet is doing on BEAM-3201.
--
Nick Verbeck - NerdyNick
NerdyNick.com
TrailsOffroad.com
NoKnownBoundaries.com
gt; >> >>> dataframe
> >> >>> (but for that, I would need PCollection elements with schemas,
> that's
> >> >>> another topic on which Eugene, Reuven and I are discussing).
> >> >>>
> >> >>> However, as all major distributions now ship Spark 2.x, I don't
> think
> >> >>> it's
> >> >>> required anymore to support Spark 1.x.
> >> >>>
> >> >>> If we agree, I will update and cleanup the PR to only support and
> >> focus
> >> >>> on
> >> >>> Spark 2.x.
> >> >>>
> >> >>> So, that's why I'm calling for a vote:
> >> >>>
> >> >>>[ ] +1 to drop Spark 1.x support and upgrade to Spark 2.x only
> >> >>>[ ] 0 (I don't care ;))
> >> >>>[ ] -1, I would like to still support Spark 1.x, and so having
> >> >>> support of
> >> >>> both Spark 1.x and 2.x (please provide specific comment)
> >> >>>
> >> >>> This vote is open for 48 hours (I have the commits ready, just
> waiting
> >> >>> the
> >> >>> end of the vote to push on the PR).
> >> >>>
> >> >>> Thanks !
> >> >>> Regards
> >> >>> JB
> >> >>> --
> >> >>> Jean-Baptiste Onofré
> >> >>> jbono...@apache.org
> >> >>> http://blog.nanthrax.net
> >> >>> Talend - http://www.talend.com
> >> >>>
> >> >>
> >> > --
> >> > Jean-Baptiste Onofré
> >> > jbono...@apache.org
> >> > http://blog.nanthrax.net
> >> > Talend - http://www.talend.com
> >> >
> >>
> >
> >
> >
> > --
> > Twitter: https://twitter.com/holdenkarau
> >
>
>
>
> --
> Twitter: https://twitter.com/holdenkarau
>
--
Nick Verbeck - NerdyNick
NerdyNick.com
TrailsOffroad.com
NoKnownBoundaries.com