Hi Stephen,
Apart from Lyft there are many Beam users on Flink. I'm not sure I can
publicly say their names, but I have been working with different
companies running multiple production pipelines with Beam on Flink.
Since you mentioned ETL, most of them are actually using streaming
pipelines.
Thanks,
Max
On 07.05.19 18:17, Austin Bennett wrote:
On the Beam YouTube channel:
https://www.youtube.com/channel/UChNnb_YO_7B0HlW6FhAXZZQ you can see two
talks from people at Lyft; they use Beam on Flink.
Other users can also chime in as to how they are running.
Would also suggest coming to BeamSummit.org in Berlin in June and/or
sharing experiences or coming to ApacheCon in September, where we are to
have 2 tracks in each of 2 days focused on Beam
https://www.apachecon.com/acna19/index.html
On Tue, May 7, 2019 at 6:52 AM <[email protected]
<mailto:[email protected]>> wrote:
Hi all,____
__ __
We currently run Apache Flink based data load processes (fairly
simple streaming ETL jobs) and are looking at converting to Apache
BEAM to give more flexibility on the runner.____
__ __
Is anyone aware of any organisations running Apache BEAM on Flink in
production. Does anyone have any case studies they would be able to
share?____
__ __
Many thanks,____
__ __
Steve____
This communication and any attachments are confidential and intended
solely for the addressee. If you are not the intended recipient
please advise us immediately and delete it. Unless specifically
stated in the message or otherwise indicated, you may not duplicate,
redistribute or forward this message and any attachments are not
intended for distribution to, or use by any person or entity in any
jurisdiction or country where such distribution or use would be
contrary to local law or regulation. NatWest Markets Plc or any
affiliated entity ("NatWest Markets") accepts no responsibility for
any changes made to this message after it was sent.
Unless otherwise specifically indicated, the contents of this
communication and its attachments are for information purposes only
and should not be regarded as an offer or solicitation to buy or
sell a product or service, confirmation of any transaction, a
valuation, indicative price or an official statement. Trading desks
may have a position or interest that is inconsistent with any views
expressed in this message. In evaluating the information contained
in this message, you should know that it could have been previously
provided to other clients and/or internal NatWest Markets personnel,
who could have already acted on it.
NatWest Markets cannot provide absolute assurances that all
electronic communications (sent or received) are secure, error free,
not corrupted, incomplete or virus free and/or that they will not be
lost, mis-delivered, destroyed, delayed or intercepted/decrypted by
others. Therefore NatWest Markets disclaims all liability with
regards to electronic communications (and the contents therein) if
they are corrupted, lost destroyed, delayed, incomplete,
mis-delivered, intercepted, decrypted or otherwise misappropriated
by others.
Any electronic communication that is conducted within or through
NatWest Markets systems will be subject to being archived, monitored
and produced to regulators and in litigation in accordance with
NatWest Markets’ policy and local laws, rules and regulations.
Unless expressly prohibited by local law, electronic communications
may be archived in countries other than the country in which you are
located, and may be treated in accordance with the laws and
regulations of the country of each individual included in the entire
chain.
Copyright NatWest Markets plc. All rights reserved. See
http://www.natwestmarkets.com/legal/s-t-discl.html for further risk
disclosure.