Hi Russell et al,
Acknowledging receipt; we’ll get these answers back to the group.
Follow-up forthcoming.
Craig
On Sep 14, 2023, at 6:38 PM, russell.spit...@gmail.com wrote:
Exactly once should be output sink dependent, what sink was being used? Sent from my iPhone On Sep 14, 2023, at 4:52 PM, Jerry Peng <jerry.boyang.p...@gmail.com> wrote:
Craig,
Thanks! Please let us know the result!
Best,
Jerry
Hi Craig,
Can you please clarify what this bug is and provide sample code causing this issue?
HTH
Mich Talebzadeh, Distinguished Technologist, Solutions Architect & Engineer
London
United Kingdom
view my Linkedin profile
https://en.everybodywiki.com/Mich_Talebzadeh
Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction
of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from such
loss, damage or destruction.
Hello Spark Community-
As part of a research effort, our team here at Antithesis tests for correctness/fault tolerance of major OSS projects.
Our team recently was testing Spark’s Structured Streaming, and we came across a data duplication bug we’d like to work with the teams on to resolve.
Our intention is to utilize this as a future case study for our platform, but prior to doing so we like to have a resolution in place so that an announcement isn’t alarming to the user base.
Attached is a high level .pdf that reviews the High Availability set-up put under test.
This was also tested across the three latest versions, and the same behavior was observed.
We can reproduce this error readily, since our environment is fully deterministic, we are just not Spark experts and would like to work with someone in the community to resolve this.
Please let us know at your earliest convenience.
Best
----------------------------- This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity for whom they are addressed. If you received this message in error, please notify the sender and remove it from your system.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
----------------------------- This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity for whom they are addressed. If you received this message in error, please notify the sender and remove it from your system.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
|