Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16114
Merged to master
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user brkyvz commented on the issue:
https://github.com/apache/spark/pull/16114
I've taken a look at the code. This change seems safe to me. Even if we
process extra data, but fail to checkpoint to Kinesis, Spark streaming will
re-process the exact same batch on a restart
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/16114
@brkyvz Could you also check this pr #16213? Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69833/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69833 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69833/consoleFull)**
for PR 16114 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69833 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69833/consoleFull)**
for PR 16114 at commit
Github user brkyvz commented on the issue:
https://github.com/apache/spark/pull/16114
I will need to take a deeper look at this to remember the code. I'm not
sure but there may be some issues with the checkpointing happening to the
WriteAheadLog and DynamoDB. Going to come back to
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69765 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69765/consoleFull)**
for PR 16114 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69765/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69765 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69765/consoleFull)**
for PR 16114 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69762/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69762 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69762/consoleFull)**
for PR 16114 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69762 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69762/consoleFull)**
for PR 16114 at commit
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/16114
@brkyvz maybe you can give this a look to make sure it makes sense?
especially the bit about the checkpointer.
---
If your project is set up for it, you can reply to this email and have your
reply
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69627/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69627 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69627/consoleFull)**
for PR 16114 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69627 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69627/consoleFull)**
for PR 16114 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69626 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69626/consoleFull)**
for PR 16114 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69626/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69626 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69626/consoleFull)**
for PR 16114 at commit
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/16114
Jenkins, retest this please.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69624 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69624/consoleFull)**
for PR 16114 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69624/
Test FAILed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69624 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69624/consoleFull)**
for PR 16114 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69620/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69620 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69620/consoleFull)**
for PR 16114 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69620 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69620/consoleFull)**
for PR 16114 at commit
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/16114
@srowen Do u know qualified maintainers on this component?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69558/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69558 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69558/consoleFull)**
for PR 16114 at commit
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69558 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69558/consoleFull)**
for PR 16114 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16114
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69546/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69546 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69546/consoleFull)**
for PR 16114 at commit
Github user dav009 commented on the issue:
https://github.com/apache/spark/pull/16114
:+1: just had a play with it, it solves my original issue.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16114
**[Test build #69546 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69546/consoleFull)**
for PR 16114 at commit
44 matches
Mail list logo
