Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73938104
@koeninger this is a definite blocker for me, I'm upgrading the connector
to scala 2.11 with a cross build. Let me know if you have time, otherwise I
will get back to
Github user koeninger commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73959340
@helena I updated it, pr is at https://github.com/apache/spark/pull/4537
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73979757
Great I'll close this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user helena closed the pull request at:
https://github.com/apache/spark/pull/3631
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user koeninger commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73728226
This will need some changes to KafkaCluster and possibly other things
related to the new api... let me know if you want a hand.
---
If your project is set up for it,
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73728845
@koeninger Yes, there consumer offset and some other minor changes to make.
I'm finding it hard to carve out time for this, high ticket load this week.
Go for it if
Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73368921
@helena I too would like to update to Kafka 0.8.2 as it does have a number
of good improvements. can you rebase? @tdas are you OK with merging this for
only master /
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73377050
Hi @srowen, will do.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73100513
Then for the new API (which does not store offsets externally) may need to
be updated to ensure compatibility. I am not sure whether the current unit
tests will catch such
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73100788
[Test build #26849 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26849/consoleFull)
for PR 3631 at commit
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73100148
Jenkins, this is ok to test.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73101317
NP, I think manual may not be necessary, just the addition of tests that
automate testing the version or testing all and handling the execution path
properly. I can add
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73120496
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73120485
[Test build #26849 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/26849/consoleFull)
for PR 3631 at commit
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-72903283
The first step would be to see whether upgrading to 0.8.2 passes the
inbuilt unit-tests or not (including the new Kafka stuff).
In addition, is there are
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-72926976
All streaming-kafka sbt tests and /dev/run-tests passed in my initial push
as beta, and with the GA update all still pass. Should I resubmit this PR
against another
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-72858529
@tdas what shall I do with this PR to complete it then?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-72784310
Aah cool. However 0.8.1 and 0.8.2 have pretty big changes between them, so
lets merge this for the next release. We are already doing a lot of
experimental Kafka stuff in
Github user rustyrazorblade commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-72775510
Kafka 0.8.2 is now listed as latest stable.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-69206347
Waiting for kafka 0.8.2 to move to GA, still beta
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-68013540
Hey @helena I am not sure whether we want to upgrade to a beta version.
Especially, there have been subtle changes within Kafka between releases and I
am afraid to make
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-68013974
Hi @tdas, +1. This PR was done as initial push, and as soon as 0.8.2 is out
of beta I planned to do the final commit, then have it considered. I never
expected it to be
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-67836412
@JoshRosen Ticket name updated :) Sorry for the delay, I was away.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
23 matches
Mail list logo
