Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/5645#discussion_r29194115
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala
---
@@ -96,9 +99,27 @@ class WriteAheadLogBackedBlockRDD
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/5645#discussion_r29194436
--- Diff:
streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala
---
@@ -96,9 +99,27 @@ class WriteAheadLogBackedBlockRDD
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73938104
@koeninger this is a definite blocker for me, I'm upgrading the connector
to scala 2.11 with a cross build. Let me know if you have time, otherwise I
will get back
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/4406#discussion_r24527030
--- Diff:
sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala
---
@@ -35,7 +37,7 @@ import
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73979757
Great I'll close this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user helena closed the pull request at:
https://github.com/apache/spark/pull/3631
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73728845
@koeninger Yes, there consumer offset and some other minor changes to make.
I'm finding it hard to carve out time for this, high ticket load this week.
Go
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73377050
Hi @srowen, will do.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-73101317
NP, I think manual may not be necessary, just the addition of tests that
automate testing the version or testing all and handling the execution path
properly. I can add
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-72926976
All streaming-kafka sbt tests and /dev/run-tests passed in my initial push
as beta, and with the GA update all still pass. Should I resubmit this PR
against another
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-72858529
@tdas what shall I do with this PR to complete it then?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22647846
--- Diff:
external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaRDD.scala ---
@@ -0,0 +1,157 @@
+/*
+ * Licensed to the Apache Software
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22647904
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala
---
@@ -0,0 +1,119 @@
+/*
+ * Licensed
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22648458
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala
---
@@ -0,0 +1,119 @@
+/*
+ * Licensed
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22647698
--- Diff: external/kafka/pom.xml ---
@@ -44,7 +44,7 @@
dependency
groupIdorg.apache.kafka/groupId
artifactIdkafka_
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22648091
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala
---
@@ -0,0 +1,119 @@
+/*
+ * Licensed
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22649516
--- Diff:
external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala ---
@@ -0,0 +1,313 @@
+/*
+ * Licensed to the Apache Software
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22649599
--- Diff:
external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala ---
@@ -0,0 +1,313 @@
+/*
+ * Licensed to the Apache Software
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22649891
--- Diff:
external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala ---
@@ -0,0 +1,313 @@
+/*
+ * Licensed to the Apache Software
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22649992
--- Diff:
external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala ---
@@ -0,0 +1,313 @@
+/*
+ * Licensed to the Apache Software
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22650033
--- Diff:
external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala ---
@@ -0,0 +1,313 @@
+/*
+ * Licensed to the Apache Software
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-69206347
Waiting for kafka 0.8.2 to move to GA, still beta
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/3798#discussion_r22662751
--- Diff:
external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaRDD.scala ---
@@ -0,0 +1,157 @@
+/*
+ * Licensed to the Apache Software
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-68013974
Hi @tdas, +1. This PR was done as initial push, and as soon as 0.8.2 is out
of beta I planned to do the final commit, then have it considered. I never
expected
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/3631#issuecomment-67836412
@JoshRosen Ticket name updated :) Sorry for the delay, I was away.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
GitHub user helena opened a pull request:
https://github.com/apache/spark/pull/3631
#2808 update kafka to version 0.8.2
#2808 update kafka to version 0.8.2. Kafka 0.8.2 is in beta still.
You can merge this pull request into a Git repository by running:
$ git pull https
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/2994#discussion_r20160540
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaOutputWriter.scala
---
@@ -0,0 +1,126 @@
+/*
+ * Licensed to the Apache
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/2994#discussion_r20107380
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaOutputWriter.scala
---
@@ -0,0 +1,126 @@
+/*
+ * Licensed to the Apache
Github user helena commented on a diff in the pull request:
https://github.com/apache/spark/pull/2994#discussion_r20059145
--- Diff:
external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaOutputWriter.scala
---
@@ -0,0 +1,126 @@
+/*
+ * Licensed to the Apache
Github user helena commented on the pull request:
https://github.com/apache/spark/pull/1907#issuecomment-52089064
@rxin @mubarak On one hand, I can understand wanting something faster or
providing greater ease of use not in an actor framework, if one finds that
paradigm a challenge
30 matches
Mail list logo