[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-27 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/5645#discussion_r29194115 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -96,9 +99,27 @@ class WriteAheadLogBackedBlockRDD

[GitHub] spark pull request: [SPARK-7056][Streaming] Make the Write Ahead L...

2015-04-27 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/5645#discussion_r29194436 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/rdd/WriteAheadLogBackedBlockRDD.scala --- @@ -96,9 +99,27 @@ class WriteAheadLogBackedBlockRDD

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-11 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-73938104 @koeninger this is a definite blocker for me, I'm upgrading the connector to scala 2.11 with a cross build. Let me know if you have time, otherwise I will get back

[GitHub] spark pull request: [SPARK-5622][SQL] add connector configuration ...

2015-02-11 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/4406#discussion_r24527030 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/HiveThriftServer2.scala --- @@ -35,7 +37,7 @@ import

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-11 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-73979757 Great I'll close this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-11 Thread helena
Github user helena closed the pull request at: https://github.com/apache/spark/pull/3631 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-10 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-73728845 @koeninger Yes, there consumer offset and some other minor changes to make. I'm finding it hard to carve out time for this, high ticket load this week. Go

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-08 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-73377050 Hi @srowen, will do. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-05 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-73101317 NP, I think manual may not be necessary, just the addition of tests that automate testing the version or testing all and handling the execution path properly. I can add

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-04 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-72926976 All streaming-kafka sbt tests and /dev/run-tests passed in my initial push as beta, and with the GA update all still pass. Should I resubmit this PR against another

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-02-04 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-72858529 @tdas what shall I do with this PR to complete it then? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22647846 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaRDD.scala --- @@ -0,0 +1,157 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22647904 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,119 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22648458 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,119 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22647698 --- Diff: external/kafka/pom.xml --- @@ -44,7 +44,7 @@ dependency groupIdorg.apache.kafka/groupId artifactIdkafka_

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22648091 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/DeterministicKafkaInputDStream.scala --- @@ -0,0 +1,119 @@ +/* + * Licensed

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22649516 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22649599 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22649891 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22649992 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22650033 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaCluster.scala --- @@ -0,0 +1,313 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2015-01-08 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-69206347 Waiting for kafka 0.8.2 to move to GA, still beta --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-4964] [Streaming] Exactly-once semantic...

2015-01-08 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/3798#discussion_r22662751 --- Diff: external/kafka/src/main/scala/org/apache/spark/rdd/kafka/KafkaRDD.scala --- @@ -0,0 +1,157 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2014-12-23 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-68013974 Hi @tdas, +1. This PR was done as initial push, and as soon as 0.8.2 is out of beta I planned to do the final commit, then have it considered. I never expected

[GitHub] spark pull request: #SPARK-2808 update kafka to version 0.8.2

2014-12-22 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/3631#issuecomment-67836412 @JoshRosen Ticket name updated :) Sorry for the delay, I was away. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: #2808 update kafka to version 0.8.2

2014-12-07 Thread helena
GitHub user helena opened a pull request: https://github.com/apache/spark/pull/3631 #2808 update kafka to version 0.8.2 #2808 update kafka to version 0.8.2. Kafka 0.8.2 is in beta still. You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] spark pull request: [SPARK-4122][STREAMING] Add a library that can...

2014-11-11 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/2994#discussion_r20160540 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaOutputWriter.scala --- @@ -0,0 +1,126 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4122][STREAMING] Add a library that can...

2014-11-10 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/2994#discussion_r20107380 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaOutputWriter.scala --- @@ -0,0 +1,126 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-4122][STREAMING] Add a library that can...

2014-11-09 Thread helena
Github user helena commented on a diff in the pull request: https://github.com/apache/spark/pull/2994#discussion_r20059145 --- Diff: external/kafka/src/main/scala/org/apache/spark/streaming/kafka/KafkaOutputWriter.scala --- @@ -0,0 +1,126 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-2468] Netty based block server / client...

2014-08-13 Thread helena
Github user helena commented on the pull request: https://github.com/apache/spark/pull/1907#issuecomment-52089064 @rxin @mubarak On one hand, I can understand wanting something faster or providing greater ease of use not in an actor framework, if one finds that paradigm a challenge