[GitHub] spark pull request: [SPARK-14531][STREAMING] Flume streaming shoul...

2016-04-11 Thread yongtang
Github user yongtang commented on the pull request: https://github.com/apache/spark/pull/12305#issuecomment-208698736 Thanks @srowen. It looks like my previous understanding of the issue might be incorrect. Let me take a detailed look and see if I could update this pull request. ---

[GitHub] spark pull request: [SPARK-14531][STREAMING] Flume streaming shoul...

2016-04-11 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12305#discussion_r59315031 --- Diff: external/flume/src/main/scala/org/apache/spark/streaming/flume/FlumeUtils.scala --- @@ -147,7 +147,8 @@ object FlumeUtils { storageLevel

[GitHub] spark pull request: [SPARK-14531][STREAMING] Flume streaming shoul...

2016-04-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12305#issuecomment-208517901 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark pull request: [SPARK-14531][STREAMING] Flume streaming shoul...

2016-04-11 Thread yongtang
GitHub user yongtang opened a pull request: https://github.com/apache/spark/pull/12305 [SPARK-14531][STREAMING] Flume streaming should respect maxRate ## What changes were proposed in this pull request? At the moment Flume streaming set the default polling max batch size as