Github user ricellis commented on a diff in the pull request:
https://github.com/apache/bahir/pull/57#discussion_r157480164
--- Diff:
sql-cloudant/src/main/scala/org/apache/bahir/cloudant/DefaultSource.scala ---
@@ -125,7 +125,7 @@ class DefaultSource extends RelationProvider
/* Create a streaming context to handle transforming docs in
* larger databases into Spark datasets
*/
- val ssc = new StreamingContext(sqlContext.sparkContext,
Seconds(10))
+ val ssc = new StreamingContext(sqlContext.sparkContext,
Seconds(8))
--- End diff --
I'm amazed this parameter was hard-coded as it seems to be a fairly
critical tuning parameter for streaming. I guess this is one for another PR.
---