Github user ricellis commented on a diff in the pull request:

    https://github.com/apache/bahir/pull/57#discussion_r157480164
  
    --- Diff: 
sql-cloudant/src/main/scala/org/apache/bahir/cloudant/DefaultSource.scala ---
    @@ -125,7 +125,7 @@ class DefaultSource extends RelationProvider
               /* Create a streaming context to handle transforming docs in
               * larger databases into Spark datasets
               */
    -          val ssc = new StreamingContext(sqlContext.sparkContext, 
Seconds(10))
    +          val ssc = new StreamingContext(sqlContext.sparkContext, 
Seconds(8))
    --- End diff --
    
    I'm amazed this parameter was hard-coded as it seems to be a fairly 
critical tuning parameter for streaming. I guess this is one for another PR.


---

Reply via email to