[ 
https://issues.apache.org/jira/browse/BAHIR-128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16294966#comment-16294966
 ] 

ASF GitHub Bot commented on BAHIR-128:
--------------------------------------

Github user ricellis commented on a diff in the pull request:

    https://github.com/apache/bahir/pull/57#discussion_r157484722
  
    --- Diff: 
sql-cloudant/src/main/scala/org/apache/bahir/cloudant/internal/ChangesReceiver.scala
 ---
    @@ -39,56 +37,38 @@ class ChangesReceiver(config: CloudantChangesConfig)
       }
     
       private def receive(): Unit = {
    -    // Get total number of docs in database using _all_docs endpoint
    -    val limit = new JsonStoreDataAccess(config)
    -      .getTotalRows(config.getTotalUrl, queryUsed = false)
    -
    -    // Get continuous _changes url
    +    // Get normal _changes url
    --- End diff --
    
    I'm a bit confused about this change. Since Spark Streaming is the basis 
for "real-time" or "continuous applications" doesn't this need to keep 
listening to the changes feed to wait for more changes?


> Test failing sporadically in sql-cloudant's CloudantChangesDFSuite
> ------------------------------------------------------------------
>
>                 Key: BAHIR-128
>                 URL: https://issues.apache.org/jira/browse/BAHIR-128
>             Project: Bahir
>          Issue Type: Bug
>            Reporter: Esteban Laver
>            Assignee: Esteban Laver
>            Priority: Minor
>
> This failure happened during pre-release testing for Bahir RC 2.2.0:
> CloudantChangesDFSuite:
> - load and save data from Cloudant database *** FAILED ***
>   0 did not equal 1967 (CloudantChangesDFSuite.scala:49)
> Partial stack trace:
> {code:java}
> Exception in thread "Cloudant Receiver" org.apache.spark.SparkException: 
> Cannot add data as BlockGenerator has not been started or has been stopped
>     at 
> org.apache.spark.streaming.receiver.BlockGenerator.addData(BlockGenerator.scala:173)
>     at 
> org.apache.spark.streaming.receiver.ReceiverSupervisorImpl.pushSingle(ReceiverSupervisorImpl.scala:120)
>     at org.apache.spark.streaming.receiver.Receiver.store(Receiver.scala:119)
>     at 
> org.apache.bahir.cloudant.internal.ChangesReceiver$$anonfun$org$apache$bahir$cloudant$internal$ChangesReceiver$$receive$1$$anonfun$apply$1.apply(ChangesReceiver.scala:82)
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to