[GitHub] spark issue #21188: [SPARK-24046][SS] Fix rate source rowsPerSecond <= rampU...

Wed, 02 May 2018 12:10:36 -0700 

Github user maasg commented on the issue:

    https://github.com/apache/spark/pull/21188
  
    Hi Jerry,
    There's an improvement from the original situation, but the initial ramp-up 
phase starts only when the time gets very close to `rampUpTime`. Here you have 
another example that shows the behavior:
    Above: The original implementation
    Below: This PR. (Notebook 
src:https://gist.github.com/maasg/95eab0e49eeef9c7457bca2900bf412e)
    
![image](https://user-images.githubusercontent.com/874997/39543852-9704b0ac-4e4c-11e8-9661-9f2bc8681c99.png)
    
    This behavior is not consistent with the working, case when `rowsPerSecond 
> rampUpTime`
    In this case, the ramp-up is quite smooth:
    
    
![image](https://user-images.githubusercontent.com/874997/39543996-075e0330-4e4d-11e8-89b2-90861cea9a71.png)



---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to