GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/21188
[SPARK-24046][SS] Fix rate source rowsPerSecond <= rampUpTime corner case
## What changes were proposed in this pull request?
Current Rate source has some issues when calculating `valueAtSecond` if
`rowsPerSecond` <= `rampUpTime`, value will not be gradually increased, details
can be found in [JIRA](https://issues.apache.org/jira/browse/SPARK-24046). So
here propose to fix this issue.
## How was this patch tested?
Add UT
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jerryshao/apache-spark SPARK-24046
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21188.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21188
----
commit bf62aed080c9a2b6b46e8ee656c70b5ae76c0d45
Author: jerryshao <sshao@...>
Date: 2018-04-28T07:29:17Z
Fix rate source rowsPerSecond <= rampUpTime corner case
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
