Github user nzw0301 commented on the issue:
https://github.com/apache/spark/pull/19372
Thank you for your reviews, @LowikC.
Like this?
```scala
val totalWordsCounts = numIterations * trainWordsCount + 1
val numWordsProcessedInPreviousIterations = (k - 1) * trainWordsCount
alpha = learningRate *
(1 - (numPartitions * wordCount.toDouble +
numWordsProcessedInPreviousIterations) /
totalWordsCounts)
if (alpha < learningRate * 0.0001) alpha = learningRate * 0.0001
logInfo("wordCount = " + (wordCount +
numWordsProcessedInPreviousIterations) +
", alpha = " + alpha)
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
