cloud-fan commented on pull request #28787:
URL: https://github.com/apache/spark/pull/28787#issuecomment-643086118


   More context:
   
   To do datetime rebase more efficiently, we put the diffs between two 
calendars in JSON files, to avoid calculating the diffs every time.
   
   We run the rebase function for all the datetime values from year 0001 to 
year 2037, using one week as the step. This is not accurate and we miss diffs 
during some short period.
   
   The good news is: although the JSON files do not match the rebase function, 
they are correct. The rebase function has a bug. We have a random test to make 
sure the rebase function matches the generated JSON files, and that's why we 
found this bug.
   
   That said, this is not a real bug as it doesn't affect end users, but it 
makes the test flaky.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to