marchpure opened a new pull request #3834:
URL: https://github.com/apache/hadoop/pull/3834


   ### Description of PR
   In some scenarios, Sqoop will use LocalJobRuner (YarnLocal mode) to run 
massive jobs,  assuming  2 million jobs have been run. Considering 
LocalJobRunner MetricName generated by nextInt function is in the range of (0, 
2147483647),
   The conflict probability will be about 2000000/2147483647 = 1/1000, which 
means that an average of one fail task for every more 1000 jobs run.
   If LocalJobRunner MetricName is generated by nextLong() whose range is (0, 
9223372036854775807), considering that Long's range is 1 billion times that of 
Int, the conflict probability is also decreased by one trillionth times.
   the conflict probability goes to 1/1000000000 from 1/1000, which alleviate 
LocalJobRunnerMetricName conflicts a lot.
   
   ### How was this patch tested?
   With long-time test, the conflict probability decreases a lot
   
   ### For code changes:
   
   - [Y] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   - [Y] Object storage: have the integration tests been executed and the 
endpoint declared according to the connector-specific documentation?
   - [Y] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [y] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, 
`NOTICE-binary` files?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to