Github user gatorsmile commented on the pull request:
https://github.com/apache/spark/pull/10335#issuecomment-165677742
Original range API with `count` (workload **1,000,000,000** rows):
```
scala> val startTime = System.currentTimeMillis; sqlContext.oldRange(0,
1000000000, 1, 15).count(); val endTime = System.currentTimeMillis; val start =
new Timestamp(startTime); val end = new Timestamp(endTime); val elapsed =
(endTime - startTime)/ 1000.0
startTime: Long = 1450416394240
endTime: Long = 1450416421199
start: java.sql.Timestamp = 2015-12-17 21:26:34.24
end: java.sql.Timestamp = 2015-12-17 21:27:01.199
elapsed: Double = 26.959
scala> val startTime = System.currentTimeMillis; sqlContext.oldRange(0,
1000000000, 1, 15).count(); val endTime = System.currentTimeMillis; val start =
new Timestamp(startTime); val end = new Timestamp(endTime); val elapsed =
(endTime - startTime)/ 1000.0
startTime: Long = 1450416424035
endTime: Long = 1450416450869
start: java.sql.Timestamp = 2015-12-17 21:27:04.035
end: java.sql.Timestamp = 2015-12-17 21:27:30.869
elapsed: Double = 26.834
scala> val startTime = System.currentTimeMillis; sqlContext.oldRange(0,
1000000000, 1, 15).count(); val endTime = System.currentTimeMillis; val start =
new Timestamp(startTime); val end = new Timestamp(endTime); val elapsed =
(endTime - startTime)/ 1000.0
startTime: Long = 1450416452321
endTime: Long = 1450416480277
start: java.sql.Timestamp = 2015-12-17 21:27:32.321
end: java.sql.Timestamp = 2015-12-17 21:28:00.277
elapsed: Double = 27.956
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
