Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/15355
@koeninger you can download the unit test logs from
https://amplab.cs.berkeley.edu/jenkins/job/spark-master-test-sbt-hadoop-2.6/1756/artifact/
I saw the offsets of the first batch (pat1 0 16 16) was wrong in the unit
test logs:
```
16/10/05 20:42:46.313 streaming-start INFO JobGenerator: Started
JobGenerator at 1475725367000 ms
16/10/05 20:42:46.313 streaming-start INFO JobScheduler: Started
JobScheduler
16/10/05 20:42:46.313
pool-1-thread-1-ScalaTest-running-DirectKafkaStreamSuite INFO StreamingContext:
StreamingContext started
16/10/05 20:42:47.015 JobGenerator INFO JobScheduler: Added jobs for time
1475725367000 ms
16/10/05 20:42:47.016 JobScheduler INFO JobScheduler: Starting job
streaming job 1475725367000 ms.0 from job set of time 1475725367000 ms
16/10/05 20:42:47.017 streaming-job-executor-0 INFO DirectKafkaStreamSuite:
pat2 0 3 16
16/10/05 20:42:47.017 streaming-job-executor-0 INFO DirectKafkaStreamSuite:
pat1 0 16 16
```
Seems the `earliest` config does not work.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
