OK, Thank you On Tue, Sep 13, 2016 at 3:27 PM, Sarnath K <[email protected]> wrote:
> Yes, that's true. If you are looking at an app timestamp(event origin > time), then We can't binary search on it. Though Binary search may be a > good approximation for the common case. > Not sure what Kylin is designed for. Let's wait to hear from the experts! > > On Sep 13, 2016 12:49, "Mario Copperfield" <[email protected]> wrote: > > > It's true that data appears in order in Kafka, but it can't assert that > the > > timestamp of data is ordered, in fact, in real time it always appear > > without order > > > > On Tue, Sep 13, 2016 at 3:14 PM, Sarnath K <[email protected]> wrote: > > > > > I am not sure about what Kylin does. But I know that data appears in > > order > > > in Kafka broker. But the consumer can consume in any order that it > likes. > > > So, offsets are more driven by Consumers and Kafka does not have a say > > on > > > it. > > > Sharing this based on my preliminary understanding of how Kafka works. > > > Best, > > > Sarnath > > > > > > On Sep 13, 2016 12:41, "Mario Copperfield" <[email protected]> > wrote: > > > > > > > Dear all, > > > > I am using kylin streaming build, and when i read the code > about > > > > this module, i found that kylin use binary search to find the offset > > > which > > > > is the closest adjust to the starttamp. I doubt that is that work if > > the > > > > data in kafka is not order? > > > > Thanks and waits. > > > > > > > > > > > > -- > > > > Best regards, > > > > Amuro Copperfield > > > > > > > > > > > > > > > -- > > Best regards, > > Amuro Copperfield > > > -- Best regards, Amuro Copperfield
