noob-se7en opened a new pull request, #17560:
URL: https://github.com/apache/pinot/pull/17560

   **Problem**
   Related to https://github.com/apache/pinot/pull/15682
   TLDR: In latest pinot version, FreshnessChecker fails for streams like 
Kinesis since latest stream offset cannot be determined always. 
   
   As per Kinesis code (from software.amazon.awssdk.services.kinesis.model):
   ```
   `/**
    * <p>
    * The ending sequence number for the range. Shards that are in the OPEN 
state have an ending sequence number of
    * <code>null</code>.
    * </p>
    * 
    * @return The ending sequence number for the range. Shards that are in the 
OPEN state have an ending sequence
    *         number of <code>null</code>.
    */
   public final String endingSequenceNumber() {
       return endingSequenceNumber;
   }`
   ```
   
   When FreshnessChecker is enabler for Kinesis streams, the server status will 
be marked as bad.
   
   **Solution**
   We skip freshness check for streams not supporting offset lag.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to