SukeshUB opened a new issue, #9567: URL: https://github.com/apache/pinot/issues/9567
I have a hybrid table. I ran the spark offline ingestion job until September 26th (it is October 10th as of this post and the time I found the issue). Now, the ingestion was successful and I see the segments in the pinot UI and in s3. Spark Output: ``` Response for pushing table enriched_click segment enriched_click_OFFLINE_2022-09-26_2022-09-26_3 to location https://pinot.internal.com.sovrn.startree.cloud/ - 200: {"status":"Su ccessfully uploaded segment: enriched_click_OFFLINE_2022-09-26_2022-09-26_3 of table: enriched_click_OFFLINE"} ``` Segments found in table:  Segment metadata:  However, data is not returned by the query console when queried for that last date. I can only see data until September 25th when I actually ran the job until the 26th  However, I can see the data when I query the OFFLINE table explicitly  As I understand, it is because I don't have any data in my real-time table yet as of this point. And I might see the data for the 27th once I have data in my real-time table. However, I haven't confirmed that yet. Will post an update once I ingest real-time data. But the issue still stands as to why pinot doesn't find the last day data of an offline table if there is no data in a real-time table. Notes: My retention on my real-time was 30 days. Offline was 730 days. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
