navina commented on issue #9417:
URL: https://github.com/apache/pinot/issues/9417#issuecomment-1253653002
@pedrov-santos98 can you check the logs in the server directory for any
exceptions that is happening during ingestion?
Based on your description, it looks like ingestion is silently failing or
dropping the records. Here are some possible ways in which you can verify that
the ingestion is still progressing:
1. Using the Rest APIs via the Swagger UI:
a. `/getTableStatus` and verify that the state is `HEALTHY`
b. `/debug/tables/{tableName}` to view the debug information for the table.
You can increase the verbosity to see more details.
c. `/consumingSegmentsInfo` -> if this doesn't return any segments, it means
there are no consuming segments and ideally, you would have caught this "error"
state in the previous 2 queries
2. Look at the metrics, if you have them exported somewhere:
a. if `LLC_PARTITION_CONSUMING` is non-zero, there is an ingestion issue
3. Look at the ZK status - make sure that the ideal state (IS) and external
view (EV) for that table match and each partition has a consuming segment.
4. Search the server logs for any error or exception.
Happy to connect on the Apache Pinot slack and troubleshoot as well. My id
is `navina`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
