Akanksha-kedia opened a new issue, #17146: URL: https://github.com/apache/pinot/issues/17146
### __What Happens__: - Error occurs on __Spark Executor nodes__ during segment push phase - The `SegmentGenerationJobSpec` object is __null__ when executors try to push segments - Fails at `SegmentPushUtils.pushSegments()` line 111 ### __Where It Fails__: ```java // SegmentPushUtils.java:111 String tableName = spec.getTableSpec().getTableName(); // ← spec is null! NPE here ``` ### __Why It Happens__: 1. __Driver loads job spec__ from file successfully ✅ 2. __Executors try to reload__ spec from the same file path 3. __File not accessible__ on executor nodes (different machines) 4. __spec becomes null__ → NullPointerException ### __Root Cause__: Pinot's `IngestionJobLauncher` uses `FileReader` which: - ❌ Only works with LOCAL files - ❌ Cannot read HDFS URIs (`hdfs://...`) - ❌ Cannot read S3 URIs (`s3://...`) - ❌ Cannot access files on different machines -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
