ujjawal4046 opened a new pull request, #2564:
URL: https://github.com/apache/phoenix/pull/2564

   ## Summary
   
   - Add `PhoenixMapReduceUtil.addPhoenixDependencyJars(Configuration)` that 
registers Phoenix and its transitive dependency jars with the YARN distributed 
cache (`tmpjars`), analogous to HBase's `addHBaseDependencyJars`.
   - Without this, MR jobs using Phoenix fail with `NoClassDefFoundError` on 
YARN containers for jars like json-path, bson, phoenix-hbase-compat, 
commons-csv, etc.
   - Update all Phoenix MR tools (UpdateStatisticsTool, IndexTool, 
IndexScrutinyTool, PhoenixSyncTableTool, TransformTool, MultiHfileOutputFormat) 
to call the new method.
   
   ## Motivation
   
   After upgrading to Phoenix 5.3, several new transitive dependencies 
(json-path, bson, phoenix-hbase-compat as a separate jar) are required at 
runtime but were not being shipped to YARN containers. Each Phoenix MR tool was 
independently maintaining an incomplete list of classes to ship. This 
centralizes the logic so downstream consumers and Phoenix's own tools stay in 
sync.
   
   JIRA: https://issues.apache.org/jira/browse/PHOENIX-7953
   
   ## Test plan
   
   - [x] New unit test `PhoenixMapReduceUtilTest` verifies all expected jars 
appear in `tmpjars`
   - [ ] Run UpdateStatisticsTool on a cluster and verify no 
`NoClassDefFoundError`
   - [ ] Run IndexTool on a cluster and verify no `NoClassDefFoundError`
   
   ## Note
   
   This code was AI-assisted using Claude (Anthropic).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to