alnzng opened a new pull request #1294: SAMZA-2470: Add Samza job lineage 
interfaces
URL: https://github.com/apache/samza/pull/1294
 
 
   ### Background
   
   Add interfaces to provide the ability to allow the users to define their own 
job lineage data model and store in the specified outside systems.
   
   ### Changes
   - [ ] Add LineageFactory class to allow users to build their own job lineage 
data model
   - [ ] Add LineageReporter and LineageReporter classes to allow users to have 
the way to store lineage information in outside systems.
   - [ ] Emit job lineage data in `JobModelManager.readJobModel()` function, 
because this function provides the ability to dynamically load Kafka topics 
matched specified regex pattern. 
   
   ### Test
   - [ ] All unit tests and integration tests are passed
   
   ### Upgrade Instructions
   None
   
   ### Usage Instructions
   
   The users need to config `lineage.factory` and `lineage.reporter.factory` to 
enable the lineage function.
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to