kw2542 opened a new pull request #1336: SAMZA-2499: Add submission config file 
support
URL: https://github.com/apache/samza/pull/1336
 
 
   Feature:
   https://cwiki.apache.org/confluence/display/SAMZA/SEP-23:+Simplify+Job+Runner
   
   Changes:
   1. Add config-path option in ApplicationRunnerCommandLine.
   2. Update loadConfig() to read property file specified by config-path as 
submission config.
   
   Tests:
   Followed https://samza.apache.org/startup/hello-samza/latest/ to test 
against Hello Samza example:
   
   1. Update wikipedia-feed.properties to include the following properties:
   
   
job.config.loader.factory=org.apache.samza.config.loaders.PropertiesConfigLoaderFactory
   
job.config.loader.properties.path=./__package/config/wikipedia-feed.properties
   
   2. Deploy the job:
   deploy/samza/bin/run-app.sh 
--config-path=$PWD/deploy/samza/config/wikipedia-feed.properties
   
   API Changes:
   1. Add --config-path option support when running run-app.sh
   
   Upgrade Instructions:
   None
   
   Usage Instructions:
   Alternative way when submitting job,
   
   deploy/samza/bin/run-app.sh \
     --config app.class=A \
     --config job.stream.factory=B \
     --config yarn.package.path=C \
     --config job.config.loader.factory=D \
     --config job.config.loader.properties.xx=E \
     --config job.name=F
   
   can be simplied to
   
   deploy/samza/bin/run-app.sh 
--config-path=/path/to/submission/properties/file/submission.properties
   
   where submission.properties contains
   
   app.class=A
   job.stream.factory=B
   yarn.package.path=C
   job.config.loader.factory=D
   job.config.loader.properties.xx=E
   job.name=F

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to