kkrugler opened a new pull request #8191:
URL: https://github.com/apache/pinot/pull/8191


   ## Description
   Support a new, optional pushFileNamePattern parameter in the pushJobSpec 
section of the job yaml. This will filter segments in the outputDir that are 
pushed to Pinot.
   
   ## Upgrade Notes
   Does this PR prevent a zero down-time upgrade? (Assume upgrade order: 
Controller, Broker, Server, Minion)
   * [ ] Yes (Please label as **<code>backward-incompat</code>**, and complete 
the section below on Release Notes)
   
   Does this PR fix a zero-downtime upgrade introduced earlier?
   * [ ] Yes (Please label this as **<code>backward-incompat</code>**, and 
complete the section below on Release Notes)
   
   Does this PR otherwise need attention when creating release notes? Things to 
consider:
   - New configuration options
   - Deprecation of configurations
   - Signature changes to public methods/interfaces
   - New plugins added or old plugins removed
   * [X] Yes (Please label this PR as **<code>release-notes</code>** and 
complete the section on Release Notes)
   ## Release Notes
   Support for name-based filtering of segments being pushed to the Pinot 
cluster.
   
   ## Documentation
   In the 
https://docs.pinot.apache.org/configuration-reference/job-specification#push-job-spec
 section, add:
   
   ```
   pushFileNamePattern | segment name pattern for which segments to push, 
supported glob and regex patterns. E.g. 
   'glob:stats_* will push all segment files under the outputDirURI whose names 
start with 'stats_'. 
   'glob:*2022-01*' will push all the segment files under the outputDirURI 
whose names contain '2022-01'.
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to