cipheraxat opened a new pull request, #36684:
URL: https://github.com/apache/beam/pull/36684
### Issue Components
- [x] Component: Beam YAML
### Changes Made
1. **Added example YAML pipeline** in
\`sdks/python/apache_beam/yaml/examples/transforms/sql/calcite_connection_properties.yaml\`
- Shows how to provide \`calcite_connection_properties\` under the
top-level \`options:\` key
- Demonstrates both YAML mapping format (preferred) and JSON string
format (for compatibility)
- Includes a working SQL transform example using PostgreSQL functions
2. **Updated YAML docs generator** in
\`sdks/python/apache_beam/yaml/generate_yaml_docs.py\`
- Added special handling for the SQL transform to include a callout about
calcite connection properties
- The generated transform catalog page will now include clear
documentation and examples
- Shows both approaches for providing connection properties
### Example Usage
**Preferred YAML mapping approach:**
\`\`\`yaml
options:
calcite_connection_properties:
fun: postgresql
\`\`\`
**Alternative JSON string approach:**
\`\`\`yaml
options:
calcite_connection_properties: '{\"fun\": \"postgresql\"}'
\`\`\`
### Testing
- Syntax validation passed for the modified Python generator
- Example YAML follows existing patterns in the examples directory
- Changes are backwards compatible and don't affect existing functionality
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
