damondouglas opened a new issue, #24468:
URL: https://github.com/apache/beam/issues/24468

   ### What needs to happen?
   
   ## What work does this Task describe?
   
   This task addresses #24464 through creation of a  
`FileWriteSchemaTransformConfiguration` as outlined in the [design 
document](https://docs.google.com/document/d/1IOZrQ4qQrUS2WwQhadN35vX4AzhG4dyXMk1J-R1qJ9c/edit?usp=sharing).
  The following outlines the `@AutoValue` based class diagrams where the 
corresponding `@AutoValue.Builder` inner class is not shown.
   
   ```mermaid
   classDiagram
   
   class FileWriteSchemaTransformConfiguration
   <<abstract>> FileWriteSchemaTransformConfiguration
   FileWriteSchemaTransformConfiguration : abstract +String getFormat()
   FileWriteSchemaTransformConfiguration : abstract +String getFileNamePrefix()
   FileWriteSchemaTransformConfiguration : abstract +String getCompression()
   FileWriteSchemaTransformConfiguration : abstract +Byte[] getDelimiter()
   FileWriteSchemaTransformConfiguration : abstract +Integer getNumShards()
   FileWriteSchemaTransformConfiguration : abstract +Boolean getEnableSharding()
   FileWriteSchemaTransformConfiguration : abstract +String 
getShardNameTemplate()
   FileWriteSchemaTransformConfiguration : abstract +String getFileNameSuffix()
   FileWriteSchemaTransformConfiguration : abstract +Row getCsvConfiguration()
   FileWriteSchemaTransformConfiguration : abstract +Row 
getParquetConfiguration()
   FileWriteSchemaTransformConfiguration : abstract +Row getXmlConfiguration()
   
   class CsvConfiguration
   <<abstract>> CsvConfiguration
   CsvConfiguration : abstract +String getPreamble()
   CsvConfiguration : abstract +String getFormat()
   
   class ParquetConfiguration
   <<abstract>> ParquetConfiguration
   ParquetConfiguration : abstract +String getCompressionCodecName()
   ParquetConfiguration : abstract +Integer getRowGroupSize()
   
   class XmlConfiguration
   <<abstract>> XmlConfiguration
   XmlConfiguration : abstract +String getRootElement()
   XmlConfiguration : abstract +String getCharset()
   ```
   
   ## What value may result from this Task's output?
   
   The configuration is the point of entry into a File write support within a 
SchemaTransform context.  See #24464 for details.
   
   ## Ready and Done Measures
   
   ### Ready
   
   The following are blockers for beginning this task.
   
   - [x] Community review of [design 
document](https://docs.google.com/document/d/1IOZrQ4qQrUS2WwQhadN35vX4AzhG4dyXMk1J-R1qJ9c/edit?usp=sharing)
   
   ### Done
   
   The following are measures for marking this Task complete.
   
   `@AutoValue` and `@AutoValue.Builder` classes for:
   - [ ] `FileWriteSchemaTransformConfiguration`
   - [ ] `CsvConfiguration`
   - [ ] `ParquetConfiguration`
   - [ ] `XmlConfiguration`
   
   ### Issue Priority
   
   Priority: 3
   
   ### Issue Component
   
   Component: beam-community


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to