officialasishkumar opened a new pull request, #10943:
URL: https://github.com/apache/seatunnel/pull/10943

   ### Purpose of this pull request
   
   Fixes #10928.
   
   This PR normalizes Parquet field names consistently when writing INT96 
values. The Parquet schema uses normalized lower-case field names, but the 
INT96 timestamp/fixed lookup could still use the original SeaTunnel field name. 
Mixed-case fields such as `createTime` could therefore miss the schema field 
during write. The configured INT96 field list and automatically selected 
timestamp fields now use the same normalization as schema and record writes.
   
   ### Does this PR introduce _any_ user-facing change?
   
   Yes. Parquet sinks can now write INT96 timestamp/fixed fields whose 
SeaTunnel column names contain uppercase letters without requiring lower-case 
aliases.
   
   ### How was this patch tested?
   
   - `JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 MAVEN_OPTS=-Xmx1536m ./mvnw 
-B -pl seatunnel-connectors-v2/connector-file/connector-file-base -DskipIT=true 
-D"license.skipAddThirdParty"=true -D"skip.ui"=true spotless:apply`
   - `JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 MAVEN_OPTS=-Xmx2048m ./mvnw 
-B -pl seatunnel-connectors-v2/connector-file/connector-file-base -am 
-DskipTests -DskipIT=true -D"license.skipAddThirdParty"=true -D"skip.ui"=true 
install`
   - `JAVA_HOME=/usr/lib/jvm/java-17-openjdk-amd64 MAVEN_OPTS=-Xmx2048m ./mvnw 
-B -pl seatunnel-connectors-v2/connector-file/connector-file-base 
-Dtest=org.apache.seatunnel.connectors.seatunnel.file.writer.ParquetWriteStrategyTest
 -DfailIfNoTests=false -DskipIT=true -D"license.skipAddThirdParty"=true 
-D"skip.ui"=true test`
   
   ### Check list
   
   * [ ] If any new Jar binary package adding in your PR, please add License 
Notice according
     [New License 
Guide](https://github.com/apache/seatunnel/blob/dev/docs/en/developer/new-license.md)
   * [ ] If necessary, please update the documentation to describe the new 
feature. https://github.com/apache/seatunnel/tree/dev/docs
   * [ ] If necessary, please update `incompatible-changes.md` to describe the 
incompatibility caused by this PR.
   * [ ] If you are contributing the connector code, please check that the 
following files are updated:
     1. Update 
[plugin-mapping.properties](https://github.com/apache/seatunnel/blob/dev/plugin-mapping.properties)
 and add new connector information in it
     2. Update the pom file of 
[seatunnel-dist](https://github.com/apache/seatunnel/blob/dev/seatunnel-dist/pom.xml)
     3. Add ci label in 
[label-scope-conf](https://github.com/apache/seatunnel/blob/dev/.github/workflows/labeler/label-scope-conf.yml)
     4. Add e2e testcase in 
[seatunnel-e2e](https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/)
     5. Update connector 
[plugin_config](https://github.com/apache/seatunnel/blob/dev/config/plugin_config)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to