XuQianJin-Stars opened a new pull request, #2260:
URL: https://github.com/apache/fluss/pull/2260
### Purpose
Linked issue: close #2251
This PR adds support for NestedRow types in Paimon lake tiering.
### Brief change log
- Modified `FlussRowAsPaimonRow.getRow()` to support nested row fields by
creating new `FlussRowAsPaimonRow` instances recursively
- Modified `FlussArrayAsPaimonArray.getRow()` to support arrays containing
nested row elements
- Added comprehensive test cases in `FlussRecordAsPaimonRowTest` covering
various nested row scenarios:
* Simple nested rows with primitive types
* Deeply nested rows (row within row)
* Arrays of nested rows
* Nested rows containing array fields
* Nested rows with all primitive types (boolean, byte, short, int, long,
float, double, string)
* Null nested rows and nullable fields within nested rows
* Nested rows with complex types (Decimal, Timestamp)
### Tests
**Unit Tests:**
- `FlussRecordAsPaimonRowTest#testSimpleNestedRow` - Tests basic nested row
conversion
- `FlussRecordAsPaimonRowTest#testDeeplyNestedRow` - Tests multi-level
nested rows
- `FlussRecordAsPaimonRowTest#testArrayOfNestedRows` - Tests arrays
containing nested rows
- `FlussRecordAsPaimonRowTest#testNestedRowWithArrayField` - Tests nested
rows with array fields
- `FlussRecordAsPaimonRowTest#testNestedRowWithAllPrimitiveTypes` - Tests
all primitive types in nested rows
- `FlussRecordAsPaimonRowTest#testNullNestedRow` - Tests null nested row
handling
- `FlussRecordAsPaimonRowTest#testNestedRowWithNullableFields` - Tests
nullable fields in nested rows
- `FlussRecordAsPaimonRowTest#testNestedRowWithDecimalAndTimestamp` - Tests
complex types in nested rows
All tests verify correct data conversion between Fluss nested rows and
Paimon nested rows.
### API and Format
**API:** No public API changes
**Format:** No storage format changes. This change only affects the internal
data conversion layer between Fluss and Paimon.
### Documentation
**New Feature:** No
This change extends existing Paimon lake tiering functionality to support
NestedRow types, which is an internal enhancement. The data type conversion
mapping table in the documentation
(`website/docs/streaming-lakehouse/integrate-data-lakes/paimon.md`) already
covers ROW types, so no documentation update is required.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
