JingsongLi commented on PR #8758:
URL: https://github.com/apache/paimon/pull/8758#issuecomment-5030430578
- `ArrowFieldWriterFactoryVisitor.visit(MapType)` changes the key
writer’s nullability to `mapType.getKeyType().isNullable()`, but
`ArrowUtils.toArrowField()` always declares the Arrow map key schema as **NOT
NULL**.
- Paimon’s `MapType` explicitly allows null keys; the default `INT` key
is also nullable. Consequently, `MAP<INT, INT> NOT NULL` can now successfully
write null keys, generating data that conflicts with the Arrow schema/spec.
- The local null-key use case has been reproduced: it is expected to
throw an exception, but no exception is actually thrown. It is recommended that
the key writer consistently use `false`; null keys that cannot be expressed
should result in a “fail loud” error.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
