The GitHub Actions job "flink-connector-aws: build on pull request" on 
flink-connector-aws.git/gsr-avro-sql-format has failed.
Run started by GitHub user fmorillo7694 (triggered by fmorillo7694).

Head commit for run:
baf324717043ab756fd6644d8723e37305515f63 / Francisco <[email protected]>
[FLINK-24379][Formats/JSON] Enforce the registered schema contract on write and 
read

Two sibling gaps of the protobuf guards added in the previous commits:

- NOT NULL on write: JsonSchemaConverter registers a NOT NULL column as a
  required, non-nullable property, but Flink's JSON serializer writes null for
  any null field and the GSR encode path skips validation, so a NOT NULL
  violation was published as a record contradicting its own schema. The
  serializer now rejects it naming the column path (top-level, nested ROW,
  ARRAY element, MAP value), mirroring the schema converter's walk.

- DECIMAL range on read: flink-json ends its decimal conversion in
  DecimalData.fromBigDecimal, which returns null when the integer part does
  not fit the reader's precision; a wider writer schema silently lost data.
  The deserializer now parses to a JsonNode, checks every DECIMAL value
  against the declared type (nested containers included) and fails with the
  value, path and type before converting. Error wrapping matches flink-json's
  own deserialize(byte[]) path. flink-shaded-jackson is declared provided,
  exactly as flink-json declares it.

GsrJsonSchemaContractTest covers both guards (12 tests); the NOT NULL and
DECIMAL tests fail against the pre-fix code. Limitations documented (en + zh).

Report URL: 
https://github.com/apache/flink-connector-aws/actions/runs/37441156073

With regards,
GitHub Actions via GitBox

Reply via email to