Jonathan Vexler created HUDI-9603:
-------------------------------------
Summary: Flink 1.18 array values incorrect in fg reader test
Key: HUDI-9603
URL: https://issues.apache.org/jira/browse/HUDI-9603
Project: Apache Hudi
Issue Type: Bug
Components: flink, reader-core
Affects Versions: 1.0.2
Reporter: Jonathan Vexler
{code:java}
<{"timestamp": 0, "_row_key": "30f916be-06d6-4ef3-a9fb-9dddc40e8abd",
"partition_path": "any_partition", "trip_type": "BLACK", "rider": "rider-001",
"driver": "driver-001", "begin_lat": 0.7585664392201925, "begin_lon":
0.37789349980839115, "end_lat": 0.7757098794857531, "end_lon":
0.1730947142293684, "distance_in_meters": 1356260410, "seconds_since_epoch":
-9002173267385180332, "weight": 0.9950906, "nation": "Canada", "current_date":
13, "current_ts": 1182257224, "height": [0, 0, 11, 121, -97], "city_to_state":
{"LA": "CA"}, "fare": {"amount": 89.22144149794701, "currency": "USD"},
"tip_history": [{"amount": 78.67847272460095, "currency": "USD"}],
"customField0": 1299566198, "customField1": 5724776041695989483,
"customField2": 0.7481167, "customField3": 0.2553663812411848, "customField4":
"25db73af-fdf9-4e04-b47d-ce44882bf362", "customField5":
"877c2613-f2a1-4afd-af4a-863814dec38b", "_hoodie_is_deleted": false}>
<{"timestamp": 0, "_row_key": "30f916be-06d6-4ef3-a9fb-9dddc40e8abd",
"partition_path": "any_partition", "trip_type": "BLACK", "rider": "rider-001",
"driver": "driver-001", "begin_lat": 0.7585664392201925, "begin_lon":
0.37789349980839115, "end_lat": 0.7757098794857531, "end_lon":
0.1730947142293684, "distance_in_meters": 1356260410, "seconds_since_epoch":
-9002173267385180332, "weight": 0.9950906, "nation": "Canada", "current_date":
13, "current_ts": 1182257224, "height": [0, 0, 11, 121, -97], "city_to_state":
{"LA": "CA"}, "fare": {"amount": 89.22144149794701, "currency": "USD"},
"tip_history": [{"amount": 4.5791476348245315, "currency": "USD"}],
"customField0": 1299566198, "customField1": 5724776041695989483,
"customField2": 0.7481167, "customField3": 0.2553663812411848, "customField4":
"25db73af-fdf9-4e04-b47d-ce44882bf362", "customField5":
"877c2613-f2a1-4afd-af4a-863814dec38b", "_hoodie_is_deleted": false}>
{code}
every field is the same except for the tip_history. This only happens on Flink
1.18 and not 1.20. I added a config to
HoodieTestDataGenerator.SchemaEvolutionConfigs that can be enabled to expose
this issue. I have marked it as a TODO in the code
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
