[
https://issues.apache.org/jira/browse/HUDI-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-1506:
------------------------------
Description:
{code:java}
//
Caused by: org.apache.spark.SparkException: Job aborted due to stage failure:
Task 4 in stage 4.0 failed 4 times, most recent failure: Lost task 4.3 in stage
4.0 (TID 24, al-prd-dtp-data-lake-10-0-88-26, executor 4):
org.apache.hudi.exception.HoodieException: etlDatetime(Part -etlDatetime) field
not found in record. Acceptable fields were :[vin, uuid, commercialType,
businessType, vehicleNo, plateColor, vehicleColor, engineId, nextFixDate,
feePrintId, transArea, createTime, updateTime, registerDate, curVehicleNo,
reportVehicleNo, model, checkDate, certifyDateA, certifyDateB, certificate,
transAgency, transAgencyNet, transDateStart, transDateStop, insurCom, insurNum,
insurType, insurCount, insurEff, insurExp, insurCreateTime, insurUpdateTime,
curVehicleCertno, reportVehicleCertno, seats, brand, vehicleType, fuelType,
engineDisplace, photo, enginePower, gpsBrand, gpsModel, gpsImei,
gpsInstallDate, curDriverUuid, reportDrivers, curTimeOn, curTimeOff, timeFrom,
timeTo, ownerName, fixState, checkState, photoId, photoIdUrl, fareType,
wheelBase, vehicleTec, vehicleSafe, lesseeName, lesseeCode, sdcOperationType,
hivePartition, etlDatetime]
{code}
we can see the `etlDatetime` do exist. it is caused by null value acturally
was:Caused by: org.apache.spark.SparkException: Job aborted due to stage
failure: Task 4 in stage 4.0 failed 4 times, most recent failure: Lost task 4.3
in stage 4.0 (TID 24, al-prd-dtp-data-lake-10-0-88-26, executor 4):
org.apache.hudi.exception.HoodieException: etlDatetime(Part -etlDatetime) field
not found in record. Acceptable fields were :[vin, uuid, commercialType,
businessType, vehicleNo, plateColor, vehicleColor, engineId, nextFixDate,
feePrintId, transArea, createTime, updateTime, registerDate, curVehicleNo,
reportVehicleNo, model, checkDate, certifyDateA, certifyDateB, certificate,
transAgency, transAgencyNet, transDateStart, transDateStop, insurCom, insurNum,
insurType, insurCount, insurEff, insurExp, insurCreateTime, insurUpdateTime,
curVehicleCertno, reportVehicleCertno, seats, brand, vehicleType, fuelType,
engineDisplace, photo, enginePower, gpsBrand, gpsModel, gpsImei,
gpsInstallDate, curDriverUuid, reportDrivers, curTimeOn, curTimeOff, timeFrom,
timeTo, ownerName, fixState, checkState, photoId, photoIdUrl, fareType,
wheelBase, vehicleTec, vehicleSafe, lesseeName, lesseeCode, sdcOperationType,
hivePartition, etlDatetime]
> Fix wrong exception thrown in HoodieAvroUtils
> ---------------------------------------------
>
> Key: HUDI-1506
> URL: https://issues.apache.org/jira/browse/HUDI-1506
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: wangxianghu
> Assignee: wangxianghu
> Priority: Major
>
> {code:java}
> //
> Caused by: org.apache.spark.SparkException: Job aborted due to stage failure:
> Task 4 in stage 4.0 failed 4 times, most recent failure: Lost task 4.3 in
> stage 4.0 (TID 24, al-prd-dtp-data-lake-10-0-88-26, executor 4):
> org.apache.hudi.exception.HoodieException: etlDatetime(Part -etlDatetime)
> field not found in record. Acceptable fields were :[vin, uuid,
> commercialType, businessType, vehicleNo, plateColor, vehicleColor, engineId,
> nextFixDate, feePrintId, transArea, createTime, updateTime, registerDate,
> curVehicleNo, reportVehicleNo, model, checkDate, certifyDateA, certifyDateB,
> certificate, transAgency, transAgencyNet, transDateStart, transDateStop,
> insurCom, insurNum, insurType, insurCount, insurEff, insurExp,
> insurCreateTime, insurUpdateTime, curVehicleCertno, reportVehicleCertno,
> seats, brand, vehicleType, fuelType, engineDisplace, photo, enginePower,
> gpsBrand, gpsModel, gpsImei, gpsInstallDate, curDriverUuid, reportDrivers,
> curTimeOn, curTimeOff, timeFrom, timeTo, ownerName, fixState, checkState,
> photoId, photoIdUrl, fareType, wheelBase, vehicleTec, vehicleSafe,
> lesseeName, lesseeCode, sdcOperationType, hivePartition, etlDatetime]
> {code}
> we can see the `etlDatetime` do exist. it is caused by null value acturally
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
