[
https://issues.apache.org/jira/browse/FLINK-23939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl updated FLINK-23939:
-------------------------
Description:
*table options as follows,*
!image-2021-08-24-16-12-48-465.png!
*kafka source table ddl as follows:*
!image-2021-08-24-16-15-47-714.png!
*kafka message for test:*
*message A:*
!image-2021-08-24-16-21-05-386.png!
*message B:*
!image-2021-08-24-16-21-23-228.png!
*1. Test 1:*
json.fail-on-missing-field = *false*
json.ignore-parse-errors = *false*
produce test kafka message and result as follows,
!image-2021-08-24-16-24-13-246.png!
*As described in the documentation, the program should throw an exception?*
*2. Test 2:*
json.fail-on-missing-field = *false*
json.ignore-parse-errors = *true*
!image-2021-08-24-16-26-32-560.png!
*As described in the documentation, the program should throw an exception?*
*3. Test 3:*
json.fail-on-missing-field = *true*
json.ignore-parse-errors = *false*
!image-2021-08-24-16-34-48-347.png!
*4. Test 4 :*
json.fail-on-missing-field = *true*
json.ignore-parse-errors = *true*
!image-2021-08-24-16-37-00-740.png!
*As described in the documentation, why should'n both be true?*
As above, the results of the above experiments make me confused. Can I achieve
such an effect? When the parsing fails, skip this data, and do not throw an
exception, and the program continues to run?
was:
*table options as follows,*
!image-2021-08-24-16-12-48-465.png!
*kafka source table ddl as follows:*
!image-2021-08-24-16-15-47-714.png!
*kafka message for test:*
*message A:*
!image-2021-08-24-16-21-05-386.png!
*message B:*
!image-2021-08-24-16-21-23-228.png!
*1. Test 1:*
json.fail-on-missing-field = *false*
json.ignore-parse-errors = *false*
produce test kafka message and result as follows,
!image-2021-08-24-16-24-13-246.png!
*As described in the documentation, the program should throw an exception?*
*2. Test 2:*
json.fail-on-missing-field = *false*
json.ignore-parse-errors = *true*
!image-2021-08-24-16-26-32-560.png!
*As described in the documentation, the program should throw an exception?*
*3. Test 3:*
json.fail-on-missing-field = *true*
json.ignore-parse-errors = *false*
!image-2021-08-24-16-34-48-347.png!
4. Test 4 :
json.fail-on-missing-field = *true*
json.ignore-parse-errors = *true*
!image-2021-08-24-16-37-00-740.png!
*As described in the documentation, why should'n both be true?*
As above, the results of the above experiments make me confused. Can I achieve
such an effect? When the parsing fails, skip this data, and do not throw an
exception, and the program continues to run?
> The result of validation and parsing failure does not match the document
> description
> ------------------------------------------------------------------------------------
>
> Key: FLINK-23939
> URL: https://issues.apache.org/jira/browse/FLINK-23939
> Project: Flink
> Issue Type: Bug
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Affects Versions: 1.12.1
> Reporter: Carl
> Priority: Major
> Attachments: image-2021-08-24-16-12-48-465.png,
> image-2021-08-24-16-15-47-714.png, image-2021-08-24-16-21-05-386.png,
> image-2021-08-24-16-21-23-228.png, image-2021-08-24-16-24-13-246.png,
> image-2021-08-24-16-26-32-560.png, image-2021-08-24-16-34-48-347.png,
> image-2021-08-24-16-37-00-740.png
>
>
> *table options as follows,*
> !image-2021-08-24-16-12-48-465.png!
> *kafka source table ddl as follows:*
> !image-2021-08-24-16-15-47-714.png!
>
> *kafka message for test:*
> *message A:*
> !image-2021-08-24-16-21-05-386.png!
>
> *message B:*
> !image-2021-08-24-16-21-23-228.png!
> *1. Test 1:*
> json.fail-on-missing-field = *false*
> json.ignore-parse-errors = *false*
> produce test kafka message and result as follows,
> !image-2021-08-24-16-24-13-246.png!
> *As described in the documentation, the program should throw an exception?*
>
> *2. Test 2:*
> json.fail-on-missing-field = *false*
> json.ignore-parse-errors = *true*
>
> !image-2021-08-24-16-26-32-560.png!
> *As described in the documentation, the program should throw an exception?*
>
> *3. Test 3:*
> json.fail-on-missing-field = *true*
> json.ignore-parse-errors = *false*
>
> !image-2021-08-24-16-34-48-347.png!
>
> *4. Test 4 :*
>
> json.fail-on-missing-field = *true*
> json.ignore-parse-errors = *true*
>
> !image-2021-08-24-16-37-00-740.png!
>
> *As described in the documentation, why should'n both be true?*
>
> As above, the results of the above experiments make me confused. Can I
> achieve such an effect? When the parsing fails, skip this data, and do not
> throw an exception, and the program continues to run?
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)