0AyanamiRei opened a new pull request, #67513:
URL: https://github.com/apache/doris/pull/67513
### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary:
Nereids routine load normalized `csv_with_names` and
`csv_with_names_and_types` to plain CSV while creating the job, then omitted
the header type during task planning. Header rows were consequently parsed as
data and counted as errors.
This change preserves the validated CSV header format in job properties and
forwards it through the Nereids task to the data description.
### Release note
Routine Load now honors `csv_with_names` and `csv_with_names_and_types`
without treating header rows as data.
### Check List (For Author)
- Test
- [ ] Regression test
- [x] Unit Test
- Extended `KafkaRoutineLoadJobTest` coverage for plain and
header-aware CSV formats.
- Not run per request.
- [ ] Manual test
- [ ] No need to test or manual test.
- Behavior changed:
- [ ] No.
- [x] Yes. Routine Load skips CSV header rows according to the
configured format.
- Does this need documentation?
- [x] No.
- [ ] Yes.
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
