Github user dongjinleekr commented on the issue:
https://github.com/apache/spark/pull/22282
As you can see, this PR consists of 3 parts:
1. Extend `UnsafeArrayData`, `UnsafeMapData` (commit 1~6)
2. Implement Kafka Headers functionality (commit 7, 10)
3. Update unit tests (commit 8, 9)
I have the following questions:
1. Should I separate group 1 as a separated issue?
2. I found that KafkaSourceSuiteBase's 'Kafka column types' test is missing
a select expression. The weird thing is that it works before the update but
does not work after the update. (It is why the last commit was added - without
specification, this test does not pass.) Is this intended one? Or, Do I
misunderstanding something?
Please have a look when you are free. Thanks.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
