sreeram26 commented on pull request #1898: URL: https://github.com/apache/hudi/pull/1898#issuecomment-667681236
Testing in docker ``` root@adhoc-2:/opt# spark-submit \ > --class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer $HUDI_UTILITIES_BUNDLE \ > --table-type COPY_ON_WRITE \ > --source-class org.apache.hudi.utilities.sources.JsonKafkaSource \ > --source-ordering-field ts \ > --target-base-path /user/hive/warehouse/stock_ticks_cow \ > --target-table stock_ticks_cow --props /var/demo/config/kafka-source.properties \ > --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider \ > --hoodie-conf hoodie.datasource.write.recordkey.field=key,symbol \ > --hoodie-conf hoodie.datasource.write.keygenerator.class=org.apache.hudi.keygen.ComplexKeyGenerator 0: jdbc:hive2://hiveserver:10000> select `_hoodie_record_key` from stock_ticks_cow where symbol = 'GOOG'; +-------------------------------------+--+ | _hoodie_record_key | +-------------------------------------+--+ | key:GOOG_2018-08-31 10,symbol:GOOG | | key:GOOG_2018-08-31 09,symbol:GOOG | +-------------------------------------+--+ 2 rows selected (0.302 seconds) ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
