ashishmgofficial edited a comment on issue #2149:
URL: https://github.com/apache/hudi/issues/2149#issuecomment-710034993


   **AvroKafkaSource** : 
   
   ```
   spark-submit --packages org.apache.spark:spark-avro_2.11:2.4.4   --class 
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer 
s3://xxxx/hudi/jars/hudi-utilities-bundle_2.11-0.6.0.jar   --table-type 
COPY_ON_WRITE   --source-class 
org.apache.hudi.utilities.sources.AvroKafkaSource   --source-ordering-field 
_ts_ms    --target-base-path s3://xxxx/warehouse/hudi_dms_acc_kafka   
--target-table hudi_dms_acc_kafka --props 
s3://xxxx/hudi/conf/hudi-kafka.properties   --schemaprovider-class 
org.apache.hudi.utilities.schema.DebeziumSchemaRegistryProvider   
--transformer-class org.apache.hudi.utilities.transform.DebeziumTransformer   
--payload-class org.apache.hudi.common.model.DebeziumAvroPayload 2>&1 | tee 
o.log
   ```
   [o.log](https://github.com/apache/hudi/files/5391752/o.log)
   
   **AvroDFSSource** : 
   
   ```
   spark-submit --packages org.apache.spark:spark-avro_2.11:2.4.4   --class 
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer 
s3://xxxx/hudi/jars/hudi-utilities-bundle_2.11-0.6.0.jar   --table-type 
COPY_ON_WRITE   --source-class org.apache.hudi.utilities.sources.AvroDFSSource  
 --source-ordering-field _ts_ms    --target-base-path 
s3://xxxx/warehouse/hudi_dms_acc_kafka   --target-table hudi_dms_acc_kafka 
--props s3://xxxx/hudi/conf/hudi-conf.properties   --schemaprovider-class 
org.apache.hudi.utilities.schema.DebeziumSchemaRegistryProvider   
--transformer-class org.apache.hudi.utilities.transform.DebeziumTransformer   
--payload-class org.apache.hudi.common.model.DebeziumAvroPayload 2>&1 | tee 
p.log
   ```
   [p.log](https://github.com/apache/hudi/files/5391748/p.log)
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to