deepakpanda93 commented on issue #14757:
URL: https://github.com/apache/hudi/issues/14757#issuecomment-3670073977
Checked and confirmed, with the below command it worked without any issue.
```
spark-submit \
--class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer \
--conf spark.sql.catalogImplementation=hive \
--jars /usr/lib/hudi/hudi-spark-bundle.jar \
/usr/lib/hudi/hudi-utilities-slim-bundle.jar \
\
--table-type COPY_ON_WRITE \
--target-base-path s3a://<your_bucket>/sandbox-jars/status_table_target2 \
--target-table status_table_target2 \
\
--source-class org.apache.hudi.utilities.sources.HoodieIncrSource \
\
--source-ordering-field last_update_time \
\
--hoodie-conf
hoodie.streamer.source.hoodieincr.path=s3a://<your_bucket>/sandbox-jars/status_table
\
\
--hoodie-conf
hoodie.streamer.source.hoodieincr.missing.checkpoint.strategy=READ_UPTO_LATEST_COMMIT
\
\
--transformer-class
org.apache.hudi.utilities.transform.SqlQueryBasedTransformer \
\
--hoodie-conf hoodie.deltastreamer.transformer.sql="SELECT id,
creation_date FROM status_db.status_table;" \
\
--hoodie-conf
hoodie.deltastreamer.source.hoodie.table.path=s3a://<your_bucket>/sandbox-jars/status_table
\
--hoodie-conf hoodie.deltastreamer.source.hoodie.table.name=status_table \
\
--hoodie-conf hoodie.datasource.write.recordkey.field=id \
--hoodie-conf hoodie.datasource.write.precombine.field=last_update_time \
--hoodie-conf hoodie.datasource.write.table.name=status_table_target2 \
\
--hoodie-conf hive.metastore.uris=thrift://hivemetastore:9083 \
\
--enable-hive-sync \
--hoodie-conf hoodie.datasource.hive_sync.database=status_db \
--hoodie-conf hoodie.datasource.hive_sync.table=status_table_target2 \
--hoodie-conf hoodie.datasource.hive_sync.mode=hms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
