Hi,
I hope things are good. We are planning on using DetalStreamer as a client for
hudi. Our plan is to use AWS DMS for initial load & CDC. The question I have is
around the documentation for the properties file that I need for dfs, source &
target. Where can I find more information on the properties files need for the
client.
Lets say if I have a source table in Oracle in the format below, will my avro
schema for source and target will be same.
CREATE TABLE orders
(
order_id NUMBER GENERATED BY DEFAULT AS IDENTITY START WITH 106 PRIMARY
KEY,
customer_id NUMBER( 6, 0 ) NOT NULL,
status VARCHAR( 20 ) NOT NULL ,
salesman_id NUMBER( 6, 0 ) ,
order_date TIMESTAMP NOT NULL
);
I would appreciate your help in this regard.
We are on this stack:
EMR : emr-5.29.0
Spark: Spark 2.4.4, spark-avro_2.11:2.4.4
Thanks
Syed Zaidi