pratyakshsharma commented on a change in pull request #1150: [HUDI-288]: Add
support for ingesting multiple kafka streams in a single DeltaStreamer
deployment
URL: https://github.com/apache/incubator-hudi/pull/1150#discussion_r399372702
##########
File path:
hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java
##########
@@ -84,26 +87,35 @@
+ "{\"name\": \"amount\",\"type\": \"double\"},{\"name\": \"currency\",
\"type\": \"string\"}]}},";
public static final String FARE_FLATTENED_SCHEMA = "{\"name\": \"fare\",
\"type\": \"double\"},"
+ "{\"name\": \"currency\", \"type\": \"string\"},";
-
public static final String TRIP_EXAMPLE_SCHEMA =
TRIP_SCHEMA_PREFIX + FARE_NESTED_SCHEMA + TRIP_SCHEMA_SUFFIX;
public static final String TRIP_FLATTENED_SCHEMA =
TRIP_SCHEMA_PREFIX + FARE_FLATTENED_SCHEMA + TRIP_SCHEMA_SUFFIX;
+ public static String TRIP_UBER_EXAMPLE_SCHEMA =
"{\"type\":\"record\",\"name\":\"tripuberrec\",\"fields\":["
+ +
"{\"name\":\"timestamp\",\"type\":\"double\"},{\"name\":\"_row_key\",\"type\":\"string\"},{\"name\":\"rider\",\"type\":\"string\"},"
+ +
"{\"name\":\"driver\",\"type\":\"string\"},{\"name\":\"fare\",\"type\":\"double\"},{\"name\":
\"_hoodie_is_deleted\", \"type\": \"boolean\", \"default\": false}]}";
+ public static String TRIP_FG_EXAMPLE_SCHEMA =
"{\"type\":\"record\",\"name\":\"tripfgrec\",\"fields\":["
+ +
"{\"name\":\"timestamp\",\"type\":\"double\"},{\"name\":\"_row_key\",\"type\":\"string\"},{\"name\":\"rider\",\"type\":\"string\"},"
+ +
"{\"name\":\"driver\",\"type\":\"string\"},{\"name\":\"fare\",\"type\":\"double\"},{\"name\":
\"_hoodie_is_deleted\", \"type\": \"boolean\", \"default\": false}]}";
+
public static final String NULL_SCHEMA =
Schema.create(Schema.Type.NULL).toString();
public static final String TRIP_HIVE_COLUMN_TYPES =
"double,string,string,string,double,double,double,double,"
- +
"struct<amount:double,currency:string>,boolean";
-
+ + "struct<amount:double,currency:string>,boolean";
public static final Schema AVRO_SCHEMA = new
Schema.Parser().parse(TRIP_EXAMPLE_SCHEMA);
public static final Schema AVRO_SCHEMA_WITH_METADATA_FIELDS =
HoodieAvroUtils.addMetadataFields(AVRO_SCHEMA);
+ public static Schema avroFgSchema = new
Schema.Parser().parse(TRIP_FG_EXAMPLE_SCHEMA);
Review comment:
Actually that is the initials of my current organisation. While testing I
put it like that and forgot to modify later. Will change the name. :)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
