[jira] [Updated] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-617: --- Status: Open (was: New) > Add support for data types convertible to String in TimestampBasedKeyGenerator > -- > > Key: HUDI-617 > URL: https://issues.apache.org/jira/browse/HUDI-617 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: Utilities >Reporter: Amit Singh >Priority: Minor > Labels: easyfix, pull-request-available > Attachments: test_data.json, test_schema.avsc > > Time Spent: 20m > Remaining Estimate: 0h > > Currently, TimestampBasedKeyGenerator only supports 4 data types for the > partition key. They are Double, Long, Float and String. However, if the > `avro.java.string` is not specified in the schema provided, Hudi throws the > following error: > org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for > partition field: org.apache.avro.util.Utf8 > at > org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) > at > org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) > > It will be better if the support was more generalised to include the data > types that provide method to convert them to String such as `Utf8` since all > these methods implement the `CharSequence` interface. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Singh updated HUDI-617: Labels: easyfix pull-request-available (was: easyfix pull-request-available pull-requests-available) > Add support for data types convertible to String in TimestampBasedKeyGenerator > -- > > Key: HUDI-617 > URL: https://issues.apache.org/jira/browse/HUDI-617 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: Utilities >Reporter: Amit Singh >Priority: Minor > Labels: easyfix, pull-request-available > Attachments: test_data.json, test_schema.avsc > > Time Spent: 20m > Remaining Estimate: 0h > > Currently, TimestampBasedKeyGenerator only supports 4 data types for the > partition key. They are Double, Long, Float and String. However, if the > `avro.java.string` is not specified in the schema provided, Hudi throws the > following error: > org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for > partition field: org.apache.avro.util.Utf8 > at > org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) > at > org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) > > It will be better if the support was more generalised to include the data > types that provide method to convert them to String such as `Utf8` since all > these methods implement the `CharSequence` interface. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-617: Labels: easyfix pull-request-available pull-requests-available (was: easyfix pull-requests-available) > Add support for data types convertible to String in TimestampBasedKeyGenerator > -- > > Key: HUDI-617 > URL: https://issues.apache.org/jira/browse/HUDI-617 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: Utilities >Reporter: Amit Singh >Priority: Minor > Labels: easyfix, pull-request-available, pull-requests-available > Attachments: test_data.json, test_schema.avsc > > Time Spent: 10m > Remaining Estimate: 0h > > Currently, TimestampBasedKeyGenerator only supports 4 data types for the > partition key. They are Double, Long, Float and String. However, if the > `avro.java.string` is not specified in the schema provided, Hudi throws the > following error: > org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for > partition field: org.apache.avro.util.Utf8 > at > org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) > at > org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) > > It will be better if the support was more generalised to include the data > types that provide method to convert them to String such as `Utf8` since all > these methods implement the `CharSequence` interface. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-617: Labels: easyfix pull-request-available (was: easyfix) > Add support for data types convertible to String in TimestampBasedKeyGenerator > -- > > Key: HUDI-617 > URL: https://issues.apache.org/jira/browse/HUDI-617 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: Utilities >Reporter: Amit Singh >Priority: Minor > Labels: easyfix, pull-request-available > Attachments: test_data.json, test_schema.avsc > > > Currently, TimestampBasedKeyGenerator only supports 4 data types for the > partition key. They are Double, Long, Float and String. However, if the > `avro.java.string` is not specified in the schema provided, Hudi throws the > following error: > org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for > partition field: org.apache.avro.util.Utf8 > at > org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) > at > org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) > > It will be better if the support was more generalised to include the data > types that provide method to convert them to String such as `Utf8` since all > these methods implement the `CharSequence` interface. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Singh updated HUDI-617: Attachment: test_schema.avsc test_data.json > Add support for data types convertible to String in TimestampBasedKeyGenerator > -- > > Key: HUDI-617 > URL: https://issues.apache.org/jira/browse/HUDI-617 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: Utilities >Reporter: Amit Singh >Priority: Minor > Labels: easyfix > Attachments: test_data.json, test_schema.avsc > > > Currently, TimestampBasedKeyGenerator only supports 4 data types for the > partition key. They are Double, Long, Float and String. However, if the > `avro.java.string` is not specified in the schema provided, Hudi throws the > following error: > org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for > partition field: org.apache.avro.util.Utf8 > at > org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) > at > org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) > > It will be better if the support was more generalised to include the data > types that provide method to convert them to String such as `Utf8` since all > these methods implement the `CharSequence` interface. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Singh updated HUDI-617: Fix Version/s: (was: 0.5.1) > Add support for data types convertible to String in TimestampBasedKeyGenerator > -- > > Key: HUDI-617 > URL: https://issues.apache.org/jira/browse/HUDI-617 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: Utilities >Reporter: Amit Singh >Priority: Minor > Labels: easyfix > > Currently, TimestampBasedKeyGenerator only supports 4 data types for the > partition key. They are Double, Long, Float and String. However, if the > `avro.java.string` is not specified in the schema provided, Hudi throws the > following error: > org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for > partition field: org.apache.avro.util.Utf8 > at > org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) > at > org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) > > It will be better if the support was more generalised to include the data > types that provide method to convert them to String such as `Utf8` since all > these methods implement the `CharSequence` interface. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Singh updated HUDI-617: Fix Version/s: 0.5.1 > Add support for data types convertible to String in TimestampBasedKeyGenerator > -- > > Key: HUDI-617 > URL: https://issues.apache.org/jira/browse/HUDI-617 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: Utilities >Reporter: Amit Singh >Priority: Minor > Labels: easyfix > Fix For: 0.5.1 > > > Currently, TimestampBasedKeyGenerator only supports 4 data types for the > partition key. They are Double, Long, Float and String. However, if the > `avro.java.string` is not specified in the schema provided, Hudi throws the > following error: > org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for > partition field: org.apache.avro.util.Utf8 > at > org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) > at > org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) > > It will be better if the support was more generalised to include the data > types that provide method to convert them to String such as `Utf8` since all > these methods implement the `CharSequence` interface. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (HUDI-617) Add support for data types convertible to String in TimestampBasedKeyGenerator
[ https://issues.apache.org/jira/browse/HUDI-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Singh updated HUDI-617: Description: Currently, TimestampBasedKeyGenerator only supports 4 data types for the partition key. They are Double, Long, Float and String. However, if the `avro.java.string` is not specified in the schema provided, Hudi throws the following error: org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for partition field: org.apache.avro.util.Utf8 at org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) at org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) It will be better if the support was more generalised to include the data types that provide method to convert them to String such as `Utf8` since all these methods implement the `CharSequence` interface. was: Currently, TimestampBasedKeyGenerator only supports 4 data types for the partition key. They are Double, Long, Float and String. However, if the `avro.java.string` is not specified in the schema provided, Hudi throws the error: org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for partition field: org.apache.avro.util.Utf8 at org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) at org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) ... It will be better if the support was more generalised to include the data types that provide method to convert them to String such as `Utf8` since all these methods implement the `CharSequence` interface. > Add support for data types convertible to String in TimestampBasedKeyGenerator > -- > > Key: HUDI-617 > URL: https://issues.apache.org/jira/browse/HUDI-617 > Project: Apache Hudi (incubating) > Issue Type: Improvement > Components: Utilities >Reporter: Amit Singh >Priority: Minor > Labels: easyfix > > Currently, TimestampBasedKeyGenerator only supports 4 data types for the > partition key. They are Double, Long, Float and String. However, if the > `avro.java.string` is not specified in the schema provided, Hudi throws the > following error: > org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for > partition field: org.apache.avro.util.Utf8 > at > org.apache.hudi.utilities.keygen.TimestampBasedKeyGenerator.getKey(TimestampBasedKeyGenerator.java:111) > at > org.apache.hudi.utilities.deltastreamer.DeltaSync.lambda$readFromSource$f92c188c$1(DeltaSync.java:338) > > It will be better if the support was more generalised to include the data > types that provide method to convert them to String such as `Utf8` since all > these methods implement the `CharSequence` interface. -- This message was sent by Atlassian Jira (v8.3.4#803005)
