[
https://issues.apache.org/jira/browse/FLINK-25284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Nuyanzin updated FLINK-25284:
------------------------------------
Description:
Currently it is impossible to specify that some values should be null sometimes.
It would be nice to have some property something like {{null-rate}} telling how
often there should be {{null}} value generated
something like that
{code:sql}
CREATE TABLE Orders (
order_number STRING,
price DECIMAL(32,2),
buyer ROW<id INT, last_name STRING>,
order_time TIMESTAMP(3),
my_map MAP<INT,STRING>,
my_arrray ARRAY<STRING>
) WITH (
'connector' = 'datagen',
'fields.order_number.null-rate' = '0.7',
'fields.price.null-rate' = '1.0',
'fields.order_time.null-rate' = '0.5',
'fields.buyer.id.null-rate' = '0.5',
'fields.buyer.null-rate' = '0.5',
'fields.my_map.key.null-rate' = '0.5',
'fields.my_map.null-rate' = '0.5',
'fields.my_array.element.null-rate' = '0.1',
'fields.my_array.null-rate' = '0.5'
);
{code}
was:
Currently it is impossible to specify that some values should be null sometimes.
It would be nice to have some property something like {{null-rate}} telling how
often there should be {{null}} value generated
> Support nulls in DataGen
> ------------------------
>
> Key: FLINK-25284
> URL: https://issues.apache.org/jira/browse/FLINK-25284
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / API
> Reporter: Sergey Nuyanzin
> Priority: Minor
> Labels: pull-request-available
>
> Currently it is impossible to specify that some values should be null
> sometimes.
> It would be nice to have some property something like {{null-rate}} telling
> how often there should be {{null}} value generated
> something like that
> {code:sql}
> CREATE TABLE Orders (
> order_number STRING,
> price DECIMAL(32,2),
> buyer ROW<id INT, last_name STRING>,
> order_time TIMESTAMP(3),
> my_map MAP<INT,STRING>,
> my_arrray ARRAY<STRING>
> ) WITH (
> 'connector' = 'datagen',
> 'fields.order_number.null-rate' = '0.7',
> 'fields.price.null-rate' = '1.0',
> 'fields.order_time.null-rate' = '0.5',
> 'fields.buyer.id.null-rate' = '0.5',
> 'fields.buyer.null-rate' = '0.5',
> 'fields.my_map.key.null-rate' = '0.5',
> 'fields.my_map.null-rate' = '0.5',
> 'fields.my_array.element.null-rate' = '0.1',
> 'fields.my_array.null-rate' = '0.5'
> );
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
