[ 
https://issues.apache.org/jira/browse/FLINK-22669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

wangqinghuan updated FLINK-22669:
---------------------------------
    Description: 
Do we have suggestions to support date format in a file path when using 
filesystem as source?

For example:

{{CREATE TABLE fs_table (}}

{{...}}

{{)}}{{ WITH (}}

'connector'='filesystem',

 'path'='ftp:/tmp/\{yyyy-MM-dd}/data',

{{'format'='parquet'}}

{{);}}

the \{yyyy-MM-dd} expression in path will be replaced with actual system time.

*Why support this?*

date expression support will be used in some scheduled jobs, such as running a 
daily job to read  current day data from FTP which will create a new file path 
using date expression every day.

  was:
Do we have suggestions to support date format in a file path when using 
filesystem as source?

For example:

{{CREATE TABLE fs_table (}}

{{...}}

{{)}}{{ WITH (}}

{{  'connector'='filesystem',}}

{{  'path'='ftp:/tmp/\{yyyy-MM-dd}/data',}}

{{'format'='parquet'}}{{}}{{);}}

the \{yyyy-MM-dd} expression in path will be replaced with actual system time.

*Why support this?*

date expression support will be used in some scheduled jobs, such as running a 
daily job to read  current day data from FTP which will create a new file path 
using date expression every day.


> Support date format in a path when use filesytem as source
> ----------------------------------------------------------
>
>                 Key: FLINK-22669
>                 URL: https://issues.apache.org/jira/browse/FLINK-22669
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: wangqinghuan
>            Priority: Minor
>
> Do we have suggestions to support date format in a file path when using 
> filesystem as source?
> For example:
> {{CREATE TABLE fs_table (}}
> {{...}}
> {{)}}{{ WITH (}}
> 'connector'='filesystem',
>  'path'='ftp:/tmp/\{yyyy-MM-dd}/data',
> {{'format'='parquet'}}
> {{);}}
> the \{yyyy-MM-dd} expression in path will be replaced with actual system time.
> *Why support this?*
> date expression support will be used in some scheduled jobs, such as running 
> a daily job to read  current day data from FTP which will create a new file 
> path using date expression every day.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to