[
https://issues.apache.org/jira/browse/FLINK-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jingsong Lee updated FLINK-18237:
---------------------------------
Description:
IllegalArgumentException when reading filesystem partitioned table with stream
mode.
{code:java}
java.lang.IllegalArgumentException: FileInputFormats with multiple paths are
not supported yet.
{code}
When reading filesystem partitioned table, there will maybe many directories to
read, but {{ContinuousFileMonitoringFunction}} not support multiple paths, we
should not use it. So for the reading of filesystem table:
* non-partitioned table: using default {{ContinuousFileMonitoringFunction}} to
read.
* partitioned table: using {{InputFormatSourceFunction}} to read.
was:
IllegalArgumentException when reading filesystem partitioned table with stream
mode.
{code:java}
java.lang.IllegalArgumentException: FileInputFormats with multiple paths are
not supported yet.
{code}
When reading filesystem partitioned table, there will maybe many directories to
read, but {{ContinuousFileMonitoringFunction}} not support multiple paths, we
should not use it. So for the reading of
> IllegalArgumentException when reading filesystem partitioned table with
> stream mode
> -----------------------------------------------------------------------------------
>
> Key: FLINK-18237
> URL: https://issues.apache.org/jira/browse/FLINK-18237
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem
> Reporter: Jingsong Lee
> Assignee: Jingsong Lee
> Priority: Critical
> Labels: pull-request-available
> Fix For: 1.11.0
>
>
> IllegalArgumentException when reading filesystem partitioned table with
> stream mode.
> {code:java}
> java.lang.IllegalArgumentException: FileInputFormats with multiple paths are
> not supported yet.
> {code}
> When reading filesystem partitioned table, there will maybe many directories
> to read, but {{ContinuousFileMonitoringFunction}} not support multiple paths,
> we should not use it. So for the reading of filesystem table:
> * non-partitioned table: using default {{ContinuousFileMonitoringFunction}}
> to read.
> * partitioned table: using {{InputFormatSourceFunction}} to read.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)