[ https://issues.apache.org/jira/browse/FLINK-18265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jingsong Lee reassigned FLINK-18265: ------------------------------------ Assignee: godfrey he (was: Jingsong Lee) > Hidden files should be ignored when the filesystem table searches for > partitions > -------------------------------------------------------------------------------- > > Key: FLINK-18265 > URL: https://issues.apache.org/jira/browse/FLINK-18265 > Project: Flink > Issue Type: Bug > Components: Connectors / FileSystem, Table SQL / API > Reporter: Jingsong Lee > Assignee: godfrey he > Priority: Blocker > Fix For: 1.11.0 > > > If there are some hidden files in the path of filesystem partitioned table, > query this table will occur: > {code:java} > Caused by: org.apache.flink.table.api.TableException: Partition keys are: > [j], incomplete partition spec: {} > at > org.apache.flink.table.filesystem.FileSystemTableSource.toFullLinkedPartSpec(FileSystemTableSource.java:209) > ~[flink-table-blink_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT] > at > org.apache.flink.table.filesystem.FileSystemTableSource.access$800(FileSystemTableSource.java:62) > ~[flink-table-blink_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT] > at > org.apache.flink.table.filesystem.FileSystemTableSource$1.lambda$getPaths$0(FileSystemTableSource.java:174) > ~[flink-table-blink_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT] > at > java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) > ~[?:1.8.0_152] > at > java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) > ~[?:1.8.0_152] > at > java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) > ~[?:1.8.0_152] > at > java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) > ~[?:1.8.0_152] > at > java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545) > ~[?:1.8.0_152] > at > java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260) > ~[?:1.8.0_152] > at > java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438) > ~[?:1.8.0_152] > at > org.apache.flink.table.filesystem.FileSystemTableSource$1.getPaths(FileSystemTableSource.java:177) > ~[flink-table-blink_2.11-1.12-SNAPSHOT.jar:1.12-SNAPSHOT] > {code} > Hidden files should be ignored when the filesystem table searches for > partitions. This is not correct partition. -- This message was sent by Atlassian Jira (v8.3.4#803005)