JingGe commented on a change in pull request #19083:
URL: https://github.com/apache/flink/pull/19083#discussion_r826135126
##########
File path: docs/content/docs/connectors/datastream/formats/parquet.md
##########
@@ -39,46 +39,71 @@ To use the format you need to add the Flink Parquet
dependency to your project:
<version>{{< version >}}</version>
</dependency>
```
-
+
+For reading Avro records, parquet-avro dependency is required additionally:
+
+```xml
+<dependency>
+ <groupId>org.apache.parquet</groupId>
+ <artifactId>parquet-avro</artifactId>
+ <version>${flink.format.parquet.version}</version>
+ <optional>true</optional>
+ <exclusions>
+ <exclusion>
+ <groupId>org.apache.hadoop</groupId>
+ <artifactId>hadoop-client</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>it.unimi.dsi</groupId>
+ <artifactId>fastutil</artifactId>
+ </exclusion>
+ </exclusions>
+</dependency>
+```
+
This format is compatible with the new Source that can be used in both batch
and streaming modes.
Thus, you can use this format for two kinds of data:
-- Bounded data
-- Unbounded data: monitors a directory for new files that appear
+- Bounded data: lists all files and reads them all.
+- Unbounded data: monitors a directory for new files that appear.
-## Flink RowData
+By default, a File Source is created in the bounded mode, to turn the source
into the continuous unbounded mode you can call
+`AbstractFileSource.AbstractFileSourceBuilder.monitorContinuously(Duration)`
additionally .
-#### Bounded data example
+**Batch mode**
Review comment:
True and this case is intended to describe the execution mode. Please
take a look at the inline comments
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
