jerryshao commented on a change in pull request #796: [WIP] Support Spark
Structured Streaming Read for Iceberg
URL: https://github.com/apache/incubator-iceberg/pull/796#discussion_r386900747
##########
File path:
spark/src/main/java/org/apache/iceberg/spark/source/IcebergSource.java
##########
@@ -135,6 +138,25 @@ public StreamWriter createStreamWriter(String runId,
StructType dsStruct,
return new StreamingWriter(table, io, encryptionManager, options, queryId,
mode, appId, dsSchema);
}
+ @Override
+ public MicroBatchReader createMicroBatchReader(Optional<StructType> schema,
String checkpointLocation,
+ DataSourceOptions options) {
+ if (schema.isPresent()) {
+ throw new IllegalStateException("Iceberg does not support specifying the
schema at read time");
Review comment:
OK, let me see how it works.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
