DaZuiZui commented on issue #843: URL: https://github.com/apache/tsfile/issues/843#issuecomment-4764391552
Hi @JackieTien97 , I have finished the initial implementation of the Spark TsFile table model connector for #843. The PR is ready for review: https://github.com/apache/tsfile/pull/845 This PR adds a Spark DataSource V2 connector for reading and writing table-model TsFile files with .format("tsfile"). It includes schema inference, append writes, column pruning, basic predicate pushdown, mergeSchema=true, CTAS support, examples, and integration tests. I have run the relevant Maven tests locally: **JAVA_HOME=$(/usr/libexec/java_home -v 21) ./mvnw -P with-java -pl java/spark-tsfile -am test** The build passed successfully. Please take a look when you have time. Any feedback is welcome. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
