alexguo-db commented on code in PR #2613:
URL: https://github.com/apache/arrow-adbc/pull/2613#discussion_r1995997917
##########
csharp/src/Drivers/Apache/Spark/SparkStatement.cs:
##########
@@ -50,6 +50,7 @@ protected override void
SetStatementProperties(TExecuteStatementReq statement)
ComplexTypesAsArrow = false,
IntervalTypesAsArrow = false,
};
+ statement.TrimArrowBatchesToLimit = true;
Review Comment:
From what I researched it seems to be a Databricks only feature (I can't
find any references in the Spark repo).
However I see that there are some other statement properties set here that I
can't find in the open source Spark repo, e.g. UseArrowNativeTypes. Is there
some place you are using to check?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
