[
https://issues.apache.org/jira/browse/SPARK-60724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-60724.
----------------------------------
Fix Version/s: 4.4.0
Resolution: Fixed
Issue resolved by pull request 59932
[https://github.com/apache/spark/pull/59932]
> Document the order of the calls of native data sources and add is_log_enabled
> -----------------------------------------------------------------------------
>
> Key: SPARK-60724
> URL: https://issues.apache.org/jira/browse/SPARK-60724
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.4.0
> Reporter: Hyukjin Kwon
> Assignee: Hyukjin Kwon
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.4.0
>
>
> A follow-up to SPARK-60101 (https://github.com/apache/spark/pull/59424), from
> the review in
> https://github.com/apache/spark/pull/59424#issuecomment-6480975990:
> - Document in spark_datasource.h the order in which Spark calls the functions
> on a handle, so that SDKs need not guard against other orders.
> - Append is_log_enabled to SparkDsHost, so that a library can skip formatting
> the messages that Spark does not log, and follow the log level of Spark.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
