[
https://issues.apache.org/jira/browse/SPARK-34128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-34128:
------------------------------------
Assignee: Apache Spark
> Suppress excessive logging of TTransportExceptions in Spark ThriftServer
> -------------------------------------------------------------------------
>
> Key: SPARK-34128
> URL: https://issues.apache.org/jira/browse/SPARK-34128
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.1, 3.1.0
> Reporter: Kent Yao
> Assignee: Apache Spark
> Priority: Minor
>
> Since Spark 3.0， the `libthrift` has been bumped up from 0.9.3 to 0.12.0.
> Due to THRIFT-4805, The SparkThrift Server will print annoying TExceptions.
> For example, the current thrift server module test in Github action workflow
> outputs more than 200MB of data for this error only, while the total size of
> the test log only about 1GB.
>
> I checked the latest `hive-service-rpc` module in the maven center,
> [https://mvnrepository.com/artifact/org.apache.hive/hive-service-rpc/3.1.2.]
> It still uses the 0.9.3 version.
>
> Due to THRIFT-5274 , It looks like we need to wait for thrift 0.14.0 to
> release or downgrade to 0.9.3 to fix this issue if any of them is appropriate
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
