qingbo jiao created SPARK-44381:
-----------------------------------
Summary: How to specify parameters in spark-sumbit to make
HiveDelegationTokenProvider refresh token regularly
Key: SPARK-44381
URL: https://issues.apache.org/jira/browse/SPARK-44381
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.1.1
Reporter: qingbo jiao
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit --master yarn --deploy-mode client --proxy-user ocdp --conf
spark.app.name=spark-hive-test --conf
spark.security.credentials.renewalRatio=0.000058 --conf
spark.kerberos.renewal.credentials=ccache --class
org.apache.spark.examples.sql.hive.SparkHiveExample
/examples/jars/spark-examples_2.12-3.1.1.jar
spark version 3.1.1,I configured it to refresh every 5 seconds。
--deploy-mode client/cluster wtih/without --proxy-user have all been tried, but
none of them will work
Missing any configuration parameters?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]