[
https://issues.apache.org/jira/browse/SPARK-44381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
qingbo jiao updated SPARK-44381:
--------------------------------
Description:
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit -{-}master yarn --deploy-mode client --proxy-user xxxx
--conf spark.app.name=spark-hive-test --conf
spark.security.credentials.renewalRatio=0.000058 --conf
spark.kerberos.renewal.credentials=ccache{-} -class
org.apache.spark.examples.sql.hive.SparkHiveExample
/examples/jars/spark-examples_2.12-3.1.1.jar
spark version 3.1.1，I configured it to refresh every 5 seconds。
--deploy-mode client/cluster wtih/without --proxy-user have all been tried, but
none of them will work
Missing any configuration parameters？
was:
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit --master yarn --deploy-mode client --proxy-user ocdp --conf
spark.app.name=spark-hive-test --conf
spark.security.credentials.renewalRatio=0.000058 --conf
spark.kerberos.renewal.credentials=ccache --class
org.apache.spark.examples.sql.hive.SparkHiveExample
/examples/jars/spark-examples_2.12-3.1.1.jar
spark version 3.1.1，I configured it to refresh every 5 seconds。
--deploy-mode client/cluster wtih/without --proxy-user have all been tried, but
none of them will work
Missing any configuration parameters？
> How to specify parameters in spark-sumbit to make HiveDelegationTokenProvider
> refresh token regularly
> -----------------------------------------------------------------------------------------------------
>
> Key: SPARK-44381
> URL: https://issues.apache.org/jira/browse/SPARK-44381
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.1.1
> Reporter: qingbo jiao
> Priority: Minor
>
> export KRB5CCNAME=FILE:/tmp/krb5cc_1001
> ./bin/spark-submit -{-}master yarn --deploy-mode client --proxy-user xxxx
> --conf spark.app.name=spark-hive-test --conf
> spark.security.credentials.renewalRatio=0.000058 --conf
> spark.kerberos.renewal.credentials=ccache{-} -class
> org.apache.spark.examples.sql.hive.SparkHiveExample
> /examples/jars/spark-examples_2.12-3.1.1.jar
> spark version 3.1.1，I configured it to refresh every 5 seconds。
> --deploy-mode client/cluster wtih/without --proxy-user have all been tried,
> but none of them will work
> Missing any configuration parameters？
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
