Hyukjin Kwon created SPARK-37887:
------------------------------------
Summary: PySpark shell sets log level to INFO by default
Key: SPARK-37887
URL: https://issues.apache.org/jira/browse/SPARK-37887
Project: Spark
Issue Type: Sub-task
Components: PySpark, Spark Shell
Affects Versions: 3.3.0
Reporter: Hyukjin Kwon
{code}
./bin/pyspark
{code}
{code}
Python 3.9.5 (default, May 18 2021, 12:31:01)
[Clang 10.0.0 ] :: Anaconda, Inc. on darwin
Type "help", "copyright", "credits" or "license" for more information.
22/01/13 10:28:15 INFO HiveConf: Found configuration file null
22/01/13 10:28:15 INFO SparkContext: Running Spark version 3.3.0-SNAPSHOT
...
>>> spark.range(10)
22/01/13 10:31:48 INFO SharedState: Setting hive.metastore.warehouse.dir
('null') to the value of spark.sql.warehouse.dir.
...
{code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
