[
https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mahima Khatri resolved SPARK-47796.
-----------------------------------
Resolution: Workaround
> Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.*
> to 2.17.1 to fix the security issue
> ----------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-47796
> URL: https://issues.apache.org/jira/browse/SPARK-47796
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell, Spark Submit
> Affects Versions: 2.1.1
> Reporter: Mahima Khatri
> Priority: Blocker
> Fix For: 2.1.1
>
> Attachments: 1.exception.png, 2.log4j1.png, 3.log4j-2.png
>
>
> Spark Download Link:
> [https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz]
> log4j Migration:
> [https://logging.apache.org/log4j/2.x/manual/migration.html]
> The spark creation is not happening .
> Below is the exception:
> *{color:#4c9aff}1.exception.png (Attached){color}*
> When analyzed further found that the class file “RendererMap“ is not at all
> present in the bridge jar.
> *log4j-1.2.17*
> *{color:#4c9aff}2.log4j1.png (Attached){color}*
> ** *log4j-1.2-api-2.17.1.jar (Bridge jar)*
> *{color:#4c9aff}3.log4j-2.png (Attached){color}*
> Following the migration steps in
> [https://logging.apache.org/log4j/2.x/manual/migration.html]
> We are simply replacing the
> Jar: */usr/local/spark/jars/log4j-1.2.17.jar*
> With:
> * log4j-1.2-api-2.17.1.jar
> * log4j-api-2.17.1.jar
> * log4j-core-2.17.1.jar
> similar to what we had done 2 years back for version spark 2.1.3 version for
> which we were not downloading the spark zip on fly ,but we already had a
> downloaded zip on which we applied the patching changes. That seemed to work
> for 2.1.3 but for an older version where we are downloading the tar.gz now
> i.e 2.1.1, there seems to be an issue.
> Looking for a right resolution in this regard. Kindly let us know if any
> further information is required.
> FYI, Some of the various things tried:
> # Upgrading the bridge ,api ,core jar to 2.17.2 and even to the latest
> # Replaced the two slf4j jars with higher version : ex. slf4j-api-1.7.25.jar
> slf4j-log4j12-1.7.25.jar
> # Adding a log4j.properties file from the template available.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
