[
https://issues.apache.org/jira/browse/SPARK-47796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mahima Khatri updated SPARK-47796:
----------------------------------
Description:
Spark Download Link:
[https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz]
log4j Migration:
[https://logging.apache.org/log4j/2.x/manual/migration.html]
The spark creation is not happening .
Below is the exception:
*{color:#4c9aff}1.exception.png (Attached){color}*
When analyzed further found that the class file “RendererMap“ is not at all
present in the bridge jar.
*log4j-1.2.17*
*{color:#4c9aff}2.log4j1.png (Attached){color}*
** *log4j-1.2-api-2.17.1.jar (Bridge jar)*
*{color:#4c9aff}3.log4j-2.png (Attached){color}*
Following the migration steps in
[https://logging.apache.org/log4j/2.x/manual/migration.html]
We are simply replacing the
Jar: */usr/local/spark/jars/log4j-1.2.17.jar*
With:
* log4j-1.2-api-2.17.1.jar
* log4j-api-2.17.1.jar
* log4j-core-2.17.1.jar
similar to what we had done 2 years back for version spark 2.1.3 version for
which we were not downloading the spark zip on fly ,but we already had a
downloaded zip on which we applied the patching changes. That seemed to work
for 2.1.3 but for an older version where we are downloading the tar.gz now,
there seems to be an issue.
Looking for a right resolution in this regard.
was:
Spark Download Link:
[https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz]
log4j Migration:
[https://logging.apache.org/log4j/2.x/manual/migration.html]
The spark creation is not happening .
Below is the exception:
!image-2024-04-10-13-42-36-796.png!
When analyzed further found that the class file “RendererMap“ is not at all
present in the bridge jar.
*log4j-1.2.17*
* !image-2024-04-10-13-43-01-206.png!*
** *log4j-1.2-api-2.17.1.jar (Bridge jar)*
*!image-2024-04-10-13-44-07-804.png!*
Following the migration steps in
[https://logging.apache.org/log4j/2.x/manual/migration.html]
We are simply replacing the
Jar: */usr/local/spark/jars/log4j-1.2.17.jar*
With:
* log4j-1.2-api-2.17.1.jar
* log4j-api-2.17.1.jar
* log4j-core-2.17.1.jar
similar to what we had done 2 years back for version spark 2.1.3 version for
which we were not downloading the spark zip on fly ,but we already had a
downloaded zip on which we applied the patching changes. That seemed to work
for 2.1.3 but for an older version where we are downloading the tar.gz now,
there seems to be an issue.
Looking for a right resolution in this regard.
> Spark Session is not created for spark-2.1.1 when log4j is migrated from 1.*
> to 2.17.1 to fix the security issue
> ----------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-47796
> URL: https://issues.apache.org/jira/browse/SPARK-47796
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell, Spark Submit
> Affects Versions: 2.1.1
> Reporter: Mahima Khatri
> Priority: Critical
> Fix For: 2.1.1
>
> Attachments: 1.exception.png, 2.log4j1.png, 3.log4j-2.png
>
>
> Spark Download Link:
> [https://archive.apache.org/dist/spark/spark-2.1.1/spark-2.1.1-bin-hadoop2.7.tgz]
> log4j Migration:
> [https://logging.apache.org/log4j/2.x/manual/migration.html]
> The spark creation is not happening .
> Below is the exception:
> *{color:#4c9aff}1.exception.png (Attached){color}*
> When analyzed further found that the class file “RendererMap“ is not at all
> present in the bridge jar.
> *log4j-1.2.17*
> *{color:#4c9aff}2.log4j1.png (Attached){color}*
> ** *log4j-1.2-api-2.17.1.jar (Bridge jar)*
> *{color:#4c9aff}3.log4j-2.png (Attached){color}*
> Following the migration steps in
> [https://logging.apache.org/log4j/2.x/manual/migration.html]
> We are simply replacing the
> Jar: */usr/local/spark/jars/log4j-1.2.17.jar*
> With:
> * log4j-1.2-api-2.17.1.jar
> * log4j-api-2.17.1.jar
> * log4j-core-2.17.1.jar
> similar to what we had done 2 years back for version spark 2.1.3 version for
> which we were not downloading the spark zip on fly ,but we already had a
> downloaded zip on which we applied the patching changes. That seemed to work
> for 2.1.3 but for an older version where we are downloading the tar.gz now,
> there seems to be an issue.
>
> Looking for a right resolution in this regard.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
