[ https://issues.apache.org/jira/browse/SPARK-28337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882619#comment-16882619 ]
Wang Yanlin commented on SPARK-28337: ------------------------------------- my pom configuration for shade commons-configuration and common-jxpath. <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <parent> <artifactId>yanzhi-app</artifactId> <groupId>com.alipay.yanzhi</groupId> <version>1.0-SNAPSHOT</version> </parent> <modelVersion>4.0.0</modelVersion> <artifactId>spark-app</artifactId> <packaging>jar</packaging> <properties> <yanzhi.shade.packageName>com.yanzhi_project</yanzhi.shade.packageName> </properties> <dependencies> <dependency> <groupId>commons-jxpath</groupId> <artifactId>commons-jxpath</artifactId> <version>1.3</version> </dependency> <dependency> <groupId>commons-configuration</groupId> <artifactId>commons-configuration</artifactId> <version>1.5</version> <scope>compile</scope> </dependency> </dependencies> <build> <plugins> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-shade-plugin</artifactId> <configuration> <shadedArtifactAttached>false</shadedArtifactAttached> <artifactSet> <includes> <include>commons-jxpath:commons-jxpath</include> <include>commons-configuration:commons-configuration</include> </includes> </artifactSet> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>META-INF/*.SF</exclude> <exclude>META-INF/*.DSA</exclude> <exclude>META-INF/*.RSA</exclude> </excludes> </filter> </filters> <!-- <relocations> <relocation> <pattern>org.apache.commons</pattern> <shadedPattern>${yanzhi.shade.packageName}.commons</shadedPattern> </relocation> </relocations> --> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> </execution> </executions> </plugin> </plugins> </build> </project> > spark jars do not contain commons-jxpath jar, cause ClassNotFound exception > --------------------------------------------------------------------------- > > Key: SPARK-28337 > URL: https://issues.apache.org/jira/browse/SPARK-28337 > Project: Spark > Issue Type: Bug > Components: Spark Submit > Affects Versions: 3.0.0 > Reporter: Wang Yanlin > Priority: Major > Attachments: exception_stack_trace.jpg, shde_in_pom.jpg > > > When submit a spark application using XPathExpressionEngine, a ClassNotFound > exception will be thrown, even though I shade then class of > commons-jxpath:commons-jxpath into my jar. > The main class of my jar is as follows: > object StaticTestMain { > def main(args: Array[String]): Unit = { > println(s"yanzhi class loader info ${getClass.getClassLoader}") > val engine = new XPathExpressionEngine() // exception happends in > this line > // some other codes. > } > } > And configuration of shade plugin as the attached picture file > "shade_in_pom.jpg" > The exception stack trace is in the attached picture file > "exception_stack_trace.jpg". -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org