wangyum commented on pull request #26533: URL: https://github.com/apache/spark/pull/26533#issuecomment-674774580
Another issue: ``` [b_carmel@carmeldevour002-715563 spark-3.0.0-bin]$ bin/spark-sql SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/b_carmel/yumwang/spark-3.1.0-SNAPSHOT-bin-benchmark-bloomfilter/jars/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/apache/releases/hadoop-2.7.3.2.6.4-ebay.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/b_carmel/yumwang/spark-3.1.0-SNAPSHOT-bin-benchmark-bloomfilter/jars/spark-unsafe_2.12-3.1.0-SNAPSHOT.jar) to constructor java.nio.DirectByteBuffer(long,int) WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release Exception in thread "DataStreamer for file /tmp/hive-b_carmel/b_carmel/ff396890-3a46-4f2e-a93b-91de0eeefe0b/inuse.info" java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()' at org.apache.hadoop.crypto.CryptoStreamUtils.freeDB(CryptoStreamUtils.java:41) at org.apache.hadoop.crypto.CryptoInputStream.freeBuffers(CryptoInputStream.java:679) at org.apache.hadoop.crypto.CryptoInputStream.close(CryptoInputStream.java:315) at java.base/java.io.FilterInputStream.close(FilterInputStream.java:179) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeStream(DFSOutputStream.java:737) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeInternal(DFSOutputStream.java:685) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:680) Exception in thread "DataStreamer for file /user/b_carmel/.sparkStaging/application_1595573410068_7264/__spark_libs__7269177261298078316.zip" java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()' at org.apache.hadoop.crypto.CryptoStreamUtils.freeDB(CryptoStreamUtils.java:41) at org.apache.hadoop.crypto.CryptoInputStream.freeBuffers(CryptoInputStream.java:679) at org.apache.hadoop.crypto.CryptoInputStream.close(CryptoInputStream.java:315) at java.base/java.io.FilterInputStream.close(FilterInputStream.java:179) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeStream(DFSOutputStream.java:737) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeInternal(DFSOutputStream.java:685) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:680) Exception in thread "DataStreamer for file /user/b_carmel/.sparkStaging/application_1595573410068_7264/__spark_conf__.zip" java.lang.NoSuchMethodError: 'sun.misc.Cleaner sun.nio.ch.DirectBuffer.cleaner()' at org.apache.hadoop.crypto.CryptoStreamUtils.freeDB(CryptoStreamUtils.java:41) at org.apache.hadoop.crypto.CryptoInputStream.freeBuffers(CryptoInputStream.java:679) at org.apache.hadoop.crypto.CryptoInputStream.close(CryptoInputStream.java:315) at java.base/java.io.FilterInputStream.close(FilterInputStream.java:179) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeStream(DFSOutputStream.java:737) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.closeInternal(DFSOutputStream.java:685) at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:680) Spark master: yarn, Application Id: application_1595573410068_7264 ``` More details: https://issues.apache.org/jira/browse/HADOOP-12760 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
