dailidong commented on issue #5543: [Proposal] Native parallel batch indexing URL: https://github.com/apache/incubator-druid/issues/5543#issuecomment-436952160 This is very useful! 👍👍👍 I'm going crazy because the library versions of Hadoop and Druid can't match. i used druid 0.12.3, hadoop 2.7.3 I have checked this article many times : http://druid.io/docs/latest/operations/other-hadoop.html, and i have set "mapreduce.job.classloader": "true" "mapreduce.job.classloader.system.classes": "-javax.validation.,java.,javax.,org.apache.commons.logging.,org.apache.log4j.,org.apache.hadoop." in jobProperties, but i got this: FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.IllegalAccessError: class sun.reflect.GeneratedConstructorAccessor5 cannot access its superclass sun.reflect.ConstructorAccessorImpl at sun.misc.Unsafe.defineClass(Native Method) at sun.reflect.ClassDefiner.defineClass(ClassDefiner.java:63) at sun.reflect.MethodAccessorGenerator$1.run(MethodAccessorGenerator.java:399) at sun.reflect.MethodAccessorGenerator$1.run(MethodAccessorGenerator.java:394) at java.security.AccessController.doPrivileged(Native Method) at sun.reflect.MethodAccessorGenerator.generate(MethodAccessorGenerator.java:393) at sun.reflect.MethodAccessorGenerator.generateConstructor(MethodAccessorGenerator.java:92) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:55) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:422) at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:739) at sun.reflect.annotation.AnnotationParser$1.run(AnnotationParser.java:305) at sun.reflect.annotation.AnnotationParser$1.run(AnnotationParser.java:303) at java.security.AccessController.doPrivileged(Native Method) at sun.reflect.annotation.AnnotationParser.annotationForMap(AnnotationParser.java:303) at sun.reflect.annotation.AnnotationParser.parseAnnotation2(AnnotationParser.java:293) at sun.reflect.annotation.AnnotationParser.parseAnnotations2(AnnotationParser.java:120) at sun.reflect.annotation.AnnotationParser.parseAnnotations(AnnotationParser.java:72) at java.lang.Class.createAnnotationData(Class.java:3521) at java.lang.Class.annotationData(Class.java:3510) at java.lang.Class.getAnnotation(Class.java:3415) at org.apache.logging.log4j.core.pattern.PatternParser.<init>(PatternParser.java:142) at org.apache.logging.log4j.core.pattern.PatternParser.<init>(PatternParser.java:112) at org.apache.logging.log4j.core.layout.PatternLayout.createPatternParser(PatternLayout.java:220) at org.apache.logging.log4j.core.layout.PatternLayout.<init>(PatternLayout.java:138) at org.apache.logging.log4j.core.layout.PatternLayout.<init>(PatternLayout.java:57) at org.apache.logging.log4j.core.layout.PatternLayout$Builder.build(PatternLayout.java:446) at org.apache.logging.log4j.core.config.AbstractConfiguration.setToDefault(AbstractConfiguration.java:518) at org.apache.logging.log4j.core.config.DefaultConfiguration.<init>(DefaultConfiguration.java:49) at org.apache.logging.log4j.core.LoggerContext.<init>(LoggerContext.java:75) at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.createContext(ClassLoaderContextSelector.java:171) at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.locateContext(ClassLoaderContextSelector.java:145) at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:70) at org.apache.logging.log4j.core.selector.ClassLoaderContextSelector.getContext(ClassLoaderContextSelector.java:57) at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:140) at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:41) at org.apache.logging.log4j.LogManager.getContext(LogManager.java:182) at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:103) at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:43) at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:42) at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:29) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:253) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:265) at io.druid.indexer.HadoopDruidIndexerMapper.<clinit>(HadoopDruidIndexerMapper.java:43) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2247) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2212) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2306) at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:187) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:747) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164) I can't find solution. any help will be appreciated!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
