I'm not 100% sure, but I think some changes went in that require all UDFs to be recompiled with Drill 1.6.0. Did you recompile your UDFs ?
Also, you can check drillbit.log and drillbit.out. When a Drillbit starts it logs any problem with the UDFs in the logs On Thu, Mar 17, 2016 at 4:25 PM, Shankar Mane <[email protected]> wrote: > > -------------------------------------------------------------------------------- > > 1. Drill in cluster is *working fine *when *customized* drill-module.conf > file is *not present *in dir "apache-drill-1.6.0/conf/drill-module.conf" > > > > -------------------------------------------------------------------------------- > > > 2. Custom UDF is not working as describe below : > > i have copied my custom UDF into dir "apache-drill-1.6.0/jars/3rdparty" on > all nodes and restarted all drillbits. > > > udf filename=udfutil-0.0.1-SNAPSHOT.jar > jar *structure* - > /* > META-INF/ > META-INF/MANIFEST.MF > com/ > com/companyname/ > com/companyname/drill/ > drill-module.conf > com/companyname/drill/channeltest.class > com/companyname/drill/DateFunc.class > com/companyname/drill/DateExtract.class > com/companyname/drill/DecodeURI.class > com/companyname/drill/ChannelID.class > com/companyname/drill/BrowserFuncNew.class > com/companyname/drill/ToDate.class > META-INF/maven/ > META-INF/maven/com.companyname.drill.udf/ > META-INF/maven/com.companyname.drill.udf/udfutil/ > META-INF/maven/com.companyname.drill.udf/udfutil/pom.xml > META-INF/maven/com.companyname.drill.udf/udfutil/pom.properties > */ > > > -- And login to drill to check whether function is working or not > /* > 0: jdbc:drill:> select DateFunc(1458228298) from (values(1)) ; > *Error: VALIDATION ERROR: From line 1, column 8 to line 1, column 26: No > match found for function signature DateFunc(<NUMERIC>)* > */ > > *IT FAILED....* > > > > > -------------------------------------------------------------------------------- > > 3. Now as described on website, now i edited file "*drill-module.conf*". > And copied this file to all nodes in cluster and restarted all drillbits. > > vi apache-drill-1.6.0/conf/drill-module.conf > > /* > drill: { > classpath.scanning: { > packages: [ > "com.companyname.drill.*" > ] > } > } > */ > > *But DRILL GET SHUTDOWN on all nodes.* > > > > > *Please help me to resolved this issue. Or suggest any other way to invoke > my custome UDFs. * > > > > > > On Thu, Mar 17, 2016 at 6:50 PM, Abdel Hakim Deneche < > [email protected]> > wrote: > > > Easiest fix when Drill fails to load a storage plugin is to delete the > > existing configurations. Deleting /tmp/drill/ should resolve this. > > > > I know this may not be practical in some cases, and other developers may > > give you a better solution. > > > > On Thu, Mar 17, 2016 at 2:13 PM, Shankar Mane < > [email protected]> > > wrote: > > > > > *drillbit.out =>* > > > > > > > > > Exception in thread "main" > > > org.apache.drill.exec.exception.DrillbitStartupException: Failure > during > > > initial startup of Drillbit. > > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:284) > > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:261) > > > at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:257) > > > Caused by: java.lang.IllegalStateException: > > > com.fasterxml.jackson.databind.JsonMappingException: Could not resolve > > type > > > id 'kudu' into a subtype of [simple type, class > > > org.apache.drill.common.logical.StoragePluginConfig]: known type ids = > > > [InfoSchemaConfig, StoragePluginConfig, SystemTablePluginConfig, file, > > > jdbc, mock, named] > > > at [Source: { > > > "storage":{ > > > kudu : { > > > type:"kudu", > > > masterAddresses: "1.2.3.4", > > > enabled: false > > > } > > > } > > > } > > > ; line: 4, column: 12] (through reference chain: > > > > > > > > > org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["kudu"]) > > > at > > > > > > > > > org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:182) > > > at > > > > > > > > > org.apache.drill.exec.store.StoragePluginRegistryImpl.init(StoragePluginRegistryImpl.java:126) > > > at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:113) > > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:281) > > > ... 2 more > > > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could > not > > > resolve type id 'kudu' into a subtype of [simple type, class > > > org.apache.drill.common.logical.StoragePluginConfig]: known type ids = > > > [InfoSchemaConfig, StoragePluginConfig, SystemTablePluginConfig, file, > > > jdbc, mock, named] > > > at [Source: { > > > "storage":{ > > > kudu : { > > > type:"kudu", > > > masterAddresses: "1.2.3.4", > > > enabled: false > > > } > > > } > > > } > > > ; line: 4, column: 12] (through reference chain: > > > > > > > > > org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["kudu"]) > > > at > > > > > > > > > com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:216) > > > at > > > > > > > > > com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:983) > > > at > > > > > > > > > com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._handleUnknownTypeId(TypeDeserializerBase.java:281) > > > at > > > > > > > > > com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:163) > > > at > > > > > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:106) > > > at > > > > > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:91) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:142) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:497) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:341) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) > > > at > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) > > > at > > > > > > > > > com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3788) > > > at > > > > > > > > > com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2779) > > > at > > > > > > > > > org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:144) > > > ... 5 more > > > > > > > > > > > > > > > > > > On Thu, Mar 17, 2016 at 6:38 PM, Shankar Mane < > > [email protected]> > > > wrote: > > > > > > > *drillbit.out =>* > > > > > > > > > > > > Exception in thread "main" > > > > org.apache.drill.exec.exception.DrillbitStartupException: Failure > > during > > > > initial startup of Drillbit. > > > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:284) > > > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:261) > > > > at org.apache.drill.exec.server.Drillbit.main(Drillbit.java:257) > > > > Caused by: java.lang.IllegalStateException: > > > > com.fasterxml.jackson.databind.JsonMappingException: Could not > resolve > > > type > > > > id 'kudu' into a subtype of [simple type, class > > > > org.apache.drill.common.logical.StoragePluginConfig]: known type ids > = > > > > [InfoSchemaConfig, StoragePluginConfig, SystemTablePluginConfig, > file, > > > > jdbc, mock, named] > > > > at [Source: { > > > > "storage":{ > > > > kudu : { > > > > type:"kudu", > > > > masterAddresses: "1.2.3.4", > > > > enabled: false > > > > } > > > > } > > > > } > > > > ; line: 4, column: 12] (through reference chain: > > > > > > > > > > org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["kudu"]) > > > > at > > > > > > > > > > org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:182) > > > > at > > > > > > > > > > org.apache.drill.exec.store.StoragePluginRegistryImpl.init(StoragePluginRegistryImpl.java:126) > > > > at org.apache.drill.exec.server.Drillbit.run(Drillbit.java:113) > > > > at org.apache.drill.exec.server.Drillbit.start(Drillbit.java:281) > > > > ... 2 more > > > > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Could > > not > > > > resolve type id 'kudu' into a subtype of [simple type, class > > > > org.apache.drill.common.logical.StoragePluginConfig]: known type ids > = > > > > [InfoSchemaConfig, StoragePluginConfig, SystemTablePluginConfig, > file, > > > > jdbc, mock, named] > > > > at [Source: { > > > > "storage":{ > > > > kudu : { > > > > type:"kudu", > > > > masterAddresses: "1.2.3.4", > > > > enabled: false > > > > } > > > > } > > > > } > > > > ; line: 4, column: 12] (through reference chain: > > > > > > > > > > org.apache.drill.exec.planner.logical.StoragePlugins["storage"]->java.util.LinkedHashMap["kudu"]) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:216) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.DeserializationContext.unknownTypeException(DeserializationContext.java:983) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._handleUnknownTypeId(TypeDeserializerBase.java:281) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.jsontype.impl.TypeDeserializerBase._findDeserializer(TypeDeserializerBase.java:163) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer._deserializeTypedForId(AsPropertyTypeDeserializer.java:106) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.jsontype.impl.AsPropertyTypeDeserializer.deserializeTypedFromObject(AsPropertyTypeDeserializer.java:91) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.AbstractDeserializer.deserializeWithType(AbstractDeserializer.java:142) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer._readAndBindStringMap(MapDeserializer.java:497) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:341) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.std.MapDeserializer.deserialize(MapDeserializer.java:26) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.SettableBeanProperty.deserialize(SettableBeanProperty.java:490) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeWithErrorWrapping(BeanDeserializer.java:465) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer._deserializeUsingPropertyBased(BeanDeserializer.java:380) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializerBase.deserializeFromObjectUsingNonDefault(BeanDeserializerBase.java:1123) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer.deserializeFromObject(BeanDeserializer.java:298) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.deser.BeanDeserializer.deserialize(BeanDeserializer.java:133) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:3788) > > > > at > > > > > > > > > > com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2779) > > > > at > > > > > > > > > > org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:144) > > > > ... 5 more > > > > > > > > > > > > On Thu, Mar 17, 2016 at 6:21 PM, Shankar Mane < > > > [email protected]> > > > > wrote: > > > > > > > >> I am not able to start drill 1.6.0. Please find the attached file > for > > > >> more details. > > > >> > > > >> > > > > > > > > > > > > > > > -- > > > > Abdelhakim Deneche > > > > Software Engineer > > > > <http://www.mapr.com/> > > > > > > Now Available - Free Hadoop On-Demand Training > > < > > > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > > > > > -- Abdelhakim Deneche Software Engineer <http://www.mapr.com/> Now Available - Free Hadoop On-Demand Training <http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
