Re: UDF with dependent JARs
Hello Tia, Try to use fat jar. If you are using maven, mvn assembly:single will generate the fat jar, which includes all necessary jars in a single jar file. Regards, Sankar S On Sat, Aug 2, 2014 at 5:17 PM, Brian Jeltema brian.jelt...@digitalenvoy.net wrote: I've written a small UDF and placed it in a JAR (a.jar). The UDF has a dependency on a class in another JAR (b.jar). in Hive, I do: add jar a.jar; add jar b.jar; create temporary function .; but when I execute the UDF, the dependency in b.jar is not found (NoClassDefFoundError). If I create a single JAR that contains the UDF and it's dependencies, the function works. Do all of the classes required for a UDF have to be supplied in a single JAR file? TIA Brian
Hive UDF boolean return type program runs very long time
Hello all, I have a simple UDF, which returns boolean return type. Without doing any checks i have returned true in my evaluate method, (tesing purpose) In hive query used join and invoked this udf, It is keep on running, No outputs for long time. after more than 23 hours, getting broken pipe exception. Reduces complete 100% multiple times, after completing 100% starting again from 0%, what would be the issue? How to find how much time evaluate funtions takes? is there any logs or report function available? I appreciate your help.. Regards, Sankar S
Re: UDF with dependent JARs
Try to use fat jar. If you are using maven, mvn assembly:single will generate the fat jar, which includes all necessary jars in a single jar file.\ Yes, as stated in my initial post, a fat JAR works. But why doesn't adding the individual JARs work? Brian (TIA = Thanks In Advance ;^) Regards, Sankar S On Sat, Aug 2, 2014 at 5:17 PM, Brian Jeltema brian.jelt...@digitalenvoy.net wrote: I've written a small UDF and placed it in a JAR (a.jar). The UDF has a dependency on a class in another JAR (b.jar). in Hive, I do: add jar a.jar; add jar b.jar; create temporary function .; but when I execute the UDF, the dependency in b.jar is not found (NoClassDefFoundError). If I create a single JAR that contains the UDF and it's dependencies, the function works. Do all of the classes required for a UDF have to be supplied in a single JAR file? TIA Brian
Re: UDF with dependent JARs
not sure, Did you set the jars in hive configuration files ? property namehive.aux.jars.path/name valuefile:///path/to/commons-codec-1.6.jar,file:///path/to/joda-time-2.2.jar,file:///path/to/sm-hive-udf-1.0-SNAPSHOT.jar/value /property On Sun, Aug 3, 2014 at 4:16 PM, Brian Jeltema brian.jelt...@digitalenvoy.net wrote: Try to use fat jar. If you are using maven, mvn assembly:single will generate the fat jar, which includes all necessary jars in a single jar file.\ Yes, as stated in my initial post, a fat JAR works. But why doesn't adding the individual JARs work? Brian (TIA = Thanks In Advance ;^) Regards, Sankar S On Sat, Aug 2, 2014 at 5:17 PM, Brian Jeltema brian.jelt...@digitalenvoy.net wrote: I've written a small UDF and placed it in a JAR (a.jar). The UDF has a dependency on a class in another JAR (b.jar). in Hive, I do: add jar a.jar; add jar b.jar; create temporary function .; but when I execute the UDF, the dependency in b.jar is not found (NoClassDefFoundError). If I create a single JAR that contains the UDF and it's dependencies, the function works. Do all of the classes required for a UDF have to be supplied in a single JAR file? TIA Brian
Requesting write access to the Hive wiki
Kindly grant me write access to the Hive wiki, so that I can edit the content. Confluence username: asingh -- Regards, Ashish
