Hi, Can someone try to reproduce and confirm whether this is an issue in 0.11
a)Create a view with some UDAF in the definition(i tried with https://github.com/scribd/hive-udaf-maxrow) b)Join this view with some other table I am getting the below exception: Examining task ID: task_201308070831_0010_m_000052 (and more) from job job_201308070831_0010 Exception in thread "Thread-98" java.lang.ClassFormatError: Absent Code attribute in method that is not native or abstract in class file javax/servlet/http/HttpServlet at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at java.lang.ClassLoader.defineClass(ClassLoader.java:615) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) at java.lang.ClassLoader.defineClass(ClassLoader.java:615) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) at org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49) at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190) at org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146) at java.lang.Thread.run(Thread.java:662) Counters: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask MapReduce Jobs Launched: Job 0: Map: 67 Reduce: 1 Cumulative CPU: 4172.93 sec HDFS Read: 43334 HDFS Write: 12982162918 SUCCESS Job 1: Map: 51 HDFS Read: 0 HDFS Write: 0 FAIL Total MapReduce CPU Time Spent: 0 days 1 hours 9 minutes 32 seconds 930 msec The same works fine in 0.8.1.6. After creating the view, i am able to query the view successfully. Only when i join with other table, it throws the above exceptions. Thanks, Pandeeswaran On Fri, Aug 9, 2013 at 4:37 PM, pandees waran <pande...@gmail.com> wrote: > Hi Nitin, > > I have executed few test cases and here are my observations. > > a) i am not using any utilities for upgrading to 0.11. Just executing the > same hql which work in 0.8.1.6 in 0.11 > > b)In my join i am having a view which has an UDAF. ( > https://github.com/scribd/hive-udaf-maxrow) > When i try to join this view(with UDAF) it another table, i am > getting the below errors: > > > java.lang.InstantiationException: > org.apache.hadoop.hive.ql.parse.ASTNodeOrigin > Continuing ... > java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new(); > Continuing ... > java.lang.InstantiationException: > org.apache.hadoop.hive.ql.parse.ASTNodeOrigin > Continuing ... > java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new(); > Continuing ... > java.lang.InstantiationException: > org.apache.hadoop.hive.ql.parse.ASTNodeOrigin > Continuing ... > java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new(); > Continuing ... > java.lang.InstantiationException: > org.apache.hadoop.hive.ql.parse.ASTNodeOrigin > Continuing ... > java.lang.RuntimeException: failed to evaluate: <unbound>=Class.new(); > > ---------------------------------------------------------------------------------------- > > My query looks like: > > select v.* from view1 v join table1 t on t.col1=v.col1 > > The same query works in in 0.8.1.6 without any issues. > This query works in 0.11 , if i remove UDAF from the view. > > Do i need to rebuild the UDAF separately for 0.11? > In general, i expect the hql which works in 0.8.1.6 should work in 0.11 > without having any code changes. please correct me , if my assumption is > incorrect. > > Thanks, > Pandeeswaran > > > > On Wed, Aug 7, 2013 at 9:00 PM, Nitin Pawar <nitinpawar...@gmail.com>wrote: > >> Will it be possible for you to share your query ? and if you are using >> any custom udf then the java code for the same ? >> >> how are you upgrading from hive-0.8 to hive-0.11? >> >> aws announced that EMR supports hive 0.11 and that was 4 days ago. Can >> you check if you need to see if you need to change something on EMR side ? >> >> >> On Wed, Aug 7, 2013 at 8:28 PM, pandees waran <pande...@gmail.com> wrote: >> >>> Hi Nitin, >>> >>> Nope! it ended up with below error messages: >>> >>> Examining task ID: task_201308070831_0010_m_000052 (and more) from job >>> job_201308070831_0010 >>> Exception in thread "Thread-98" java.lang.ClassFormatError: Absent >>> Code attribute in method that is not native or abstract in class file >>> javax/servlet/http/HttpServlet >>> at java.lang.ClassLoader.defineClass1(Native Method) >>> at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) >>> at java.lang.ClassLoader.defineClass(ClassLoader.java:615) >>> at >>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) >>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) >>> at java.net.URLClassLoader.access$000(URLClassLoader.java:58) >>> at java.net.URLClassLoader$1.run(URLClassLoader.java:197) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306) >>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247) >>> at java.lang.ClassLoader.defineClass1(Native Method) >>> at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631) >>> at java.lang.ClassLoader.defineClass(ClassLoader.java:615) >>> at >>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) >>> at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) >>> at java.net.URLClassLoader.access$000(URLClassLoader.java:58) >>> at java.net.URLClassLoader$1.run(URLClassLoader.java:197) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306) >>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247) >>> at >>> org.apache.hadoop.hive.shims.Hadoop20SShims.getTaskAttemptLogUrl(Hadoop20SShims.java:49) >>> at >>> org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.getTaskInfos(JobDebugger.java:190) >>> at >>> org.apache.hadoop.hive.ql.exec.JobDebugger$TaskInfoGrabber.run(JobDebugger.java:146) >>> at java.lang.Thread.run(Thread.java:662) >>> Counters: >>> FAILED: Execution Error, return code 2 from >>> org.apache.hadoop.hive.ql.exec.MapRedTask >>> MapReduce Jobs Launched: >>> Job 0: Map: 67 Reduce: 1 Cumulative CPU: 4172.93 sec HDFS Read: >>> 43334 HDFS Write: 12982162918 SUCCESS >>> Job 1: Map: 51 HDFS Read: 0 HDFS Write: 0 FAIL >>> Total MapReduce CPU Time Spent: 0 days 1 hours 9 minutes 32 seconds 930 >>> msec >>> >>> >>> But, the same query works fine in hive 0.8.1.6 without any issues. >>> i am working on the 0.11 upgrade and facing this issue. >>> >>> Thanks, >>> Pandeeswaran >>> >>> On 8/7/13, Nitin Pawar <nitinpawar...@gmail.com> wrote: >>> > before applying patch, >>> > >>> > can you confirm that map join query worked fine and gave the results >>> you >>> > wanted? >>> > >>> > >>> > On Wed, Aug 7, 2013 at 6:46 PM, Sathya Narayanan K <ksat...@live.com> >>> > wrote: >>> > >>> >> Hi,**** >>> >> >>> >> ** ** >>> >> >>> >> I am also facing the same issue. Could anyone please suggest whether >>> we >>> >> can apply any patch?**** >>> >> >>> >> ** ** >>> >> >>> >> Thanks,**** >>> >> >>> >> Sathya Narayanan **** >>> >> >>> >> ** ** >>> >> >>> >> *From:* pandees waran [mailto:pande...@gmail.com] >>> >> *Sent:* Wednesday, August 07, 2013 6:39 PM >>> >> *To:* user@hive.apache.org >>> >> *Subject:* Join issue in 0.11**** >>> >> >>> >> ** ** >>> >> >>> >> Hi, >>> >> >>> >> I am facing the same issue as mentioned in the below JIRA: >>> >> >>> >> https://issues.apache.org/jira/browse/HIVE-3872**** >>> >> >>> >> I am using amazon EMR with hive 0.11. **** >>> >> >>> >> Do i need to apply any patch on top of 0.11 to fix this NPE issue.? >>> >> **** >>> >> >>> >> >>> >> -- **** >>> >> >>> >> Thanks,**** >>> >> >>> >> Pandeeswaran**** >>> >> >>> > >>> > >>> > >>> > -- >>> > Nitin Pawar >>> > >>> >>> >>> -- >>> Thanks, >>> Pandeeswaran >>> >> >> >> >> -- >> Nitin Pawar >> > > > > -- > Thanks, > Pandeeswaran > -- Thanks, Pandeeswaran
