Re: LineageLogger can't getEdges

2018-09-13 Thread lk_hadoop
I write a log on org.apache.hadoop.hive.ql.Driver : LOG.info("Driver:1866 : " + hookContext.getIndex().getFinalSelectOps().size()); if I config LineageLogger to the log will out put 1 or it will out put 0 , why ?? 2018-09-13 lk_hadoop 发件人:"lk_hadoop" 发送时间:2018-09-13 13:28

Re: Re: LineageLogger can't getEdges

2018-09-13 Thread lk_hadoop
is this the reason ? code in Optimizer.java if (postExecHooks.contains("org.apache.hadoop.hive.ql.hooks.PostExecutePrinter") || postExecHooks.contains("org.apache.hadoop.hive.ql.hooks.LineageLogger")) { transformations.add(new Generator()); } 2018-09-13 lk_hadoop

UDFClassLoader isolation leaking

2018-09-13 Thread Jason Gerlowski
Hi all, Wanted to let you know of a potential bug I've run into when loading custom jar's dynamically (i.e. "ADD JAR /path/to/jar"). Hopefully someone can tell me if this is a bug, expected behavior, or something I'm causing myself :) We have a custom StorageHandler that we're updating from

Re: UDFClassLoader isolation leaking

2018-09-13 Thread Gopal Vijayaraghavan
Hi, > Hopefully someone can tell me if this is a bug, expected behavior, or > something I'm causing myself :) I don't think this is expected behaviour, but where the bug is what I'm looking into. > We have a custom StorageHandler that we're updating from Hive 1.2.1 to Hive > 3.0.0. Most

how can I sychronize with hive metadata

2018-09-13 Thread lk_hadoop
hi,all: I wan't to sychronize hive metadata, if one table was added or alter I can be notified , I know there is a HiveMetaHook interface , but it exactly was not a hook. 2018-09-14 lk_hadoop

Re: How to Grant All Privileges for All Databases except one in Hive SQL

2018-09-13 Thread Anup Tiwari
Hi, Can someone reply on this? On Tue, 11 Sep 2018 19:21 Anup Tiwari, wrote: > Hi All, > > I have similar requirement as mentioned in the link Link to question > > . > >

Re: Improve performance of Analyze table compute statistics

2018-09-13 Thread Prabhakar Reddy
Thank you Gopal for this Information.Currently I am using EMR to run this query.As this operation is CPU intensive could you please let me know if increasing the RAM/cores can speed up this process? On Tue, Aug 28, 2018 at 8:56 PM Gopal Vijayaraghavan wrote: > > > Will it be referring to orc