Tao
This will be immensely useful. Contributions are most welcome.

Sharad

On Wed, Aug 24, 2016 at 12:14 AM, Tao Yan <[email protected]> wrote:

> Thanks for the reply.
>
> I am also thinking if we could associate a hive table / hive view directly
> with a conceptual table, just like how we associate a logical table with
> conceptual table. This should be feasible because a hive table contains all
> columns' information, schema information and storage information. And the
> way Lens read metadata can be easily used to read native hive table since
> it is actually store Lens table in hive.
>
> The benefit of supporting hive table/view as one type of logical/physical
> table is to make the migration from hive to Lens seamless because people
> don't have to redefine the hive tables in Lens.
>
> Thanks,
>
> On Mon, Aug 22, 2016 at 10:43 PM, amareshwarisr . <[email protected]>
> wrote:
>
>> Tao,
>>
>> It would be good addition. But as of now, there is no utility doing the
>> same.
>>
>> Thanks
>>
>> On Tue, Aug 23, 2016 at 2:39 AM, Tao Yan <[email protected]> wrote:
>>
>>> Hi Lens Developer,
>>>
>>> When I am trying to define Lens cube, dimension, fact and dimtables
>>> based on existing hive data, I found a lot of things in common: they all
>>> use the exact same column names and types as hive table, they all use the
>>> exact same Input/Output format and Serde Library. So, I wonder if you have
>>> developed any utility methods or tools to generate those definition files
>>> from Hive tables' metadata.
>>>
>>> Thanks,
>>> --
>>>
>>> *Tao Yan*
>>> Software Engineer
>>> Data Analytics Infrastructure Tools and Services
>>>
>>>
>>>
>>> 206.250.5345
>>> [email protected]
>>> https://www.linkedin.com/in/taousc
>>>
>>
>>
>
>
> --
>
> *Tao Yan*
> Software Engineer
> Data Analytics Infrastructure Tools and Services
>
>
>
> 206.250.5345
> [email protected]
> https://www.linkedin.com/in/taousc
>

Reply via email to