Re: Teradata into hadoop Migration

Bhagaban, First step is to ingest data into Hadoop using sqoop. Teradata has powerful connectors to Hadoop where the connectors are to be installed on all data nodes and then run imports using fast export etc., Challenge would be to create the same workflows in Hadoop that you had in teradata.

Re: Teradata into hadoop Migration

>From TD perspective have a look at this - https://youtu.be/NTTQdAfZMJA They are planning to opensource it. Perhaps you can get in touch with the team. Let me know if you are interested. If you are TD contacts, ask about this, they should be able to point to the right people. Again, this is not

Re: Teradata into hadoop Migration

Hi, I think Cloudera Navigator Optimizer is the tool you are looking for. It allows you to transform SQL queries (TD) into Impala and Hive. http://blog.cloudera.com/blog/2015/11/introducing-cloudera-navigator-optimizer-for-optimal-sql-workload-efficiency-on-apache-hadoop/

Re: Teradata into hadoop Migration

Sorry, I don't have much insight about this apart from basic Sqoop. AFAIK, it is more of vendor specific, you may need to dig more into that line. Thanks, Rakesh On Mon, Aug 1, 2016 at 11:38 PM, Bhagaban Khatai wrote: > Thanks Rakesh for the useful information. But we

Re: Teradata into hadoop Migration

Thanks Rakesh for the useful information. But we are using sqoop for data transfer but all TD logic we are implementing thru Hive. But it's taking time by using mapping provided by TD team and the same logic we are implementing. What I want some tool or ready-made framework so that development

Re: Teradata into hadoop Migration

I will suggest to also look at TPT from teradata which is much faster than sqoop On 01-Aug-2016 6:17 pm, "Gmail" wrote: > Hi Bhagaban > > I have seen more efficient way of data transfer by fast exporting the data > and put them directly in HDFS. And then create structure as

Re: Teradata into hadoop Migration

Hi Bhagaban I have seen more efficient way of data transfer by fast exporting the data and put them directly in HDFS. And then create structure as per the data in HIVE or PIG. We have developed DDL transformation script using shell script which can convert the TERADATA DDL to Hive DDL. This

Re: Teradata into hadoop Migration

rg> Subject: Re: Teradata into hadoop Migration Hi Bhagaban, Perhaps, you can try "Apache Sqoop" to transfer data to Hadoop from Teradata. Apache Sqoop provides an efficient approach for transferring large data between Hadoop related systems and structured data stores. It allows

Re: Teradata into hadoop Migration

Hi Bhagaban, Perhaps, you can try "Apache Sqoop" to transfer data to Hadoop from Teradata. Apache Sqoop provides an efficient approach for transferring large data between Hadoop related systems and structured data stores. It allows support for a data store to be added as a so-called connector and

Teradata into hadoop Migration

Hi Guys- I need a quick help if anybody done any migration project in TD into hadoop. We have very tight deadline and I am trying to find any tool (online or paid) for quick development. Please help us here and guide me if any other way is available to do the development fast. Bhagaban