[ 
https://issues.apache.org/jira/browse/FALCON-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14633904#comment-14633904
 ] 

Venkat Ramachandran edited comment on FALCON-36 at 7/20/15 6:02 PM:
--------------------------------------------------------------------

* Attaching a patch containing the DATABASE and FEED entity definition XSDs. 
* The directory also contains temporarily an sample XML for review purposes.
* Currently focuses on IMPORT specification alone - EXPORT is in the next patch.
* Filter is moved out as it needs more discussion - For now, it can be achieved 
via argument
* Supported extraction and merge types combination are (for now):
   extract-type=full; merge-type=snapshot
   extract-type=incremental; merge-type=append (will require a diff column name)



was (Author: me.venkatr):
Attaching a patch containing the DATABASE and FEED entity definition XSDs. The 
directory also contains temporarily an sample XML for review purposes.

> Ability to ingest data from databases
> -------------------------------------
>
>                 Key: FALCON-36
>                 URL: https://issues.apache.org/jira/browse/FALCON-36
>             Project: Falcon
>          Issue Type: Improvement
>          Components: acquisition
>    Affects Versions: 0.3
>            Reporter: Venkatesh Seetharam
>            Assignee: Venkat Ramachandran
>         Attachments: FALCON-36.patch, FALCON-36.rebase.patch, 
> FALCON-36.review.patch, Falcon Data Ingestion - Proposal.docx, 
> falcon-36.xsd.patch.1
>
>
> Attempt to address data import from RDBMS into hadoop and export of data from 
> Hadoop into RDBMS. The plan is to use sqoop 1.x to materialize data motion 
> from/to RDBMS to/from HDFS. Hive will not be integrated in the first pass 
> until Falcon has a first class integration with HCatalog.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to