[
https://issues.apache.org/jira/browse/ATLAS-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ramesh Mani updated ATLAS-2525:
-------------------------------
Description:
Atlas Hbase/Hive hook improvement to provide import from file
Hook script should have another option -f to accept a file which contains the
database/table in hive or namespace/table in hbase and import it into Atlas
Format can be JSON or CSV.
HIVE CASE:
import-hive.sh -f <filename>: This can be JSON or CSV file
{code:java}
{code:java}
import-hive.sh -f <filename>: This can be JSON or CSV file
Imports all databases and tables in the file...
cvs format:
database1,tbl1,tbl2,tbl3,..
database2,tbl1,tbl2,tbl3,..
JSON format:
{
"database1" :["tbl1","tbl2","tbl3",..]
"database2" :["tbl1","tbl2","tbl3",..]
}{code}
JSON format:
{ "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2"
:["tbl1","tbl2","tbl3",..] }
HBASE CASE:
{code:java}
import-hbase.sh [-t <filename>] : This can be JSON or CSV file
cvs format:
namespace1,tbl1,tbl2,tbl3,..
namespace2,tbl1,tbl2,tbl3,..
JSON format:
{
"namespace1" :["tbl1","tbl2","tbl3",..]
"namespace2" :["tbl1","tbl2","tbl3",..]
}
{code:java}
{code}
was:
Atlas Hbase/Hive hook improvement to provide import from file
Hook script should have another option -f to accept a file which contains the
database/table in hive or namespace/table in hbase and import it into Atlas
Format can be JSON or CSV.
HIVE CASE:
import-hive.sh -f <filename>: This can be JSON or CSV file Imports all
databases and tables in the file... cvs format: namespace1,tbl1,tbl2,tbl3,..
namespace2,tbl1,tbl2,tbl3,..
{code:java}
{code:java}
import-hive.sh -f <filename>: This can be JSON or CSV file
Imports all databases and tables in the file...
cvs format:
database1,tbl1,tbl2,tbl3,..
database2,tbl1,tbl2,tbl3,..
JSON format:
{
"database1" :["tbl1","tbl2","tbl3",..]
"database2" :["tbl1","tbl2","tbl3",..]
}{code}
JSON format:
{ "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2"
:["tbl1","tbl2","tbl3",..] }
HBASE CASE:
{code:java}
import-hbase.sh [-t <filename>] : This can be JSON or CSV file
cvs format:
namespace1,tbl1,tbl2,tbl3,..
namespace2,tbl1,tbl2,tbl3,..
JSON format:
{
"namespace1" :["tbl1","tbl2","tbl3",..]
"namespace2" :["tbl1","tbl2","tbl3",..]
}
{code:java}
{code}
> Atlas Hbase/Hive hook improvement to provide import from file
> -------------------------------------------------------------
>
> Key: ATLAS-2525
> URL: https://issues.apache.org/jira/browse/ATLAS-2525
> Project: Atlas
> Issue Type: Bug
> Affects Versions: trunk, 0.8.2
> Reporter: Ramesh Mani
> Assignee: Ramesh Mani
> Priority: Major
> Fix For: trunk, 0.8.2
>
> Attachments:
> 0001-ATLAS-2525-Atlas-Hbase-Hive-hook-improvement-to-prov.patch
>
>
> Atlas Hbase/Hive hook improvement to provide import from file
> Hook script should have another option -f to accept a file which contains the
> database/table in hive or namespace/table in hbase and import it into Atlas
> Format can be JSON or CSV.
> HIVE CASE:
> import-hive.sh -f <filename>: This can be JSON or CSV file
> {code:java}
> {code:java}
> import-hive.sh -f <filename>: This can be JSON or CSV file
> Imports all databases and tables in the file...
> cvs format:
> database1,tbl1,tbl2,tbl3,..
> database2,tbl1,tbl2,tbl3,..
> JSON format:
> {
> "database1" :["tbl1","tbl2","tbl3",..]
> "database2" :["tbl1","tbl2","tbl3",..]
> }{code}
> JSON format:
> { "namespace1" :["tbl1","tbl2","tbl3",..] "namespace2"
> :["tbl1","tbl2","tbl3",..] }
> HBASE CASE:
> {code:java}
> import-hbase.sh [-t <filename>] : This can be JSON or CSV file
> cvs format:
> namespace1,tbl1,tbl2,tbl3,..
> namespace2,tbl1,tbl2,tbl3,..
> JSON format:
> {
> "namespace1" :["tbl1","tbl2","tbl3",..]
> "namespace2" :["tbl1","tbl2","tbl3",..]
> }
> {code:java}
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
