[
https://issues.apache.org/jira/browse/ATLAS-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
chaitali borole reassigned ATLAS-3551:
--------------------------------------
Assignee: chaitali borole
> Atlas unable to import entities if an HBase column family is deleted
> --------------------------------------------------------------------
>
> Key: ATLAS-3551
> URL: https://issues.apache.org/jira/browse/ATLAS-3551
> Project: Atlas
> Issue Type: Bug
> Affects Versions: 2.0.0
> Reporter: Nixon Rodrigues
> Assignee: chaitali borole
> Priority: Minor
>
> *Description*
> Importing Hbase entities fails if an Hbase column family was previously
> deleted.
> *Steps to reproduce:*
> kinit as user hbase
> create a table:
>
> {noformat}
> $ echo "create 'default:hbase_table_csaba2'
> ,{NAME=>'col_fam_csaba2_1'},{NAME=>'col_fam_csaba2_2'}" |
> /usr/hdp/current/hbase-client/bin/hbase shell -n
> Created table default:hbase_table_csaba2
> Took 1.2510 seconds
> Hbase::Table - hbase_table_csaba2
> {noformat}
> import the table:
> {noformat}
> $ /usr/hdp/current/atlas-server/hook-bin/import-hbase.sh -t
> hbase_table_csaba2 -Datlas.conf=/etc/hbase/conf
> HBase Data Model imported successfully!!!
>
> {noformat}
> delete one of the column families:
> {noformat}
> $ echo "alter 'default:hbase_table_csaba2', NAME => 'col_fam_csaba2_1',
> METHOD=>'delete'" | /usr/hdp/current/hbase-client/bin/hbase shell -n
> Updating all regions with the new schema...
> 1/1 regions updated.
> Done.
> Took 2.5881 seconds
>
> {noformat}
> import the table again:
> {noformat}
> $ /usr/hdp/current/atlas-server/hook-bin/import-hbase.sh -t
> hbase_table_csaba2 -Datlas.conf=/etc/hbase/conf
> ImportHBaseEntities failed. Please check the log file for the detailed error
> message
> Failed to import HBase Data Model!!!
> Log file content: (/grid/0/log/import-hbase.log):
> 2019-10-03 12:41:28,391 INFO - [main:] ~ Table already present in Atlas.
> Updating it..: default:hbase_table_csaba2@cl1 (HBaseBridge:403)
> 2019-10-03 12:41:28,416 INFO - [main:] ~ method=POST
> path=api/atlas/v2/entity/ contentType=application/json; charset=UTF-8
> accept=application/json status=404 (AtlasBaseClient:387)
> 2019-10-03 12:41:28,418 ERROR - [main:] ~ ImportHBaseEntities failed
> (HBaseBridge:196)
> org.apache.atlas.AtlasServiceException: Metadata service API
> org.apache.atlas.AtlasClientV2$API_V2@2a389173 failed with status 404 (Not
> Found) Response Body (
> {"errorCode":"ATLAS-404-00-007","errorMessage":"Invalid instance
> creation/updation parameters passed : hbase_column_family.table: mandatory
> attribute value missing in type hbase_column_family"}
> )
> at
> org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:427)
> at
> org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:353)
> at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:229)
> at org.apache.atlas.AtlasClientV2.updateEntity(AtlasClientV2.java:324)
> at
> org.apache.atlas.hbase.bridge.HBaseBridge.updateEntityInAtlas(HBaseBridge.java:615)
> at
> org.apache.atlas.hbase.bridge.HBaseBridge.createOrUpdateTable(HBaseBridge.java:409)
> at
> org.apache.atlas.hbase.bridge.HBaseBridge.importTable(HBaseBridge.java:282)
> at
> org.apache.atlas.hbase.bridge.HBaseBridge.importHBaseEntities(HBaseBridge.java:235)
> at org.apache.atlas.hbase.bridge.HBaseBridge.main(HBaseBridge.java:186)
> This causes the atlas split 2 failure: test_import_hbase_without_args
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
