-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70768/
-----------------------------------------------------------
(Updated June 14, 2019, 9:21 a.m.)
Review request for atlas, Ashutosh Mestry, madhan, Nixon Rodrigues, and Sarath
Subramanian.
Changes
-------
Added Perfomance improvement numbers
Bugs: ATLAS-3256
https://issues.apache.org/jira/browse/ATLAS-3256
Repository: atlas
Description (updated)
-------
Please refer jira for description
Perfomance improvement numbers with new extract strategy:
##Baseline
Full export: #1
Number of entities: 12342
Duration: 93 secs
Full export: #2
Number of entities: 25703
Duration: 245 secs
##Optimization:
Full export: #1
Number of entities: 12342
Duration: 82 secs
Improvement: 12%
Full export: #2
Number of entities: 25703
Duration: 185 secs
Improvement: 24%
Diffs
-----
repository/src/main/java/org/apache/atlas/repository/impexp/EntitiesExtractor.java
PRE-CREATION
repository/src/main/java/org/apache/atlas/repository/impexp/ExportService.java
11289ea
repository/src/main/java/org/apache/atlas/repository/impexp/ExtractStrategy.java
PRE-CREATION
repository/src/main/java/org/apache/atlas/repository/impexp/IncrementalExportEntityProvider.java
3a2a917
repository/src/main/java/org/apache/atlas/repository/impexp/RelationshipAttributesExtractor.java
PRE-CREATION
repository/src/main/java/org/apache/atlas/repository/impexp/VertexExtractor.java
PRE-CREATION
repository/src/test/java/org/apache/atlas/repository/impexp/IncrementalExportEntityProviderTest.java
85ed5f9
repository/src/test/java/org/apache/atlas/repository/impexp/RelationshipAttributesExtractorTest.java
PRE-CREATION
repository/src/test/resources/hive_db_lineage.zip PRE-CREATION
Diff: https://reviews.apache.org/r/70768/diff/3/
Testing
-------
Added UTs
Test cases are passing
Manual testing approach:
1. exported data > data1.zip
2. cleaned hbase & solr
3. imported data1.zip & verified imported data
4. exported again > data2.zip
5. compared contents of data1.zip & data2.zip
Thanks,
Nikhil Bonte
