----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70768/#review215994 -----------------------------------------------------------
Ship it! Ship It! - Nixon Rodrigues On June 14, 2019, 9:21 a.m., Nikhil Bonte wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/70768/ > ----------------------------------------------------------- > > (Updated June 14, 2019, 9:21 a.m.) > > > Review request for atlas, Ashutosh Mestry, madhan, Nixon Rodrigues, and > Sarath Subramanian. > > > Bugs: ATLAS-3256 > https://issues.apache.org/jira/browse/ATLAS-3256 > > > Repository: atlas > > > Description > ------- > > Please refer jira for description > > Perfomance improvement numbers with new extract strategy: > > ##Baseline > > Full export: #1 > > Number of entities: 12342 > Duration: 93 secs > > > Full export: #2 > > Number of entities: 25703 > Duration: 245 secs > > > ##Optimization: > > Full export: #1 > > Number of entities: 12342 > Duration: 82 secs > Improvement: 12% > > > Full export: #2 > > Number of entities: 25703 > Duration: 185 secs > Improvement: 24% > > > Diffs > ----- > > > repository/src/main/java/org/apache/atlas/repository/impexp/EntitiesExtractor.java > PRE-CREATION > > repository/src/main/java/org/apache/atlas/repository/impexp/ExportService.java > 11289ea > > repository/src/main/java/org/apache/atlas/repository/impexp/ExtractStrategy.java > PRE-CREATION > > repository/src/main/java/org/apache/atlas/repository/impexp/IncrementalExportEntityProvider.java > 3a2a917 > > repository/src/main/java/org/apache/atlas/repository/impexp/RelationshipAttributesExtractor.java > PRE-CREATION > > repository/src/main/java/org/apache/atlas/repository/impexp/VertexExtractor.java > PRE-CREATION > > repository/src/test/java/org/apache/atlas/repository/impexp/IncrementalExportEntityProviderTest.java > 85ed5f9 > > repository/src/test/java/org/apache/atlas/repository/impexp/RelationshipAttributesExtractorTest.java > PRE-CREATION > repository/src/test/resources/hive_db_lineage.zip PRE-CREATION > > > Diff: https://reviews.apache.org/r/70768/diff/3/ > > > Testing > ------- > > Added UTs > Test cases are passing > > Manual testing approach: > 1. exported data > data1.zip > 2. cleaned hbase & solr > 3. imported data1.zip & verified imported data > 4. exported again > data2.zip > 5. compared contents of data1.zip & data2.zip > > > Thanks, > > Nikhil Bonte > >
