Hi Madhan, Thanks for trying the patch.
- Audit is not supported when using Berkley as a backend. This is a known limitation and audit is only supported on HBase and Cassandra. - I'll take a look at the bad substitution, I didn't see that with my build/testing last night. - I don't believe these failures are due to this patch. If you look at the test history, there has been some instability around some of these tests I think. Additionally, if you look at the current wiki, all distributions that use Berkley as part of the maven build specify the turning off of tests using -DskipTests. In fact I found that tests are unstable when using any variation of -Pdist where a specific non-full distribution is used. Thanks! Pierre On Fri, Apr 13, 2018 at 9:45 AM, Nixon Rodrigues < [email protected]> wrote: > Hi Pierre, > > > The tried to apply your patch ATLAS-2478-2.patch, > > the build was successful with *-Pdist,berkeley-elasticsearch* profile, and > Atlas UI loaded with all inbuild types, quick_script run fine and data > loaded on UI. > > Found few issues. > > * Audits are not displaying on UI > > * Getting this error log while running atlas_start.py / atlas_stop and > quick_start script > */Users/nixon/projects/atlas_commit/distro/target/apache- > atlas-1.0.0-SNAPSHOT-bin/apache-atlas-1.0.0-SNAPSHOT/conf/atlas-env.sh: > line 65: MANAGE_EMBEDDED_CASSANDRA=${cassandra.embedded}: bad > substitution* > > * Unit test cases are failing in repository module > > > https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/264/console > > org.apache.atlas.repository.migration.HiveParititionTest > fileImporterTest(org.apache.atlas.repository.migration.HiveParititionTest) > Time elapsed: 33.33 sec <<< FAILURE! > java.lang.AssertionError: expected [136] but found [154] > at org.testng.Assert.fail(Assert.java:94) > at org.testng.Assert.failNotEquals(Assert.java:496) > at org.testng.Assert.assertEquals(Assert.java:125) > at org.testng.Assert.assertEquals(Assert.java:267) > at org.testng.Assert.assertEquals(Assert.java:277) > at org.apache.atlas.repository.migration.MigrationBaseAsserts. > assertMigrationStatus(MigrationBaseAsserts.java:189) > at org.apache.atlas.repository.migration.HiveParititionTest. > fileImporterTest(HiveParititionTest.java:58) > > > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 101.706 sec - in org.apache.atlas.repository.impexp.ImportServiceTest > > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: > 104.293 sec <<< FAILURE! - in > org.apache.atlas.repository.migration.HiveStocksTest > migrateStocks(org.apache.atlas.repository.migration.HiveStocksTest) > Time elapsed: 43.624 sec <<< FAILURE! > java.lang.AssertionError: expected [187] but found [226] > at org.testng.Assert.fail(Assert.java:94) > at org.testng.Assert.failNotEquals(Assert.java:496) > at org.testng.Assert.assertEquals(Assert.java:125) > at org.testng.Assert.assertEquals(Assert.java:267) > at org.testng.Assert.assertEquals(Assert.java:277) > at org.apache.atlas.repository.migration.MigrationBaseAsserts. > assertMigrationStatus(MigrationBaseAsserts.java:189) > at org.apache.atlas.repository.migration.HiveStocksTest. > migrateStocks(HiveStocksTest.java:61) > > > Tests run: 246, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: > 157.432 sec - in org.apache.atlas.query.DSLQueriesTest > > Results : > > Failed tests: > HiveParititionTest.fileImporterTest:58->MigrationBaseAsserts. > assertMigrationStatus:189 > expected [136] but found [154] > HiveStocksTest.migrateStocks:61->MigrationBaseAsserts. > assertMigrationStatus:189 > expected [187] but found [226] > > Tests run: 518, Failures: 2, Errors: 0, Skipped: 7 > > [INFO] ------------------------------------------------------------ > ------------ > [INFO] Reactor Summary: > [INFO] > [INFO] Apache Atlas Server Build Tools .................... SUCCESS [ > 0.896 s] > [INFO] apache-atlas ....................................... SUCCESS [ > 3.241 s] > [INFO] Apache Atlas Test Utility Tools .................... SUCCESS [ > 5.267 s] > [INFO] Open Connector Framework (OCF) ..................... SUCCESS [ > 3.437 s] > [INFO] Open Metadata Repository Services (OMRS) ........... SUCCESS [ > 5.248 s] > [INFO] Open Metadata and Governance (OMAG) Server APIs .... SUCCESS [ > 1.089 s] > [INFO] Apache Atlas Integration ........................... SUCCESS [ > 36.600 s] > [INFO] Apache Atlas Common ................................ SUCCESS [ > 4.063 s] > [INFO] Apache Atlas Client ................................ SUCCESS [ > 0.229 s] > [INFO] atlas-client-common ................................ SUCCESS [ > 1.053 s] > [INFO] atlas-client-v1 .................................... SUCCESS [ > 3.049 s] > [INFO] Apache Atlas Server API ............................ SUCCESS [ > 1.286 s] > [INFO] Apache Atlas Notification .......................... SUCCESS [ > 19.733 s] > [INFO] atlas-client-v2 .................................... SUCCESS [ > 0.669 s] > [INFO] Apache Atlas Graph Database Projects ............... SUCCESS [ > 0.090 s] > [INFO] Apache Atlas Graph Database API .................... SUCCESS [ > 0.609 s] > [INFO] Graph Database Common Code ......................... SUCCESS [ > 0.773 s] > [INFO] Apache Atlas JanusGraph DB Impl .................... SUCCESS [02:24 > min] > [INFO] Apache Atlas Graph Database Implementation Dependencies SUCCESS > [ 2.043 s] > [INFO] Shaded version of Apache hbase client .............. SUCCESS [ > 8.351 s] > [INFO] Apache Atlas Titan 0.5.4 Graph DB Impl ............. SUCCESS [ > 27.454 s] > [INFO] Shaded version of Apache hbase server .............. SUCCESS [ > 20.335 s] > [INFO] Apache Atlas Authorization ......................... SUCCESS [ > 3.421 s] > [INFO] Apache Atlas Repository ............................ FAILURE [02:47 > min] > [INFO] Apache Atlas UI .................................... SKIPPED > [INFO] Apache Atlas Web Application ....................... SKIPPED > [INFO] Apache Atlas Documentation ......................... SKIPPED > [INFO] Apache Atlas FileSystem Model ...................... SKIPPED > [INFO] Apache Atlas Plugin Classloader .................... SKIPPED > [INFO] Apache Atlas Hive Bridge Shim ...................... SKIPPED > [INFO] Apache Atlas Hive Bridge ........................... SKIPPED > [INFO] Apache Atlas Falcon Bridge Shim .................... SKIPPED > [INFO] Apache Atlas Falcon Bridge ......................... SKIPPED > [INFO] Apache Atlas Sqoop Bridge Shim ..................... SKIPPED > [INFO] Apache Atlas Sqoop Bridge .......................... SKIPPED > [INFO] Apache Atlas Storm Bridge Shim ..................... SKIPPED > [INFO] Apache Atlas Storm Bridge .......................... SKIPPED > [INFO] Apache Atlas Hbase Bridge Shim ..................... SKIPPED > [INFO] Apache Atlas Hbase Bridge .......................... SKIPPED > [INFO] Apache Atlas Migration Exporter .................... SKIPPED > [INFO] Apache Atlas Distribution .......................... SKIPPED > [INFO] ------------------------------------------------------------ > ------------ > [INFO] BUILD FAILURE > > > > > > > On Thu, Apr 12, 2018 at 11:07 PM, Pierre Padovani < > [email protected]> wrote: > > > I could swear I had uploaded the diff to the review board. I updated the > > review with the diff, and added an additional sentence around hbase/solr. > > > > As near as I can tell, the change doesn't affect new installations, only > > existing that are upgrading. The only thing that will likely need to be > > done will be a full reindex to handle the field name changes made to the > > constants file. > > > > Pierre > > > > On Thu, Apr 12, 2018 at 12:07 PM, Madhan Neethiraj <[email protected]> > > wrote: > > > > > Pierre, > > > > > > The review is in 'Discarded' state and no source file changes. > > > > > > I see a note on 'backwards incompatible' introduced in this patch. It > is > > > not clear what the impact will be on existing deployments that use > > > HBase+Solr. Can you please add details? > > > > > > Thanks, > > > Madhan > > > > > > > > > > > > > > > On 4/12/18, 9:48 AM, "Pierre Padovani" <pierre.padovani@ > > > civitaslearning.com> wrote: > > > > > > Hey all, > > > > > > I submitted a review to fix the Elasticsearch support several weeks > > > ago, > > > and it has gotten no traction. > > > > > > https://reviews.apache.org/r/66064/ > > > > > > The current Elasticsearch support is severely broken, and cannot > > > function > > > with any of the currently support Elasticsearch versions for > > > JanusGraph. > > > This patch resolves those issues. > > > > > > Can someone please take a look at this and get it reviewed? This > > really > > > should make the 1.0.0 cut of Atlas. > > > > > > Thanks! > > > > > > Pierre Padovani > > > > > > > > > > > > > > >
