Hi Madhan,

Thanks for trying the patch.

- Audit is not supported when using Berkley as a backend. This is a known
limitation and audit is only supported on HBase and Cassandra.
- I'll take a look at the bad substitution, I didn't see that with my
build/testing last night.
- I don't believe these failures are due to this patch. If you look at the
test history, there has been some instability around some of these tests I
think. Additionally, if you look at the current wiki, all distributions
that use Berkley as part of the maven build specify the turning off of
tests using -DskipTests. In fact I found that tests are unstable when using
any variation of -Pdist where a specific non-full distribution is used.

Thanks!

Pierre

On Fri, Apr 13, 2018 at 9:45 AM, Nixon Rodrigues <
[email protected]> wrote:

> Hi Pierre,
>
>
> The tried to apply your patch ATLAS-2478-2.patch,
>
> the build was successful with *-Pdist,berkeley-elasticsearch* profile, and
> Atlas UI loaded with all inbuild types, quick_script run fine and data
> loaded on UI.
>
> Found few issues.
>
> * Audits are not displaying on UI
>
> * Getting this error log while running atlas_start.py / atlas_stop and
> quick_start script
> */Users/nixon/projects/atlas_commit/distro/target/apache-
> atlas-1.0.0-SNAPSHOT-bin/apache-atlas-1.0.0-SNAPSHOT/conf/atlas-env.sh:
> line 65: MANAGE_EMBEDDED_CASSANDRA=${cassandra.embedded}: bad
> substitution*
>
> * Unit test cases are failing in repository module
>
>
> https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/264/console
>
> org.apache.atlas.repository.migration.HiveParititionTest
> fileImporterTest(org.apache.atlas.repository.migration.HiveParititionTest)
>  Time elapsed: 33.33 sec  <<< FAILURE!
> java.lang.AssertionError: expected [136] but found [154]
>         at org.testng.Assert.fail(Assert.java:94)
>         at org.testng.Assert.failNotEquals(Assert.java:496)
>         at org.testng.Assert.assertEquals(Assert.java:125)
>         at org.testng.Assert.assertEquals(Assert.java:267)
>         at org.testng.Assert.assertEquals(Assert.java:277)
>         at org.apache.atlas.repository.migration.MigrationBaseAsserts.
> assertMigrationStatus(MigrationBaseAsserts.java:189)
>         at org.apache.atlas.repository.migration.HiveParititionTest.
> fileImporterTest(HiveParititionTest.java:58)
>
>
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> 101.706 sec - in org.apache.atlas.repository.impexp.ImportServiceTest
>
> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> 104.293 sec <<< FAILURE! - in
> org.apache.atlas.repository.migration.HiveStocksTest
> migrateStocks(org.apache.atlas.repository.migration.HiveStocksTest)
> Time elapsed: 43.624 sec  <<< FAILURE!
> java.lang.AssertionError: expected [187] but found [226]
>         at org.testng.Assert.fail(Assert.java:94)
>         at org.testng.Assert.failNotEquals(Assert.java:496)
>         at org.testng.Assert.assertEquals(Assert.java:125)
>         at org.testng.Assert.assertEquals(Assert.java:267)
>         at org.testng.Assert.assertEquals(Assert.java:277)
>         at org.apache.atlas.repository.migration.MigrationBaseAsserts.
> assertMigrationStatus(MigrationBaseAsserts.java:189)
>         at org.apache.atlas.repository.migration.HiveStocksTest.
> migrateStocks(HiveStocksTest.java:61)
>
>
> Tests run: 246, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> 157.432 sec - in org.apache.atlas.query.DSLQueriesTest
>
> Results :
>
> Failed tests:
>   HiveParititionTest.fileImporterTest:58->MigrationBaseAsserts.
> assertMigrationStatus:189
> expected [136] but found [154]
>   HiveStocksTest.migrateStocks:61->MigrationBaseAsserts.
> assertMigrationStatus:189
> expected [187] but found [226]
>
> Tests run: 518, Failures: 2, Errors: 0, Skipped: 7
>
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Atlas Server Build Tools .................... SUCCESS [
> 0.896 s]
> [INFO] apache-atlas ....................................... SUCCESS [
> 3.241 s]
> [INFO] Apache Atlas Test Utility Tools .................... SUCCESS [
> 5.267 s]
> [INFO] Open Connector Framework (OCF) ..................... SUCCESS [
> 3.437 s]
> [INFO] Open Metadata Repository Services (OMRS) ........... SUCCESS [
> 5.248 s]
> [INFO] Open Metadata and Governance (OMAG) Server APIs .... SUCCESS [
> 1.089 s]
> [INFO] Apache Atlas Integration ........................... SUCCESS [
> 36.600 s]
> [INFO] Apache Atlas Common ................................ SUCCESS [
> 4.063 s]
> [INFO] Apache Atlas Client ................................ SUCCESS [
> 0.229 s]
> [INFO] atlas-client-common ................................ SUCCESS [
> 1.053 s]
> [INFO] atlas-client-v1 .................................... SUCCESS [
> 3.049 s]
> [INFO] Apache Atlas Server API ............................ SUCCESS [
> 1.286 s]
> [INFO] Apache Atlas Notification .......................... SUCCESS [
> 19.733 s]
> [INFO] atlas-client-v2 .................................... SUCCESS [
> 0.669 s]
> [INFO] Apache Atlas Graph Database Projects ............... SUCCESS [
> 0.090 s]
> [INFO] Apache Atlas Graph Database API .................... SUCCESS [
> 0.609 s]
> [INFO] Graph Database Common Code ......................... SUCCESS [
> 0.773 s]
> [INFO] Apache Atlas JanusGraph DB Impl .................... SUCCESS [02:24
> min]
> [INFO] Apache Atlas Graph Database Implementation Dependencies SUCCESS
> [  2.043 s]
> [INFO] Shaded version of Apache hbase client .............. SUCCESS [
> 8.351 s]
> [INFO] Apache Atlas Titan 0.5.4 Graph DB Impl ............. SUCCESS [
> 27.454 s]
> [INFO] Shaded version of Apache hbase server .............. SUCCESS [
> 20.335 s]
> [INFO] Apache Atlas Authorization ......................... SUCCESS [
> 3.421 s]
> [INFO] Apache Atlas Repository ............................ FAILURE [02:47
> min]
> [INFO] Apache Atlas UI .................................... SKIPPED
> [INFO] Apache Atlas Web Application ....................... SKIPPED
> [INFO] Apache Atlas Documentation ......................... SKIPPED
> [INFO] Apache Atlas FileSystem Model ...................... SKIPPED
> [INFO] Apache Atlas Plugin Classloader .................... SKIPPED
> [INFO] Apache Atlas Hive Bridge Shim ...................... SKIPPED
> [INFO] Apache Atlas Hive Bridge ........................... SKIPPED
> [INFO] Apache Atlas Falcon Bridge Shim .................... SKIPPED
> [INFO] Apache Atlas Falcon Bridge ......................... SKIPPED
> [INFO] Apache Atlas Sqoop Bridge Shim ..................... SKIPPED
> [INFO] Apache Atlas Sqoop Bridge .......................... SKIPPED
> [INFO] Apache Atlas Storm Bridge Shim ..................... SKIPPED
> [INFO] Apache Atlas Storm Bridge .......................... SKIPPED
> [INFO] Apache Atlas Hbase Bridge Shim ..................... SKIPPED
> [INFO] Apache Atlas Hbase Bridge .......................... SKIPPED
> [INFO] Apache Atlas Migration Exporter .................... SKIPPED
> [INFO] Apache Atlas Distribution .......................... SKIPPED
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] BUILD FAILURE
>
>
>
>
>
>
> On Thu, Apr 12, 2018 at 11:07 PM, Pierre Padovani <
> [email protected]> wrote:
>
> > I could swear I had uploaded the diff to the review board. I updated the
> > review with the diff, and added an additional sentence around hbase/solr.
> >
> > As near as I can tell, the change doesn't affect new installations, only
> > existing that are upgrading. The only thing that will likely need to be
> > done will be a full reindex to handle the field name changes made to the
> > constants file.
> >
> > Pierre
> >
> > On Thu, Apr 12, 2018 at 12:07 PM, Madhan Neethiraj <[email protected]>
> > wrote:
> >
> > > Pierre,
> > >
> > > The review is in 'Discarded' state and no source file changes.
> > >
> > > I see a note on 'backwards incompatible' introduced in this patch. It
> is
> > > not clear what the impact will be on existing deployments that use
> > > HBase+Solr. Can you please add details?
> > >
> > > Thanks,
> > > Madhan
> > >
> > >
> > >
> > >
> > > On 4/12/18, 9:48 AM, "Pierre Padovani" <pierre.padovani@
> > > civitaslearning.com> wrote:
> > >
> > >     Hey all,
> > >
> > >     I submitted a review to fix the Elasticsearch support several weeks
> > > ago,
> > >     and it has gotten no traction.
> > >
> > >     https://reviews.apache.org/r/66064/
> > >
> > >     The current Elasticsearch support is severely broken, and cannot
> > > function
> > >     with any of the currently support Elasticsearch versions for
> > > JanusGraph.
> > >     This patch resolves those issues.
> > >
> > >     Can someone please take a look at this and get it reviewed? This
> > really
> > >     should make the 1.0.0 cut of Atlas.
> > >
> > >     Thanks!
> > >
> > >     Pierre Padovani
> > >
> > >
> > >
> > >
> >
>

Reply via email to