Review Request 72865: ATLAS-3934: docker scripts to build and run Apache Atlas in containers
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72865/ --- Review request for atlas, Ashutosh Mestry, Jayendra Parab, keval bhatt, Mehul Parikh, Nikhil Bonte, Nixon Rodrigues, Sarath Subramanian, Sharmadha Sainath, and Sidharth Mishra. Bugs: ATLAS-3934 https://issues.apache.org/jira/browse/ATLAS-3934 Repository: atlas Description --- - added docker files, docker-compose files and scripts to build Atlas in a container. The image to build Atlas supports following volumns: -- scripts: build scripts in the local directory will be made available in the container -- dist:archives from the build will be copied into this volume -- .m2: if provided, build uses the give .m2 directory, which can help avoid large downloads -- patches: patche files, if present, will be applied on top of the specified github branch -- src: if provided, builds from the sources in this directory (instead of from sources from github) - added docker file, docker-compose file and scripts to install and run Atlas in a container. Diffs - dev-support/atlas-docker/.dockerignore PRE-CREATION dev-support/atlas-docker/Dockerfile.atlas PRE-CREATION dev-support/atlas-docker/Dockerfile.atlas-base PRE-CREATION dev-support/atlas-docker/Dockerfile.atlas-build PRE-CREATION dev-support/atlas-docker/README.md 5296f05ba dev-support/atlas-docker/dist/.gitignore PRE-CREATION dev-support/atlas-docker/docker-compose.atlas-base.yml PRE-CREATION dev-support/atlas-docker/docker-compose.atlas-build.yml PRE-CREATION dev-support/atlas-docker/docker-compose.atlas.yml PRE-CREATION dev-support/atlas-docker/patches/.gitignore PRE-CREATION dev-support/atlas-docker/scripts/atlas-build.sh PRE-CREATION dev-support/atlas-docker/scripts/atlas.sh PRE-CREATION Diff: https://reviews.apache.org/r/72865/diff/1/ Testing --- - verified build with the following command: docker-compose -f docker-compose.atlas-base.yml -f docker-compose.atlas-build.yml up - verified install and running of Atlas with the following command: docker-compose -f docker-compose.atlas-base.yml -f docker-compose.atlas.yml up -d - Ran quick start successfully Thanks, Madhan Neethiraj
Re: Review Request 72863: ATLAS-3939: added build profile berkeley-solr
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72863/ --- (Updated Sept. 12, 2020, 12:15 a.m.) Review request for atlas, Ashutosh Mestry, Nikhil Bonte, Sarath Subramanian, and Sidharth Mishra. Summary (updated) - ATLAS-3939: added build profile berkeley-solr Bugs: ATLAS-3939 https://issues.apache.org/jira/browse/ATLAS-3939 Repository: atlas Description --- added build profile berkeley-solr Diffs (updated) - distro/.gitignore PRE-CREATION distro/pom.xml b92bd3548 distro/src/bin/atlas_config.py 2d6143331 distro/src/bin/atlas_start.py 963faf402 distro/src/bin/atlas_stop.py 2e15c0f3f docs/src/documents/Setup/BuildInstruction.md 05f98fb9b docs/src/documents/Setup/InstallationInstruction.md fdff3a57e webapp/pom.xml 792b16445 Diff: https://reviews.apache.org/r/72863/diff/2/ Changes: https://reviews.apache.org/r/72863/diff/1-2/ Testing --- - built Atlas with profile berkeley-solr - deployed Atlas built above, started and successfully ran quick start Thanks, Madhan Neethiraj
[jira] [Created] (ATLAS-3939) Add build profile for berkeleydb-solr
Madhan Neethiraj created ATLAS-3939: --- Summary: Add build profile for berkeleydb-solr Key: ATLAS-3939 URL: https://issues.apache.org/jira/browse/ATLAS-3939 Project: Atlas Issue Type: Improvement Components: atlas-core Reporter: Madhan Neethiraj Assignee: Madhan Neethiraj Atlas supports a number of build profiles, like external-hbase-sol/embedded-hbase-solr/embedded-cassandra-solr/berkeley-elasticsearch, for various combinations of backend stores an index stores. This should be extended to support berkeley-solr as well; this profile can be useful for dev/testing of Atlas. -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: Review Request 72815: Deletion of non existing hive entities
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72815/ --- (Updated Sept. 11, 2020, 12:27 p.m.) Review request for atlas, Jayendra Parab, Madhan Neethiraj, Nikhil Bonte, Nixon Rodrigues, and Sarath Subramanian. Changes --- updating patch for branch-0.8 Repository: atlas Description --- **Problem:** Whenever database or table is dropped in hive, and HiveHook is not enabled, we dont have anyway to get the database and table sync with hive. **Workaround:** Added support to delete hive entities in Atlas which are dropped in hive. **Usage:** ./import-hive.sh -deleteNonExisting **NOTE:** **atlas.hook.hive.page.limit** property is added to configure the pageSize/limit while fetching entities from Atlas Diffs (updated) - addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java f18d01b7c client/client-v2/src/main/java/org/apache/atlas/AtlasClientV2.java 6968e8358 Diff: https://reviews.apache.org/r/72815/diff/4/ Changes: https://reviews.apache.org/r/72815/diff/3-4/ Testing --- Manually tested Thanks, Pinal Shah
[jira] [Created] (ATLAS-3938) Import Hive Script: Support deletion of non existing database and table entities
Pinal created ATLAS-3938: Summary: Import Hive Script: Support deletion of non existing database and table entities Key: ATLAS-3938 URL: https://issues.apache.org/jira/browse/ATLAS-3938 Project: Atlas Issue Type: Improvement Reporter: Pinal Assignee: Pinal *Problem* : Whenever database or table is dropped in hive, and HiveHook is not enabled, we dont have anyway to get the database and table sync with hive. *Workaround* : Added support to delete database and table entities present in Atlas, but not in Hive. *Usage* : ./import-hive.sh -deleteNonExisting *NOTE : atlas.hook.hive.page.limit* property is added to configure the pageSize/limit while fetching entities from Atlas -- This message was sent by Atlassian Jira (v8.3.4#803005)
Re: My question about Apache Atlas
Hi, https://community.cloudera.com/t5/Community-Articles/Atlas-Development-Environment-Setup-using-IntelliJ-on/ta-p/247870 is a bit old but should be helpful. On Fri, Sep 11, 2020 at 12:40 PM vishal suvagia wrote: > Hi, In order to import Atlas in IDEA, you will need to Open the project > as a Maven Project and select the option to load all the dependent modules. > > Thanks > Vishal Suvagia. >On Friday, 11 September, 2020, 12:32:45 pm IST, Keval Bhatt < > kbh...@apache.org> wrote: > > Forwarding to the dev list. > > -- Forwarded message - > From: 875434775 > Date: Wed, Sep 9, 2020 at 5:01 PM > Subject: My question about Apache Atlas > To: kbhatt > > > Hi,Mr. Bhatt.I am using Atlas recently,I'd like to ask how can I setup > Atlas by IDEA？ > Waiting for your answer...Thanks -- Thanks, Umesh
Re: My question about Apache Atlas
Hi, In order to import Atlas in IDEA, you will need to Open the project as a Maven Project and select the option to load all the dependent modules. Thanks Vishal Suvagia. On Friday, 11 September, 2020, 12:32:45 pm IST, Keval Bhatt wrote: Forwarding to the dev list. -- Forwarded message - From: 875434775 Date: Wed, Sep 9, 2020 at 5:01 PM Subject: My question about Apache Atlas To: kbhatt Hi,Mr. Bhatt.I am using Atlas recently,I'd like to ask how can I setup Atlas by IDEA？ Waiting for your answer...Thanks
Fwd: My question about Apache Atlas
Forwarding to the dev list. -- Forwarded message - From: 875434775 Date: Wed, Sep 9, 2020 at 5:01 PM Subject: My question about Apache Atlas To: kbhatt Hi,Mr. Bhatt.I am using Atlas recently,I'd like to ask how can I setup Atlas by IDEA？ Waiting for your answer...Thanks
