Re: Review Request 72943: ATLAS-3988 : REST GET entity API with type's GUID throws NPE

2020-10-20 Thread chaitali 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72943/
---

(Updated Oct. 21, 2020, 6:51 a.m.)


Review request for atlas, Jayendra Parab, Madhan Neethiraj, Nixon Rodrigues, 
and Sarath Subramanian.


Bugs: ATLAS-3988
https://issues.apache.org/jira/browse/ATLAS-3988


Repository: atlas


Description
---

Issue :
GET on /api/atlas/v2/entity/guid/ throws invalid GUID exception.

BUT GET on /api/atlas/v2/entity/guid/ throws NPE.

 
2020-01-14 02:19:07,272 ERROR - [pool-2-thread-3 - 
a0b7457e-d43f-4fca-9581-8db695ef7af3:] ~ graph rollback due to exception 
(GraphTransactionInterceptor:167)
java.lang.NullPointerException
at org.apache.atlas.type.AtlasTypeRegistry.getType(AtlasTypeRegistry.java:94)
at 
org.apache.atlas.repository.store.graph.v2.EntityGraphRetriever.mapAttributes(EntityGraphRetriever.java:608)
at 
org.apache.atlas.repository.store.graph.v2.EntityGraphRetriever.mapVertexToAtlasEntity(EntityGraphRetriever.java:448)

This patch fixes the issue by adding a null check for typename exists or not 
for the guid passed.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/AtlasErrorCode.java a14e43a1e 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
 2199277ad 


Diff: https://reviews.apache.org/r/72943/diff/2/

Changes: https://reviews.apache.org/r/72943/diff/1-2/


Testing
---

Tested with GET call GET on /api/atlas/v2/entity/guid/  by 
passing typename guid to this entity call.


Thanks,

chaitali

[jira] [Updated] (ATLAS-3943) UI: Show Import/Export operations in administration audit.

2020-10-20 Thread Keval Bhatt (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-3943:
---
Attachment: ATLAS-3943-4.patch

> UI: Show Import/Export operations in administration audit.
> --
>
> Key: ATLAS-3943
> URL: https://issues.apache.org/jira/browse/ATLAS-3943
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
> Attachments: ATLAS-3943-1.patch, ATLAS-3943-2.patch, 
> ATLAS-3943-3.patch, ATLAS-3943-4.patch, ATLAS-3943.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Created] (ATLAS-4000) update Jetty version to 9.4.31

2020-10-20 Thread Madhan Neethiraj (Jira) 
Madhan Neethiraj created ATLAS-4000:
---

 Summary: update Jetty version to 9.4.31
 Key: ATLAS-4000
 URL: https://issues.apache.org/jira/browse/ATLAS-4000
 Project: Atlas
  Issue Type: Improvement
Reporter: Madhan Neethiraj
Assignee: Madhan Neethiraj


Atlas currently uses Jetty version 9.2.12, which is about 4 years old. This 
should be upgraded to a recent version - like 9.4.31.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (ATLAS-3943) UI: Show Import/Export operations in administration audit.

2020-10-20 Thread Keval Bhatt (Jira) 


 [ 
https://issues.apache.org/jira/browse/ATLAS-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-3943:
---
Parent: (was: ATLAS-3935)
Issue Type: Improvement  (was: Sub-task)

> UI: Show Import/Export operations in administration audit.
> --
>
> Key: ATLAS-3943
> URL: https://issues.apache.org/jira/browse/ATLAS-3943
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 3.0.0, 2.2.0
>
> Attachments: ATLAS-3943-1.patch, ATLAS-3943-2.patch, 
> ATLAS-3943-3.patch, ATLAS-3943.patch
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 72943: ATLAS-3988 : REST GET entity API with type's GUID throws NPE

2020-10-20 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72943/#review222088
---




repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
Lines 382 (patched)


consider replacing if condition check with:

=> StringUtils.isEmpty(GraphHelper.getTypeName(ret))


- Sarath Subramanian


On Oct. 9, 2020, 3:46 a.m., chaitali wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72943/
> ---
> 
> (Updated Oct. 9, 2020, 3:46 a.m.)
> 
> 
> Review request for atlas, Jayendra Parab, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3988
> https://issues.apache.org/jira/browse/ATLAS-3988
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Issue :
> GET on /api/atlas/v2/entity/guid/ throws invalid GUID exception.
> 
> BUT GET on /api/atlas/v2/entity/guid/ throws NPE.
> 
>  
> 2020-01-14 02:19:07,272 ERROR - [pool-2-thread-3 - 
> a0b7457e-d43f-4fca-9581-8db695ef7af3:] ~ graph rollback due to exception 
> (GraphTransactionInterceptor:167)
> java.lang.NullPointerException
> at org.apache.atlas.type.AtlasTypeRegistry.getType(AtlasTypeRegistry.java:94)
> at 
> org.apache.atlas.repository.store.graph.v2.EntityGraphRetriever.mapAttributes(EntityGraphRetriever.java:608)
> at 
> org.apache.atlas.repository.store.graph.v2.EntityGraphRetriever.mapVertexToAtlasEntity(EntityGraphRetriever.java:448)
> 
> This patch fixes the issue by adding a null check for typename exists or not 
> for the guid passed.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/AtlasErrorCode.java a14e43a1e 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
>  00146b106 
> 
> 
> Diff: https://reviews.apache.org/r/72943/diff/1/
> 
> 
> Testing
> ---
> 
> Tested with GET call GET on /api/atlas/v2/entity/guid/  by 
> passing typename guid to this entity call.
> 
> 
> Thanks,
> 
> chaitali
> 
>

Re: Review Request 72943: ATLAS-3988 : REST GET entity API with type's GUID throws NPE

2020-10-20 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72943/#review222087
---




intg/src/main/java/org/apache/atlas/AtlasErrorCode.java
Lines 197 (patched)


"entityguid" => "entity with guid: {0}"


- Sarath Subramanian


On Oct. 9, 2020, 3:46 a.m., chaitali wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72943/
> ---
> 
> (Updated Oct. 9, 2020, 3:46 a.m.)
> 
> 
> Review request for atlas, Jayendra Parab, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3988
> https://issues.apache.org/jira/browse/ATLAS-3988
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Issue :
> GET on /api/atlas/v2/entity/guid/ throws invalid GUID exception.
> 
> BUT GET on /api/atlas/v2/entity/guid/ throws NPE.
> 
>  
> 2020-01-14 02:19:07,272 ERROR - [pool-2-thread-3 - 
> a0b7457e-d43f-4fca-9581-8db695ef7af3:] ~ graph rollback due to exception 
> (GraphTransactionInterceptor:167)
> java.lang.NullPointerException
> at org.apache.atlas.type.AtlasTypeRegistry.getType(AtlasTypeRegistry.java:94)
> at 
> org.apache.atlas.repository.store.graph.v2.EntityGraphRetriever.mapAttributes(EntityGraphRetriever.java:608)
> at 
> org.apache.atlas.repository.store.graph.v2.EntityGraphRetriever.mapVertexToAtlasEntity(EntityGraphRetriever.java:448)
> 
> This patch fixes the issue by adding a null check for typename exists or not 
> for the guid passed.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/AtlasErrorCode.java a14e43a1e 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v2/EntityGraphRetriever.java
>  00146b106 
> 
> 
> Diff: https://reviews.apache.org/r/72943/diff/1/
> 
> 
> Testing
> ---
> 
> Tested with GET call GET on /api/atlas/v2/entity/guid/  by 
> passing typename guid to this entity call.
> 
> 
> Thanks,
> 
> chaitali
> 
>

Re: Review Request 72938: ATLAS-3984 Add UI Date Timezone and UI Date Format in Session api

2020-10-20 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72938/#review222086
---


Fix it, then Ship it!





webapp/src/main/java/org/apache/atlas/web/resources/AdminResource.java
Lines 200 (patched)


why is 'uiDateTimezone' a boolean flag - do we expect a timezone value? If 
you are expecting a boolean value, consider giving a meaningful property name.


- Sarath Subramanian


On Oct. 8, 2020, 11:21 p.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72938/
> ---
> 
> (Updated Oct. 8, 2020, 11:21 p.m.)
> 
> 
> Review request for atlas, Jayendra Parab, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3984
> https://issues.apache.org/jira/browse/ATLAS-3984
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Add UI Date Timezone and UI Date Format in Session api.
> 
> Provide a way to user to read these "UI Date Timezone" and "UI Date Format" 
> values from property file.
> 
> 
> Diffs
> -
> 
>   webapp/src/main/java/org/apache/atlas/web/resources/AdminResource.java 
> 3a6139f 
> 
> 
> Diff: https://reviews.apache.org/r/72938/diff/2/
> 
> 
> Testing
> ---
> 
> PreCommit: 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/81/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>

[jira] [Commented] (ATLAS-3999) Update build to avoid distro in multiple formats - tar.gz and dir

2020-10-20 Thread ASF subversion and git services (Jira) 


[ 
https://issues.apache.org/jira/browse/ATLAS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218104#comment-17218104
 ] 

ASF subversion and git services commented on ATLAS-3999:


Commit bd9d1213b48721f269f32db1ee388e2beb9a7d3d in atlas's branch 
refs/heads/master from Madhan Neethiraj
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=bd9d121 ]

ATLAS-3999: updated build to remove copying of dist artifacts into directories


> Update build to avoid distro in multiple formats - tar.gz and dir
> -
>
> Key: ATLAS-3999
> URL: https://issues.apache.org/jira/browse/ATLAS-3999
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 3.0.0
>
> Attachments: ATLAS-3999.patch
>
>
> Atlas build generates distro in multiple formats - for example: tar.gz or zip 
> and a directory. To save build time and disk space, build should be updated 
> to only generate archives - .tar.gz or .zip, and avoid creating directories 
> with the same contents.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 72908: ATLAS-3957 Use Audit framework to capture audit entries for "Server Start" and "Server In Active mode" (HA)

2020-10-20 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72908/#review222083
---


Fix it, then Ship it!





webapp/src/main/java/org/apache/atlas/web/service/EmbeddedServer.java
Lines 128 (patched)


consider moving initialization lines - 128 and 129 to the constructor



webapp/src/main/java/org/apache/atlas/web/service/EmbeddedServer.java
Lines 133 (patched)


nit: add new line before 'if' statement in lline 133, 136



webapp/src/main/java/org/apache/atlas/web/service/EmbeddedServer.java
Lines 140 (patched)


nit: add new line before try statement start in line 140 and line 146


- Sarath Subramanian


On Oct. 9, 2020, 7:46 a.m., Mandar Ambawane wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72908/
> ---
> 
> (Updated Oct. 9, 2020, 7:46 a.m.)
> 
> 
> Review request for atlas, Jayendra Parab, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3957
> https://issues.apache.org/jira/browse/ATLAS-3957
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> By using Audit Framework, capture audit entries for "Server Start" and 
> "Server In Active mode" (HA)
> 
> These audit entries can be seen under the "Audits" tab of Admin section.
> 
> 
> Diffs
> -
> 
>   addons/models/-Area0/0010-base_model.json 1de9e57 
>   
> addons/models/-Area0/patches/006-base_model_add_atlas_operation_attributes.json
>  a27525e 
>   intg/src/main/java/org/apache/atlas/model/audit/AtlasAuditEntry.java 
> 9ed4168 
>   test-tools/src/main/resources/solr/core-template/solrconfig.xml 7cbfbd9 
>   webapp/src/main/java/org/apache/atlas/BeanUtil.java PRE-CREATION 
>   webapp/src/main/java/org/apache/atlas/web/service/EmbeddedServer.java 
> 6985291 
>   webapp/src/main/java/org/apache/atlas/web/service/ServiceState.java 113b2b2 
> 
> 
> Diff: https://reviews.apache.org/r/72908/diff/3/
> 
> 
> Testing
> ---
> 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/35/console
> 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/66/consoleFull
> 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/75/console
> 
> 
> Thanks,
> 
> Mandar Ambawane
> 
>

Re: Review Request 72960: ATLAS-3994 : import-hive.sh script fails when missing mandatory attribute value is null

2020-10-20 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72960/#review222082
---


Fix it, then Ship it!





addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
Lines 386 (patched)


nit: fix extra space formatting.


- Sarath Subramanian


On Oct. 19, 2020, 7:33 a.m., chaitali wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72960/
> ---
> 
> (Updated Oct. 19, 2020, 7:33 a.m.)
> 
> 
> Review request for atlas, Jayendra Parab, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3994
> https://issues.apache.org/jira/browse/ATLAS-3994
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> 06:33:41.409 [main] ERROR org.apache.atlas.hive.bridge.HiveMetaStoreBridge - 
> Import failed for hive_table tobedeleted__wallet
> org.apache.atlas.AtlasServiceException: Metadata service API 
> org.apache.atlas.AtlasClientV2$API_V2@17f2dd85 failed with status 404 (Not 
> Found) Response Body (
> 
> {"errorCode":"ATLAS-404-00-007","errorMessage":"Invalid instance 
> creation/updation parameters passed : hive_process.userName: mandatory 
> attribute value missing in type hive_process"}
> 
> )
> 
> This patch adds the null check for "owner" to fix the bug.
> 
> 
> Diffs
> -
> 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java
>  24e06dc2b 
> 
> 
> Diff: https://reviews.apache.org/r/72960/diff/3/
> 
> 
> Testing
> ---
> 
> Tested import hive script for db, tables
> 
> 
> Thanks,
> 
> chaitali
> 
>

Re: Review Request 72970: ATLAS-3996 : Upgrade ant to 1.10.9

2020-10-20 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72970/#review222081
---


Ship it!




Ship It!

- Sarath Subramanian


On Oct. 19, 2020, 1:31 a.m., chaitali wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72970/
> ---
> 
> (Updated Oct. 19, 2020, 1:31 a.m.)
> 
> 
> Review request for atlas, Jayendra Parab, Madhan Neethiraj, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3996
> https://issues.apache.org/jira/browse/ATLAS-3996
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Upgrade ant to 1.10.9 due to vulnerability to CVE-2020-11979
> It is a transitive dependency comes from solr-test-framework.
> 
> 
> Diffs
> -
> 
>   pom.xml 6b5d2fde6 
> 
> 
> Diff: https://reviews.apache.org/r/72970/diff/1/
> 
> 
> Testing
> ---
> 
> Tested with following scenario :
> Created entities eg from Hive shell
> mvn clean install
> mvn clean package -Pdist,embedded-hbase-solr -DskipTests
> Atlas server is running successfully
> 
> 
> Thanks,
> 
> chaitali
> 
>

Re: Review Request 72977: ATLAS-3999: updated build to remove copying of dist artifacts into directories

2020-10-20 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72977/#review222080
---


Ship it!




Ship It!

- Sarath Subramanian


On Oct. 20, 2020, 4:45 p.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72977/
> ---
> 
> (Updated Oct. 20, 2020, 4:45 p.m.)
> 
> 
> Review request for atlas, Ashutosh Mestry, Jayendra Parab, Nikhil Bonte, 
> Nixon Rodrigues, Pinal Shah, Sarath Subramanian, and Sidharth Mishra.
> 
> 
> Bugs: ATLAS-3999
> https://issues.apache.org/jira/browse/ATLAS-3999
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> - updated assembly descriptors to remove 'dir' format
> - size of dist/target directory went down from 2.2gb to 822mb
> 
> 
> Diffs
> -
> 
>   distro/src/main/assemblies/atlas-falcon-hook-package.xml 1c1ff003e 
>   distro/src/main/assemblies/atlas-hbase-hook-package.xml ba51b2378 
>   distro/src/main/assemblies/atlas-hive-hook-package.xml a0e7bc706 
>   distro/src/main/assemblies/atlas-impala-hook-package.xml 7e6177efa 
>   distro/src/main/assemblies/atlas-kafka-hook-package.xml 8394ea8d7 
>   distro/src/main/assemblies/atlas-repair-index-package.xml 7d92bb2e1 
>   distro/src/main/assemblies/atlas-server-package.xml 241ed0463 
>   distro/src/main/assemblies/atlas-sqoop-hook-package.xml 0e91af993 
>   distro/src/main/assemblies/atlas-storm-hook-package.xml 92bc68958 
>   distro/src/main/assemblies/classification-updater.xml f4bfe3cde 
>   distro/src/main/assemblies/migration-exporter.xml be0a9d56c 
>   distro/src/main/assemblies/src-package.xml a17b31e85 
>   distro/src/main/assemblies/standalone-package.xml aa462cdb6 
> 
> 
> Diff: https://reviews.apache.org/r/72977/diff/1/
> 
> 
> Testing
> ---
> 
> - verified that UTs and ITs succeed with these updates
> - successfully built Atlas, setup in docker container, executed quick-search
> - pre-commit tests run results: 
> https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/94
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>

Review Request 72977: ATLAS-3999: updated build to remove copying of dist artifacts into directories

2020-10-20 Thread Madhan Neethiraj 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72977/
---

Review request for atlas, Ashutosh Mestry, Jayendra Parab, Nikhil Bonte, Nixon 
Rodrigues, Pinal Shah, Sarath Subramanian, and Sidharth Mishra.


Bugs: ATLAS-3999
https://issues.apache.org/jira/browse/ATLAS-3999


Repository: atlas


Description
---

- updated assembly descriptors to remove 'dir' format
- size of dist/target directory went down from 2.2gb to 822mb


Diffs
-

  distro/src/main/assemblies/atlas-falcon-hook-package.xml 1c1ff003e 
  distro/src/main/assemblies/atlas-hbase-hook-package.xml ba51b2378 
  distro/src/main/assemblies/atlas-hive-hook-package.xml a0e7bc706 
  distro/src/main/assemblies/atlas-impala-hook-package.xml 7e6177efa 
  distro/src/main/assemblies/atlas-kafka-hook-package.xml 8394ea8d7 
  distro/src/main/assemblies/atlas-repair-index-package.xml 7d92bb2e1 
  distro/src/main/assemblies/atlas-server-package.xml 241ed0463 
  distro/src/main/assemblies/atlas-sqoop-hook-package.xml 0e91af993 
  distro/src/main/assemblies/atlas-storm-hook-package.xml 92bc68958 
  distro/src/main/assemblies/classification-updater.xml f4bfe3cde 
  distro/src/main/assemblies/migration-exporter.xml be0a9d56c 
  distro/src/main/assemblies/src-package.xml a17b31e85 
  distro/src/main/assemblies/standalone-package.xml aa462cdb6 


Diff: https://reviews.apache.org/r/72977/diff/1/


Testing
---

- verified that UTs and ITs succeed with these updates
- successfully built Atlas, setup in docker container, executed quick-search
- pre-commit tests run results: 
https://ci-builds.apache.org/job/Atlas/job/PreCommit-ATLAS-Build-Test/94


Thanks,

Madhan Neethiraj

[jira] [Created] (ATLAS-3999) Update build to avoid distro in multiple formats - tar.gz and dir

2020-10-20 Thread Madhan Neethiraj (Jira) 
Madhan Neethiraj created ATLAS-3999:
---

 Summary: Update build to avoid distro in multiple formats - tar.gz 
and dir
 Key: ATLAS-3999
 URL: https://issues.apache.org/jira/browse/ATLAS-3999
 Project: Atlas
  Issue Type: Improvement
  Components:  atlas-core
Reporter: Madhan Neethiraj
Assignee: Madhan Neethiraj


Atlas build generates distro in multiple formats - for example: tar.gz or zip 
and a directory. To save build time and disk space, build should be updated to 
only generate archives - .tar.gz or .zip, and avoid creating directories with 
the same contents.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Review Request 72893: ATLAS-3427: Hook Enhancements for Improved Resiliency

2020-10-20 Thread Madhan Neethiraj 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72893/#review222079
---


Ship it!




Ship It!

- Madhan Neethiraj


On Oct. 6, 2020, 5:47 p.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72893/
> ---
> 
> (Updated Oct. 6, 2020, 5:47 p.m.)
> 
> 
> Review request for atlas, Deep Singh, Madhan Neethiraj, mayank jain, Nikhil 
> Bonte, Nixon Rodrigues, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3427
> https://issues.apache.org/jira/browse/ATLAS-3427
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> (Internal review) 
> **Description**
> Integration: _AtlasHook_ receives enhanced _NotificationInterface_ in the 
> form of _AtlasFileSpool_. This capability can be optionally set using: 
> _atlas.hook.spool.dir_ configuration property.
> 
> _AtlasFileSpool_: Enhances default hook functionality by encapsulating the 
> default _NotificationInterface_ with file spooling capability. In case of 
> destination being unavailable, the messages received will be spooled to local 
> file system.
> 
> What is spool?
> - These are files containg data (messages in this specific case).
> 
> Files on the disk that are managed using index files. Index files have 
> special structure that is used to describe the spool files. 
> 
> Who generates spool files?
> _AtlasHook_ is base class from which all hooks. It is responsible for sending 
> messages to a destination (mostly Kafka). If destination is down, an 
> exception is raised by the destination. Before the implementation, the 
> message was logged after retry. With this implementation, the message will be 
> spooled, and when the destination is up, it is sent to the destination.
> 
> How are spool file stored?
> - Spool files and index files are store on disk in local file system.
> 
> Structure of _AtlasFileSpool_:
> - _IndexManagement_: Storage and retrieval of index files. Provides Spooler 
> (see below) with _PrintWriter_ to write messages to the disk.
> - _Spooler_: 
>   - Interacts with _IndexManagement_ to receive _PrintWriter_. 
>   - Serializes messages and writes to the spool file. 
> - _Publisher_: 
>   - Interacts with _IndexManagement_ to receive _IndexRecord_ that is ready 
> to be published.
>   - Reads messages from the spool file that is described in the _IndexRecord_ 
> and attempts to send it to the destination.
>   - If destination is down, it waits for destination to be up.
> - _SpoolConfiguration_: Stores configuration specific to the implementation.
> - _SpoolUtils_: Utility methods for file storage.
> 
> 
> **Impacted Areas**
> Hooks:
> - Hive: HS2
> - Hive: HMS
> - Impala.
> - HBase.
> - Spark.
> 
> 
> Diffs
> -
> 
>   addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
> 651323490 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveMetastoreHookImpl.java
>  3c0f0c106 
>   notification/pom.xml 8affd59a2 
>   notification/src/main/java/org/apache/atlas/hook/AtlasHook.java 8659126eb 
>   notification/src/main/java/org/apache/atlas/hook/FailedMessagesLogger.java 
> b319e81b8 
>   notification/src/main/java/org/apache/atlas/kafka/NotificationProvider.java 
> 2dd970ef7 
>   
> notification/src/main/java/org/apache/atlas/notification/AbstractNotification.java
>  45a66bf07 
>   
> notification/src/main/java/org/apache/atlas/notification/LogConfigUtils.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/NotificationException.java
>  2dd9c9fa0 
>   
> notification/src/main/java/org/apache/atlas/notification/NotificationInterface.java
>  6caf7e2d5 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/Archiver.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/AtlasFileSpool.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/FileOperations.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/IndexManagement.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/Publisher.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/SpoolConfiguration.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/SpoolUtils.java
>  PRE-CREATION 
>   notification/src/main/java/org/apache/atlas/notification/spool/Spooler.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/models/IndexRecord.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/models/IndexRecords.java
>  PRE-CREATION 
>   
> notification/src/main/java/org

Re: Review Request 72893: ATLAS-3427: Hook Enhancements for Improved Resiliency

2020-10-20 Thread Madhan Neethiraj 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72893/#review222077
---




notification/src/main/java/org/apache/atlas/notification/spool/IndexManagement.java
Lines 351 (patched)


Exception OverlappingFileLockException doesn't seem to be thrown in the try 
block. What condition causes this exception?



notification/src/main/java/org/apache/atlas/notification/spool/Publisher.java
Lines 150 (patched)


Should 'messages' be cleared after #150, since dispatch() is called again 
with 'messages' at line #154 below.



notification/src/main/java/org/apache/atlas/notification/spool/SpoolUtils.java
Lines 140 (patched)


SPOOL_FILE_NAME_FORMAT_PREFIX is defined as "%s.%s%s"; the second argument 
here is an int. Please review and update the format string, if necessary.


- Madhan Neethiraj


On Oct. 6, 2020, 5:47 p.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72893/
> ---
> 
> (Updated Oct. 6, 2020, 5:47 p.m.)
> 
> 
> Review request for atlas, Deep Singh, Madhan Neethiraj, mayank jain, Nikhil 
> Bonte, Nixon Rodrigues, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3427
> https://issues.apache.org/jira/browse/ATLAS-3427
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> (Internal review) 
> **Description**
> Integration: _AtlasHook_ receives enhanced _NotificationInterface_ in the 
> form of _AtlasFileSpool_. This capability can be optionally set using: 
> _atlas.hook.spool.dir_ configuration property.
> 
> _AtlasFileSpool_: Enhances default hook functionality by encapsulating the 
> default _NotificationInterface_ with file spooling capability. In case of 
> destination being unavailable, the messages received will be spooled to local 
> file system.
> 
> What is spool?
> - These are files containg data (messages in this specific case).
> 
> Files on the disk that are managed using index files. Index files have 
> special structure that is used to describe the spool files. 
> 
> Who generates spool files?
> _AtlasHook_ is base class from which all hooks. It is responsible for sending 
> messages to a destination (mostly Kafka). If destination is down, an 
> exception is raised by the destination. Before the implementation, the 
> message was logged after retry. With this implementation, the message will be 
> spooled, and when the destination is up, it is sent to the destination.
> 
> How are spool file stored?
> - Spool files and index files are store on disk in local file system.
> 
> Structure of _AtlasFileSpool_:
> - _IndexManagement_: Storage and retrieval of index files. Provides Spooler 
> (see below) with _PrintWriter_ to write messages to the disk.
> - _Spooler_: 
>   - Interacts with _IndexManagement_ to receive _PrintWriter_. 
>   - Serializes messages and writes to the spool file. 
> - _Publisher_: 
>   - Interacts with _IndexManagement_ to receive _IndexRecord_ that is ready 
> to be published.
>   - Reads messages from the spool file that is described in the _IndexRecord_ 
> and attempts to send it to the destination.
>   - If destination is down, it waits for destination to be up.
> - _SpoolConfiguration_: Stores configuration specific to the implementation.
> - _SpoolUtils_: Utility methods for file storage.
> 
> 
> **Impacted Areas**
> Hooks:
> - Hive: HS2
> - Hive: HMS
> - Impala.
> - HBase.
> - Spark.
> 
> 
> Diffs
> -
> 
>   addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
> 651323490 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveMetastoreHookImpl.java
>  3c0f0c106 
>   notification/pom.xml 8affd59a2 
>   notification/src/main/java/org/apache/atlas/hook/AtlasHook.java 8659126eb 
>   notification/src/main/java/org/apache/atlas/hook/FailedMessagesLogger.java 
> b319e81b8 
>   notification/src/main/java/org/apache/atlas/kafka/NotificationProvider.java 
> 2dd970ef7 
>   
> notification/src/main/java/org/apache/atlas/notification/AbstractNotification.java
>  45a66bf07 
>   
> notification/src/main/java/org/apache/atlas/notification/LogConfigUtils.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/NotificationException.java
>  2dd9c9fa0 
>   
> notification/src/main/java/org/apache/atlas/notification/NotificationInterface.java
>  6caf7e2d5 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/Archiver.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/AtlasFileSpool.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/a

Re: Review Request 72893: ATLAS-3427: Hook Enhancements for Improved Resiliency

2020-10-20 Thread Sarath Subramanian 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72893/#review222078
---




notification/src/main/java/org/apache/atlas/notification/LogConfigUtils.java
Lines 70 (patched)


consider moving the logic to get file appender path from approach2 within 
getFileAppenderPath()

something like in line #70:

if (StringUtils.isEmpty(ret)) {
  // move getFileAppenderPathApproach2() implementation here.
}



notification/src/main/java/org/apache/atlas/notification/spool/IndexManagement.java
Lines 59 (patched)


consider replacing exceptions in line 59, 64, 69, 74 with atlas base 
exception with error code.



notification/src/main/java/org/apache/atlas/notification/spool/IndexManagement.java
Lines 89 (patched)


consider initializing within the constructor and remove lines 93-95



notification/src/main/java/org/apache/atlas/notification/spool/IndexManagement.java
Lines 180 (patched)


consider calling init() within the constructor



notification/src/main/java/org/apache/atlas/notification/spool/IndexManagement.java
Lines 321 (patched)


consider calling init() within the constructor



notification/src/main/java/org/apache/atlas/notification/spool/IndexManagement.java
Lines 401 (patched)


consider calling init() within the constructor



notification/src/main/java/org/apache/atlas/notification/spool/models/IndexRecord.java
Lines 59 (patched)


consider using enum to represent index record status



pom.xml
Lines 700 (patched)


log4j.version property is duplicated in line# 688, consider updating the 
previous log4j version.


- Sarath Subramanian


On Oct. 6, 2020, 10:47 a.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72893/
> ---
> 
> (Updated Oct. 6, 2020, 10:47 a.m.)
> 
> 
> Review request for atlas, Deep Singh, Madhan Neethiraj, mayank jain, Nikhil 
> Bonte, Nixon Rodrigues, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3427
> https://issues.apache.org/jira/browse/ATLAS-3427
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> (Internal review) 
> **Description**
> Integration: _AtlasHook_ receives enhanced _NotificationInterface_ in the 
> form of _AtlasFileSpool_. This capability can be optionally set using: 
> _atlas.hook.spool.dir_ configuration property.
> 
> _AtlasFileSpool_: Enhances default hook functionality by encapsulating the 
> default _NotificationInterface_ with file spooling capability. In case of 
> destination being unavailable, the messages received will be spooled to local 
> file system.
> 
> What is spool?
> - These are files containg data (messages in this specific case).
> 
> Files on the disk that are managed using index files. Index files have 
> special structure that is used to describe the spool files. 
> 
> Who generates spool files?
> _AtlasHook_ is base class from which all hooks. It is responsible for sending 
> messages to a destination (mostly Kafka). If destination is down, an 
> exception is raised by the destination. Before the implementation, the 
> message was logged after retry. With this implementation, the message will be 
> spooled, and when the destination is up, it is sent to the destination.
> 
> How are spool file stored?
> - Spool files and index files are store on disk in local file system.
> 
> Structure of _AtlasFileSpool_:
> - _IndexManagement_: Storage and retrieval of index files. Provides Spooler 
> (see below) with _PrintWriter_ to write messages to the disk.
> - _Spooler_: 
>   - Interacts with _IndexManagement_ to receive _PrintWriter_. 
>   - Serializes messages and writes to the spool file. 
> - _Publisher_: 
>   - Interacts with _IndexManagement_ to receive _IndexRecord_ that is ready 
> to be published.
>   - Reads messages from the spool file that is described in the _IndexRecord_ 
> and attempts to send it to the destination.
>   - If destination is down, it waits for destination to be up.
> - _SpoolConfiguration_: Stores configuration specific to the implementation.
> - _SpoolUtils_: Utility methods for file storage.
> 
> 
> **Impacted Areas**
> Hooks:
> - Hive: HS2
> - Hive: HMS
> - Impala.
> - HBase.
> - Spark.
> 
> 
> Diffs
> -
> 
>   addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
> 651323490 
>   
>

Re: Review Request 72893: ATLAS-3427: Hook Enhancements for Improved Resiliency

2020-10-20 Thread Nixon Rodrigues 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72893/#review222076
---


Ship it!




Ship It!

- Nixon Rodrigues


On Oct. 6, 2020, 5:47 p.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72893/
> ---
> 
> (Updated Oct. 6, 2020, 5:47 p.m.)
> 
> 
> Review request for atlas, Deep Singh, Madhan Neethiraj, mayank jain, Nikhil 
> Bonte, Nixon Rodrigues, and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3427
> https://issues.apache.org/jira/browse/ATLAS-3427
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> (Internal review) 
> **Description**
> Integration: _AtlasHook_ receives enhanced _NotificationInterface_ in the 
> form of _AtlasFileSpool_. This capability can be optionally set using: 
> _atlas.hook.spool.dir_ configuration property.
> 
> _AtlasFileSpool_: Enhances default hook functionality by encapsulating the 
> default _NotificationInterface_ with file spooling capability. In case of 
> destination being unavailable, the messages received will be spooled to local 
> file system.
> 
> What is spool?
> - These are files containg data (messages in this specific case).
> 
> Files on the disk that are managed using index files. Index files have 
> special structure that is used to describe the spool files. 
> 
> Who generates spool files?
> _AtlasHook_ is base class from which all hooks. It is responsible for sending 
> messages to a destination (mostly Kafka). If destination is down, an 
> exception is raised by the destination. Before the implementation, the 
> message was logged after retry. With this implementation, the message will be 
> spooled, and when the destination is up, it is sent to the destination.
> 
> How are spool file stored?
> - Spool files and index files are store on disk in local file system.
> 
> Structure of _AtlasFileSpool_:
> - _IndexManagement_: Storage and retrieval of index files. Provides Spooler 
> (see below) with _PrintWriter_ to write messages to the disk.
> - _Spooler_: 
>   - Interacts with _IndexManagement_ to receive _PrintWriter_. 
>   - Serializes messages and writes to the spool file. 
> - _Publisher_: 
>   - Interacts with _IndexManagement_ to receive _IndexRecord_ that is ready 
> to be published.
>   - Reads messages from the spool file that is described in the _IndexRecord_ 
> and attempts to send it to the destination.
>   - If destination is down, it waits for destination to be up.
> - _SpoolConfiguration_: Stores configuration specific to the implementation.
> - _SpoolUtils_: Utility methods for file storage.
> 
> 
> **Impacted Areas**
> Hooks:
> - Hive: HS2
> - Hive: HMS
> - Impala.
> - HBase.
> - Spark.
> 
> 
> Diffs
> -
> 
>   addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveHook.java 
> 651323490 
>   
> addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/HiveMetastoreHookImpl.java
>  3c0f0c106 
>   notification/pom.xml 8affd59a2 
>   notification/src/main/java/org/apache/atlas/hook/AtlasHook.java 8659126eb 
>   notification/src/main/java/org/apache/atlas/hook/FailedMessagesLogger.java 
> b319e81b8 
>   notification/src/main/java/org/apache/atlas/kafka/NotificationProvider.java 
> 2dd970ef7 
>   
> notification/src/main/java/org/apache/atlas/notification/AbstractNotification.java
>  45a66bf07 
>   
> notification/src/main/java/org/apache/atlas/notification/LogConfigUtils.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/NotificationException.java
>  2dd9c9fa0 
>   
> notification/src/main/java/org/apache/atlas/notification/NotificationInterface.java
>  6caf7e2d5 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/Archiver.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/AtlasFileSpool.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/FileOperations.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/IndexManagement.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/Publisher.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/SpoolConfiguration.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/SpoolUtils.java
>  PRE-CREATION 
>   notification/src/main/java/org/apache/atlas/notification/spool/Spooler.java 
> PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/models/IndexRecord.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/apache/atlas/notification/spool/models/IndexRecords.java
>  PRE-CREATION 
>   
> notification/src/main/java/org/

[jira] [Commented] (ATLAS-3998) Build Atlas : [ERROR] Unable to save binary /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor/linux-x64-57 : { Error: EACCES: p

2020-10-20 Thread Ash bit (Jira) 


[ 
https://issues.apache.org/jira/browse/ATLAS-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217528#comment-17217528
 ] 

Ash bit commented on ATLAS-3998:


Do you guys have an already built artifacts that I could use?

> Build Atlas : [ERROR] Unable to save binary 
> /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor/linux-x64-57
>  : { Error: EACCES: permission denie
> ---
>
> Key: ATLAS-3998
> URL: https://issues.apache.org/jira/browse/ATLAS-3998
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.1.0
>Reporter: Ash bit
>Priority: Major
>
> Guys,
> I have been trying to install Atlas in both RHEL and Ubuntu on AWS and I 
> followed multiple websites like below ones:
>  * [http://atlas.apache.org/#/BuildInstallation]
>  * [https://apothem.blog/apache-atlas.html]
>  * [https://github.com/apache/atlas]
> but no matter I follow any of the above links, it always fails with the 
> following error:
> udit` to get more info.
> [INFO]
> [INFO] > node-sass@4.14.1 install 
> /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass
> [INFO] > node scripts/install.js
> [INFO]
> [ERROR] Unable to save binary 
> /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor/linux-x64-57
>  : { Error: EACCES: permission denied, mkdir 
> '/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor'
> [ERROR] at Object.fs.mkdirSync (fs.js:885:18)
> [ERROR] at sync 
> (/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/mkdirp/index.js:72:13)
> [ERROR] at Function.sync 
> (/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/mkdirp/index.js:78:24)
> [ERROR] at checkAndDownloadBinary 
> (/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/scripts/install.js:114:11)
> [ERROR] at Object. 
> (/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/scripts/install.js:157:1)
> [ERROR] at Module._compile (module.js:635:30)
> [ERROR] at Object.Module._extensions..js (module.js:646:10)
> [ERROR] at Module.load (module.js:554:32)
> [ERROR] at tryModuleLoad (module.js:497:12)
> [ERROR] at Function.Module._load (module.js:489:3)
> [ERROR] errno: -13,
> [ERROR] code: 'EACCES',
> [ERROR] syscall: 'mkdir',
> [ERROR] path: 
> '/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor'
>  }
> [INFO]
> [INFO] > core-js@2.6.11 postinstall 
> /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/core-js
> [INFO] > node -e "try\{require('./postinstall')}catch(e){}"
> [INFO]
> [INFO] Thank you for using core-js ( https://github.com/zloirock/core-js ) 
> for polyfilling JavaScript standard library!
> [INFO]
> [INFO] The project needs your help! Please consider supporting of core-js on 
> Open Collective or Patreon:
> [INFO] > https://opencollective.com/core-js
> [INFO] > https://www.patreon.com/zloirock
> [INFO]
> [INFO] Also, the author of core-js ( https://github.com/zloirock ) is looking 
> for a good job -)
> [INFO]
> [INFO]
> [INFO] > node-sass@4.14.1 postinstall 
> /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass
> [INFO] > node scripts/build.js
> [INFO]
> [INFO] Building: 
> /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node/node 
> /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-gyp/bin/node-gyp.js
>  rebuild --verbose --libsass_ext= --libsass_cflags= --libsass_ldflags= 
> --libsass_library=
> [ERROR] gyp info it worked if it ends with ok
> [ERROR] gyp verb cli [ 
> '/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node/node',
> [ERROR] gyp verb cli 
> '/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-gyp/bin/node-gyp.js',
> [ERROR] gyp verb cli 'rebuild',
> [ERROR] gyp verb cli '--verbose',
> [ERROR] gyp verb cli '--libsass_ext=',
> [ERROR] gyp verb cli '--libsass_cflags=',
> [ERROR] gyp verb cli '--libsass_ldflags=',
> [ERROR] gyp verb cli '--libsass_library=' ]
> [ERROR] gyp info using node-gyp@3.8.0
> [ERROR] gyp info using node@8.9.0 | linux | x64
> [ERROR] gyp verb command rebuild []
> [ERROR] gyp verb command clean []
> [ERROR] gyp verb clean removing "build" directory
> [ERROR] gyp verb command configure []
> [ERROR] gyp verb check python checking for Python executable "python2" in the 
> PATH
> [ERROR] gyp verb `which` failed Error: not found: python2
> [ERROR] gyp verb `which` failed at getNotFoundError 
> (/home/ec2-user/apache-atlas-sources-2.0.0/da

[jira] [Created] (ATLAS-3998) Build Atlas : [ERROR] Unable to save binary /home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor/linux-x64-57 : { Error: EACCES: per

2020-10-20 Thread Ash bit (Jira) 
Ash bit created ATLAS-3998:
--

 Summary: Build Atlas : [ERROR] Unable to save binary 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor/linux-x64-57
 : { Error: EACCES: permission denie
 Key: ATLAS-3998
 URL: https://issues.apache.org/jira/browse/ATLAS-3998
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 2.1.0
Reporter: Ash bit


Guys,

I have been trying to install Atlas in both RHEL and Ubuntu on AWS and I 
followed multiple websites like below ones:
 * [http://atlas.apache.org/#/BuildInstallation]
 * [https://apothem.blog/apache-atlas.html]
 * [https://github.com/apache/atlas]

but no matter I follow any of the above links, it always fails with the 
following error:

udit` to get more info.
[INFO]
[INFO] > node-sass@4.14.1 install 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass
[INFO] > node scripts/install.js
[INFO]
[ERROR] Unable to save binary 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor/linux-x64-57
 : { Error: EACCES: permission denied, mkdir 
'/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor'
[ERROR] at Object.fs.mkdirSync (fs.js:885:18)
[ERROR] at sync 
(/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/mkdirp/index.js:72:13)
[ERROR] at Function.sync 
(/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/mkdirp/index.js:78:24)
[ERROR] at checkAndDownloadBinary 
(/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/scripts/install.js:114:11)
[ERROR] at Object. 
(/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/scripts/install.js:157:1)
[ERROR] at Module._compile (module.js:635:30)
[ERROR] at Object.Module._extensions..js (module.js:646:10)
[ERROR] at Module.load (module.js:554:32)
[ERROR] at tryModuleLoad (module.js:497:12)
[ERROR] at Function.Module._load (module.js:489:3)
[ERROR] errno: -13,
[ERROR] code: 'EACCES',
[ERROR] syscall: 'mkdir',
[ERROR] path: 
'/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass/vendor'
 }
[INFO]
[INFO] > core-js@2.6.11 postinstall 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/core-js
[INFO] > node -e "try\{require('./postinstall')}catch(e){}"
[INFO]
[INFO] Thank you for using core-js ( https://github.com/zloirock/core-js ) for 
polyfilling JavaScript standard library!
[INFO]
[INFO] The project needs your help! Please consider supporting of core-js on 
Open Collective or Patreon:
[INFO] > https://opencollective.com/core-js
[INFO] > https://www.patreon.com/zloirock
[INFO]
[INFO] Also, the author of core-js ( https://github.com/zloirock ) is looking 
for a good job -)
[INFO]
[INFO]
[INFO] > node-sass@4.14.1 postinstall 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-sass
[INFO] > node scripts/build.js
[INFO]
[INFO] Building: 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node/node 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-gyp/bin/node-gyp.js
 rebuild --verbose --libsass_ext= --libsass_cflags= --libsass_ldflags= 
--libsass_library=
[ERROR] gyp info it worked if it ends with ok
[ERROR] gyp verb cli [ 
'/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node/node',
[ERROR] gyp verb cli 
'/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/node-gyp/bin/node-gyp.js',
[ERROR] gyp verb cli 'rebuild',
[ERROR] gyp verb cli '--verbose',
[ERROR] gyp verb cli '--libsass_ext=',
[ERROR] gyp verb cli '--libsass_cflags=',
[ERROR] gyp verb cli '--libsass_ldflags=',
[ERROR] gyp verb cli '--libsass_library=' ]
[ERROR] gyp info using node-gyp@3.8.0
[ERROR] gyp info using node@8.9.0 | linux | x64
[ERROR] gyp verb command rebuild []
[ERROR] gyp verb command clean []
[ERROR] gyp verb clean removing "build" directory
[ERROR] gyp verb command configure []
[ERROR] gyp verb check python checking for Python executable "python2" in the 
PATH
[ERROR] gyp verb `which` failed Error: not found: python2
[ERROR] gyp verb `which` failed at getNotFoundError 
(/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/which/which.js:13:12)
[ERROR] gyp verb `which` failed at F 
(/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/which/which.js:68:19)
[ERROR] gyp verb `which` failed at E 
(/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/which/which.js:80:29)
[ERROR] gyp verb `which` failed at 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/which/which.js:89:16
[ERROR] gyp verb `which` failed at 
/home/ec2-user/apache-atlas-sources-2.0.0/dashboardv2/target/node_modules/isexe/index.js:42:5
[ERROR] gyp verb `which` failed at 
/hom