Review Request 73347: ATLAS-4159 Fix build failure on Linux ARM64

2021-05-11 Thread Martin Grigorov

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73347/
---

Review request for atlas.


Repository: atlas


Description
---

Apache Atlas build fails on Linux ARM64 due to dependencies which do not 
provide binaries for linux/aarch64 CPU architecture.


Diffs
-

  addons/sqoop-bridge/src/main/java/org/apache/atlas/sqoop/hook/SqoopHook.java 
4785960a7 
  addons/storm-bridge-shim/pom.xml f4e75927f 
  addons/storm-bridge/pom.xml 71525438b 
  notification/pom.xml 28d13bc13 
  pom.xml bfa4abccc 
  repository/pom.xml bf34efee2 


Diff: https://reviews.apache.org/r/73347/diff/1/


Testing
---

Ran full test suite on Linux ARM64


Thanks,

Martin Grigorov



Re: Review Request 73347: ATLAS-4159 Fix build failure on Linux ARM64

2021-10-29 Thread Martin Grigorov

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73347/
---

(Updated Oct. 29, 2021, 12:50 p.m.)


Review request for atlas.


Repository: atlas


Description
---

Apache Atlas build fails on Linux ARM64 due to dependencies which do not 
provide binaries for linux/aarch64 CPU architecture.


Diffs (updated)
-

  pom.xml a3f30e890 


Diff: https://reviews.apache.org/r/73347/diff/2/

Changes: https://reviews.apache.org/r/73347/diff/1-2/


Testing
---

Ran full test suite on Linux ARM64


Thanks,

Martin Grigorov



Testing Atlas on Linux ARM64

2021-11-03 Thread Martin Grigorov
Dear Apache Atlas devs,

Recently I've tried to build Atlas on Linux Ubuntu 20.04 ARM64 [1].
There were few small issues but after some debugging I was able to fix them
and build it successfully!

As a Java application Atlas should run on any of the supported platforms by
JDK/JRE!
This is true until the application uses native libraries. In Atlas's case
the problem was an old version of RocksDB-JNI library coming as a
transitive dependency of Apache Storm.

Since Linux ARM64 is more and more being used on the server/cloud I'd like
to ask Atlas devs whether you are interested adding Jenkins agent that will
test the commits/patches or even run periodically (e.g. nightly/weekly) to
prevent regressions when updating dependencies and to give some confidence
to Atlas users that they could deploy it on such platform.

Disclaimer: I work for OpenLab Testing (https://docs.openlabtesting.org/)
and we could donate a Linux ARM64 VM that could be used as Jenkins agent
for long term usage! Several other Apache projects already use such VMs,
e.g. Hadoop, Cassandra, Kafka, Mesos, ...
Other projects use TravisCI for testing on arm64/ppc64/s390x. In case you
prefer TravisCI then I could help with a patch adding .travis.yml to Atlas!

1. https://issues.apache.org/jira/browse/ATLAS-4159

Regards,
Martin


Re: Is Linux ARM64 supported ?

2021-12-08 Thread Martin Grigorov
Hi Mark,

I believe the fix is not part yet of any release.
Atlas 2.2.0 has been released at 2021-08-17 (
https://atlas.apache.org/#/Downloads) and the fix has been merged at Oct
6th (
https://github.com/apache/atlas/commit/8b48f0183e5ae34da1a7bad33aa75c427d35d063
).

Regards,
Martin


On Wed, Dec 8, 2021 at 1:09 PM Mark Jens  wrote:

> Anyone ?
>
> On Mon, 6 Dec 2021 at 14:35, Mark Jens  wrote:
>
> > Hello Atlas devs!
> >
> > I see that https://issues.apache.org/jira/browse/ATLAS-4159 fixes a
> build
> > issue on Linux ARM64.
> > What is not clear to me is in which version the fix is part of ?
> > The ticket's "Fix Version" was not updated when the ticket has been
> > resolved.
> >
> > Thank you!
> >
> > Mark
> >
>


Re: Is Linux ARM64 supported ?

2021-12-08 Thread Martin Grigorov
Hi Ashutosh,

I appreciate your reply here!

On Wed, Dec 8, 2021 at 8:19 PM Ashutosh Mestry 
wrote:

> Hi Martin
>
> Your fix was merged on Oct-6. It should be part of the next Atlas release.
> We have not decided on the timeframe for the release yet.
>

Understood!


>
> About Jenkin job form ARM64: Right not, I am not sure how to proceed with
> that. Hence we have not picked it up yet. I am not sure on the approvals
> needed for the same. If you have any experience with that, we can certainly
> look at it.
>

There are no legal or financial requirements for this.
As I mentioned in my other email (
https://lists.apache.org/thread/gmjj2ryzg76jwmfdfxtl51n8rtjly0km) several
other Apache projects already do this.
The process is:
- Apache Atlas team has to decide whether it sees value in testing on Linux
ARM64
- if you decide to add ARM64 Jenkins agent then can create a ticket at
https://issues.apache.org/jira/browse/INFRA and either assign me or at
least mention me (@mgrigorov), so I receive a notification
- the ticket has to specify the preferred Linux distro (CentOS, Ubuntu,
...) and the hardware spec (CPU, RAM, disk, ...)
- OpenLab Testing will provide the VM and share privately its SSH
credentials with Apache Atlas and Apache Infra teams
- Apache Infra team will set it up as Jenkins agent and configure it to be
used only by Atlas project
- Apache Atlas team could use the SSH credentials to connect to the VM to
debug build/tests issues when needed
- If Apache Atlas team decides in the future that the VM is no more needed
for any reason then you have to create a new INFRA ticket to request its
removal as Jenkins agent

That's it!

Please let me know if you have any questions!

Regards,
Martin


> Best regards,
>
> ~ ashutosh
> Ashutosh Mestry
>
>
> From: Martin Grigorov 
> Date: Wednesday, December 8, 2021 at 4:24 AM
> To: dev@atlas.apache.org 
> Subject: Re: Is Linux ARM64 supported ?
> Hi Mark,
>
>
> On Wed, Dec 8, 2021 at 1:51 PM Mark Jens  wrote:
>
> > Thank you for your answer, Martin!
> >
> > Do you recommend using Atlas on Linux ARM64 ? What is your experience ?
> >
>
> Honestly, I don't!
> The reason is not technical though!
> My main concern is the lack of responsiveness of the Atlas team. It took
> many months to get some attention.
> Last time I've tested the build it was working but without proper testing
> on Linux ARM64 regressions may appear anytime! I've proposed adding Jenkins
> agent on ARM64 at
> https://lists.apache.org/thread/gmjj2ryzg76jwmfdfxtl51n8rtjly0km but guess
> what ? No one ever answered :-/
>
> Regards,
> Martin
>
>
> >
> > Mark
> >
> > On Wed, 8 Dec 2021 at 13:25, Martin Grigorov 
> wrote:
> >
> > > Hi Mark,
> > >
> > > I believe the fix is not part yet of any release.
> > > Atlas 2.2.0 has been released at 2021-08-17 (
> > > https://atlas.apache.org/#/Downloads) and the fix has been merged at
> Oct
> > > 6th (
> > >
> > >
> >
> https://github.com/apache/atlas/commit/8b48f0183e5ae34da1a7bad33aa75c427d35d063
> > > ).
> > >
> > > Regards,
> > > Martin
> > >
> > >
> > > On Wed, Dec 8, 2021 at 1:09 PM Mark Jens 
> wrote:
> > >
> > > > Anyone ?
> > > >
> > > > On Mon, 6 Dec 2021 at 14:35, Mark Jens 
> wrote:
> > > >
> > > > > Hello Atlas devs!
> > > > >
> > > > > I see that https://issues.apache.org/jira/browse/ATLAS-4159 fixes
> a
> > > > build
> > > > > issue on Linux ARM64.
> > > > > What is not clear to me is in which version the fix is part of ?
> > > > > The ticket's "Fix Version" was not updated when the ticket has been
> > > > > resolved.
> > > > >
> > > > > Thank you!
> > > > >
> > > > > Mark
> > > > >
> > > >
> > >
> >
>