This is HUGE!! thanks Jarek. I have been suffering from slowness for months.

Thanks,

Ping


On Thu, Mar 10, 2022 at 3:19 AM Kevin Yang <[email protected]> wrote:

> Excellent! Thanks to Jarek and everyone involved for working on getting us
> better support on ARM-based Linux. 🙏 Looking forward for the upcoming
> improvements 👍
>
> On Thu, Mar 10, 2022 at 3:13 AM Jarek Potiuk <[email protected]> wrote:
>
>> Hello Everyone,
>>
>> Another day, another announcement. I have just merged this PR
>> https://github.com/apache/airflow/pull/22127 that adds support for
>> development for Mac OS M1 users (and also anyone who uses ARM-based linux.
>>
>> The M1 users have (rightfully) complained about rather poor performance
>> for Dockerized Airflow in Breeze (the intel-based images were used via
>> emulation and suffered roughly ~ 10x slower speed which made them barely
>> usable for development).
>>
>> As of today, our images used for development in Breeze are multi-platform
>> (amd64/arm64). This is - for now -  development only and has some
>> limitations (mysql and mssql support is missing until mysql and mssql
>> release arm-based clients and servers - but we have full postgres and
>> sqlite support - including native ARM postgres server Docker image).
>>
>> Some initial teething problems have been fixed (thanks Elad/Ephraim :)
>> but also as a follow up I will  need to observe it and implement a few
>> build optimizations (next few days). So if you see any problems, delays
>> etc, ping me on #breeze channel in our slack.
>>
>> Also building ARM images on Intel also suffers from the same 10x slower
>> emulation problems so we need to modify our CI / self-hosted
>> infrastructure, but once we do and once we start testing ARM on CI, we will
>> also be able to release multi-platform "release" images, completing
>> https://github.com/apache/airflow/issues/15635 and opening up Airflow to
>> be used on ARM-based linux.
>>
>> I hope in 2.3.0 we will be able to release the Airflow Production ARM
>> image.
>>
>> J.
>>
>>

Reply via email to