David, Great to hear this interest regarding integration with Airflow and happy to help guide as well.
Similar to XD, I would very much like to understand both the user base sizing and areas of interest from an integration standpoint. >From your perspective, at the risk of repeating both XD and Kaxil's point, the critical thing to understand and focus on is really the ongoing maintenance and support of the Provider package post initial development. There is a cost to make sure the Provider package is up to date as changes are made to Huawei Cloud, as well as keeping it current with respect to underlying dependencies. The release process we have in place for Airflow Providers also relies on community testing, so that would be an important factor to consider in your release and update process. We track all issues for Providers and Core Airflow in the Airflow Github repo, so that is also important to stay on top of. Happy to answer more questions and help as needed. Best regards, Vikram On Thu, Oct 6, 2022 at 7:35 AM Kaxil Naik <kaxiln...@gmail.com> wrote: > > > On Thu, 6 Oct 2022 at 15:29, Kaxil Naik <kaxiln...@gmail.com> wrote: > >> Very glad to see more companies and folks interested in integration with >> Airflow. >> >> To add to XD's point - Would you or your team be willing to help maintain >> that integration forward? By maintain -> Keeping the APIs up-to-date with >> product APIs, dependencies are up-to-date etc? and ofcourse testing? >> >> Regards, >> Kaxil >> >> On Thu, 6 Oct 2022 at 14:20, Xiaodong Deng <xdd...@apache.org> wrote: >> >>> Hi David, >>> >>> Many thanks for the email. >>> >>> Such contributions would be definitely welcomed & appreciated. As you >>> already found out, there are certain criteria, like "*generic enough, >>> are well documented, fully covered by tests and with capabilities of being >>> tested by people in the community*". >>> >>> I believe you and your team will handle the documentation and unit test >>> part, etc. So no concern on that. >>> >>> However, it will be helpful if you can provide information about the >>> Provider you plan to add is "*generic enough*" AND "*capabilities of >>> being tested by people in the community*", hence: >>> >>> - It would be great if you can share some figures with the >>> community, e.g. the user pool size of Huawei Cloud, intersection of >>> Huawei >>> Cloud users & Airflow users (as you mentioned, many of your users are >>> requesting Airflow integration) >>> - You may also need to help clarify how to ensure your Profiver can >>> be well tested by people in the community, especially when you have a new >>> version release later (we don't want to have a provider release without >>> any >>> user testing it) >>> >>> Look forward to hearing from you. Meanwhile, I would also like to hear >>> other folks' thoughts on this. >>> >>> Many thanks! >>> >>> >>> Regards, >>> XD >>> >>> >>> On Thu, Oct 6, 2022 at 3:09 PM David Sanchez Plaza >>> <david.sanchez.pl...@huawei.com.invalid> wrote: >>> >>>> Dear Airflow community, >>>> >>>> >>>> >>>> I’m David Sanchez Plaza, currently working as Cloud Solution Architect. >>>> >>>> >>>> >>>> I am investigating on the integration of *Apache Airflow* with *Huawei >>>> Cloud* and improve future cooperation. Many of our customers are >>>> requesting this integration and we have several services to include in. >>>> >>>> >>>> >>>> Based on the website >>>> >>>> >>>> >>>> “*Can I contribute my own provider to Apache Airflow?* >>>> >>>> Of course, but it’s better to check at developer’s mailing list whether >>>> such contribution will be accepted by the Community, before investing time >>>> to make the provider compliant with community requirements. The Community >>>> only accepts providers that are generic enough, are well documented, fully >>>> covered by tests and with capabilities of being tested by people in the >>>> community. So we might not always be in the position to accept such >>>> contributions.” >>>> >>>> I would like to ask the community, will this contribution, after >>>> complying with all Airflow community requirements, be accepted into >>>> Airflow? >>>> >>>> >>>> >>>> Thanks in advance! >>>> >>>> >>>> >>>> Best regards >>>> >>>> David Sanchez Plaza >>>> >>>> >>>> >>>> *Huawei Cloud Business Dept, International Cloud & AI* >>>> >>>> *David Sanchez Plaza - **大卫* >>>> >>>> *Huawei HCIE Cloud Service Solutions Architect (Link >>>> <https://www.youracclaim.com/badges/332b8d61-055a-45a1-a301-0c4094a77202/public_url>)* >>>> >>>> Mobile: +86 17722639223 >>>> >>>> D District, Huawei Bantian Base, Huawei, Shenzhen, China. >>>> >>>> [image: cid:image002.png@01D4D50A.2F372780] [image: >>>> cid:image004.png@01D4D50A.2F372780] <http://intl.huaweicloud.com/> [image: >>>> cid:image005.png@01D4D50A.2F372780] >>>> <https://www.linkedin.com/showcase/huawei-cloud/> [image: >>>> cid:image006.png@01D4D50A.2F372780] >>>> <https://www.facebook.com/Huawei-Cloud-1995859487299836/> [image: >>>> cid:image007.png@01D4D50A.2F372780] <https://twitter.com/Huawei_Cloud> >>>> [image: >>>> 494f24f47d32af5819074491a59e2458] >>>> <https://mp.weixin.qq.com/s?__biz=MzI1Mzc1MzMyOQ==&mid=100007026&idx=1&sn=91c07c2a030ab5fee15f24d601da530c&chksm=69cefeec5eb977faae9c29647b7512ec7e0f9bb6301e863c892dde95106d2ec732ff43662666#rd> >>>> [image: 5edacfeb19fb3f9d99604eeaee3be363] >>>> <https://weibo.com/p/1006061930559805/home?from=page_100606&mod=TAB&is_all=1#place> >>>> >>>> >>>> >>>
