Re: [Progress Update] Improvements to the Apache Beam website - Phase 1

[Aizhamal Nurmamat kyzy]

Hi Kenn,

The transition will occur in the next 6-8 weeks as estimated by the
vendors. For now, there will be no changes to the workflow. Once we start
contributing pull requests to migrate the website, we'll communicate on the
dev@ list to hold off other PRs. We'll also make sure to update cwiki on
how to make website changes for everyone.
Thanks!


On Wed, Mar 11, 2020 at 8:47 AM Kenneth Knowles  wrote:

> LGTM. Any idea when the transition to Docsy will occur? Will there be a
> period that we will need to pause changes to the website?
>
> On Tue, Mar 10, 2020 at 2:00 PM Aizhamal Nurmamat kyzy <
> aizha...@apache.org> wrote:
>
>> Hello everyone,
>>
>> As per our previous discussion [1], we are ready to move forward with the
>> 1st phase of our project plan and migrate the Beam website to Docsy [2].
>> Please review the doc and discussion to see the background for the change.
>> Also feel free to ask any questions and share any feedback you might have
>> in this thread.
>>
>> We have partnered with a 3rd party vendor - Polidea- to execute the
>> migration, and will be sharing progress updates and collecting feedback on
>> the dev@ list.
>>
>> Hope you are all well and stay healthy,
>>
>> Aizhamal
>>
>> [1]
>> https://lists.apache.org/thread.html/rfab4cc1411318c3f4667bee051df68f37be11846ada877f3576c41a9%40%3Cdev.beam.apache.org%3E
>>
>> [2]
>> https://docs.google.com/document/d/1HlRHfmc9MvKkFEf2gfIL3RYVxTmBXQL4sXjAGGOjeiI/edit#heading=h.5rqdbnson7px
>>
>>

Re: /zetasql/local_service/liblocal_service_jni.jnilib was not found inside JAR

[Tomo Suzuki]

I see. Thank you. I also found Alex's ticket for zetasql.
https://github.com/google/zetasql/issues/25

Closing thread.

Regards,
Tomo

On Mon, Mar 16, 2020 at 3:21 PM Andrew Pilloud  wrote:

> That error is expected unless you've built your own jar with
> liblocal_service_jni.jnilib for OS X. A few have tried but no one has
> succeeded (as far as I know), it is on the ZetaSQL team's todo list. You'll
> need to run that module on Linux for now.
>
> See: https://github.com/google/zetasql/pull/3
>
> Andrew
>
> On Mon, Mar 16, 2020 at 12:09 PM Tomo Suzuki  wrote:
>
>> Hi Beam developers,
>>
>> I started getting test failures when building Beam in my MacBook Pro.
>> Module: sdks/java/extensions/sql/zetasql. The NoClassDefFoundError occurs
>> because of jnilib file is missing.
>>
>> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException:
>> File /zetasql/local_service/liblocal_service_jni.jnilib was not found
>> inside JAR.
>> at
>> com.google.zetasql.JniChannelProvider.(JniChannelProvider.java:68)
>> ... 69 more
>> Caused by: java.io.FileNotFoundException: File
>> /zetasql/local_service/liblocal_service_jni.jnilib was not found inside JAR.
>> at
>> com.google.zetasql.cz.adamh.utils.NativeUtils.loadLibraryFromJar(NativeUtils.java:105)
>> at
>> com.google.zetasql.JniChannelProvider.(JniChannelProvider.java:66)
>> ... 69 more
>>
>> Full log:
>> https://gist.github.com/suztomo/f3d8815e8f48aeabd0288de34c1488f0
>>
>> Has anyone encountered a similar problem?
>>
>> --
>> Regards,
>> Tomo
>>
>

-- 
Regards,
Tomo

Re: /zetasql/local_service/liblocal_service_jni.jnilib was not found inside JAR

[Andrew Pilloud]

That error is expected unless you've built your own jar with
liblocal_service_jni.jnilib for OS X. A few have tried but no one has
succeeded (as far as I know), it is on the ZetaSQL team's todo list. You'll
need to run that module on Linux for now.

See: https://github.com/google/zetasql/pull/3

Andrew

On Mon, Mar 16, 2020 at 12:09 PM Tomo Suzuki  wrote:

> Hi Beam developers,
>
> I started getting test failures when building Beam in my MacBook Pro.
> Module: sdks/java/extensions/sql/zetasql. The NoClassDefFoundError occurs
> because of jnilib file is missing.
>
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: File
> /zetasql/local_service/liblocal_service_jni.jnilib was not found inside JAR.
> at
> com.google.zetasql.JniChannelProvider.(JniChannelProvider.java:68)
> ... 69 more
> Caused by: java.io.FileNotFoundException: File
> /zetasql/local_service/liblocal_service_jni.jnilib was not found inside JAR.
> at
> com.google.zetasql.cz.adamh.utils.NativeUtils.loadLibraryFromJar(NativeUtils.java:105)
> at
> com.google.zetasql.JniChannelProvider.(JniChannelProvider.java:66)
> ... 69 more
>
> Full log: https://gist.github.com/suztomo/f3d8815e8f48aeabd0288de34c1488f0
>
> Has anyone encountered a similar problem?
>
> --
> Regards,
> Tomo
>

/zetasql/local_service/liblocal_service_jni.jnilib was not found inside JAR

[Tomo Suzuki]

Hi Beam developers,

I started getting test failures when building Beam in my MacBook Pro.
Module: sdks/java/extensions/sql/zetasql. The NoClassDefFoundError occurs
because of jnilib file is missing.

Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: File
/zetasql/local_service/liblocal_service_jni.jnilib was not found inside JAR.
at
com.google.zetasql.JniChannelProvider.(JniChannelProvider.java:68)
... 69 more
Caused by: java.io.FileNotFoundException: File
/zetasql/local_service/liblocal_service_jni.jnilib was not found inside JAR.
at
com.google.zetasql.cz.adamh.utils.NativeUtils.loadLibraryFromJar(NativeUtils.java:105)
at
com.google.zetasql.JniChannelProvider.(JniChannelProvider.java:66)
... 69 more

Full log: https://gist.github.com/suztomo/f3d8815e8f48aeabd0288de34c1488f0

Has anyone encountered a similar problem?

-- 
Regards,
Tomo

Re: Autolink references for Apache Beam

[Kyle Weaver]

Awesome. This makes it much easier to navigate the project, especially for
new contributors. Thanks Ismaël!

On Sun, Mar 15, 2020 at 12:02 AM Ismaël Mejía  wrote:

> Autolink references are working now.
>
> On Fri, Mar 13, 2020 at 9:31 PM Ismaël Mejía  wrote:
> >
> > Thanks Kyle for catching that, I pinged INFRA again hopefully it will
> > be working soon.
> >
> > On Fri, Mar 13, 2020 at 8:49 PM Kyle Weaver  wrote:
> > >
> > > Sounds like a really cool feature! However, it doesn't seem to work:
> links are missing the BEAM- prefix, e.g.
> https://issues.apache.org/jira/browse/9475
> > >
> > > On Fri, Mar 13, 2020 at 12:42 PM Ismaël Mejía 
> wrote:
> > >>
> > >> Github released some months ago a new feature to configure Autolink
> references
> > >> for Apache Beam a new github feature to have automatic links to
> issues in
> > >> external systems e.g.  JIRA for our case.
> > >>
> > >> https://github.blog/2019-10-14-introducing-autolink-references/
> > >>
> > >> For info I filled INFRA-19967 to request this for Beam and Infra
> quickly enabled
> > >> it, the links should be started to populate in the new PRs soon.
>

Contributor permissions

[Yaron Neuman]

Hi Everyone,
Great to e-meet you all

Can someone please add me as a contributor? 
I would like to assign/create tickets to work on, starting with BEAM-9502 :)

Thanks,
Yaron

Re: Contributor permission for Beam Jira tickets

[Ismaël Mejía]

Done, welcome!

On Mon, Mar 16, 2020 at 5:26 PM Yaron Neuman  wrote:
>
> Hi,
>
> This is Yaron Neuman.
> I would like to contribute issues related to java-sdk and dataflow runner.
> Can someone add me as a contributor for Beam's Jira issue
> tracker? I would like to create/assign tickets for my work.
>
> My username in JIRA is "yaronneuman"
>
> Thanks,
> Y

Contributor permission for Beam Jira tickets

[Yaron Neuman]

Hi,

This is Yaron Neuman.
I would like to contribute issues related to java-sdk and dataflow runner.
Can someone add me as a contributor for Beam's Jira issue
tracker? I would like to create/assign tickets for my work.

My username in JIRA is "yaronneuman"

Thanks,
Y

Beam dependency check failing

[Michał Walenia]

Hi,
two last builds of Beam Dependency Check job failed with errors related to
Python grpc_tools dependency.
https://issues.apache.org/jira/browse/BEAM-9507 here's the issue I created
to track this.

-- 

Michał Walenia
Polidea  | Software Engineer

M: +48 791 432 002 <+48791432002>
E: michal.wale...@polidea.com

Unique Tech
Check out our projects! 

Beam Dependency Check Report (2020-03-16)

[Apache Jenkins Server]

ERROR: File 'src/build/dependencyUpdates/beam-dependency-check-report.html' does not exist