Re: [Proposal] Support State Batching and Prefetching over FnApi

be gathered across multiple elements. And it >> would see the Fn API streaming protocol might mean the implementation is >> different than it is in ReduceFnRunner. >> >> Kenn >> >> On Mon, Jun 14, 2021 at 2:46 PM Luke Cwik wrote: >> >>> The th

Re: [Proposal] Support State Batching and Prefetching over FnApi

eys which > would be the most common type of batching. > > On Thu, May 6, 2021 at 3:13 PM Rui Wang wrote: > >> At this moment, the third approach in the doc is preferred. To recap, the >> third approach is the one that only changes FnApi by adding a repeated >> fiel

Re: BeamSQL: Error when using WHERE statements with OVER windows

The exception you shared is truncated so I am not sure the root cause of this exception (it only shows the top which says BeamSql cannot convert the query to a pipeline PTransforms). Assuming you have basic knowledge of BeamSQL and Calcite. If you want to contribute to analytics function, there

Re: [Proposal] Support State Batching and Prefetching over FnApi

is this approach does not support smart prefetching (which needs runners support). However we can add that in the future if necessary and that won't conflict with existing design. Please let us know if you have any objection before the implementation. -Rui On Mon, Mar 22, 2021 at 12:27 PM Rui Wang wrote

Re: [DISCUSSION] TPC-DS benchmark via Beam SQL, issues

>Could you point me out why "non equi-join” can’t be supported? Either it can and this is just a question of implementation? It is a question of implementation. As assuming join are implemented by CoGBK, non-equi-join probably means you have to generate the key space and then use CoGBK (which is

Re: [ANNOUNCE] New committer: Yichi Zhang

Nice work Yichi! Congrats! -Rui On Wed, Apr 28, 2021 at 11:50 AM Ankur Goenka wrote: > Congrats Yichi! > > On Thu, Apr 22, 2021 at 10:13 AM Yichi Zhang wrote: > >> Thanks everyone! It's my honor and I hope I can make more contributions >> in the future! >> >> On Thu, Apr 22, 2021 at 10:11 AM

Re: [DISCUSSION] TPC-DS benchmark via Beam SQL, issues

for a key in memory). -Rui On Tue, Apr 27, 2021 at 11:25 AM Brian Hulette wrote: > > > On Tue, Apr 27, 2021 at 10:25 AM Rui Wang wrote: > >> >> >> On Tue, Apr 27, 2021 at 9:10 AM Alexey Romanenko < >> aromanenko@gmail.com> wrote: >> >>&

Re: [DISCUSSION] TPC-DS benchmark via Beam SQL, issues

On Tue, Apr 27, 2021 at 9:10 AM Alexey Romanenko wrote: > Hello all, > > I try to run a Beam implementation [1] of TPC-DS benchmark [2] and I > observe that most of the queries don’t pass because of different reasons > (see below). I run it with Spark Runner but the issues, I believe, are >

Re: [ANNOUNCE] New committer: Ning Kang

Congrats! -Rui On Tue, Mar 23, 2021 at 1:05 PM Yichi Zhang wrote: > Congratulations Ning! > > On Tue, Mar 23, 2021 at 1:00 PM Robin Qiu wrote: > >> Congratulations Ning! >> >> On Tue, Mar 23, 2021 at 12:56 PM Ahmet Altay wrote: >> >>> Congratulations Ning! >>> >>> On Tue, Mar 23, 2021 at

[Proposal] Support State Batching and Prefetching over FnApi

Hi Community, Andrew Crites and I drafted a document to discuss how to support state prefetching and batching over FnApi, which seems a missing functionality in FnApi. This will help us support Java state readLater() Api over FnApi. Please see:

Re: [ANNOUNCE] New committer: Piotr Szuberski

Congrats! -Rui On Fri, Jan 22, 2021 at 10:48 AM Boyuan Zhang wrote: > Congrats Piotr! > > On Fri, Jan 22, 2021 at 10:47 AM Yichi Zhang wrote: > >> Congrats Piotrek! >> >> On Fri, Jan 22, 2021 at 10:02 AM Robert Burke wrote: >> >>> Congrats Piotr! >>> >>> On Fri, Jan 22, 2021, 10:00 AM

Re: [ANNOUNCE] New PMC Member: Chamikara Jayalath

Congratulations, Cham! -Rui On Thu, Jan 21, 2021 at 3:15 PM Robert Bradshaw wrote: > Congratulations, Cham! > > On Thu, Jan 21, 2021 at 3:13 PM Brian Hulette wrote: > >> Great news, congratulations Cham! >> >> On Thu, Jan 21, 2021 at 3:08 PM Robin Qiu wrote: >> >>> Congratulations, Cham! >>>

Re: [PROPOSAL] Preparing for Beam 2.28.0 release

Thanks Cham for working on this! -Rui On Wed, Jan 13, 2021 at 11:32 AM Kyle Weaver wrote: > Thanks for stepping up Cham! > > Remember to mark critical JIRA issues as release blockers everybody! > > On Wed, Jan 13, 2021 at 11:25 AM Chamikara Jayalath > wrote: > >> Hi All, >> >> Beam 2.28.0

Re: More than one parameter IN for SQL UDF?

Even if not considering CombineFn, but just thinking about the aggregation function itself, I find it hard to model an aggregation function with more than one column (though aggregation function can have multiple non-aggregate parameters). The pair idea (in SQL it could be a struct) makes more

Re: Farewell mail

Thank you Piotr for all your contributions so far! Wish all the best! -Rui On Wed, Dec 16, 2020 at 12:36 PM Ismaël Mejía wrote: > Thanks Piotr, > > You made an impact on Beam! Best wishes in the future projects and > feel welcome whenever you want to contribute again. > > Ismaël > > > > On

Re: Bigtable for BeamSQL - question about the schema design

with the onlyReadLatest option. > > >> >> On 2020/11/06 20:43:03, Ismaël Mejía wrote: >> > Thanks for the references Rui. I think it is worth to consider how >> > open source systems do it. >> > The great thing about this is that we could 'easily

Re: Question about LOGICAL_AND

Or the question is, which BeamSQL dialect you are using? -Rui On Thu, Nov 12, 2020 at 12:41 PM Robin Qiu wrote: > Hi Sonam, AND operator is already defined by Calcite and the mapping is > here: >

Re: Bigtable table for BeamSQL - request for a review

Thanks Piotr, I should be able to have an initial review by the end of this week. -Rui On Thu, Nov 12, 2020 at 10:20 AM Piotr Szuberski < piotr.szuber...@polidea.com> wrote: > I've finished the Bigtable for BeamSQL with read operation (for now > without filters) - would anyone like to

Re: Bigtable for BeamSQL - question about the schema design

Another two references are from how Flink and Spark uses HBase by SQL: https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/connectors/hbase.html https://stackoverflow.com/questions/39530938/sparksql-on-hbase-tables -Rui On Thu, Nov 5, 2020 at 9:46 AM Piotr Szuberski wrote: >

Re: [ANNOUNCE] Beam 2.25.0 Released

Thank you Robin! -Rui On Mon, Oct 26, 2020 at 11:44 AM Pablo Estrada wrote: > Thanks Robin! > > On Mon, Oct 26, 2020 at 11:06 AM Robin Qiu wrote: > >> The Apache Beam team is pleased to announce the release of version 2.25.0. >> >> Apache Beam is an open source unified programming model to

Re: [PROPOSAL] Preparing for Beam 2.25.0 release

Thanks Robin for working on this! -Rui On Wed, Sep 9, 2020 at 10:11 AM Robin Qiu wrote: > Hello everyone, > > The next Beam release (2.25.0) is scheduled to be cut on September 23 > according to the release calendar [1]. > > I'd like to volunteer myself to handle this release. I plan on

Re: [ANNOUNCE] New committer: Heejong Lee

Congrats, Heejong! -Rui On Tue, Sep 8, 2020 at 11:26 AM Robin Qiu wrote: > Congrats, Heejong! > > On Tue, Sep 8, 2020 at 11:23 AM Valentyn Tymofieiev > wrote: > >> Congratulations, Heejong! >> >> On Tue, Sep 8, 2020 at 11:14 AM Ahmet Altay wrote: >> >>> Hi everyone, >>> >>> Please join me

Re: [PROPOSAL] Preparing for Beam 2.24.0 release

Awesome! -Rui On Thu, Aug 6, 2020 at 4:14 PM Ahmet Altay wrote: > +1 - Thank you Daniel!! > > On Wed, Jul 29, 2020 at 4:30 PM Daniel Oliveira > wrote: > >> > You probably meant 2.24.0. >> >> Thanks, yes I did. Mark "Fix Version/s" as "2.24.0" everyone. :) >> >> On Wed, Jul 29, 2020 at 4:14

Re: Use Coder message for cross-lang ExternalConfigurationPayload?

I can help review the Java change. -Rui On Thu, Aug 6, 2020 at 9:53 AM Brian Hulette wrote: > The PR for this is up now: https://github.com/apache/beam/pull/12481 > Any volunteers to help review? We may want a separate reviewer for Python > and Java changes. > > Brian > > On Wed, Aug 5, 2020

Re: Git commit history: "fixup" commits

+1 thanks Alexey. My apologies that I merged such a case recently (but not intentionally). I tried to use the "squash and merge" button with a consolidated commit message. After clicking the button, github showed "failed to merge" and gave a retry button, and after clicking that retry button,

Re: [DISCUSS] Remove JavaBeamZetaSQL and JavaBeamZetaSQLJava11 PreCommits

a precommit (which calls "buildDependents") but I have not figured > it out. > > Kenn > > On Tue, Jul 28, 2020 at 4:13 PM Rui Wang wrote: > >> Hi community, >> >> I observed that when there is a BeamSQL related PR, there will be four >> precommits: SQL

[DISCUSS] Remove JavaBeamZetaSQL and JavaBeamZetaSQLJava11 PreCommits

Hi community, I observed that when there is a BeamSQL related PR, there will be four precommits: SQL precommit, JavaBeamZetaSQL Precommit, and their Java11 version. It turns out that SQL precommit will run tests from the Beam ZetaSQL module. Thus we can remove JavaBeamZetaSQL and

Re: Should Location propert of meta sql Table be Nullable ?

I think so. NULL (or call it unknown) is used to distinguish set/not set a field. -Rui On Tue, Jul 21, 2020 at 3:29 PM Brian Hulette wrote: > I think properties should be @Nullable as well then? It's also optional in > the parser. > > On Tue, Jul 21, 2020 at 2:21 PM Rui Wang wr

Re: Should Location propert of meta sql Table be Nullable ?

Hi Jayendra, The "location" of a table is where the table data stores. So it could be null because that field in parser is optional [1] [1]: https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/src/main/codegen/includes/parserImpls.ftl#L177 -Rui On Tue, Jul 21, 2020 at 9:40 AM

Re: Chronically flaky tests

Is there an observation that enabling tenacity improves the development experience on Python SDK? E.g. less wait time to get PR pass and merged? Or it might be a matter of a right number of retry to align with the "flakiness" of a test? -Rui On Thu, Jul 16, 2020 at 10:38 AM Valentyn Tymofieiev

Re:

Welcome! -Rui On Fri, Jul 10, 2020 at 10:33 AM Kenneth Knowles wrote: > Welcome to dev@ ! > > On Fri, Jul 10, 2020 at 2:14 AM Maximilian Michels wrote: > >> Welcome Emily! Looking forward to your questions. >> >> Cheers, >> Max >> >> On 08.07.20 20:07, Emily Ye wrote: >> > Greetings,

Re: Request for Java PR review

I didn't hear that has been changed so assume it's still only committers that can see suggested reviewers, thus picking up someone based on the source code history could be the feasible solution for non-committers. An improvement though could be when picking up someone from the history, you can

Re: Match_Recognize Design Documentation

/s.apache.org/beam-sql-pattern-recognization > > @Rui Wang helped me finish the documentation (I am > very grateful for his help). I would very much appreciate it if there are > additional suggestions! > > Many thanks, > Qihang >

Re: [ANNOUNCE] New PMC Member: Alexey Romanenko

Congrats! -Rui On Tue, Jun 16, 2020 at 2:42 PM Ankur Goenka wrote: > Congratulations Alexey! > > On Tue, Jun 16, 2020 at 2:41 PM Thomas Weise wrote: > >> Congratulations! >> >> >> On Tue, Jun 16, 2020 at 1:27 PM Valentyn Tymofieiev >> wrote: >> >>> Congratulations! >>> >>> On Tue, Jun 16,

Re: [PROPOSAL] Preparing for Beam 2.23.0 release

Thank you Valentyn! On Mon, Jun 15, 2020 at 1:08 PM Ahmet Altay wrote: > Thank you Valentyn! > > On Mon, Jun 15, 2020 at 12:46 PM Ankur Goenka wrote: > >> Thanks Valentyn! >> >> On Mon, Jun 15, 2020 at 12:41 PM Kyle Weaver wrote: >> >>> Sounds good, thanks Valentyn! >>> >>> On Mon, Jun 15,

Re: Jira components for cross-language transforms

+1 on dedicated components for cross-language transform. It might be easy to manage to have one component (one tag for all SDK) rather than multiple ones. Re Ashwin, Cham knows more than me. AFAIK, cross-language transforms will maximize code reuse for newly developed SDK (e.g. IO transforms

Re: [ANNOUNCE] New committer: Robin Qiu

Nice! Congrats! -Rui On Tue, May 19, 2020 at 11:13 AM Pablo Estrada wrote: > yoohoo : ) > > On Tue, May 19, 2020 at 11:03 AM Yifan Zou wrote: > >> Congratulations, Robin! >> >> On Tue, May 19, 2020 at 10:53 AM Udi Meiri wrote: >> >>> Congratulations Robin! >>> >>> On Tue, May 19, 2020,

Re: [PROPOSAL] Preparing for Beam 2.22.0 release

Thank you, Brian! -Rui On Wed, May 6, 2020 at 9:59 AM Ahmet Altay wrote: > Thank you, Brian. > > On Mon, May 4, 2020 at 1:59 PM Luke Cwik wrote: > >> Thanks Brian. >> >> On Mon, May 4, 2020 at 10:57 AM Kyle Weaver wrote: >> >>> Thanks Brian! >>> >>> I'd also like to remind everyone to

Re: Google Summer of Code 2020 [Accepted Proposal]

Welcome! -Rui On Tue, May 5, 2020 at 1:58 PM Chamikara Jayalath wrote: > Congrats! > > On Tue, May 5, 2020 at 1:34 PM Robert Bradshaw > wrote: > >> Congratulations and welcome! >> >> On Tue, May 5, 2020 at 12:46 PM Ismaël Mejía wrote: >> > >> > Hello Aldair, >> > You were added in JIRA as a

Re: GSoC 2020: Congratulations, your proposal with The Apache Software Foundation has been accepted!

Beam. Thanks so much >> for your support during the application period, specially to my mentor Rui >> Wang. >> >> Please let me know if you have suggestions or ideas for my project. >> >> Cheers, >> John >> >> -- Forwarded messag

Re: GSoC 2020: Congratulations, your proposal with The Apache Software Foundation has been accepted!

>> you guys in the aggregation analytics functionality of Beam. Thanks so much >> for your support during the application period, specially to my mentor Rui >> Wang. >> >> Please let me know if you have suggestions or ideas for my project. >> >> Cheers, >>

Re: Greetings from Tyson

Welcome! -Rui On Wed, Apr 29, 2020, 3:13 PM Brian Hulette wrote: > Welcome Tyson! > > On Wed, Apr 29, 2020 at 2:54 PM Ahmet Altay wrote: > >> Welcome! >> >> On Tue, Apr 28, 2020 at 3:06 PM Hannah Jiang >> wrote: >> >>> Welcome to the community! >>> >>> >>> On Tue, Apr 28, 2020 at 2:45 PM

Re: [ANNOUNCE] Beam 2.20.0 Released

/tree/release-2.20.0? >>> >>> On Fri, Apr 24, 2020 at 9:04 AM Jan Lukavský wrote: >>> >>>> Hi Rui, >>>> >>>> thanks making for this release! Is is possible we are missing git tag >>>> for this release? I cannot find it. >>

Re: Website publish jobs fail recently

>> >>> Did we end up emailing builds@ or should this be filed as a ticket to >>> infra ? >>> >>> +Rui Wang -- This is preventing Rui from updating >>> the website post 2.20 release. >>> >>> On Tue, Apr 14, 2020 at 9:01 PM Kenneth Kn

Re: [ANNOUNCE] Beam 2.20.0 Released

Note that due to a bug on infrastructure, the website change failed to publish. But 2.20.0 artifacts are available to use right now. -Rui On Thu, Apr 16, 2020 at 11:45 AM Rui Wang wrote: > The Apache Beam team is pleased to announce the release of version 2.20.0. > > Apache Beam i

[ANNOUNCE] Beam 2.20.0 Released

. -- Rui Wang, on behalf of The Apache Beam team

[RELEASE VOTE RESULT] Release 2.20.0, release candidate #2

I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 4 of which are binding: * Ahmet Altay * Kenneth Knowles * Jean-Baptiste Onofré * Robert Bradshaw There are no disapproving votes. Thanks for everyone's help! I'm going to finalize the release and

Re: [VOTE] Release 2.20.0, release candidate #2

ated python quickstarts batch/streaming with python 2.7. >>>> >>>> Thank you Rui! >>>> >>>> On Thu, Apr 9, 2020 at 12:28 PM Valentyn Tymofieiev < >>>> valen...@google.com> wrote: >>>> >>>>> +1. Checked mobile gami

[VOTE] Release 2.20.0, release candidate #2

Hi everyone, Please review and vote on the release candidate #2 for the version 2.20.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Re: [VOTE] Release 2.20.0, release candidate #1

On Mon, Apr 6, 2020 at 3:11 PM Rui Wang wrote: > >> I see. I will also leave the community to decide. >> >> With the unit tests in [1], the fix becomes sufficient (e.g. if the >> community decides that the fix is critical, I will also need to include >> those tests

Re: [VOTE] Release 2.20.0, release candidate #1

; I'll leave it up to the community to decide, but it seems like a pretty > big bug. > > Also, fwiw, there is a PR open that adds a test for this [1], but it was > never merged (it's been open for 12 days). > > [1] https://github.com/apache/beam/pull/11226 > > On Mon, Apr 6, 2020 at 5:52 PM

Re: [VOTE] Release 2.20.0, release candidate #1

at 2:46 PM Steve Niemitz wrote: > timers are essentially broken without it, so I'd say -1 > > On Mon, Apr 6, 2020 at 5:45 PM Rui Wang wrote: > >> ok so the source is consistent with the binary. What undecided is if >> missing that commit is -1, or that can be marked as a k

Re: [VOTE] Release 2.20.0, release candidate #1

low Python >>> containers don't install one of Beam 2.20.0 dependencies, which will be >>> fixed. >>> >>> >>>> I verified the signatures and sources, they all look good, except that >>>> we're missing https://github.com/apache/beam/pull/

Re: [VOTE] Release 2.20.0, release candidate #1

ignatures and sources, they all look good, except that > we're missing https://github.com/apache/beam/pull/11252 if we were hoping > to get that in. The wheel looks fine as well. > > On Mon, Apr 6, 2020 at 12:16 PM Rui Wang wrote: > >> A friendly ping to remind the vote for RC

Re: [VOTE] Release 2.20.0, release candidate #1

ed this ( >> https://issues.apache.org/jira/browse/BEAM-9388) but we did not get a >> chance to work on it. >> >> >>> >>> On Fri, Apr 3, 2020 at 8:16 PM Rui Wang wrote: >>> > >>> > Add Maven and Java versions that were used for buil

Re: [VOTE] Release 2.20.0, release candidate #1

Add Maven and Java versions that were used for building java artifacts: maven: 3.6.2 java: 1.8.0_181 -Rui On Thu, Apr 2, 2020 at 9:06 PM Rui Wang wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version 1.20.0, > as follows: > [ ] +1, Approve

[VOTE] Release 2.20.0, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the version 1.20.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Re: Google Summer of Coding Proposal

eviously, I had some experience with Apache Parquet, Apache > Carbondata and Apache Spark. I have long been interested in participating > in some ASF projects, particularly databases projects. > > One of the Beam projects caught my attention and I started to contact > mentor Mr. Rui Wa

Re: ZetaSQL to Calcite translation layer

Hi Steve, Could you clarify a bit: could you use [1] directly to solve your case? If not, why? [1]: https://mvnrepository.com/artifact/org.apache.beam/beam-sdks-java-extensions-sql-zetasql/2.17.0 -Rui On Thu, Mar 26, 2020 at 1:23 PM Steve Niemitz wrote: > Oh I think I actually remember

Re: [Release 2.20.0 Reminder] Update changes.md

Typo: I will review changes.md after a *RC* passes voting. -Rui On Wed, Mar 25, 2020 at 1:42 PM Rui Wang wrote: > Hi Community, > > I am making progress for cutting RC0 (waiting for a few JIRA blockers). > Meanwhile, please update [1] if you have relevant bits for: highlights, ne

[Release 2.20.0 Reminder] Update changes.md

Hi Community, I am making progress for cutting RC0 (waiting for a few JIRA blockers). Meanwhile, please update [1] if you have relevant bits for: highlights, new features, known issues, bug fixes,etc. that are in the 2.20.0 release branch. I will review changes.md after a PR passes voting and

Re: [GSoC 2020 Proposal] BEAM-9198 BeamSQL aggregation analytics functionality

Welcome to Beam community! I will check the proposal soon and we should be good on GSoC timeline. Also anyone in the Beam community can feel free to comment on it. -Rui On Mon, Mar 23, 2020 at 4:53 PM John Mora wrote: > Hi all, > > I really hope that all of you and your family are well. As I

Run Python PreCommit break?

Hi Community, Is python precommit breaking? I have observed a consistent test case failure from apache_beam.runners.portability.portable_runner_test.PortableRunnerTest.test_group_by_key [1] in the release branch. It might have been fixed in the master branch. Does anyone have insight on it?

Re: [DISCUSS] Query external resources as Tables with Beam SQL

ABLE" does exactly what you describe in > "CREATE TABLE". You could add a table property to set the CreateDisposition > if you wanted to change that behavior. > > Andrew > > On Thu, Mar 5, 2020 at 11:10 AM Rui Wang wrote: > >> "CREATE TABLE" c

Re: [DISCUSS] Query external resources as Tables with Beam SQL

EATE EXTERNAL TABLE" > distinction. We added the "EXTERNAL" to make it clear that Beam wasn't > storing the table. Most of our current table providers will create the > underlying table as needed. > > Andrew > > On Thu, Mar 5, 2020 at 10:47 AM Rui Wang wrote:

Re: [DISCUSS] Query external resources as Tables with Beam SQL

There are two pieces of news from the proposal: 1. Spanner source in SQL. (Welcome to contribute it) 2. CREATE TABLE statement than CREATE EXTERNAL TABLE (the difference is whether assuming the table exists or not) There is a table property in the statement already that you can reuse to save

[Discuss] Propose Calcite Vendor Release (1.22.0)

Hi Community, As Calcite is closing to finish their 1.22.0 release, I want to propose a Calcite vendor release and I am volunteer to be the release manager. I will wait until next Monday(03/09) to kick off the release if there is no objection. Best, Rui Wang

Re: [PROPOSAL] Preparing for Beam 2.20.0 release

PM Rui Wang wrote: > Hi community, > > Just fyi: > > The 2.20.0 release branch should be cut yesterday (02/26) per schedule. > However as our python precommit was broken so I didn't cut the branch. > > I am closely working with PR [1] owner to fix the python precommit.

Re: [PROPOSAL] Preparing for Beam 2.20.0 release

n introduced by the move to vendored gRPC 1.26.0 and >>> it >>> probably will require an extra vendored gRPC release so better to give it >>> some priority. >>> >>> >>> On Wed, Feb 12, 2020 at 6:48 PM Ahmet Altay wrote: >>> >>>&g

Re: [ANNOUNCE] New committer: Jincheng Sun

Congrats! -Rui On Mon, Feb 24, 2020 at 11:24 PM Austin Bennett wrote: > Congrats! > > On Mon, Feb 24, 2020, 11:22 PM Alex Van Boxel wrote: > >> Congrats! >> >> _/ >> _/ Alex Van Boxel >> >> >> On Mon, Feb 24, 2020 at 8:13 PM Kyle Weaver wrote: >> >>> Thanks Jincheng for all your work on

Re: Intend to participate in GSOC 2020

Hello Jack, Regarding how to get started with Beam, as you are pursuing tasks in GSOC 2020, each task involves different components of Beam so the way to start will differ. It would be better to ask the Jira creator. You could directly ask your questions in GSOC 2020 Jiras. For me I opened the

[PROPOSAL] Preparing for Beam 2.20.0 release

Hi all, The next (2.20.0) release branch cut is scheduled for 02/26, according to the calendar . I would like to volunteer myself to do this release. The plan is to cut the branch on that date,

Re: Jenkins jobs not running for my PR 10438

Tried to trigger tests in the PR. Let's continue following up there. -Rui On Wed, Feb 5, 2020 at 4:07 PM Tomo Suzuki wrote: > Hi Beam Committers, > > Would you run the precommit checks for > https://github.com/apache/beam/pull/10769 > with the following 6 additional commands (one command per

Re: [ANNOUNCE] Beam 2.18.0 Released

Thank you Udi for taking care of Beam 2.18.0 release! -Rui On Tue, Jan 28, 2020 at 10:59 AM Udi Meiri wrote: > The Apache Beam team is pleased to announce the release of version 2.18.0. > > Apache Beam is an open source unified programming model to define and > execute data processing

Re: GSOC announced!

ther sources I should refer > to? > > I will open a separate email to get permission on JIRA. > > Cheers. > Bin > > On Wed, Jan 15, 2020 at 1:16 PM Rui Wang wrote: > >> Hi Xinbin, >> >> I assume you want to contribute to Apache Beam whil

Re: Jenkins jobs not running for my PR 10438

at 14:32 Tomo Suzuki wrote: > >> Hi Rui, >> (Thank you for quick response) >> >> Would you run one command per one comment? I don't think Jenkins >> recognizes multiple at once. >> >> On Thu, Jan 23, 2020 at 2:25 PM Rui Wang wrote: >> > >>

Re: Jenkins jobs not running for my PR 10438

Done On Thu, Jan 23, 2020 at 11:20 AM Tomo Suzuki wrote: > Hi Beam Committers, > > I appreciate if you can run precommit checks for > https://github.com/apache/beam/pull/10674 > plus the following 6 extra commands: > > Run Java PostCommit > Run Java HadoopFormatIO Performance Test > Run

Re: Jenkins jobs not running for my PR 10438

te: >> >>> Done >>> >>> On Tue, Jan 21, 2020 at 4:03 PM Kirill Kozlov >>> wrote: >>> >>>> Forgot to paste a link to a PR: >>>> https://github.com/apache/beam/pull/10649 >>>> >>>> On

Re: Jenkins jobs not running for my PR 10438

Done but I am not seeing tests are triggered by those two commands. On Tue, Jan 21, 2020 at 3:42 PM Kirill Kozlov wrote: > Hello again! > > Could someone trigger tests on this PR please? > *Run SQL postcommit* > *Run JavaBeamZetaSQL PreCommit* > > On Mon, Jan 20, 2020 at 2:38 PM Kirill Kozlov

Re: GSOC announced!

Thanks! > Bin > > On Wed, Jan 15, 2020 at 8:52 AM Ismaël Mejía wrote: > >> Thanks for bringing this info. +1 on the Nexmark + Python + Portability >> project. >> Let's sync on that one Pablo. I am interested on co-mentoring it. >> >> >> On Tue

Re: GSOC announced!

Great! I will try to propose something for BeamSQL. -Rui On Tue, Jan 14, 2020 at 10:40 AM Pablo Estrada wrote: > Hello everyone, > > As with every year, the Google Summer of Code has been announced[1], so we > can start preparing for it if anyone is interested. It's early in the > process for

Re: No AfterWatermark firings in Dataflow

If it indeed happened as you have described, I will be very interested in the expected behaviour. Something I remembered before: the trigger condition meets just gives the runner/engine "permission" to fire, but runner/engine may not fire immediately. But I don't know if the engine/runner will

Re: [PROPOSAL] Preparing for Beam 2.19 release

Thanks Boyuan for taking care of 2.19 release! -Rui On Wed, Jan 8, 2020 at 7:18 PM Boyuan Zhang wrote: > Hi all, > > The next (2.19) release branch cut is scheduled forJan 15th, according to > the calendar >

Re: Full stream-stream join semantics

there can be two copies of the >>> stateful dofn, one running at watermark and the other at (watermark - >>> allowed lateness). One would produce ON_TIME (maybe wrong) results, the >>> other would produce LATE but correct ones. Being able to compare them, the >>>

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congrats! -Rui On Wed, Nov 20, 2019 at 11:48 AM Valentyn Tymofieiev wrote: > Congrats, Daniel! > > On Wed, Nov 20, 2019 at 11:47 AM Kenneth Knowles wrote: > >> Hi all, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Daniel Oliveira >> >> Daniel introduced

Re: [ANNOUNCE] New committer: Brian Hulette

Congrats! -Rui On Fri, Nov 15, 2019 at 8:16 AM Thomas Weise wrote: > Congratulations! > > > On Fri, Nov 15, 2019 at 6:34 AM Connell O'Callaghan > wrote: > >> Well done Brian!!! >> >> Kenn thank you for sharing >> >> On Fri, Nov 15, 2019 at 6:31 AM Cyrus Maden wrote: >> >>> Congrats

Re: Outreachy Applicant

Oct 15, 2019 at 10:16 PM Rui Wang wrote: > >> Sorry Omshi. I waited a bit for someone to add your JIRA id. But we can >> start without it. I will find a starter task and send it to you. >> >> >> -Rui >> >> On Tue, Oct 15, 2019 at 8:54 AM Abhishek

Re: Outreachy Applicant

d, Oct 9, 2019, 11:24 PM Omshi Samal > wrote: > > > > > Hello! > > > > > > My username is omshi. > > > > > > > > > > > > On Wed, Oct 9, 2019 at 10:38 PM Rui Wang wrote: > > > > > >> Welcome! Can you share your username/ID of [1]?

Re: Outreachy Applicant

Welcome! Can you share your username/ID of [1]? [1]: https://jira.apache.org/jira/secure/Dashboard.jspa -Rui On Wed, Oct 9, 2019 at 10:05 AM Omshi Samal wrote: > Hello everyone! > > Hope you're doing well! > I'm Omshi from Bhubaneswar, India and I'm an Outreachy applicant hoping to > work on

Re: Contributor permission

I am not aware of starter tags. Which component/project you are interested in? -Rui On Mon, Oct 7, 2019 at 11:02 AM Leonardo Miguel < leonardo.mig...@arquivei.com.br> wrote: > Hi, > > I've been working with Beam for three years now and I would like to start > contributing. > Could someone

Re: outreachy intern

Welcome Diksha! Can you share your username of [1]? [1]: https://jira.apache.org/jira/secure/Dashboard.jspa -Rui On Fri, Oct 4, 2019 at 9:44 AM Thomas Weise wrote: > Welcome, Diksha! > > > On Fri, Oct 4, 2019 at 8:47 AM diksha gupta > wrote: > >> Hi, I am Diksha Gupta, outreachy intern. >>

Re: Outreachy applicant

Hi Ismael, Sorry I wasn't aware that you also has a project. Carlos has contacted me on SQL before. Next time I will ask people to also include their interest of project in introduction emails. -Rui On Thu, Oct 3, 2019 at 9:47 AM Rui Wang wrote: > Hi Isamel, > > Carlos is an

Re: Outreachy applicant

Hi Isamel, Carlos is an Outreachy applicant so I will take care of starter tasks. -Rui On Thu, Oct 3, 2019 at 6:31 AM Ismaël Mejía wrote: > Hello Carlos! > > Just added you as a contributor so you can self assign the tickets you > want to work on > What project are you interested in? > >

Re: Outreachy applicant

Can you copy your username? That link directs me to my own profile. -Rui On Wed, Oct 2, 2019 at 1:34 PM Mujuzi Moses wrote: > JIRA: https://issues.apache.org/jira/secure/ViewProfile.jspa > > On Wed, Oct 2, 2019, 9:00 PM Rui Wang wrote: > >> Welcome! Welcome! >> >

Share Outreachy project progress

Hi Community, I submitted an Outreachy project proposal on behalf of Apache Beam(it's related to BeamSQL, yeah!). The workflow of Outreachy project is, in Oct 2019, applicants should try to make contributions to projects (for us it's Beam). After that, there will be a final match between

Re: Outreachy applicant

Welcome! Welcome! Have you already created an account on [1]? We can add your JIRA account id to apache beam as the first step. [1]: https://jira.apache.org/jira/secure/Dashboard.jspa -Rui On Wed, Oct 2, 2019 at 6:26 AM Mujuzi Moses wrote: > Hello there, my name is Mujuzi Moses from Uganda

Re: [ANNOUNCE] New committer: Alan Myrvold

Congrats! -Rui On Fri, Sep 27, 2019 at 9:54 AM Pablo Estrada wrote: > Yooh! : D > > On Fri, Sep 27, 2019 at 9:53 AM Yifan Zou wrote: > >> Congratulations, Alan! >> >> On Fri, Sep 27, 2019 at 9:18 AM Ahmet Altay wrote: >> >>> Hi, >>> >>> Please join me and the rest of the Beam PMC in

Re: Pointers on Contributing to Structured Streaming Spark Runner

ma to > Spark, so it can be optimized in the planner layer. It will be great to > hear back your plans on that. > > Congrats on this great work! > Thanks, > Xinyu > > On Wed, Sep 11, 2019 at 6:02 PM Rui Wang wrote: > >> Hello Etienne, >> >> Your slide mentione

Re: Pointers on Contributing to Structured Streaming Spark Runner

Hello Etienne, Your slide mentioned that streaming mode development is blocked because Spark lacks supporting multiple-aggregations in its streaming mode but design is ongoing. Do you have a link or something else to their design discussion/doc? -Rui On Wed, Sep 11, 2019 at 5:10 PM Etienne

Re: [VOTE] Vendored Dependencies Release

ifacts from dist.apache.org to archive.apache.org >> using Subversion. """ >> >> Is there a PMC member could help on this operation to move [1] to >> "release" repo? >> >> [1]: [1] >> https://dist.apache.org/repos/dist/dev/beam/vendo

  1   2   3   >