[jira] [Created] (BEAM-3216) Add an integration test for HadoopInputFormatIO Read transform

Chamikara Jayalath created BEAM-3216: Summary: Add an integration test for HadoopInputFormatIO Read transform Key: BEAM-3216 URL: https://issues.apache.org/jira/browse/BEAM-3216 Project: Beam

[jira] [Created] (BEAM-3217) Add a performance test for HadoopInputFormatIO

Chamikara Jayalath created BEAM-3217: Summary: Add a performance test for HadoopInputFormatIO Key: BEAM-3217 URL: https://issues.apache.org/jira/browse/BEAM-3217 Project: Beam Issue

[jira] [Commented] (BEAM-2689) Provide a fixed URL to the latest version of the source code

[ https://issues.apache.org/jira/browse/BEAM-2689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256735#comment-16256735 ] Jean-Baptiste Onofré commented on BEAM-2689: +1 At least release guide update. > Provide a

[jira] [Created] (BEAM-3211) Add an integration test for TextIO ReadAll transform and dynamic writes

Chamikara Jayalath created BEAM-3211: Summary: Add an integration test for TextIO ReadAll transform and dynamic writes Key: BEAM-3211 URL: https://issues.apache.org/jira/browse/BEAM-3211 Project:

[jira] [Assigned] (BEAM-3216) Add an integration test for HadoopInputFormatIO Read transform

[ https://issues.apache.org/jira/browse/BEAM-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-3216: Assignee: Łukasz Gajowy (was: Chamikara Jayalath) > Add an integration test for

[jira] [Assigned] (BEAM-3211) Add an integration test for TextIO ReadAll transform and dynamic writes

[ https://issues.apache.org/jira/browse/BEAM-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-3211: Assignee: Łukasz Gajowy (was: Chamikara Jayalath) > Add an integration test for

[jira] [Assigned] (BEAM-3215) Add a performance test for HBaseIO

[ https://issues.apache.org/jira/browse/BEAM-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-3215: Assignee: Kamil Szewczyk (was: Chamikara Jayalath) > Add a performance test for

[jira] [Assigned] (BEAM-3217) Add a performance test for HadoopInputFormatIO

[ https://issues.apache.org/jira/browse/BEAM-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-3217: Assignee: Łukasz Gajowy (was: Chamikara Jayalath) > Add a performance test for

[jira] [Created] (BEAM-3212) Add an integration tests for MongoDbIO Read/Write transforms

Chamikara Jayalath created BEAM-3212: Summary: Add an integration tests for MongoDbIO Read/Write transforms Key: BEAM-3212 URL: https://issues.apache.org/jira/browse/BEAM-3212 Project: Beam

[jira] [Commented] (BEAM-3212) Add an integration tests for MongoDbIO Read/Write transforms

[ https://issues.apache.org/jira/browse/BEAM-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256752#comment-16256752 ] Chamikara Jayalath commented on BEAM-3212: -- cc: [~jbonofre] feel free to take this if you are

[jira] [Commented] (BEAM-3212) Add an integration tests for MongoDbIO Read/Write transforms

[ https://issues.apache.org/jira/browse/BEAM-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256755#comment-16256755 ] Jean-Baptiste Onofré commented on BEAM-3212: It sounds good ! Thanks ! > Add an integration

[jira] [Created] (BEAM-3215) Add a performance test for HBaseIO

Chamikara Jayalath created BEAM-3215: Summary: Add a performance test for HBaseIO Key: BEAM-3215 URL: https://issues.apache.org/jira/browse/BEAM-3215 Project: Beam Issue Type: Test

[jira] [Created] (BEAM-3213) Add a performance test for MongoDBIO

Chamikara Jayalath created BEAM-3213: Summary: Add a performance test for MongoDBIO Key: BEAM-3213 URL: https://issues.apache.org/jira/browse/BEAM-3213 Project: Beam Issue Type: Test

[jira] [Assigned] (BEAM-3212) Add an integration tests for MongoDbIO Read/Write transforms

[ https://issues.apache.org/jira/browse/BEAM-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-3212: -- Assignee: Jean-Baptiste Onofré (was: Chamikara Jayalath) > Add an integration

Build failed in Jenkins: beam_PerformanceTests_Python #568

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam7 (beam) in workspace

[jira] [Assigned] (BEAM-3206) Spark runner does not shut down after pipeline completion

[ https://issues.apache.org/jira/browse/BEAM-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-3206: -- Assignee: Ben Sidhom (was: Amit Sela) > Spark runner does not shut down after pipeline

[jira] [Commented] (BEAM-2689) Provide a fixed URL to the latest version of the source code

[ https://issues.apache.org/jira/browse/BEAM-2689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256730#comment-16256730 ] Ismaël Mejía commented on BEAM-2689: Bringing back this one since I suppose we need to automate/update

[jira] [Assigned] (BEAM-3214) Add an integration test for HBaseIO Read/Write transforms

[ https://issues.apache.org/jira/browse/BEAM-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-3214: Assignee: Kamil Szewczyk (was: Chamikara Jayalath) > Add an integration test for

[1/2] beam git commit: [BEAM-3206] Shut down executor when spark runner finishes

Repository: beam Updated Branches: refs/heads/master 0df7ba9d6 -> f10399d7c [BEAM-3206] Shut down executor when spark runner finishes The Spark runner previously left the JVM process hanging after completion because its one-time use executor service was never shut down. This change shuts down

[jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257111#comment-16257111 ] ethanhunt999 commented on BEAM-1920: Can u please help us with the pull request, from where I can

Build failed in Jenkins: beam_PostCommit_Python_Verify #3565

See -- [...truncated 883.25 KB...] test_getitem_param_must_be_tuple (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok test_getitem_param_must_have_length_2

[jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256995#comment-16256995 ] Chaoran Yu commented on BEAM-1920: -- [image: Earn.com] Sent by Earn.com

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #286

See Changes: [iemejia] [BEAM-3206] Shut down executor when spark runner finishes -- [...truncated 207.52 KB...] ],

[jira] [Commented] (BEAM-2113) Apex Runner is not able to submit any job to YARN

[ https://issues.apache.org/jira/browse/BEAM-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256978#comment-16256978 ] ethanhunt999 commented on BEAM-2113: I am getting the same issue. Can anyone help me out here. I am

[GitHub] beam pull request #4138: Shut down executor when spark runner finishes

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/4138 ---

[2/2] beam git commit: This closes #4138

This closes #4138 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f10399d7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f10399d7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f10399d7 Branch:

Build failed in Jenkins: beam_PostCommit_Python_Verify #3564

See Changes: [iemejia] [BEAM-3206] Shut down executor when spark runner finishes -- [...truncated 933.41 KB...] copying

[jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256987#comment-16256987 ] ethanhunt999 commented on BEAM-1920: We are not able to find any source code that supports Spark 2.*.

[jira] [Resolved] (BEAM-3206) Spark runner does not shut down after pipeline completion

[ https://issues.apache.org/jira/browse/BEAM-3206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-3206. Resolution: Fixed Fix Version/s: 2.3.0 > Spark runner does not shut down after pipeline

[jira] [Assigned] (BEAM-1189) Add guide for release verifiers in the release guide

[ https://issues.apache.org/jira/browse/BEAM-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-1189: - Assignee: Kenneth Knowles (was: Griselda Cuevas Zambrano) > Add guide for release

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4364

See

[jira] [Resolved] (BEAM-3210) The problem about the use of waitUntilFinish() in DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-3210. - Resolution: Not A Problem Assignee: Luke Cwik (was: Thomas Groh) Fix Version/s: (was:

[jira] [Commented] (BEAM-2524) Update Google Cloud Console URL returned by DataflowRunner to support regions.

[ https://issues.apache.org/jira/browse/BEAM-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257336#comment-16257336 ] ASF GitHub Bot commented on BEAM-2524: -- GitHub user lostluck opened a pull request:

[jira] [Created] (BEAM-3218) Change PubsubBoundedWriter to check total byte size

Thang Nguyen created BEAM-3218: -- Summary: Change PubsubBoundedWriter to check total byte size Key: BEAM-3218 URL: https://issues.apache.org/jira/browse/BEAM-3218 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-3210) The problem about the use of waitUntilFinish() in DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257227#comment-16257227 ] Luke Cwik commented on BEAM-3210: - Your using a non-thread safe data structure and not synchronizing

Build failed in Jenkins: beam_PerformanceTests_Python #569

See Changes: [iemejia] [BEAM-3206] Shut down executor when spark runner finishes -- Started by timer [EnvInject] - Loading node environment variables. Building

[GitHub] beam pull request #4144: [BEAM-2524] Update the gcloud cancel command to inc...

GitHub user lostluck opened a pull request: https://github.com/apache/beam/pull/4144 [BEAM-2524] Update the gcloud cancel command to include the --region flag. Have the cancel command provided by the Dataflow Runner specify the region for the job, so jobs started in other regions

[GitHub] beam pull request #4145: Many simplifications to WriteFiles

GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/4145 Many simplifications to WriteFiles Commits explain what's going on. I recommend reviewing each commit individually. Most importantly, this unifies windowed and unwindowed finalize (this is the only

[jira] [Created] (BEAM-3219) DataflowRunner: @Setup not called for batch stateful DoFn

Kenneth Knowles created BEAM-3219: - Summary: DataflowRunner: @Setup not called for batch stateful DoFn Key: BEAM-3219 URL: https://issues.apache.org/jira/browse/BEAM-3219 Project: Beam Issue

[1/3] beam git commit: [BEAM-2709] Add TezRunner

Repository: beam Updated Branches: refs/heads/tez-runner f10399d7c -> da4687a6e http://git-wip-us.apache.org/repos/asf/beam/blob/8994f07e/runners/tez/src/test/java/org/apache/beam/runners/tez/translation/TezDoFnProcessorTest.java

[2/3] beam git commit: [BEAM-2709] Add TezRunner

[BEAM-2709] Add TezRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8994f07e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8994f07e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/8994f07e Branch:

[3/3] beam git commit: This closes #3677: [BEAM-2709] Add TezRunner

This closes #3677: [BEAM-2709] Add TezRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/da4687a6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/da4687a6 Diff:

[jira] [Updated] (BEAM-3219) DataflowRunner: @Setup not called for batch stateful DoFn

[ https://issues.apache.org/jira/browse/BEAM-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3219: -- Affects Version/s: 2.2.0 2.0.0 2.1.0 >

[2/6] beam git commit: [Nexmark] Extract BidGenerator from Generator

[Nexmark] Extract BidGenerator from Generator Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d8a6fad9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d8a6fad9 Diff:

[5/6] beam git commit: [Nexmark] Extract PersonGenerator, StringsGenerator, LongGenerator from Generator

[Nexmark] Extract PersonGenerator, StringsGenerator, LongGenerator from Generator Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7055e0f3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7055e0f3 Diff:

[4/6] beam git commit: [Nexmark] Extract GeneratorCheckpoint into a separate class. Move getNextEvent() call to the top of the stack.

[Nexmark] Extract GeneratorCheckpoint into a separate class. Move getNextEvent() call to the top of the stack. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4fce6401 Tree:

[GitHub] beam pull request #4087: [BEAM-3147] Nexmark Generator refactor

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/4087 ---

[jira] [Created] (BEAM-3220) Design for runner comparison with narrative intro for each runner

Kenneth Knowles created BEAM-3220: - Summary: Design for runner comparison with narrative intro for each runner Key: BEAM-3220 URL: https://issues.apache.org/jira/browse/BEAM-3220 Project: Beam

[06/50] [abbrv] beam git commit: Add A FnService, FnServer to runner Fn Execution

Add A FnService, FnServer to runner Fn Execution A FnService is a closeable BindableService. A FnServer is exactly one FnService and a server which exposes it as an endpoint. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[02/50] [abbrv] beam git commit: NonNull by default in runners/core

NonNull by default in runners/core Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/87b07d83 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/87b07d83 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/87b07d83

[09/50] [abbrv] beam git commit: This closes #4112

This closes #4112 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/51c938d4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/51c938d4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/51c938d4 Branch:

[18/50] [abbrv] beam git commit: This closes #4090: [BEAM-3074] Stage the portable pipeline; put URL in pipeline options

This closes #4090: [BEAM-3074] Stage the portable pipeline; put URL in pipeline options Stage the portable pipeline; put URL in pipeline options Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/219b9caa Tree:

[13/50] [abbrv] beam git commit: This closes #4115

This closes #4115 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2b4a6b5d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2b4a6b5d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2b4a6b5d Branch:

[20/50] [abbrv] beam git commit: Fix expectations in CombineTest

Fix expectations in CombineTest Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a593e490 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a593e490 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a593e490 Branch:

[24/50] [abbrv] beam git commit: Closes #4094

Closes #4094 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4ddfc584 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4ddfc584 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4ddfc584 Branch:

[32/50] [abbrv] beam git commit: Replace the View.As transforms for Dataflow batch because the entire implementation is specialized.

Replace the View.As transforms for Dataflow batch because the entire implementation is specialized. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c2f815c5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c2f815c5 Diff:

[41/50] [abbrv] beam git commit: Specifies numShards on windowed writes examples, as it is now required

Specifies numShards on windowed writes examples, as it is now required Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9c5f8be9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9c5f8be9 Diff:

[46/50] [abbrv] beam git commit: [BEAM-3202] Ensure that PipelineOptions.getOptionsId is always populated.

[BEAM-3202] Ensure that PipelineOptions.getOptionsId is always populated. This closes #4140 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/40100db5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/40100db5 Diff:

[26/50] [abbrv] beam git commit: Closes #4132

Closes #4132 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9f780c96 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9f780c96 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9f780c96 Branch:

[01/50] [abbrv] beam git commit: NonNull by default in runners/core/fn

Repository: beam Updated Branches: refs/heads/tez-runner 2fa4fdecd -> f10399d7c NonNull by default in runners/core/fn Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6fc163e3 Tree:

[23/50] [abbrv] beam git commit: This closes #3988: [BEAM-3052] ReduceFnRunner: Do not manage EOW hold or timer, set GC hold and timer always

This closes #3988: [BEAM-3052] ReduceFnRunner: Do not manage EOW hold or timer, set GC hold and timer always ReduceFnRunner: Do not manage EOW hold or timer, set GC hold and timer always Truncate the very last fixed window if it goes beyond representable time Tidy a troublesome

[50/50] [abbrv] beam git commit: This closes #4138

This closes #4138 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f10399d7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f10399d7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f10399d7 Branch:

[29/50] [abbrv] beam git commit: This closes #4124: [BEAM-3169] Fixes a data loss bug in WriteFiles when used with fire-once triggers

This closes #4124: [BEAM-3169] Fixes a data loss bug in WriteFiles when used with fire-once triggers Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/209bb6d7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/209bb6d7

[12/50] [abbrv] beam git commit: support topicPartition in BeamKafkaTable

support topicPartition in BeamKafkaTable Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/92b3a9ac Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/92b3a9ac Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/92b3a9ac

[04/50] [abbrv] beam git commit: Dataflow: Add option to upload heap dumps to GCS

Dataflow: Add option to upload heap dumps to GCS This flag needs to go in before backend runner code that reads it. It will have no effect until that code is deployed. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2fc1c055

[14/50] [abbrv] beam git commit: Integrate bundle retry code for the DirectRunner

Integrate bundle retry code for the DirectRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9a183f95 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9a183f95 Diff:

[3/6] beam git commit: [Nexmark] Extract AuctionGenerator, PriceGenerator from Generator

[Nexmark] Extract AuctionGenerator, PriceGenerator from Generator Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e895fc82 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e895fc82 Diff:

[1/6] beam git commit: [Nexmark] Extract BidGenerator from Generator

Repository: beam Updated Branches: refs/heads/master f10399d7c -> a52dbeaca http://git-wip-us.apache.org/repos/asf/beam/blob/d8a6fad9/sdks/java/nexmark/src/main/java/org/apache/beam/sdk/nexmark/sources/utils/AuctionGenerator.java

[6/6] beam git commit: This closes #4807: [BEAM-3147] Nexmark Generator refactor

This closes #4807: [BEAM-3147] Nexmark Generator refactor [Nexmark] Extract BidGenerator from Generator [Nexmark] Extract AuctionGenerator, PriceGenerator from Generator [Nexmark] Extract PersonGenerator, StringsGenerator, LongGenerator from Generator [Nexmark] Extract

[30/50] [abbrv] beam git commit: Updated jdbc's pom.xml

Updated jdbc's pom.xml Corrected `io-it-suite-local` comment Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e72e7311 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e72e7311 Diff:

[40/50] [abbrv] beam git commit: This closes #3581

This closes #3581 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c3a96bf3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c3a96bf3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c3a96bf3 Branch:

[39/50] [abbrv] beam git commit: Fixed adding timestamp and id attributes to pubsub messages

Fixed adding timestamp and id attributes to pubsub messages Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f77a8580 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f77a8580 Diff:

[28/50] [abbrv] beam git commit: WriteFiles improvements:

WriteFiles improvements: * More clear and consistent shard number assignment logic * Uses Reshuffle instead of GBK in finalize Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2eea9fee Tree:

[10/50] [abbrv] beam git commit: [BEAM-3060] Adds TextIOIT for DirectRunner and local filesystem

[BEAM-3060] Adds TextIOIT for DirectRunner and local filesystem This is one of multiple commits to resolve the 3060 issue. Currently only local filesystem, relatively small datasets and DirectRunner are supported. More runners, filesystems and larger dataset testing ability (of gigabytes size)

[34/50] [abbrv] beam git commit: [BEAM-2926] Migrate to using a trivial multimap materialization within the Java SDK.

http://git-wip-us.apache.org/repos/asf/beam/blob/5e2593da/runners/spark/src/main/java/org/apache/beam/runners/spark/util/SparkSideInputReader.java -- diff --git

[35/50] [abbrv] beam git commit: [BEAM-2926] Migrate to using a trivial multimap materialization within the Java SDK.

[BEAM-2926] Migrate to using a trivial multimap materialization within the Java SDK. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5e2593da Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5e2593da Diff:

[45/50] [abbrv] beam git commit: [BEAM-3202] Ensure that PipelineOptions.getOptionsId is always populated.

[BEAM-3202] Ensure that PipelineOptions.getOptionsId is always populated. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c234352e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c234352e Diff:

[47/50] [abbrv] beam git commit: [BEAM-3035] Introduces Reify transform

[BEAM-3035] Introduces Reify transform Initially contains stuff from ReifyTimestamps, for reifying/extracting timestamps and windows. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7966b759 Tree:

[21/50] [abbrv] beam git commit: Truncate the very last fixed window if it goes beyond representable time

Truncate the very last fixed window if it goes beyond representable time Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/296cba00 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/296cba00 Diff:

[15/50] [abbrv] beam git commit: This closes #4113

This closes #4113 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2df25db3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2df25db3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2df25db3 Branch:

[42/50] [abbrv] beam git commit: This closes #4137: [BEAM-3195] Specifies numShards on windowed writes examples, as it is now required

This closes #4137: [BEAM-3195] Specifies numShards on windowed writes examples, as it is now required Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/92013ec9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/92013ec9

[27/50] [abbrv] beam git commit: Update minimum cython version to 0.26.1

Update minimum cython version to 0.26.1 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0f738087 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0f738087 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0f738087

[38/50] [abbrv] beam git commit: [BEAM-2926] Migrate to using a trivial multimap materialization within the Java SDK.

[BEAM-2926] Migrate to using a trivial multimap materialization within the Java SDK. This closes #4011 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/30886ace Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/30886ace

[19/50] [abbrv] beam git commit: Tidy a troublesome TestStreamTest

Tidy a troublesome TestStreamTest Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/555ba40d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/555ba40d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/555ba40d Branch:

[37/50] [abbrv] beam git commit: Update Dataflow worker image to be compatible with side input changes.

Update Dataflow worker image to be compatible with side input changes. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d5a8aea0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d5a8aea0 Diff:

[49/50] [abbrv] beam git commit: [BEAM-3206] Shut down executor when spark runner finishes

[BEAM-3206] Shut down executor when spark runner finishes The Spark runner previously left the JVM process hanging after completion because its one-time use executor service was never shut down. This change shuts down the executor after jobs have been submitted, allowing graceful JVM termination.

[22/50] [abbrv] beam git commit: ReduceFnRunner: Do not manage EOW hold or timer, set GC hold and timer always

ReduceFnRunner: Do not manage EOW hold or timer, set GC hold and timer always Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9c994ca4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9c994ca4 Diff:

[17/50] [abbrv] beam git commit: This closes #4122

This closes #4122 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1b3f1c1f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1b3f1c1f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1b3f1c1f Branch:

[33/50] [abbrv] beam git commit: Fix BatchViewOverrides ViewAsSingleton to apply the combine fn that was being replaced.

Fix BatchViewOverrides ViewAsSingleton to apply the combine fn that was being replaced. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/accb2087 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/accb2087 Diff:

[16/50] [abbrv] beam git commit: Fix flakiness in sideinputs_test

Fix flakiness in sideinputs_test Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ebeb3fd9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ebeb3fd9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ebeb3fd9 Branch:

[11/50] [abbrv] beam git commit: This closes #4081

This closes #4081 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/acfab896 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/acfab896 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/acfab896 Branch:

[31/50] [abbrv] beam git commit: This closes #4121

This closes #4121 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7ce0a82b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7ce0a82b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7ce0a82b Branch:

[08/50] [abbrv] beam git commit: Properly handle side input exception when all reader threads complete

Properly handle side input exception when all reader threads complete Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6779b8ec Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6779b8ec Diff:

[43/50] [abbrv] beam git commit: Fix user_score example.

Fix user_score example. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3b24ce8d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3b24ce8d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3b24ce8d Branch:

[44/50] [abbrv] beam git commit: This closes #4141

This closes #4141 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f96bbd4e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f96bbd4e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f96bbd4e Branch:

[05/50] [abbrv] beam git commit: This closes #4100

This closes #4100 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6e4781b5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6e4781b5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6e4781b5 Branch:

[36/50] [abbrv] beam git commit: Rebase and update code to honor findbugs @Nullable/@Nonnull conversion

Rebase and update code to honor findbugs @Nullable/@Nonnull conversion Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/12246ad0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/12246ad0 Diff:

[07/50] [abbrv] beam git commit: [BEAM-2899] Add A FnService, FnServer to runner Fn Execution

[BEAM-2899] Add A FnService, FnServer to runner Fn Execution This closes #4088 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a0eb00e7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a0eb00e7 Diff:

[jira] [Commented] (BEAM-3147) Nexmark in SQL

[ https://issues.apache.org/jira/browse/BEAM-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257540#comment-16257540 ] ASF GitHub Bot commented on BEAM-3147: -- Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-3200) Streaming Pipeline throws RuntimeException when using DynamicDestinations and Method.FILE_LOADS

[ https://issues.apache.org/jira/browse/BEAM-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257978#comment-16257978 ] AJ commented on BEAM-3200: -- Thanks for looking into this. From your explanation it sounds like this should never

  1   2   >