[beam] branch master updated (817cf97 -> 0be4c54)

This is an automated email from the ASF dual-hosted git repository. jkff pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 817cf97 Merge pull request #4735 from angoenka/change_default_thread add bd9c6aa `extractOutput()` ended up resett

[beam] 01/01: Merge pull request #4688: [BEAM-3705] ApproximateUnique resets its accumulator with each firing.

This is an automated email from the ASF dual-hosted git repository. jkff pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 0be4c54cc8475e6cfc246bd056a122abe3e8dc49 Merge: 817cf97 c24aebd Author: Eugene Kirpichov AuthorDate: Thu Feb 22 23:59:45 201

Build failed in Jenkins: beam_PostCommit_Python_Verify #4294

See Changes: [rangadi] `extractOutput()` ended up resetting underlying aggregation. This is due [rangadi] review comments. [rangadi] Use TreeSet in place of PriorityQueue. [rangadi] update checks

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #976

See Changes: [rangadi] `extractOutput()` ended up resetting underlying aggregation. This is due [rangadi] review comments. [rangadi] Use TreeSet in place of PriorityQueue. [ranga

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #977

See -- [...truncated 118.43 KB...] f(self, obj) # Call unbound method with explicit self File "

[beam] 01/01: Merge pull request #4723: [BEAM-3317] Use fixed system time for KinesisReaderTest

This is an automated email from the ASF dual-hosted git repository. iemejia pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 51b793aea70c333011123c3ffd58ea6f26c61b51 Merge: 0be4c54 d0f272f Author: Ismaël Mejía AuthorDate: Fri Feb 23 10:21:36 2018

[beam] branch master updated (0be4c54 -> 51b793a)

This is an automated email from the ASF dual-hosted git repository. iemejia pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0be4c54 Merge pull request #4688: [BEAM-3705] ApproximateUnique resets its accumulator with each firing. add d0

[jira] [Resolved] (BEAM-3317) KinesisReaderTest is Flaky due to overadvanced watermarks

[ https://issues.apache.org/jira/browse/BEAM-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-3317. Resolution: Fixed Fix Version/s: 2.4.0 > KinesisReaderTest is Flaky due to overadvanced waterm

Build failed in Jenkins: beam_PostCommit_Python_Verify #4295

See -- [...truncated 1.02 MB...] copying apache_beam/runners/dataflow/test_dataflow_runner.py -> apache-beam-2.4.0.dev0/apache_beam/runners/dataflow copying apache_beam/run

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #978

See Changes: [pawel.pk.kaczmarczyk] [BEAM-3317] Use fixed system time for testing -- [...truncated 115.45 KB...] File "

[beam] 12/12: Merge pull request #4639: [BEAM-2140] Fix SplittableDoFn ValidatesRunner tests in Flink Streaming Runner

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 0259636661998b8aabd3bf20eff8d519bcb9fb47 Merge: 51b793a 6148a6d Author: Aljoscha Krettek AuthorDate: Fri Feb 23 11:59:36

[beam] 02/12: Allow overriding DoFnRunners in subclasses of Flink DoFnOperator

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit c40868fe2fc550ae97c7b2d9308dd8b58b20edab Author: Aljoscha Krettek AuthorDate: Thu Jan 11 10:52:01 2018 +0100 Allow

[beam] 03/12: Invoke finishBundle() before teardown() in DoFnOperator

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 4029e23f3075365eddcdad5187b4fc8a6e590989 Author: Aljoscha Krettek AuthorDate: Fri Jan 5 14:22:40 2018 +0100 Invoke

[beam] 01/12: Make parameter of DoFnRunners.lateDataDroppingRunner() more specific

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 50c6d9316c8c5089065dd291b097e06b0c80980e Author: Aljoscha Krettek AuthorDate: Thu Jan 11 10:56:49 2018 +0100 Make p

[jira] [Closed] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2140. -- Resolution: Fixed > Fix SplittableDoFn ValidatesRunner tests in FlinkRunner > ---

[beam] branch master updated (51b793a -> 0259636)

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 51b793a Merge pull request #4723: [BEAM-3317] Use fixed system time for KinesisReaderTest new 50c6d93 Make pa

[beam] 09/12: [BEAM-2140] Enable SDF tests for Flink Streaming Runner

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit c920a39b9781ac604f55059e597e327643d58205 Author: Aljoscha Krettek AuthorDate: Fri Jan 5 14:20:19 2018 +0100 [BEAM-2

[beam] 05/12: [BEAM-2140] Block DoFnOperator.close() if we have pending timers

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 3eecb381f3fb412df6844cfc13b12bf265253926 Author: Aljoscha Krettek AuthorDate: Fri Jan 5 14:17:49 2018 +0100 [BEAM-2

Build failed in Jenkins: beam_PostCommit_Python_Verify #4296

See Changes: [pawel.pk.kaczmarczyk] [BEAM-3317] Use fixed system time for testing -- [...truncated 1.02 MB...] copying apache_beam/runners/dataflow/internal/_

[beam] 11/12: [BEAM-3727] Never shutdown sources in Flink Streaming execution mode

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 6148a6d063a0503ee435ab5084fcba3fb864b26f Author: Aljoscha Krettek AuthorDate: Thu Feb 22 14:26:16 2018 +0100 [BEAM-

[beam] 06/12: [BEAM-2140] Don't use StatefulDoFnRunner when running SDF in FlinkRunner

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit d15979f2cf0d6bc47d049a6ea157d9d7b2b97848 Author: Aljoscha Krettek AuthorDate: Wed Jan 10 06:48:49 2018 +0100 [BEAM-

[beam] 08/12: [BEAM-2140] Use ProcessFnRunner in DoFnRunner for executing SDF

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 74ac703bbfa40d16e7d1115912768c7a63598d52 Author: Aljoscha Krettek AuthorDate: Thu Feb 8 13:02:26 2018 +0100 [BEAM-2

[jira] [Updated] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-2140: --- Fix Version/s: 2.4.0 > Fix SplittableDoFn ValidatesRunner tests in FlinkRunner > --

[beam] 04/12: [BEAM-2140] Ignore event-time timers in SplittableDoFnOperator

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 2e0b192efbae72fe5c0ef61abfc7b4d1b3bb75f5 Author: Aljoscha Krettek AuthorDate: Fri Jan 5 14:16:27 2018 +0100 [BEAM-2

[beam] 10/12: [BEAM-2140] Enable SDF tests in gradle for Flink Streaming Runner

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 6ba3fc1ff2798764756a7188980facc31eb1ac4c Author: Aljoscha Krettek AuthorDate: Thu Feb 8 13:00:34 2018 +0100 [BEAM-2

[beam] 07/12: Make ProcessFnRunner constructor public

This is an automated email from the ASF dual-hosted git repository. aljoscha pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 4ec4644952c05167f52ae0937e043140d26059ae Author: Aljoscha Krettek AuthorDate: Thu Feb 8 13:01:22 2018 +0100 Make Pr

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #5079

See -- [...truncated 157.33 KB...] 2018-02-23T11:43:21.166 [INFO] Tests run: 243, Failures: 0, Errors: 0, Skipped: 0 2018-02-23T11:43:21.166 [INFO] [JENKINS] R

Build failed in Jenkins: beam_PerformanceTests_Python #947

See Changes: [rangadi] `extractOutput()` ended up resetting underlying aggregation. This is due [rangadi] review comments. [pawel.pk.kaczmarczyk] [BEAM-3317] Use fixed system time for testing [rang

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #979

See Changes: [aljoscha.krettek] Make parameter of DoFnRunners.lateDataDroppingRunner() more specific [aljoscha.krettek] Allow overriding DoFnRunners in subclasses of Flink DoFnOpe

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #5080

See

Build failed in Jenkins: beam_PerformanceTests_Spark #1391

See Changes: [rangadi] `extractOutput()` ended up resetting underlying aggregation. This is due [rangadi] review comments. [pawel.pk.kaczmarczyk] [BEAM-3317] Use fixed system time for testing [rang

Build failed in Jenkins: beam_PostCommit_Python_Verify #4297

See Changes: [aljoscha.krettek] Make parameter of DoFnRunners.lateDataDroppingRunner() more specific [aljoscha.krettek] Allow overriding DoFnRunners in subclasses of Flink DoFnOperator [aljoscha.

[jira] [Closed] (BEAM-3690) Dependency Conflict problems: several conflicting classes exist in different JARs (mockito-all/hamcrest-all)

[ https://issues.apache.org/jira/browse/BEAM-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PandaMonkey closed BEAM-3690. - Resolution: Fixed > Dependency Conflict problems: several conflicting classes exist in different > JARs (m

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #980

See -- [...truncated 124.32 KB...] self.to_runner_api(), self.runner, self._options).run(False) File "

Build failed in Jenkins: beam_PostCommit_Python_Verify #4298

See -- [...truncated 1.02 MB...] copying apache_beam/runners/dataflow/internal/apiclient.py -> apache-beam-2.4.0.dev0/apache_beam/runners/dataflow/internal copying apache_b

[jira] [Created] (BEAM-3739) @Parameter annotation does not work for UDFs in Beam SQL

Samuel Waggoner created BEAM-3739: - Summary: @Parameter annotation does not work for UDFs in Beam SQL Key: BEAM-3739 URL: https://issues.apache.org/jira/browse/BEAM-3739 Project: Beam Issue T

[jira] [Assigned] (BEAM-3573) Test jars should export only tests

[ https://issues.apache.org/jira/browse/BEAM-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-3573: - Assignee: Kenneth Knowles > Test jars should export only tests > -

[jira] [Assigned] (BEAM-3138) Stop depending on Test JARs

[ https://issues.apache.org/jira/browse/BEAM-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-3138: - Assignee: Kenneth Knowles > Stop depending on Test JARs > --- > >

[jira] [Assigned] (BEAM-2219) All TestRunners or no TestRunners should be registered

[ https://issues.apache.org/jira/browse/BEAM-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-2219: - Assignee: Kenneth Knowles > All TestRunners or no TestRunners should be registered > -

[jira] [Resolved] (BEAM-2219) All TestRunners or no TestRunners should be registered

[ https://issues.apache.org/jira/browse/BEAM-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2219. --- Resolution: Fixed Fix Version/s: Not applicable Looks like they are all registered. No n

Build failed in Jenkins: beam_PerformanceTests_Python #948

See -- [...truncated 15 B...] Building remotely on beam3 (beam) in workspace > git rev-parse --is-inside-wor

Build failed in Jenkins: beam_PerformanceTests_Spark #1392

See -- [...truncated 92.05 KB...] 'apache-beam-testing:bqjob_r2d88b74fa20c8ba6_0161c3e414e9_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to F

[jira] [Commented] (BEAM-3681) S3Filesystem fails when copying empty files

[ https://issues.apache.org/jira/browse/BEAM-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374827#comment-16374827 ] Jacob Marble commented on BEAM-3681: Strange that I haven't bumped into this, but likel

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #6046

See

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #981

See -- [...truncated 118.22 KB...] spec=transform_to_runner_api(self.transform, context), File "

Build failed in Jenkins: beam_PostCommit_Python_Verify #4299

See -- [...truncated 1.02 MB...] copying apache_beam/runners/dataflow/internal/apiclient.py -> apache-beam-2.4.0.dev0/apache_beam/runners/dataflow/internal copying apache_b

[jira] [Commented] (BEAM-3681) S3Filesystem fails when copying empty files

[ https://issues.apache.org/jira/browse/BEAM-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375031#comment-16375031 ] Ismaël Mejía commented on BEAM-3681: It was quite tricky to find, I really found it by

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #6047

See

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #982

See Changes: [mairbek] Changes multipe structuredValue implementations. Most notably, updates -- [...truncated 117.95 KB...] File "

[jira] [Created] (BEAM-3740) Prototype of retractions support by DirectRunner

Anton Kedin created BEAM-3740: - Summary: Prototype of retractions support by DirectRunner Key: BEAM-3740 URL: https://issues.apache.org/jira/browse/BEAM-3740 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-2939) Fn API streaming SDF support

[ https://issues.apache.org/jira/browse/BEAM-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2939: -- Assignee: Eugene Kirpichov > Fn API streaming SDF support >

[jira] [Closed] (BEAM-3698) Support SDF over Fn API

[ https://issues.apache.org/jira/browse/BEAM-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3698. -- Resolution: Duplicate Fix Version/s: Not applicable > Support SDF over Fn API > --

[jira] [Commented] (BEAM-2939) Fn API streaming SDF support

[ https://issues.apache.org/jira/browse/BEAM-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375125#comment-16375125 ] Eugene Kirpichov commented on BEAM-2939: Proposed design: https://s.apache.org/beam

[jira] [Created] (BEAM-3741) Proto changes for splitting over Fn API

Eugene Kirpichov created BEAM-3741: -- Summary: Proto changes for splitting over Fn API Key: BEAM-3741 URL: https://issues.apache.org/jira/browse/BEAM-3741 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-3742) Support for running a streaming SDF in Python SDK

Eugene Kirpichov created BEAM-3742: -- Summary: Support for running a streaming SDF in Python SDK Key: BEAM-3742 URL: https://issues.apache.org/jira/browse/BEAM-3742 Project: Beam Issue Type:

[jira] [Created] (BEAM-3743) Support for SDF splitting protocol in ULR

Eugene Kirpichov created BEAM-3743: -- Summary: Support for SDF splitting protocol in ULR Key: BEAM-3743 URL: https://issues.apache.org/jira/browse/BEAM-3743 Project: Beam Issue Type: Sub-task

Build failed in Jenkins: beam_PostCommit_Python_Verify #4300

See Changes: [mairbek] Changes multipe structuredValue implementations. Most notably, updates -- [...truncated 1.03 MB...] copying apache_beam/runners/dataflo

[jira] [Created] (BEAM-3744) Support full PubsubMessages

Udi Meiri created BEAM-3744: --- Summary: Support full PubsubMessages Key: BEAM-3744 URL: https://issues.apache.org/jira/browse/BEAM-3744 Project: Beam Issue Type: Bug Components: sdk-py-cor

Build failed in Jenkins: beam_PerformanceTests_Compressed_TextIOIT #177

See Changes: [mairbek] Changes multipe structuredValue implementations. Most notably, updates -- [...truncated 32.00 KB...] [INFO] Excluding com.g

Build failed in Jenkins: beam_PerformanceTests_Python #949

See Changes: [mairbek] Changes multipe structuredValue implementations. Most notably, updates -- [...truncated 15 B...] Building remotely on beam3 (beam) in wor

Build failed in Jenkins: beam_PerformanceTests_Spark #1393

See Changes: [mairbek] Changes multipe structuredValue implementations. Most notably, updates -- [...truncated 91.66 KB...] 'apache-beam-testing:bqjob_r2418b1e0

[beam] branch master updated: [BEAM-3634] Refactor BeamRelNode to return a PTransform (#4705)

This is an automated email from the ASF dual-hosted git repository. mingmxu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 14b17ad [BEAM-3634] Refactor BeamRelNode to retu

[beam] branch master updated: [BEAM-591] KafkaIO : Improve watermarks and support server side timestamps (#4680)

This is an automated email from the ASF dual-hosted git repository. mingmxu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 9f84beb [BEAM-591] KafkaIO : Improve watermarks

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #983

See Changes: [XuMingmin] [BEAM-3634] Refactor BeamRelNode to return a PTransform (#4705) [XuMingmin] [BEAM-591] KafkaIO : Improve watermarks and support server side ---

Build failed in Jenkins: beam_PostCommit_Python_Verify #4301

See Changes: [XuMingmin] [BEAM-3634] Refactor BeamRelNode to return a PTransform (#4705) [XuMingmin] [BEAM-591] KafkaIO : Improve watermarks and support server side

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #984

See -- [...truncated 121.93 KB...] urn, typed_param = self.to_runner_api_parameter(context) File "

Build failed in Jenkins: beam_PostCommit_Python_Verify #4302

See -- [...truncated 1.02 MB...] copying apache_beam/runners/dataflow/internal/dependency.py -> apache-beam-2.4.0.dev0/apache_beam/runners/dataflow/internal copying apache_

Jenkins build is back to normal : beam_PerformanceTests_Compressed_TextIOIT #178

See

Build failed in Jenkins: beam_PerformanceTests_Python #950

See Changes: [XuMingmin] [BEAM-3634] Refactor BeamRelNode to return a PTransform (#4705) [XuMingmin] [BEAM-591] KafkaIO : Improve watermarks and support server side --

Build failed in Jenkins: beam_PerformanceTests_TextIOIT #194

See Changes: [XuMingmin] [BEAM-3634] Refactor BeamRelNode to return a PTransform (#4705) [XuMingmin] [BEAM-591] KafkaIO : Improve watermarks and support server side

Build failed in Jenkins: beam_PerformanceTests_Spark #1394

See Changes: [XuMingmin] [BEAM-3634] Refactor BeamRelNode to return a PTransform (#4705) [XuMingmin] [BEAM-591] KafkaIO : Improve watermarks and support server side --