[GitHub] beam pull request #1920: [BEAM-1392] DoFn teardown not called on empty parti...

GitHub user aviemzur opened a pull request: https://github.com/apache/beam/pull/1920 [BEAM-1392] DoFn teardown not called on empty partitions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Assigned] (BEAM-1394) Use Flink InternalTimerService for TimerInternals

[ https://issues.apache.org/jira/browse/BEAM-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-1394: -- Assignee: (was: Aljoscha Krettek) > Use Flink InternalTimerService for

[2/2] beam git commit: This closes #1921

This closes #1921 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c442ef81 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c442ef81 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c442ef81 Branch:

[1/2] beam git commit: [BEAM-1304] Checking for nullity before trying to obtain an aggregator's value.

Repository: beam Updated Branches: refs/heads/master e5afbb27f -> c442ef81a [BEAM-1304] Checking for nullity before trying to obtain an aggregator's value. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/882c654b Tree:

[jira] [Created] (BEAM-1394) Use Flink InternalTimerService for TimerInternals

Aljoscha Krettek created BEAM-1394: -- Summary: Use Flink InternalTimerService for TimerInternals Key: BEAM-1394 URL: https://issues.apache.org/jira/browse/BEAM-1394 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1392) DoFn teardown not called on empty partitions

[ https://issues.apache.org/jira/browse/BEAM-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853176#comment-15853176 ] ASF GitHub Bot commented on BEAM-1392: -- GitHub user aviemzur opened a pull request:

[jira] [Created] (BEAM-1393) Update Flink Runner to Flink 1.2.0

Aljoscha Krettek created BEAM-1393: -- Summary: Update Flink Runner to Flink 1.2.0 Key: BEAM-1393 URL: https://issues.apache.org/jira/browse/BEAM-1393 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-1354) TextIO should comply with PTransform style guide

[ https://issues.apache.org/jira/browse/BEAM-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1354: --- Assignee: Aviem Zur > TextIO should comply with PTransform style guide >

[jira] [Assigned] (BEAM-1393) Update Flink Runner to Flink 1.2.0

[ https://issues.apache.org/jira/browse/BEAM-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1393: -- Assignee: Jingsong Lee > Update Flink Runner to Flink 1.2.0 >

[GitHub] beam pull request #1920: [BEAM-1392] DoFn teardown not called on empty parti...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1920 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #1920

This closes #1920 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e5afbb27 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e5afbb27 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e5afbb27 Branch:

[jira] [Assigned] (BEAM-1304) NPE if trying to get value of Aggregator that does not exist.

[ https://issues.apache.org/jira/browse/BEAM-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin reassigned BEAM-1304: Assignee: Stas Levin (was: Amit Sela) > NPE if trying to get value of Aggregator that does not

[GitHub] beam pull request #1921: [BEAM-1304] Checking for nullity before trying to o...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1921 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (BEAM-1304) NPE if trying to get value of Aggregator that does not exist.

[ https://issues.apache.org/jira/browse/BEAM-1304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin resolved BEAM-1304. -- Resolution: Fixed Fix Version/s: 0.6.0 > NPE if trying to get value of Aggregator that does not

[GitHub] beam pull request #1921: [BEAM-1304] Checking for nullity before trying to o...

GitHub user staslev opened a pull request: https://github.com/apache/beam/pull/1921 [BEAM-1304] Checking for nullity before trying to obtain an aggregator's value. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[jira] [Updated] (BEAM-1394) Use Flink InternalTimerService for TimerInternals

[ https://issues.apache.org/jira/browse/BEAM-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1394: --- Description: When updating our Flink version to 1.2 we can use the new internal timer API for

[jira] [Commented] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853298#comment-15853298 ] Daniel Halperin commented on BEAM-1396: --- To add a little more flavor: I'm not sure what right thing

[jira] [Assigned] (BEAM-1397) Introduce IO metrics

[ https://issues.apache.org/jira/browse/BEAM-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1397: --- Assignee: Aviem Zur (was: Daniel Halperin) > Introduce IO metrics > > >

[jira] [Created] (BEAM-1397) Introduce IO metrics

Aviem Zur created BEAM-1397: --- Summary: Introduce IO metrics Key: BEAM-1397 URL: https://issues.apache.org/jira/browse/BEAM-1397 Project: Beam Issue Type: New Feature Components:

[jira] [Assigned] (BEAM-1397) Introduce IO metrics

[ https://issues.apache.org/jira/browse/BEAM-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1397: --- Assignee: Daniel Halperin (was: Davor Bonaci) > Introduce IO metrics > > >

[jira] [Assigned] (BEAM-1398) KafkaIO metrics

[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1398: --- Assignee: Aviem Zur (was: Daniel Halperin) > KafkaIO metrics > --- > >

[jira] [Assigned] (BEAM-1398) KafkaIO metrics

[ https://issues.apache.org/jira/browse/BEAM-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1398: --- Assignee: Daniel Halperin (was: Davor Bonaci) > KafkaIO metrics > --- > >

[jira] [Created] (BEAM-1398) KafkaIO metrics

Aviem Zur created BEAM-1398: --- Summary: KafkaIO metrics Key: BEAM-1398 URL: https://issues.apache.org/jira/browse/BEAM-1398 Project: Beam Issue Type: New Feature Components:

[jira] [Resolved] (BEAM-1126) Expose UnboundedSource split backlog in number of events

[ https://issues.apache.org/jira/browse/BEAM-1126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1126. - Resolution: Invalid Fix Version/s: Not applicable > Expose UnboundedSource split backlog in number

[jira] [Created] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

Amit Sela created BEAM-1396: --- Summary: GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee Key: BEAM-1396 URL: https://issues.apache.org/jira/browse/BEAM-1396

[jira] [Commented] (BEAM-1395) SparkGroupAlsoByWindowFn not sorting grouped elements by timestamp

[ https://issues.apache.org/jira/browse/BEAM-1395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853309#comment-15853309 ] ASF GitHub Bot commented on BEAM-1395: -- GitHub user amitsela opened a pull request:

[GitHub] beam pull request #1922: [BEAM-1395] SparkGroupAlsoByWindowFn not sorting gr...

GitHub user amitsela opened a pull request: https://github.com/apache/beam/pull/1922 [BEAM-1395] SparkGroupAlsoByWindowFn not sorting grouped elements by timestamp Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[jira] [Comment Edited] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853298#comment-15853298 ] Daniel Halperin edited comment on BEAM-1396 at 2/5/17 5:54 PM: --- To add a

[jira] [Resolved] (BEAM-1334) Split UsesMetrics category and tests into UsesCommittedMetrics and UsesAttemptedMetrics

[ https://issues.apache.org/jira/browse/BEAM-1334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1334. - Resolution: Done Fix Version/s: 0.6.0 > Split UsesMetrics category and tests into

[jira] [Resolved] (BEAM-1379) Shade Guava in beam-sdks-java-io-kafka module

[ https://issues.apache.org/jira/browse/BEAM-1379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur resolved BEAM-1379. - Resolution: Fixed Fix Version/s: 0.6.0 > Shade Guava in beam-sdks-java-io-kafka module >

Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Apex #411

See

[jira] [Commented] (BEAM-1387) DatastoreIO: use batch-datastore.googleapis.com as the endpoint

[ https://issues.apache.org/jira/browse/BEAM-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853396#comment-15853396 ] ASF GitHub Bot commented on BEAM-1387: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: [BEAM-1387] DatastoreV1: use batch-datastore.googleapis.com endpoint

Repository: beam Updated Branches: refs/heads/master c442ef81a -> 4d0e8ecf1 [BEAM-1387] DatastoreV1: use batch-datastore.googleapis.com endpoint If localhost is not set. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #1915: [BEAM-1387] DatastoreV1: use batch-datastore.google...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1915 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #1915

This closes #1915 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4d0e8ecf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4d0e8ecf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4d0e8ecf Branch:

[jira] [Resolved] (BEAM-1387) DatastoreIO: use batch-datastore.googleapis.com as the endpoint

[ https://issues.apache.org/jira/browse/BEAM-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1387. --- Resolution: Fixed Fix Version/s: 0.6.0 > DatastoreIO: use

Build failed in Jenkins: beam_PostCommit_Java_RunnableOnService_Dataflow #2208

See -- [...truncated 26076 lines...] [INFO] 2017-02-06T06:57:28.688Z: (2526ad5fb5c41518): Fusing consumer PAssert$266/GroupGlobally/RemoveActualsTriggering/Identity into

[jira] [Updated] (BEAM-1223) Replace public constructors with static factory methods for Sum.[*]Fn classes

[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1223: -- Summary: Replace public constructors with static factory methods for Sum.[*]Fn classes (was:

[jira] [Commented] (BEAM-1223) Replace public constructors with static factory methods for Sum.[*]Fn classes

[ https://issues.apache.org/jira/browse/BEAM-1223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853621#comment-15853621 ] Daniel Halperin commented on BEAM-1223: --- Hey [~staslev], I just found in testing the 0.5.0 that this

[jira] [Created] (BEAM-1395) SparkGroupAlsoByWindowFn not sorting grouped elements by timestamp

Amit Sela created BEAM-1395: --- Summary: SparkGroupAlsoByWindowFn not sorting grouped elements by timestamp Key: BEAM-1395 URL: https://issues.apache.org/jira/browse/BEAM-1395 Project: Beam Issue

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Apex #412

See

[GitHub] beam pull request #1923: [BEAM-1369] Reduce test times for two retry based t...

GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1923 [BEAM-1369] Reduce test times for two retry based tests R: @charlesccychen PTAL - The gcsio test was taking 2s so reducing the segment override makes it faster. - The retry test now just

[1/2] beam git commit: Remove the usage of OldDoFn and clean up function names

Repository: beam Updated Branches: refs/heads/master 4d0e8ecf1 -> b3d962df2 Remove the usage of OldDoFn and clean up function names Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/137d392e Tree:

[jira] [Commented] (BEAM-886) Support new DoFn in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853441#comment-15853441 ] ASF GitHub Bot commented on BEAM-886: - Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #1917

This closes #1917 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b3d962df Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b3d962df Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b3d962df Branch:

[GitHub] beam pull request #1917: [BEAM-886] Remove the usage of OldDoFn and clean up...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1917 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-425) Create Elasticsearch IO

[ https://issues.apache.org/jira/browse/BEAM-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853477#comment-15853477 ] Reza Nouri commented on BEAM-425: - Hi [~echauchot], I am trying to use elasticIO, but I am getting the

[jira] [Comment Edited] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853491#comment-15853491 ] Kenneth Knowles edited comment on BEAM-1396 at 2/6/17 4:25 AM: --- Glad you

[jira] [Commented] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853642#comment-15853642 ] Amit Sela commented on BEAM-1396: - It was always called {{SparkGroupAlsoByWindow}}, and it actually

[jira] [Commented] (BEAM-1396) GABWVOBDoFn expects grouped values to be ordered by their timestamp but there is no such guarantee

[ https://issues.apache.org/jira/browse/BEAM-1396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853587#comment-15853587 ] Daniel Halperin commented on BEAM-1396: --- :+1: > GABWVOBDoFn expects grouped values to be ordered by

[jira] [Created] (BEAM-1400) Transient Apex runner postcommit failure in WindowTest.testOutputTimeFnDefault

Kenneth Knowles created BEAM-1400: - Summary: Transient Apex runner postcommit failure in WindowTest.testOutputTimeFnDefault Key: BEAM-1400 URL: https://issues.apache.org/jira/browse/BEAM-1400

[GitHub] beam pull request #1925: Add git .mailmap file

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1925 Add git .mailmap file Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like: `[BEAM-]