[GitHub] incubator-beam pull request: Removes spurious re-builds of sdks/ja...

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/287 Removes spurious re-builds of sdks/java/core Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is

[GitHub] incubator-beam pull request: Speed up non-release builds

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/286 Speed up non-release builds Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-256) Add lifecycle even verifiers for Beam pipelines.

[ https://issues.apache.org/jira/browse/BEAM-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15270093#comment-15270093 ] ASF GitHub Bot commented on BEAM-256: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-256] Add verifiers to Beam

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/273 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[3/3] incubator-beam git commit: [BEAM-256] Address wrong import order and add millis to output path for WordCountIT

[BEAM-256] Address wrong import order and add millis to output path for WordCountIT Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3f0eead5 Tree:

[GitHub] incubator-beam pull request: Refactor BigQueryServices to support ...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/285 Refactor BigQueryServices to support extract and query jobs You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #268

See

Re: Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #267

The first one of these failed because of a flake. This time, it looks like a test job was canceled? [link

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #267

See

[2/2] incubator-beam git commit: This closes #252

This closes #252 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6819dff8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6819dff8 Diff:

[GitHub] incubator-beam pull request: Replace dataflow stagingLocation with...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/252 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Replace dataflow stagingLocation with tempLocation in example module.

Repository: incubator-beam Updated Branches: refs/heads/master 9b9d73fbf -> 6819dff86 Replace dataflow stagingLocation with tempLocation in example module. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request: Create TransformingSource and Bounded...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/284 Create TransformingSource and BoundedSourceTester You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[jira] [Commented] (BEAM-22) DirectPipelineRunner: support for unbounded collections

[ https://issues.apache.org/jira/browse/BEAM-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269636#comment-15269636 ] ASF GitHub Bot commented on BEAM-22: GitHub user tgroh opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-22] Refactor CompletionCallback...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/282 [BEAM-22] Refactor CompletionCallbacks Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] incubator-beam pull request: Create runners/core module for artifa...

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/281 Create runners/core module for artifact org.apache.beam:runners-core Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[jira] [Commented] (BEAM-168) IntervalBoundedExponentialBackOff change broke Beam-on-Dataflow

[ https://issues.apache.org/jira/browse/BEAM-168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269558#comment-15269558 ] ASF GitHub Bot commented on BEAM-168: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request: [BEAM-168] IntervalBEB: remove deprec...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/278 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: [BEAM-168] IntervalBEB: remove deprecated function

[BEAM-168] IntervalBEB: remove deprecated function The pre-commit wordcount test will confirm that this does not break the Cloud Dataflow worker. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/58ac312c

[GitHub] incubator-beam pull request: [BEAM-154] Use dependencyManagement a...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/267 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-255) Understand and improve performance of Write/FileBasedSink

[ https://issues.apache.org/jira/browse/BEAM-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269549#comment-15269549 ] ASF GitHub Bot commented on BEAM-255: - Github user asfgit closed the pull request at:

[3/3] incubator-beam git commit: [BEAM-154] Use dependencyManagement and pluginManagement to keep all modules sync in term of version

[BEAM-154] Use dependencyManagement and pluginManagement to keep all modules sync in term of version Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/04bffa17 Tree:

[jira] [Commented] (BEAM-154) Provide Maven BOM

[ https://issues.apache.org/jira/browse/BEAM-154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269550#comment-15269550 ] ASF GitHub Bot commented on BEAM-154: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: [BEAM-255] Write: add limited logging

Repository: incubator-beam Updated Branches: refs/heads/master 3bcc5058a -> ec0e9fd7b [BEAM-255] Write: add limited logging This will help, for all sinks, users and developers gain insight into where time is spent. (Enabling DEBUG level will provide more insight.) Project:

[1/3] incubator-beam git commit: Closes #267

Repository: incubator-beam Updated Branches: refs/heads/master ec0e9fd7b -> 6260cc137 Closes #267 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6260cc13 Tree:

[GitHub] incubator-beam pull request: [BEAM-255] Write: add limited logging

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/279 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-248) Register DisplayData from anonymous implementation PTransforms

[ https://issues.apache.org/jira/browse/BEAM-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269544#comment-15269544 ] ASF GitHub Bot commented on BEAM-248: - GitHub user swegner opened a pull request:

[jira] [Commented] (BEAM-254) Add maven-rat-plugin execution

[ https://issues.apache.org/jira/browse/BEAM-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269510#comment-15269510 ] Jean-Baptiste Onofré commented on BEAM-254: --- Checkstyle applies on Java source, rat can check any

[2/2] incubator-beam git commit: Closes #276

Closes #276 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3bcc5058 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3bcc5058 Diff:

[GitHub] incubator-beam pull request: Upgrade bigquery library to v2-rev292...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/276 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-254) Add maven-rat-plugin execution

[ https://issues.apache.org/jira/browse/BEAM-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269494#comment-15269494 ] Scott Wegner commented on BEAM-254: --- Doesn't checkstyle already provide this via the

[jira] [Commented] (BEAM-255) Understand and improve performance of Write/FileBasedSink

[ https://issues.apache.org/jira/browse/BEAM-255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269481#comment-15269481 ] ASF GitHub Bot commented on BEAM-255: - GitHub user dhalperi opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-255] Write: add limited logging

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/279 [BEAM-255] Write: add limited logging This will help, for all sinks, users and developers gain insight into where time is spent. (Enabling DEBUG level will provide more insight.)

[jira] [Created] (BEAM-255) Understand and improve performance of Write/FileBasedSink

Daniel Halperin created BEAM-255: Summary: Understand and improve performance of Write/FileBasedSink Key: BEAM-255 URL: https://issues.apache.org/jira/browse/BEAM-255 Project: Beam Issue

[jira] [Resolved] (BEAM-50) BigQueryIO.Write: reimplement in Java

[ https://issues.apache.org/jira/browse/BEAM-50?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-50. - Resolution: Fixed > BigQueryIO.Write: reimplement in Java > - >

[jira] [Commented] (BEAM-168) IntervalBoundedExponentialBackOff change broke Beam-on-Dataflow

[ https://issues.apache.org/jira/browse/BEAM-168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269369#comment-15269369 ] ASF GitHub Bot commented on BEAM-168: - GitHub user dhalperi opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-168] IntervalBEB: remove deprec...

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/278 [BEAM-168] IntervalBEB: remove deprecated function The pre-commit wordcount test will confirm that this does not break the Cloud Dataflow worker. This resolves BEAM-168. You

[jira] [Updated] (BEAM-225) Create Class for Common TypeDescriptors

[ https://issues.apache.org/jira/browse/BEAM-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-225: -- Assignee: Davor Bonaci > Create Class for Common TypeDescriptors >

[jira] [Updated] (BEAM-225) Create Class for Common TypeDescriptors

[ https://issues.apache.org/jira/browse/BEAM-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-225: -- Assignee: Jesse Anderson (was: Davor Bonaci) > Create Class for Common TypeDescriptors >

[jira] [Commented] (BEAM-225) Create Class for Common TypeDescriptors

[ https://issues.apache.org/jira/browse/BEAM-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269249#comment-15269249 ] ASF GitHub Bot commented on BEAM-225: - GitHub user eljefe6a opened a pull request:

[GitHub] incubator-beam pull request: [BEAM-225] Create Class for Common Ty...

GitHub user eljefe6a opened a pull request: https://github.com/apache/incubator-beam/pull/275 [BEAM-225] Create Class for Common TypeDescriptors Jira issue BEAM-225 Create Class for Common TypeDescriptors. Adding KVTypeDescriptors and TypeDescriptors to make primitives easier. You

[jira] [Commented] (BEAM-233) Make Registering Avro Specific Records Easier

[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269199#comment-15269199 ] Kenneth Knowles commented on BEAM-233: -- I should also note two other options: # It is probably pretty

[jira] [Closed] (BEAM-183) Update package name for DisplayData types

[ https://issues.apache.org/jira/browse/BEAM-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-183. - Resolution: Won't Fix We will leave it as-is. > Update package name for DisplayData types >

[jira] [Updated] (BEAM-233) Make Registering Avro Specific Records Easier

[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-233: - Assignee: (was: Kenneth Knowles) > Make Registering Avro Specific Records Easier >

[jira] [Closed] (BEAM-231) Remove ClassForDisplay infrastructure class.

[ https://issues.apache.org/jira/browse/BEAM-231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-231. - Resolution: Fixed > Remove ClassForDisplay infrastructure class. >

[jira] [Updated] (BEAM-233) Make Registering Avro Specific Records Easier

[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-233: - Issue Type: Improvement (was: Bug) > Make Registering Avro Specific Records Easier >

[jira] [Comment Edited] (BEAM-233) Make Registering Avro Specific Records Easier

[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269047#comment-15269047 ] Kenneth Knowles edited comment on BEAM-233 at 5/3/16 4:48 PM: -- This makes good

[jira] [Comment Edited] (BEAM-233) Make Registering Avro Specific Records Easier

[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269047#comment-15269047 ] Kenneth Knowles edited comment on BEAM-233 at 5/3/16 4:49 PM: -- This makes good

[jira] [Updated] (BEAM-225) Create Class for Common TypeDescriptors

[ https://issues.apache.org/jira/browse/BEAM-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-225: - Labels: starter (was: ) > Create Class for Common TypeDescriptors >

[jira] [Commented] (BEAM-225) Create Class for Common TypeDescriptors

[ https://issues.apache.org/jira/browse/BEAM-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269022#comment-15269022 ] Kenneth Knowles commented on BEAM-225: -- Definitely a nice idea. Might you be up for it, [~eljefe6aa]?

[jira] [Closed] (BEAM-232) Update AvroIO JavaDoc to Mention Registering Coder

[ https://issues.apache.org/jira/browse/BEAM-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci closed BEAM-232. - Resolution: Won't Fix > Update AvroIO JavaDoc to Mention Registering Coder >

[jira] [Commented] (BEAM-232) Update AvroIO JavaDoc to Mention Registering Coder

[ https://issues.apache.org/jira/browse/BEAM-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268989#comment-15268989 ] Davor Bonaci commented on BEAM-232: --- Thanks. (We'll try to do something more systematic to address this.)

[jira] [Commented] (BEAM-232) Update AvroIO JavaDoc to Mention Registering Coder

[ https://issues.apache.org/jira/browse/BEAM-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268938#comment-15268938 ] Jesse Anderson commented on BEAM-232: - I can understand your POV and feel free to close it. The

[GitHub] incubator-beam pull request: [BEAM-103][BEAM-130] Make Flink Sourc...

GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/274 [BEAM-103][BEAM-130] Make Flink Source Parallel and Checkpointed Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x ] Make

[jira] [Commented] (BEAM-103) Make UnboundedSourceWrapper parallel

[ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268736#comment-15268736 ] ASF GitHub Bot commented on BEAM-103: - GitHub user aljoscha opened a pull request:

[jira] [Commented] (BEAM-140) Improve examples provided with the Flink runner

[ https://issues.apache.org/jira/browse/BEAM-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268726#comment-15268726 ] Aljoscha Krettek commented on BEAM-140: --- +1 for unification > Improve examples provided with the

[jira] [Resolved] (BEAM-129) Support pubsub IO

[ https://issues.apache.org/jira/browse/BEAM-129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek resolved BEAM-129. --- Resolution: Invalid Subsumed by BEAM-53 > Support pubsub IO > - > >

[jira] [Assigned] (BEAM-130) Checkpointing of custom sources and sinks

[ https://issues.apache.org/jira/browse/BEAM-130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-130: - Assignee: Aljoscha Krettek (was: Kostas Kloudas) > Checkpointing of custom sources and

[jira] [Created] (BEAM-254) Add maven-rat-plugin execution

Jean-Baptiste Onofré created BEAM-254: - Summary: Add maven-rat-plugin execution Key: BEAM-254 URL: https://issues.apache.org/jira/browse/BEAM-254 Project: Beam Issue Type: Task

[jira] [Assigned] (BEAM-103) Make UnboundedSourceWrapper parallel

[ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-103: - Assignee: Aljoscha Krettek (was: Kostas Kloudas) > Make UnboundedSourceWrapper parallel >

[jira] [Created] (BEAM-253) Unify Flink Operator Wrappers

Aljoscha Krettek created BEAM-253: - Summary: Unify Flink Operator Wrappers Key: BEAM-253 URL: https://issues.apache.org/jira/browse/BEAM-253 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-241) Not easy for runners to get late-data dropping

[ https://issues.apache.org/jira/browse/BEAM-241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268405#comment-15268405 ] Aljoscha Krettek commented on BEAM-241: --- I see, in there you are also relying on the fact that

[jira] [Updated] (BEAM-225) Create Class for Common TypeDescriptors

[ https://issues.apache.org/jira/browse/BEAM-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-225: -- Assignee: Kenneth Knowles (was: Davor Bonaci) > Create Class for Common TypeDescriptors >

[jira] [Issue Comment Deleted] (BEAM-232) Update AvroIO JavaDoc to Mention Registering Coder

[ https://issues.apache.org/jira/browse/BEAM-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-232: -- Comment: was deleted (was: Registering a coder is somewhat orthogonal to this section. The model

[jira] [Commented] (BEAM-232) Update AvroIO JavaDoc to Mention Registering Coder

[ https://issues.apache.org/jira/browse/BEAM-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268239#comment-15268239 ] Davor Bonaci commented on BEAM-232: --- Registering a coder is somewhat orthogonal to this section. The

[jira] [Commented] (BEAM-232) Update AvroIO JavaDoc to Mention Registering Coder

[ https://issues.apache.org/jira/browse/BEAM-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268238#comment-15268238 ] Davor Bonaci commented on BEAM-232: --- Registering a coder is somewhat orthogonal to this section. The

[jira] [Commented] (BEAM-233) Make Registering Avro Specific Records Easier

[ https://issues.apache.org/jira/browse/BEAM-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15268234#comment-15268234 ] Davor Bonaci commented on BEAM-233: --- [~kenn], can you comment? > Make Registering Avro Specific Records

[jira] [Updated] (BEAM-234) Remove the word Pipeline from the name of all PipelineRunner implementations

[ https://issues.apache.org/jira/browse/BEAM-234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-234: -- Assignee: Thomas Groh (was: Davor Bonaci) > Remove the word Pipeline from the name of all PipelineRunner