[jira] [Commented] (BEAM-1303) Improve ToString Class

[ https://issues.apache.org/jira/browse/BEAM-1303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15842336#comment-15842336 ] ASF GitHub Bot commented on BEAM-1303: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #1830

This closes #1830 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/47304d1f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/47304d1f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/47304d1f Branch:

[GitHub] beam pull request #1830: [BEAM-1303] ToString Improvements

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1830 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Refactored existing code. Added iterable and KV. Changed from element to of.

Repository: beam Updated Branches: refs/heads/master 83f8c460c -> 47304d1fc Refactored existing code. Added iterable and KV. Changed from element to of. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e01ce864 Tree:

[jira] [Commented] (BEAM-362) Move shared runner functionality out of SDK and into runners/core-java

[ https://issues.apache.org/jira/browse/BEAM-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1584#comment-1584 ] ASF GitHub Bot commented on BEAM-362: - GitHub user kennknowles opened a pull request:

[GitHub] beam pull request #1858: [BEAM-362] Move state-oriented remnants of OldDoFn ...

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1858 [BEAM-362] Move state-oriented remnants of OldDoFn to runners/core-java Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[jira] [Resolved] (BEAM-1177) Input DStream "bundles" should be in serialized form and include relevant metadata.

[ https://issues.apache.org/jira/browse/BEAM-1177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-1177. Resolution: Fixed > Input DStream "bundles" should be in serialized form and include relevant >

[jira] [Updated] (BEAM-1327) Replace OutputTimeFn with enum

[ https://issues.apache.org/jira/browse/BEAM-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1327: -- Issue Type: New Feature (was: Bug) > Replace OutputTimeFn with enum >

[jira] [Created] (BEAM-1328) Serialize/deserialize WindowingStrategy in a language-agnostic manner

Kenneth Knowles created BEAM-1328: - Summary: Serialize/deserialize WindowingStrategy in a language-agnostic manner Key: BEAM-1328 URL: https://issues.apache.org/jira/browse/BEAM-1328 Project: Beam

[jira] [Created] (BEAM-1327) Replace OutputTimeFn with enum

Kenneth Knowles created BEAM-1327: - Summary: Replace OutputTimeFn with enum Key: BEAM-1327 URL: https://issues.apache.org/jira/browse/BEAM-1327 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-1235) BigQueryIO doesn't show the load job error to the user

[ https://issues.apache.org/jira/browse/BEAM-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1235. --- Resolution: Fixed > BigQueryIO doesn't show the load job error to the user >

[jira] [Commented] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840885#comment-15840885 ] Daniel Halperin commented on BEAM-1315: --- I don't think this needs to be a blocker for the release, so

[jira] [Updated] (BEAM-1315) FileBasedSink could write tmp files above the output prefix.

[ https://issues.apache.org/jira/browse/BEAM-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1315: -- Fix Version/s: (was: 0.5.0) > FileBasedSink could write tmp files above the output prefix. >

[GitHub] beam pull request #1857: Updating dataflow client protos

GitHub user pabloem opened a pull request: https://github.com/apache/beam/pull/1857 Updating dataflow client protos Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-1235) BigQueryIO doesn't show the load job error to the user

[ https://issues.apache.org/jira/browse/BEAM-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840798#comment-15840798 ] ASF GitHub Bot commented on BEAM-1235: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: [BEAM-1235] BigQueryIO.Write: log failed load/copy jobs.

Repository: beam Updated Branches: refs/heads/master 2cbc08b58 -> 83f8c460c [BEAM-1235] BigQueryIO.Write: log failed load/copy jobs. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6531545e Tree:

[2/2] beam git commit: This closes #1823

This closes #1823 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/83f8c460 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/83f8c460 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/83f8c460 Branch:

[jira] [Commented] (BEAM-1270) Display data for ReadFromText/WriteToText is not being shown

[ https://issues.apache.org/jira/browse/BEAM-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840746#comment-15840746 ] ASF GitHub Bot commented on BEAM-1270: -- Github user pabloem closed the pull request at:

[GitHub] beam pull request #1835: Refactoring metrics for cross-runner context switch...

Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/1835 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1776: [BEAM-1270] Fix display data for ReadFromText and W...

Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/1776 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1095

See

[1/2] beam git commit: Refactoring metrics infrastructure

Repository: beam Updated Branches: refs/heads/python-sdk e3849af8c -> 3d6f20d67 Refactoring metrics infrastructure Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b148f5cc Tree:

[2/2] beam git commit: Closes #1835

Closes #1835 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3d6f20d6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3d6f20d6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3d6f20d6 Branch:

[1/2] beam git commit: Fix read/write display data

Repository: beam Updated Branches: refs/heads/python-sdk c6420df97 -> e3849af8c Fix read/write display data Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e4eda3c3 Tree:

[2/2] beam git commit: Closes #1776

Closes #1776 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e3849af8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e3849af8 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e3849af8 Branch:

[jira] [Resolved] (BEAM-1326) WindowedWordCountIT generated output location can easily collide

[ https://issues.apache.org/jira/browse/BEAM-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-1326. --- Resolution: Fixed Fix Version/s: 0.5.0 > WindowedWordCountIT generated output location

[jira] [Commented] (BEAM-1326) WindowedWordCountIT generated output location can easily collide

[ https://issues.apache.org/jira/browse/BEAM-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840592#comment-15840592 ] ASF GitHub Bot commented on BEAM-1326: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #1856

This closes #1856 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2cbc08b5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2cbc08b5 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2cbc08b5 Branch:

[GitHub] beam pull request #1856: [BEAM-1326] Add prefix and suffix to WindowedWordCo...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1856 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Add prefix and suffix to WindowedWordCountIT output location

Repository: beam Updated Branches: refs/heads/master 963772414 -> 2cbc08b58 Add prefix and suffix to WindowedWordCountIT output location Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4d0225e8 Tree:

[jira] [Commented] (BEAM-1326) WindowedWordCountIT generated output location can easily collide

[ https://issues.apache.org/jira/browse/BEAM-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840528#comment-15840528 ] ASF GitHub Bot commented on BEAM-1326: -- GitHub user kennknowles opened a pull request:

[jira] [Created] (BEAM-1326) WindowedWordCountIT generated output location can easily collide

Kenneth Knowles created BEAM-1326: - Summary: WindowedWordCountIT generated output location can easily collide Key: BEAM-1326 URL: https://issues.apache.org/jira/browse/BEAM-1326 Project: Beam

[GitHub] beam pull request #1856: [BEAM-1326] Add prefix and suffix to WindowedWordCo...

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1856 [BEAM-1326] Add prefix and suffix to WindowedWordCountIT output location Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

Build failed in Jenkins: beam_PostCommit_Python_Verify #1094

See -- [...truncated 3756 lines...] { "key": "fn", "label": "Transform Function", "namespace":

[jira] [Commented] (BEAM-1316) DoFn#startBundle and #finishBundle should not be able to output

[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840324#comment-15840324 ] Kenneth Knowles commented on BEAM-1316: --- That is a good example that breaks my false dichotomy. I

[GitHub] beam pull request #1855: Add wrapping of lambda in a SimpleFunction

GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/1855 Add wrapping of lambda in a SimpleFunction Here's a fun trick for getting a type descriptor attached to a lambda that seems nicer than `.withOutputType(...)`. For discussion. You can merge this

[jira] [Comment Edited] (BEAM-1317) Strategy around snippet versioning

[ https://issues.apache.org/jira/browse/BEAM-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840219#comment-15840219 ] Davor Bonaci edited comment on BEAM-1317 at 1/26/17 6:57 PM: - I think policy is

[jira] [Commented] (BEAM-1317) Strategy around snippet versioning

[ https://issues.apache.org/jira/browse/BEAM-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840219#comment-15840219 ] Davor Bonaci commented on BEAM-1317: I think policy is the solution -- take snippets from a released

[GitHub] beam pull request #1854: Some performance improvements to NewDoFn but moving...

GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1854 Some performance improvements to NewDoFn but moving common code The NewDoFN are still slower than the Old one but this improves the performance a bit. R: @robertwb PTAL Be sure to

[jira] [Commented] (BEAM-886) Support new DoFn in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840204#comment-15840204 ] ASF GitHub Bot commented on BEAM-886: - Github user sb2nov closed the pull request at:

[GitHub] beam pull request #1852: Update the NOTICE year range

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1852 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Update the NOTICE year range

Repository: beam Updated Branches: refs/heads/master 717b415f1 -> 963772414 Update the NOTICE year range Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b97b3935 Tree:

[jira] [Resolved] (BEAM-560) In JAXBCoder, use a pair of ThreadLocals to cache Marshaller/Unmarshaller

[ https://issues.apache.org/jira/browse/BEAM-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-560. --- Resolution: Fixed Assignee: Kai Jiang (was: Davor Bonaci) > In JAXBCoder, use a pair of

[jira] [Resolved] (BEAM-974) Adds attributes support to PubsubIO

[ https://issues.apache.org/jira/browse/BEAM-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-974. -- Resolution: Fixed Fix Version/s: 0.5.0 > Adds attributes support to PubsubIO >

[GitHub] beam pull request #1853: [BEAM-974] DataflowRunner: upgrade worker with Pubs...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1853 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: DataflowRunner: upgrade worker with Pubsub attribute changes

l index 9858b3d..b446b7b 100644 --- a/runners/google-cloud-dataflow-java/pom.xml +++ b/runners/google-cloud-dataflow-java/pom.xml @@ -33,7 +33,7 @@ jar - beam-master-20170120 + beam-master-20170126 6

[2/2] beam git commit: This closes #1853

This closes #1853 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/717b415f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/717b415f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/717b415f Branch:

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840015#comment-15840015 ] Eugene Kirpichov commented on BEAM-1323: I don't think there's a generic way to automatically split

[jira] [Commented] (BEAM-1316) DoFn#startBundle and #finishBundle should not be able to output

[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840014#comment-15840014 ] Daniel Halperin commented on BEAM-1316: --- What if my output includes a list of filenames paired with

[jira] [Commented] (BEAM-1316) DoFn#startBundle and #finishBundle should not be able to output

[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840002#comment-15840002 ] Kenneth Knowles commented on BEAM-1316: --- I suggest very explicitly distinguishing flushing to

[jira] [Resolved] (BEAM-1248) Combine with side inputs API should match ParDo

[ https://issues.apache.org/jira/browse/BEAM-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-1248. --- Resolution: Fixed > Combine with side inputs API should match ParDo >

[jira] [Commented] (BEAM-1325) DataflowRunner support for Class-Path jars

[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839880#comment-15839880 ] Luke Cwik commented on BEAM-1325: - We can recursively look at the "Class-Path" manifest of each jar, seeded

[jira] [Updated] (BEAM-1325) DataflowRunner support for Class-Path jars

[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1325: -- Description: See https://github.com/GoogleCloudPlatform/DataflowJavaSDK/issues/538 The code

[jira] [Commented] (BEAM-947) WindowedWordCountIT fails due to not setting "--output" pipeline options

[ https://issues.apache.org/jira/browse/BEAM-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839847#comment-15839847 ] Daniel Halperin commented on BEAM-947: -- (ignore the above PR -- I tagged the wrong issue). Should be

[jira] [Commented] (BEAM-814) Improve performance when staging files

[ https://issues.apache.org/jira/browse/BEAM-814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839843#comment-15839843 ] ASF GitHub Bot commented on BEAM-814: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #1849: [BEAM-814] Dataflow: parallelize staging of files

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1849 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/3] beam git commit: PackageUtil: preserve classpath ordering when uploading

PackageUtil: preserve classpath ordering when uploading Also add a test Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b0b91c84 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b0b91c84 Diff:

[1/3] beam git commit: Recommit "DataflowRunner: parallelize staging of files"

Repository: beam Updated Branches: refs/heads/master 1c6e66741 -> b4726d088 Recommit "DataflowRunner: parallelize staging of files" Revert "This closes #1847" This reverts commit 1c6e667414788fe99f583fac39d458a4984ae162, reversing changes made to 6413299a20be57de849684479134479fa1acee2d.

[jira] [Commented] (BEAM-1325) DataflowRunner support for Class-Path jars

[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839827#comment-15839827 ] Daniel Halperin commented on BEAM-1325: --- This SO post:

[jira] [Comment Edited] (BEAM-1325) DataflowRunner support for Class-Path jars

[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839821#comment-15839821 ] Luke Cwik edited comment on BEAM-1325 at 1/26/17 3:07 PM: -- Its not just that the

[jira] [Commented] (BEAM-1325) DataflowRunner support for Class-Path jars

[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839821#comment-15839821 ] Luke Cwik commented on BEAM-1325: - Its not just that the Class-Path should be understood and added to

[jira] [Commented] (BEAM-947) WindowedWordCountIT fails due to not setting "--output" pipeline options

[ https://issues.apache.org/jira/browse/BEAM-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839803#comment-15839803 ] ASF GitHub Bot commented on BEAM-947: - GitHub user dhalperi opened a pull request:

[GitHub] beam pull request #1853: [BEAM-947] DataflowRunner: upgrade worker with Pubs...

GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/1853 [BEAM-947] DataflowRunner: upgrade worker with Pubsub attribute changes You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/beam

[jira] [Created] (BEAM-1325) DataflowRunner support for Class-Path jars

Daniel Halperin created BEAM-1325: - Summary: DataflowRunner support for Class-Path jars Key: BEAM-1325 URL: https://issues.apache.org/jira/browse/BEAM-1325 Project: Beam Issue Type: New

[GitHub] beam pull request #1852: Update the NOTICE year range

GitHub user jbonofre opened a pull request: https://github.com/apache/beam/pull/1852 Update the NOTICE year range Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-214) Create Parquet IO

[ https://issues.apache.org/jira/browse/BEAM-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15839674#comment-15839674 ] ASF GitHub Bot commented on BEAM-214: - GitHub user jbonofre opened a pull request:

[GitHub] beam pull request #1851: [BEAM-214] Add ParquetIO

GitHub user jbonofre opened a pull request: https://github.com/apache/beam/pull/1851 [BEAM-214] Add ParquetIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted like: `[BEAM-]

[jira] [Created] (BEAM-1324) Able to define the thread count via PipelineOptions

Jean-Baptiste Onofré created BEAM-1324: -- Summary: Able to define the thread count via PipelineOptions Key: BEAM-1324 URL: https://issues.apache.org/jira/browse/BEAM-1324 Project: Beam

[jira] [Assigned] (BEAM-1248) Combine with side inputs API should match ParDo

[ https://issues.apache.org/jira/browse/BEAM-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang reassigned BEAM-1248: --- Assignee: Kai Jiang > Combine with side inputs API should match ParDo >

[jira] [Updated] (BEAM-1248) Combine with side inputs API should match ParDo

[ https://issues.apache.org/jira/browse/BEAM-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang updated BEAM-1248: Fix Version/s: 0.5.0 > Combine with side inputs API should match ParDo >