[jira] [Commented] (BEAM-886) Support new DoFn in Python SDK

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837338#comment-15837338 ] ASF GitHub Bot commented on BEAM-886: - GitHub user sb2nov opened a pull request: ht

[GitHub] beam pull request #1842: [BEAM-886] Migrate CallableWrapperDoFn to extend Ne...

2017-01-24 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1842 [BEAM-886] Migrate CallableWrapperDoFn to extend NewDoFn - Migrate the CallableWrapperDoFn class to extend NewDoFn instead of OldDoFn - Add a test for callables such as set/list as they can not be

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1085

2017-01-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #1084

2017-01-24 Thread Apache Jenkins Server
See -- [...truncated 909 lines...] test_repr (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok test_tuple_compatibility (apache_beam.typehints.typehints_test.IterableHintTe

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #2427

2017-01-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1311) Flink Translations are not properly 1-to-1 with the PValues, PInputs, or POutputs

2017-01-24 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837060#comment-15837060 ] Thomas Groh commented on BEAM-1311: --- Basically I munged a call to {{getTag()}} and a call

[jira] [Created] (BEAM-1311) Flink Translations are not properly 1-to-1 with the PValues, PInputs, or POutputs

2017-01-24 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1311: - Summary: Flink Translations are not properly 1-to-1 with the PValues, PInputs, or POutputs Key: BEAM-1311 URL: https://issues.apache.org/jira/browse/BEAM-1311 Project: Beam

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #1435

2017-01-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1310) Add running integration tests for JdbcIO

2017-01-24 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837042#comment-15837042 ] Stephen Sisk commented on BEAM-1310: Pull request: https://github.com/apache/beam/pull/

[jira] [Issue Comment Deleted] (BEAM-1310) Add running integration tests for JdbcIO

2017-01-24 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk updated BEAM-1310: --- Comment: was deleted (was: Pull request: https://github.com/apache/beam/pull/1841) > Add running integ

[jira] [Commented] (BEAM-1310) Add running integration tests for JdbcIO

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837034#comment-15837034 ] ASF GitHub Bot commented on BEAM-1310: -- GitHub user ssisk opened a pull request:

[GitHub] beam pull request #1841: BEAM-1310 Add integration tests for JdbcIO

2017-01-24 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/1841 BEAM-1310 Add integration tests for JdbcIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted like:

[GitHub] beam pull request #1838: Refactor BigQueryServices to have TableReference in...

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1838 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Refactor BigQueryServices to have TableReference in methods signatures

2017-01-24 Thread tgroh
Repository: beam Updated Branches: refs/heads/master e77de7c61 -> 7402d7600 Refactor BigQueryServices to have TableReference in methods signatures Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f9d1d682 Tree: http://git-wip

[2/2] beam git commit: This closes #1838

2017-01-24 Thread tgroh
This closes #1838 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7402d760 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7402d760 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7402d760 Branch: refs/heads/maste

[jira] [Commented] (BEAM-1310) Add running integration tests for JdbcIO

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837024#comment-15837024 ] ASF GitHub Bot commented on BEAM-1310: -- Github user ssisk closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #1434

2017-01-24 Thread Apache Jenkins Server
See

[GitHub] beam pull request #1840: BEAM-1310 Add integration tests for JdbcIO

2017-01-24 Thread ssisk
Github user ssisk closed the pull request at: https://github.com/apache/beam/pull/1840 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (BEAM-1310) Add running integration tests for JdbcIO

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837006#comment-15837006 ] ASF GitHub Bot commented on BEAM-1310: -- GitHub user ssisk opened a pull request:

[GitHub] beam pull request #1840: BEAM-1310 Add integration tests for JdbcIO

2017-01-24 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/1840 BEAM-1310 Add integration tests for JdbcIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X ] Make sure the PR title is formatted like:

[GitHub] beam pull request #1839: Check that a Multi-Output map contains the Tag, not...

2017-01-24 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1839 Check that a Multi-Output map contains the Tag, not the TaggedValue Fixes Flink Batch translation. Be sure to do all of the following to help us incorporate your contribution quickly and ea

[jira] [Created] (BEAM-1310) Add running integration tests for JdbcIO

2017-01-24 Thread Stephen Sisk (JIRA)
Stephen Sisk created BEAM-1310: -- Summary: Add running integration tests for JdbcIO Key: BEAM-1310 URL: https://issues.apache.org/jira/browse/BEAM-1310 Project: Beam Issue Type: Bug Com

[jira] [Created] (BEAM-1309) FileIOChannelFactory.match() traverses entire parent directory recursively

2017-01-24 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1309: -- Summary: FileIOChannelFactory.match() traverses entire parent directory recursively Key: BEAM-1309 URL: https://issues.apache.org/jira/browse/BEAM-1309 Project: B

[jira] [Commented] (BEAM-1218) De-Googlify Python SDK

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836963#comment-15836963 ] ASF GitHub Bot commented on BEAM-1218: -- Github user aaltay closed the pull request at:

[GitHub] beam pull request #1836: [BEAM-1218] Install test dependencies in the post c...

2017-01-24 Thread aaltay
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1836 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (BEAM-1298) Increment major version used by Dataflow runner to 5

2017-01-24 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-1298. -- Resolution: Fixed Fix Version/s: Not applicable > Increment major version used by

[jira] [Resolved] (BEAM-1239) Update examples to use Beam text source

2017-01-24 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-1239. -- Resolution: Fixed Fix Version/s: Not applicable > Update examples to use Beam text

[jira] [Resolved] (BEAM-1299) Remove native text source and sink

2017-01-24 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-1299. -- Resolution: Fixed Fix Version/s: Not applicable > Remove native text source and si

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #2426

2017-01-24 Thread Apache Jenkins Server
See -- [...truncated 10995 lines...] at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363)

[GitHub] beam pull request #1838: Refactor BigQueryServices to have TableReference in...

2017-01-24 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1838 Refactor BigQueryServices to have TableReference in methods signatures. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[jira] [Resolved] (BEAM-1302) Improve warning messages in BigQueryServicesImpl.

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He resolved BEAM-1302. -- Resolution: Fixed Fix Version/s: 0.5.0 > Improve warning messages in BigQueryServicesImpl. > -

[jira] [Commented] (BEAM-1302) Improve warning messages in BigQueryServicesImpl.

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836938#comment-15836938 ] Pei He commented on BEAM-1302: -- Fixed in https://github.com/apache/beam/commit/2a23e8b5dd11c8

[GitHub] beam pull request #1820: [BEAM-1299] Removes Dataflow native text source and...

2017-01-24 Thread chamikaramj
Github user chamikaramj closed the pull request at: https://github.com/apache/beam/pull/1820 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1299) Remove native text source and sink

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836930#comment-15836930 ] ASF GitHub Bot commented on BEAM-1299: -- Github user chamikaramj closed the pull reques

[jira] [Commented] (BEAM-1218) De-Googlify Python SDK

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836929#comment-15836929 ] ASF GitHub Bot commented on BEAM-1218: -- GitHub user robertwb opened a pull request:

[jira] [Resolved] (BEAM-1258) BigQueryIO.Write: CREATE_IF_NEEDED and per-window tables is broken

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He resolved BEAM-1258. -- Resolution: Fixed > BigQueryIO.Write: CREATE_IF_NEEDED and per-window tables is broken >

[GitHub] beam pull request #1837: [BEAM-1218 ] Remove dataflow_test.py

2017-01-24 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/1837 [BEAM-1218 ] Remove dataflow_test.py This reverts commit 96fcc7d31c2540f867c3a73903c2aa99183a6b8b. Be sure to do all of the following to help us incorporate your contribution quickly and

[2/2] beam git commit: Closes #1836

2017-01-24 Thread robertwb
Closes #1836 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9540cf17 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9540cf17 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9540cf17 Branch: refs/heads/python-sdk

[1/2] beam git commit: Install test dependencies in the post commit script.

2017-01-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/python-sdk 43cb4d709 -> 9540cf176 Install test dependencies in the post commit script. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/19789db9 Tree: http://git-wip-us.apache.org

[2/2] beam git commit: Closes #1820

2017-01-24 Thread robertwb
Closes #1820 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/43cb4d70 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/43cb4d70 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/43cb4d70 Branch: refs/heads/python-sdk

[1/2] beam git commit: Removes Dataflow native text source and sink from Beam SDK.

2017-01-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/python-sdk f9831236c -> 43cb4d709 Removes Dataflow native text source and sink from Beam SDK. Users should be using Beam text source and sink available in module 'textio.py' instead of this. Also removes Dataflow native file source/sink that is o

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #1433

2017-01-24 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1082

2017-01-24 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #1432

2017-01-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-59) IOChannelFactory rethinking/redesign

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836878#comment-15836878 ] ASF GitHub Bot commented on BEAM-59: Github user asfgit closed the pull request at:

[1/2] beam git commit: [BEAM-59] Beam FileSystem.setDefaultConfig: remove scheme from the signature.

2017-01-24 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 1148be6bb -> e77de7c61 [BEAM-59] Beam FileSystem.setDefaultConfig: remove scheme from the signature. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4cdd8771 Tree: http://

[GitHub] beam pull request #1826: [BEAM-59] Beam FileSystem.setDefaultConfig: remove ...

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1826 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #1826

2017-01-24 Thread dhalperi
This closes #1826 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e77de7c6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e77de7c6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e77de7c6 Branch: refs/heads/maste

[jira] [Closed] (BEAM-1307) DataflowRunner tests failing with a test using an unbounded source

2017-01-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1307. - Resolution: Fixed Fix Version/s: (was: 0.5.0) Not applicable > Datafl

[jira] [Commented] (BEAM-1307) DataflowRunner tests failing with a test using an unbounded source

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836873#comment-15836873 ] ASF GitHub Bot commented on BEAM-1307: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #1834

2017-01-24 Thread dhalperi
This closes #1834 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1148be6b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1148be6b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1148be6b Branch: refs/heads/maste

[1/2] beam git commit: Add a UsesUnboundedPCollections category and exclude it from DataflowRunner batch tests

2017-01-24 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master f2389ab7b -> 1148be6bb Add a UsesUnboundedPCollections category and exclude it from DataflowRunner batch tests Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bffe80d5 Tr

[GitHub] beam pull request #1834: [BEAM-1307] Add a UsesUnboundedPCollections categor...

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1834 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #1431

2017-01-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1218) De-Googlify Python SDK

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836823#comment-15836823 ] ASF GitHub Bot commented on BEAM-1218: -- GitHub user aaltay opened a pull request:

[GitHub] beam pull request #1836: [BEAM-1218] Install test dependencies in the post c...

2017-01-24 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1836 [BEAM-1218] Install test dependencies in the post commit script. We should be able re-do the https://github.com/apache/beam/pull/1813 change, with this change. You can merge this pull request into a

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Dataflow #2094

2017-01-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1071) Support pre-existing tables with streaming BigQueryIO

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836785#comment-15836785 ] ASF GitHub Bot commented on BEAM-1071: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: [BEAM-1071] Allow for BigQueryIO to write tables with CREATE_NEVER disposition

2017-01-24 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 11c3cd70b -> f2389ab7b [BEAM-1071] Allow for BigQueryIO to write tables with CREATE_NEVER disposition Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dc369522 Tree: http:/

[GitHub] beam pull request #1590: [BEAM-1071] Allow for streaming tables with CREATE_...

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1590 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #1590

2017-01-24 Thread dhalperi
This closes #1590 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f2389ab7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f2389ab7 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f2389ab7 Branch: refs/heads/maste

[GitHub] beam pull request #1835: Refactoring metrics for cross-runner context switch...

2017-01-24 Thread pabloem
GitHub user pabloem opened a pull request: https://github.com/apache/beam/pull/1835 Refactoring metrics for cross-runner context switch for DoFns. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR titl

Build failed in Jenkins: beam_PostCommit_Python_Verify #1081

2017-01-24 Thread Apache Jenkins Server
See -- [...truncated 12631 lines...] raise type(exn), args, sys.exc_info()[2] File "apache_beam/runners/common.py", line 265, in apache_beam.runners.common.DoFnRunner.process (apache

[jira] [Updated] (BEAM-1306) Support additional configuration in BigQueryServices.insertAll()

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1306: - Description: ignoreUnknownValues is requested in https://issues.apache.org/jira/browse/BEAM-1267 There are additi

[jira] [Updated] (BEAM-1306) Support additional configuration in BigQueryServices.insertAll()

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1306: - Description: ignoreUnknownValues is requested in https://issues.apache.org/jira/browse/BEAM-1267 There are additi

[jira] [Created] (BEAM-1308) Consider removing TimeDomain from user APIs

2017-01-24 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-1308: - Summary: Consider removing TimeDomain from user APIs Key: BEAM-1308 URL: https://issues.apache.org/jira/browse/BEAM-1308 Project: Beam Issue Type: Improvem

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #1430

2017-01-24 Thread Apache Jenkins Server
See

Re: Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #2093

2017-01-24 Thread Dan Halperin
https://issues.apache.org/jira/browse/BEAM-1307 -- PR is out to fix. On Tue, Jan 24, 2017 at 1:40 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See RunnableOnService_Dataflow/changes> > >

[jira] [Created] (BEAM-1307) DataflowRunner tests failing with a test using an unbounded source

2017-01-24 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1307: - Summary: DataflowRunner tests failing with a test using an unbounded source Key: BEAM-1307 URL: https://issues.apache.org/jira/browse/BEAM-1307 Project: Beam

[GitHub] beam pull request #1833: Removes ReduceFnExecutor interface

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1833 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Removes ReduceFnExecutor interface

2017-01-24 Thread kenn
Repository: beam Updated Branches: refs/heads/master b3334879f -> 11c3cd70b Removes ReduceFnExecutor interface Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8989473b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8

[2/2] beam git commit: This closes #1833: Removes ReduceFnExecutor interface

2017-01-24 Thread kenn
This closes #1833: Removes ReduceFnExecutor interface Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/11c3cd70 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/11c3cd70 Diff: http://git-wip-us.apache.org/repos/asf/beam/dif

[GitHub] beam pull request #1834: [NEEDS JIRA] Add a UsesUnboundedPCollections catego...

2017-01-24 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/1834 [NEEDS JIRA] Add a UsesUnboundedPCollections category and exclude it from DataflowRunner in batch R: @tgroh You can merge this pull request into a Git repository by running: $ git pull https:

[jira] [Assigned] (BEAM-1306) Support additional configuration in BigQueryServices.insertAll()

2017-01-24 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-1306: Assignee: Pei He (was: Davor Bonaci) > Support additional configuration in BigQueryServices.insertAll() > -

[jira] [Created] (BEAM-1306) Support additional configuration in BigQueryServices.insertAll()

2017-01-24 Thread Pei He (JIRA)
Pei He created BEAM-1306: Summary: Support additional configuration in BigQueryServices.insertAll() Key: BEAM-1306 URL: https://issues.apache.org/jira/browse/BEAM-1306 Project: Beam Issue Type: Impr

[jira] [Created] (BEAM-1305) Support additional configuration in BigQueryServices.insertAll()

2017-01-24 Thread Pei He (JIRA)
Pei He created BEAM-1305: Summary: Support additional configuration in BigQueryServices.insertAll() Key: BEAM-1305 URL: https://issues.apache.org/jira/browse/BEAM-1305 Project: Beam Issue Type: Impr

[GitHub] beam pull request #1832: Fix case where side inputs may be an iterable rathe...

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1832 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: Closes #1832

2017-01-24 Thread robertwb
Closes #1832 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f9831236 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f9831236 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f9831236 Branch: refs/heads/python-sdk

[1/2] beam git commit: Fix case where side inputs may be an iterable rather than a list.

2017-01-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/python-sdk d0dc1f375 -> f9831236c Fix case where side inputs may be an iterable rather than a list. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9052366f Tree: http://git-wip-

[jira] [Commented] (BEAM-278) Add I/O section

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836673#comment-15836673 ] ASF GitHub Bot commented on BEAM-278: - Github user melap closed the pull request at:

[GitHub] beam-site pull request #96: [BEAM-278] Add I/O section to programming guide

2017-01-24 Thread melap
Github user melap closed the pull request at: https://github.com/apache/beam-site/pull/96 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Dataflow #2093

2017-01-24 Thread Apache Jenkins Server
See

[GitHub] beam pull request #1833: Removes ReduceFnExecutor interface

2017-01-24 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/1833 Removes ReduceFnExecutor interface R: @kennknowles You can merge this pull request into a Git repository by running: $ git pull https://github.com/jkff/incubator-beam old-cleanups Alternatively y

Build failed in Jenkins: beam_PostCommit_Python_Verify #1080

2017-01-24 Thread Apache Jenkins Server
See -- [...truncated 12707 lines...] raise type(exn), args, sys.exc_info()[2] File "apache_beam/runners/common.py", line 265, in apache_beam.runners.common.DoFnRunner.process (apache

Jenkins build is still unstable: beam_PostCommit_Java_RunnableOnService_Flink #1429

2017-01-24 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-1304) NPE if trying to get value of Aggregator that does not exist.

2017-01-24 Thread Amit Sela (JIRA)
Amit Sela created BEAM-1304: --- Summary: NPE if trying to get value of Aggregator that does not exist. Key: BEAM-1304 URL: https://issues.apache.org/jira/browse/BEAM-1304 Project: Beam Issue Type: B

[jira] [Commented] (BEAM-1258) BigQueryIO.Write: CREATE_IF_NEEDED and per-window tables is broken

2017-01-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836584#comment-15836584 ] ASF GitHub Bot commented on BEAM-1258: -- Github user asfgit closed the pull request at:

[4/4] beam git commit: This closes #1825

2017-01-24 Thread dhalperi
This closes #1825 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b3334879 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b3334879 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b3334879 Branch: refs/heads/maste

[1/4] beam git commit: [BEAM-1258] demote retrying loggings to info level.

2017-01-24 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master cb6e0a80c -> b3334879f [BEAM-1258] demote retrying loggings to info level. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3afdc5c0 Tree: http://git-wip-us.apache.org/repo

[GitHub] beam pull request #1825: [BEAM-1258] Improve logging in BigQueryIO.verifyTab...

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1825 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/4] beam git commit: [BEAM-1302] BigQueryServicesImpl: skip logging warning if exceptions do not need retry.

2017-01-24 Thread dhalperi
[BEAM-1302] BigQueryServicesImpl: skip logging warning if exceptions do not need retry. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2a23e8b5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2a23e8b5 Diff: http://git-w

[3/4] beam git commit: [BEAM-1258] Improve logging in BigQueryIO.verifyTableEmpty().

2017-01-24 Thread dhalperi
[BEAM-1258] Improve logging in BigQueryIO.verifyTableEmpty(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5b6dd91d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5b6dd91d Diff: http://git-wip-us.apache.org/repos/asf/

[jira] [Commented] (BEAM-1229) flink KafkaIOExamples submit error

2017-01-24 Thread Alexey Diomin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836570#comment-15836570 ] Alexey Diomin commented on BEAM-1229: - yes, example already fixed > flink KafkaIOExamp

[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-01-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836555#comment-15836555 ] Amit Sela commented on BEAM-302: Oh, got it, thanks! > Add Scio Scala DSL to Beam > ---

[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-01-24 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836553#comment-15836553 ] Neville Li commented on BEAM-302: - WIP branch here using 0.4.0 https://github.com/spotify/sc

[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-01-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836551#comment-15836551 ] Amit Sela commented on BEAM-302: You mean 0.5.0 ? > Add Scio Scala DSL to Beam > --

[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-01-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836549#comment-15836549 ] Jean-Baptiste Onofré commented on BEAM-302: --- I updated to 0.4.0 release and I will

[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-01-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836540#comment-15836540 ] Amit Sela commented on BEAM-302: [~davor] where are we with Scio integration ? > Add Scio S

[GitHub] beam pull request #1832: Fix case where side inputs may be an iterable rathe...

2017-01-24 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/1832 Fix case where side inputs may be an iterable rather than a list. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Commented] (BEAM-302) Add Scio Scala DSL to Beam

2017-01-24 Thread Chaoran Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15836537#comment-15836537 ] Chaoran Yu commented on BEAM-302: - Thanks Amit for the clarification. Any idea for which rel

  1   2   >