[jira] [Assigned] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2768: -- Assignee: Reuven Lax (was: Kenneth Knowles) > Fix bigquery.WriteTables generating

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2833

2017-08-15 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127687#comment-16127687 ] Eugene Kirpichov commented on BEAM-2768: Could you tell more about how you're using

[jira] [Commented] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127924#comment-16127924 ] Reuven Lax commented on BEAM-2768: -- The load job for a specific table is the UUID (which is generated when

[1/5] beam git commit: [BEAM-2740] Hide BeamSqlEnv.

2017-08-15 Thread takidau
Repository: beam Updated Branches: refs/heads/DSL_SQL 9eec6a030 -> a1cc5518e http://git-wip-us.apache.org/repos/asf/beam/blob/49aad927/sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/schema/BeamSqlRowCoderTest.java

[4/5] beam git commit: [BEAM-2740] Hide BeamSqlEnv.

2017-08-15 Thread takidau
[BEAM-2740] Hide BeamSqlEnv. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/49aad927 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/49aad927 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/49aad927 Branch:

[2/5] beam git commit: [BEAM-2740] Hide BeamSqlEnv.

2017-08-15 Thread takidau
http://git-wip-us.apache.org/repos/asf/beam/blob/49aad927/sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/BeamSqlApiSurfaceTest.java -- diff --git

[jira] [Commented] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread Matti Remes (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127852#comment-16127852 ] Matti Remes commented on BEAM-2768: --- {code:java} public static void loadRowsToBigQuery(String name,

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127927#comment-16127927 ] Kenneth Knowles commented on BEAM-2671: --- [~staslev] previously, timers were each processed

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4578

2017-08-15 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2769) Java Shim for submitting to Java Runners

2017-08-15 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-2769: - Summary: Java Shim for submitting to Java Runners Key: BEAM-2769 URL: https://issues.apache.org/jira/browse/BEAM-2769 Project: Beam Issue Type: Bug

[2/2] beam git commit: This closes #3718

2017-08-15 Thread tgroh
This closes #3718 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3a8b0b68 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3a8b0b68 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3a8b0b68 Branch:

[1/2] beam git commit: Fix Javadoc for waitUntilFinish

2017-08-15 Thread tgroh
Repository: beam Updated Branches: refs/heads/master f7e8f886c -> 3a8b0b68c Fix Javadoc for waitUntilFinish Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9ff3ac3d Tree:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3772

2017-08-15 Thread Apache Jenkins Server
See

[jira] [Closed] (BEAM-2722) Remove redundant windowing information from the BeamRecord itself

2017-08-15 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2722. Resolution: Fixed Fix Version/s: Not applicable > Remove redundant windowing information from the

[jira] [Closed] (BEAM-2740) update exposed methods in BeamSqlEnv

2017-08-15 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2740. Resolution: Fixed Fix Version/s: Not applicable > update exposed methods in BeamSqlEnv >

[GitHub] beam pull request #3720: [BEAM-2769] Add a JobApiRunner

2017-08-15 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3720 [BEAM-2769] Add a JobApiRunner Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3719: Add PipelineOptionsTranslation

2017-08-15 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3719 Add PipelineOptionsTranslation Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3718: Fix Javadoc for waitUntilFinish

2017-08-15 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3718 Fix Javadoc for waitUntilFinish Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[3/5] beam git commit: [BEAM-2740] Hide BeamSqlEnv.

2017-08-15 Thread takidau
http://git-wip-us.apache.org/repos/asf/beam/blob/49aad927/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/schema/kafka/BeamKafkaCSVTable.java -- diff --git

[5/5] beam git commit: [BEAM-2740] This closes #3708

2017-08-15 Thread takidau
[BEAM-2740] This closes #3708 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a1cc5518 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a1cc5518 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a1cc5518 Branch:

[GitHub] beam pull request #3718: Fix Javadoc for waitUntilFinish

2017-08-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3718 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2769) Java Shim for submitting to Java Runners

2017-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127998#comment-16127998 ] ASF GitHub Bot commented on BEAM-2769: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #3722: [BEAM-2768] Ensure that each triggered load generat...

2017-08-15 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/3722 [BEAM-2768] Ensure that each triggered load generates a different job id You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128315#comment-16128315 ] ASF GitHub Bot commented on BEAM-2768: -- GitHub user reuvenlax opened a pull request:

[jira] [Commented] (BEAM-1612) Support real Bundle in Flink runner

2017-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128268#comment-16128268 ] ASF GitHub Bot commented on BEAM-1612: -- Github user asfgit closed the pull request at:

[jira] [Closed] (BEAM-1612) Support real Bundle in Flink runner

2017-08-15 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-1612. Resolution: Fixed > Support real Bundle in Flink runner > --- > >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3775

2017-08-15 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2836

2017-08-15 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2772) BigQueryIO doesn't properly set job id when using triggered file loads

2017-08-15 Thread Reuven Lax (JIRA)
Reuven Lax created BEAM-2772: Summary: BigQueryIO doesn't properly set job id when using triggered file loads Key: BEAM-2772 URL: https://issues.apache.org/jira/browse/BEAM-2772 Project: Beam

[jira] [Commented] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128321#comment-16128321 ] Reuven Lax commented on BEAM-2768: -- Sorry - this pull request was intended for a different JIRA (it fixes

[GitHub] beam pull request #3368: [BEAM-1612] Support real Bundle in Flink runner

2017-08-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3368 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3774

2017-08-15 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2740) update exposed methods in BeamSqlEnv

2017-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128209#comment-16128209 ] ASF GitHub Bot commented on BEAM-2740: -- Github user xumingming closed the pull request at:

[GitHub] beam pull request #3708: [BEAM-2740] introduce the new InnerBeamSqlEnv/BeamS...

2017-08-15 Thread xumingming
Github user xumingming closed the pull request at: https://github.com/apache/beam/pull/3708 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (BEAM-2770) Mark all SQL APIs @Experiemental

2017-08-15 Thread Tyler Akidau (JIRA)
Tyler Akidau created BEAM-2770: -- Summary: Mark all SQL APIs @Experiemental Key: BEAM-2770 URL: https://issues.apache.org/jira/browse/BEAM-2770 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2770) Mark all SQL APIs @Experiemental

2017-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128042#comment-16128042 ] ASF GitHub Bot commented on BEAM-2770: -- GitHub user takidau opened a pull request:

[GitHub] beam pull request #3721: [BEAM-2770] Add @Experimental and ImmutableList.cop...

2017-08-15 Thread takidau
GitHub user takidau opened a pull request: https://github.com/apache/beam/pull/3721 [BEAM-2770] Add @Experimental and ImmutableList.copyOf Some final API polish, making sure \@Experimental annotations are on all the public SQL API classes, and immutable objects always return

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3773

2017-08-15 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2835

2017-08-15 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2834

2017-08-15 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2771) Allow using side inputs as ValueProviders

2017-08-15 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2771: --- Summary: Allow using side inputs as ValueProviders Key: BEAM-2771 URL: https://issues.apache.org/jira/browse/BEAM-2771 Project: Beam Issue Type: New Feature

[beam-site] branch asf-site updated (d6d0ef9 -> 0aabce4)

2017-08-15 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from d6d0ef9 This closes #290 add ac4992f Add MapReduce and Tez runners to ongoing projects. add

[beam-site] 01/01: Prepare repository for deployment.

2017-08-15 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 0aabce40315fe8af2d93198922057b11519383f5 Author: Mergebot AuthorDate: Wed Aug 16

[beam-site] 02/02: This closes #282

2017-08-15 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit d2a5750d2431f7ae9637add3bd03dc36424fe33c Merge: d6d0ef9 ac4992f Author: Mergebot

[beam-site] branch mergebot updated (cb01a19 -> d2a5750)

2017-08-15 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard cb01a19 This closes #285 discard 80eadfa add MingminXu to team.md add b4431d4 Update company

[beam-site] 01/02: Add MapReduce and Tez runners to ongoing projects.

2017-08-15 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit ac4992fac11a6468d818c106170eadb6928d62fa Author: Pei He AuthorDate: Wed Aug 9 10:32:37

[1/2] beam git commit: [BEAM-1612] Support real Bundle in Flink runner

2017-08-15 Thread pei
Repository: beam Updated Branches: refs/heads/master 3a8b0b68c -> 724eda37e [BEAM-1612] Support real Bundle in Flink runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ceec7ce5 Tree:

[2/2] beam git commit: This closes #3368

2017-08-15 Thread pei
This closes #3368 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/724eda37 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/724eda37 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/724eda37 Branch:

[jira] [Updated] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread Matti Remes (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matti Remes updated BEAM-2768: -- Description: This is a result of BigQueryIO not creating unique job ids for batch inserts, thus

[jira] [Created] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread Matti Remes (JIRA)
Matti Remes created BEAM-2768: - Summary: Fix bigquery.WriteTables generating non-unique job identifiers Key: BEAM-2768 URL: https://issues.apache.org/jira/browse/BEAM-2768 Project: Beam Issue

[jira] [Updated] (BEAM-2768) Fix bigquery.WriteTables generating non-unique job identifiers

2017-08-15 Thread Matti Remes (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matti Remes updated BEAM-2768: -- Description: This is a result of BigQueryIO not creating unique job ids for batch inserts, thus

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4576

2017-08-15 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3770

2017-08-15 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2831

2017-08-15 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2767) BigQueryIO result different for REPEATED field between DirectRunner and DataflowRunner

2017-08-15 Thread Andre (JIRA)
Andre created BEAM-2767: --- Summary: BigQueryIO result different for REPEATED field between DirectRunner and DataflowRunner Key: BEAM-2767 URL: https://issues.apache.org/jira/browse/BEAM-2767 Project: Beam

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2832

2017-08-15 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4577

2017-08-15 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3771

2017-08-15 Thread Apache Jenkins Server
See