[GitHub] beam-site pull request #256: Add Hive (HCatalog) to the list of available I/...

Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/256 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[3/3] beam-site git commit: This closes #256

This closes #256 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/1c164e08 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/1c164e08 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/1c164e08

[2/3] beam-site git commit: Regenerate website

Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/b49b5e01 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/b49b5e01 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/b49b5e01

[1/3] beam-site git commit: Add Hive (HCatalog) to the list of available I/O transforms

Repository: beam-site Updated Branches: refs/heads/asf-site ad4c5c011 -> 1c164e086 Add Hive (HCatalog) to the list of available I/O transforms Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/993d2c4a Tree:

[jira] [Commented] (BEAM-1348) Model the Fn Api

[ https://issues.apache.org/jira/browse/BEAM-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049957#comment-16049957 ] ASF GitHub Bot commented on BEAM-1348: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #3366: [BEAM-1348] Mark Runner API like types declared wit...

GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3366 [BEAM-1348] Mark Runner API like types declared within Fn API as deprecated Add additional documentation. Be sure to do all of the following to help us incorporate your contribution

[jira] [Assigned] (BEAM-2443) BeamSqlRecordType should migrate to using a builder pattern via AutoValue/AutoBuilder

[ https://issues.apache.org/jira/browse/BEAM-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2443: -- Assignee: James Xu (was: Xu Mingmin) > BeamSqlRecordType should migrate to using a builder pattern via

[jira] [Commented] (BEAM-2443) BeamSqlRecordType should migrate to using a builder pattern via AutoValue/AutoBuilder

[ https://issues.apache.org/jira/browse/BEAM-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049941#comment-16049941 ] James Xu commented on BEAM-2443: I will take this one. > BeamSqlRecordType should migrate to using a

[jira] [Commented] (BEAM-2444) DSL SQL: Use standard java exceptions instead of custom ones

[ https://issues.apache.org/jira/browse/BEAM-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049938#comment-16049938 ] ASF GitHub Bot commented on BEAM-2444: -- GitHub user xumingming opened a pull request:

[GitHub] beam pull request #3365: [BEAM-2444] BeamSql: use java standard exception

GitHub user xumingming opened a pull request: https://github.com/apache/beam/pull/3365 [BEAM-2444] BeamSql: use java standard exception R: @XuMingmin R: @takidau You can merge this pull request into a Git repository by running: $ git pull

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3366

See

[jira] [Commented] (BEAM-1287) Give new DoFn the ability to output to a particular window

[ https://issues.apache.org/jira/browse/BEAM-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049935#comment-16049935 ] Kenneth Knowles commented on BEAM-1287: --- Did you grab this intentionally, [~tgroh]? I ask because it

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4111

See

[jira] [Assigned] (BEAM-2444) DSL SQL: Use standard java exceptions instead of custom ones

[ https://issues.apache.org/jira/browse/BEAM-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2444: -- Assignee: James Xu (was: Xu Mingmin) > DSL SQL: Use standard java exceptions instead of custom ones >

[jira] [Commented] (BEAM-2444) DSL SQL: Use standard java exceptions instead of custom ones

[ https://issues.apache.org/jira/browse/BEAM-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049929#comment-16049929 ] James Xu commented on BEAM-2444: I will take this one. > DSL SQL: Use standard java exceptions instead of

[jira] [Commented] (BEAM-2440) DSL SQL: Reduce visibility to simplify backwards compatibility

[ https://issues.apache.org/jira/browse/BEAM-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049928#comment-16049928 ] ASF GitHub Bot commented on BEAM-2440: -- GitHub user xumingming opened a pull request:

[GitHub] beam pull request #3364: [BEAM-2440] BeamSql: reduce visibility

GitHub user xumingming opened a pull request: https://github.com/apache/beam/pull/3364 [BEAM-2440] BeamSql: reduce visibility Since the packages are cross-import each other, many of them can't be set to `package private` access level. You can merge this pull request into a Git

[jira] [Assigned] (BEAM-2440) DSL SQL: Reduce visibility to simplify backwards compatibility

[ https://issues.apache.org/jira/browse/BEAM-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu reassigned BEAM-2440: -- Assignee: James Xu (was: Xu Mingmin) > DSL SQL: Reduce visibility to simplify backwards compatibility

[jira] [Commented] (BEAM-2440) DSL SQL: Reduce visibility to simplify backwards compatibility

[ https://issues.apache.org/jira/browse/BEAM-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049918#comment-16049918 ] James Xu commented on BEAM-2440: I will take this one. > DSL SQL: Reduce visibility to simplify backwards

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3365

See

[jira] [Commented] (BEAM-1585) Ability to add new file systems to beamFS in the python sdk

[ https://issues.apache.org/jira/browse/BEAM-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049886#comment-16049886 ] ASF GitHub Bot commented on BEAM-1585: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3359: [BEAM-1585] Add beam plugins as pipeline options

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3359 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-1585] Add beam plugins as pipeline options

[BEAM-1585] Add beam plugins as pipeline options Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/329bf1e7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/329bf1e7 Diff:

[1/2] beam git commit: Closes #3359

Repository: beam Updated Branches: refs/heads/master c96208347 -> 42c88f415 Closes #3359 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/42c88f41 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/42c88f41 Diff:

[GitHub] beam pull request #3363: Beam 765 TriggerStateMachine does not need to be se...

GitHub user evindj opened a pull request: https://github.com/apache/beam/pull/3363 Beam 765 TriggerStateMachine does not need to be separate from OnceTriggerStateMachine Be sure to do all of the following to help us incorporate your contribution quickly and easily: -

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2493

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #134

See Changes: [altay] Choose GroupAlsoByWindows implementation based on streaming flag -- [...truncated 2.65 MB...] 2017-06-15T00:34:43.920 [INFO]

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » JDK 1.7 (latest),beam #86

See Changes: [altay] Choose GroupAlsoByWindows implementation based on streaming flag -- [...truncated 1.56 MB...]

[jira] [Commented] (BEAM-1265) Add streaming support to Python DirectRunner

[ https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049822#comment-16049822 ] ASF GitHub Bot commented on BEAM-1265: -- Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-2356) support logical operators

[ https://issues.apache.org/jira/browse/BEAM-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049821#comment-16049821 ] ASF GitHub Bot commented on BEAM-2356: -- Github user xumingming closed the pull request at:

[1/2] beam git commit: Choose GroupAlsoByWindows implementation based on streaming flag

Repository: beam Updated Branches: refs/heads/master dd9abc397 -> c96208347 Choose GroupAlsoByWindows implementation based on streaming flag Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0b600d20 Tree:

[GitHub] beam pull request #3218: [BEAM-2356] add NOT operator & some refactoring

Github user xumingming closed the pull request at: https://github.com/apache/beam/pull/3218 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3362: Migrate DirectRunner evaluators to use Beam state A...

GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3362 Migrate DirectRunner evaluators to use Beam state API This change depends on #3318. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-2404) BigQueryIO reading stalls if no data is returned by query

[ https://issues.apache.org/jira/browse/BEAM-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049768#comment-16049768 ] Stephen Sisk commented on BEAM-2404: Hi Andre, I investigated this bug, and I can't seem to repro it.

[jira] [Assigned] (BEAM-1287) Give new DoFn the ability to output to a particular window

[ https://issues.apache.org/jira/browse/BEAM-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-1287: - Assignee: Thomas Groh > Give new DoFn the ability to output to a particular window >

[jira] [Commented] (BEAM-115) Beam Runner API

[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049723#comment-16049723 ] ASF GitHub Bot commented on BEAM-115: - GitHub user robertwb opened a pull request:

[GitHub] beam pull request #3361: [BEAM-115] Port fn_api_runner to be able to use run...

GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3361 [BEAM-115] Port fn_api_runner to be able to use runner protos. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Commented] (BEAM-2447) Reintroduce DoFn.ProcessContinuation

[ https://issues.apache.org/jira/browse/BEAM-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049718#comment-16049718 ] ASF GitHub Bot commented on BEAM-2447: -- GitHub user jkff opened a pull request:

[GitHub] beam pull request #3360: [BEAM-2447] Reintroduces DoFn.ProcessContinuation

GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3360 [BEAM-2447] Reintroduces DoFn.ProcessContinuation This is a revert of https://github.com/apache/beam/pull/2455, amended according to the new semantics described in

Build failed in Jenkins: beam_PostCommit_Python_Verify #2492

See -- [...truncated 676.69 KB...] } ], "is_wrapper": true }, "output_name": "out",

[jira] [Commented] (BEAM-1585) Ability to add new file systems to beamFS in the python sdk

[ https://issues.apache.org/jira/browse/BEAM-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049684#comment-16049684 ] ASF GitHub Bot commented on BEAM-1585: -- Github user sb2nov closed the pull request at:

[GitHub] beam pull request #3273: [BEAM-1585] Add ability to attach a bootstrap scrip...

Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/3273 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1585) Ability to add new file systems to beamFS in the python sdk

[ https://issues.apache.org/jira/browse/BEAM-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049683#comment-16049683 ] ASF GitHub Bot commented on BEAM-1585: -- GitHub user sb2nov opened a pull request:

[GitHub] beam pull request #3359: [BEAM-1585] Add beam plugins as pipeline options

GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/3359 [BEAM-1585] Add beam plugins as pipeline options Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[jira] [Created] (BEAM-2450) Transform names and named applications should not be null or empty

Scott Wegner created BEAM-2450: -- Summary: Transform names and named applications should not be null or empty Key: BEAM-2450 URL: https://issues.apache.org/jira/browse/BEAM-2450 Project: Beam

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3364

See

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049601#comment-16049601 ] ASF GitHub Bot commented on BEAM-1542: -- GitHub user mairbek opened a pull request:

[GitHub] beam pull request #3358: [BEAM-1542] Support ValueProviders in SpannerIO

GitHub user mairbek opened a pull request: https://github.com/apache/beam/pull/3358 [BEAM-1542] Support ValueProviders in SpannerIO You can merge this pull request into a Git repository by running: $ git pull https://github.com/mairbek/beam providers Alternatively you can

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3363

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #133

See Changes: [tgroh] Do not produce Unprocessed Inputs if all inputs were Processed -- [...truncated 2.64 MB...] 2017-06-14T18:37:10.892 [INFO]

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » JDK 1.7 (latest),beam #85

See Changes: [tgroh] Do not produce Unprocessed Inputs if all inputs were Processed -- [...truncated 1.56 MB...]

Build failed in Jenkins: beam_PostCommit_Python_Verify #2491

See Changes: [tgroh] Do not produce Unprocessed Inputs if all inputs were Processed -- [...truncated 622.03 KB...] "key": "fn",

[jira] [Commented] (BEAM-2398) Increasing latency within DirectRunner caused by cumulated TransformWatermarks

[ https://issues.apache.org/jira/browse/BEAM-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049402#comment-16049402 ] ASF GitHub Bot commented on BEAM-2398: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3353: [BEAM-2398] Do not produce Unprocessed Inputs if al...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3353 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (BEAM-2398) Increasing latency within DirectRunner caused by cumulated TransformWatermarks

[ https://issues.apache.org/jira/browse/BEAM-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-2398. --- Resolution: Fixed Fix Version/s: 2.1.0 > Increasing latency within DirectRunner caused by

[2/2] beam git commit: Do not produce Unprocessed Inputs if all inputs were Processed

Do not produce Unprocessed Inputs if all inputs were Processed This stops the WatermarkManager "Pending Bundles" from growing without bound. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8a850af3 Tree:

[1/2] beam git commit: This closes #3353

Repository: beam Updated Branches: refs/heads/master eebff9089 -> dd9abc397 This closes #3353 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dd9abc39 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/dd9abc39 Diff:

[1/2] beam git commit: Add NOT operator on DSL_SQL branch (plus some refactoring)

Repository: beam Updated Branches: refs/heads/DSL_SQL 1e080e2ba -> 07fda7c2d Add NOT operator on DSL_SQL branch (plus some refactoring) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/447bed59 Tree:

[2/2] beam git commit: [BEAM-2356] This closes #3218

[BEAM-2356] This closes #3218 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/07fda7c2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/07fda7c2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/07fda7c2 Branch:

[jira] [Assigned] (BEAM-2449) Support ValueProviders in KafkaIO

[ https://issues.apache.org/jira/browse/BEAM-2449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-2449: - Assignee: (was: Thomas Groh) Component/s: (was: runner-dataflow) > Support

[jira] [Created] (BEAM-2449) Support ValueProviders in KafkaIO

peay created BEAM-2449: -- Summary: Support ValueProviders in KafkaIO Key: BEAM-2449 URL: https://issues.apache.org/jira/browse/BEAM-2449 Project: Beam Issue Type: Improvement Components:

[jira] [Commented] (BEAM-2442) DSL SQL: Public classes/methods should not expose/use calcite types

[ https://issues.apache.org/jira/browse/BEAM-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049314#comment-16049314 ] ASF GitHub Bot commented on BEAM-2442: -- GitHub user xumingming opened a pull request:

[jira] [Updated] (BEAM-2448) FileBasedSink writing to incorrect path when path prefixe has no file component in path (e.g. /tmp/)

[ https://issues.apache.org/jira/browse/BEAM-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2448: Description: This was reported by a user on dev@, original report:

[GitHub] beam pull request #3357: [BEAM-2442] BeamSql api surface test

GitHub user xumingming opened a pull request: https://github.com/apache/beam/pull/3357 [BEAM-2442] BeamSql api surface test Summary: * The surface api of BeamSql includes the following: * BeamSql * BeamSqlCli * BeamSqlEnv * All the classes in package

[jira] [Resolved] (BEAM-1925) Make DoFn invocation logic of Python SDK more extensible

[ https://issues.apache.org/jira/browse/BEAM-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-1925. -- Resolution: Fixed Fix Version/s: 2.1.0 > Make DoFn invocation logic of Python SDK

[jira] [Updated] (BEAM-2448) FileBasedSink writing to incorrect path when path prefixe has no file component in path (e.g. /tmp/)

[ https://issues.apache.org/jira/browse/BEAM-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2448: Affects Version/s: 2.1.0 2.0.0 Description: This was reported by a user on

[jira] [Created] (BEAM-2448) FileBasedSink writing to incorrect path when path prefixe has no file component in path (e.g. /tmp/)

Luke Cwik created BEAM-2448: --- Summary: FileBasedSink writing to incorrect path when path prefixe has no file component in path (e.g. /tmp/) Key: BEAM-2448 URL: https://issues.apache.org/jira/browse/BEAM-2448

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3362

See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4106

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #132

See -- [...truncated 2.65 MB...] 2017-06-14T12:34:54.167 [INFO] Downloaded: https://repo.maven.apache.org/maven2/org/sonatype/gossip/gossip/1.8/gossip-1.8.pom

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #2364

See

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » JDK 1.7 (latest),beam #84

See -- [...truncated 478.70 KB...] 2017-06-14\T\12:03:59.813 [INFO] 2017-06-14\T\12:03:59.813 [INFO] ---

[jira] [Comment Edited] (BEAM-2328) Introduce Apache Tika Input component

[ https://issues.apache.org/jira/browse/BEAM-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049057#comment-16049057 ] Sergey Beryozkin edited comment on BEAM-2328 at 6/14/17 11:09 AM: -- Hi JB,

[jira] [Commented] (BEAM-2328) Introduce Apache Tika Input component

[ https://issues.apache.org/jira/browse/BEAM-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049057#comment-16049057 ] Sergey Beryozkin commented on BEAM-2328: Hi JB, All, I'm now ready to create the initial PR. As I

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2363

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3361

See

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4105

See

Build failed in Jenkins: beam_PostCommit_Java_JDK_Versions_Test » JDK 1.7 (latest),beam #83

See -- [...truncated 1.51 MB...] 2017-06-14\T\06:32:28.359 [INFO] Downloaded:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #131

See -- [...truncated 351.27 KB...] [INFO] I/O exception (java.net.SocketException) caught when processing request to {s}->https://repo.maven.apache.org:443: