[GitHub] beam pull request #3444: Implement streaming GroupByKey in Python DirectRunn...

2017-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3444 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3444

2017-06-26 Thread altay
This closes #3444 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8036001d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8036001d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/8036001d Branch:

[1/2] beam git commit: Implement streaming GroupByKey in Python DirectRunner

2017-06-26 Thread altay
Repository: beam Updated Branches: refs/heads/master 95e6bbe50 -> 8036001da Implement streaming GroupByKey in Python DirectRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/eb379e76 Tree:

[jira] [Commented] (BEAM-2287) UDAF support

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064280#comment-16064280 ] ASF GitHub Bot commented on BEAM-2287: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #3447: [BEAM-2287] UDAF support

2017-06-26 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3447 [BEAM-2287] UDAF support R: @xumingming @takidau add an abstract class `BeamSqlUdaf` following the UDAF definition in Calcite, also COUNT/SUM/AVG/MAX/MIN/ are rewritten with this new

[jira] [Commented] (BEAM-2523) GCP IO exposes protobuf on its API surface, causing user pain

2017-06-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064247#comment-16064247 ] Luke Cwik commented on BEAM-2523: - Based upon the dependency dump, it seems as though no protobuf-java is

[jira] [Issue Comment Deleted] (BEAM-2523) GCP IO exposes protobuf on its API surface, causing user pain

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2523: -- Comment: was deleted (was: Putting the SDK, DataflowRunner, and GCP IO on the same classpath,

[jira] [Updated] (BEAM-2523) GCP IO exposes protobuf on its API surface, causing user pain

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2523: -- Description: Putting the SDK, DataflowRunner, and GCP IO on the same classpath, results in (at

[jira] [Commented] (BEAM-2523) GCP IO exposes protobuf on its API surface, causing user pain

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064239#comment-16064239 ] Kenneth Knowles commented on BEAM-2523: --- Putting the SDK, DataflowRunner, and GCP IO on the same

[jira] [Updated] (BEAM-2523) GCP IO exposes protobuf on its API surface, causing user pain

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2523: -- Summary: GCP IO exposes protobuf on its API surface, causing user pain (was: Dataflow runner

[jira] [Issue Comment Deleted] (BEAM-940) ByteBuddyOnTimerInvokerFactory: key the cache with a (Class, id) tuple or OnTimerMethod

2017-06-26 Thread Innocent (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Innocent updated BEAM-940: -- Comment: was deleted (was: Do you mean LoadingCache> was renamed to

[jira] [Created] (BEAM-2523) Dataflow runner exposes protobuf on its API surface, causing user pain

2017-06-26 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2523: - Summary: Dataflow runner exposes protobuf on its API surface, causing user pain Key: BEAM-2523 URL: https://issues.apache.org/jira/browse/BEAM-2523 Project: Beam

[jira] [Updated] (BEAM-2498) Dataflow runner should shade Runner/Fn API protos

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2498: -- Fix Version/s: 2.1.0 > Dataflow runner should shade Runner/Fn API protos >

[jira] [Commented] (BEAM-2522) upgrading jackson

2017-06-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064198#comment-16064198 ] Luke Cwik commented on BEAM-2522: - [~antonymayi] Do you want to propose a PR which does this change? >

[jira] [Updated] (BEAM-2522) upgrading jackson

2017-06-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2522: Priority: Minor (was: Major) > upgrading jackson > - > > Key: BEAM-2522 >

[jira] [Commented] (BEAM-210) Allow control of empty ON_TIME panes analogous to final panes

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064192#comment-16064192 ] ASF GitHub Bot commented on BEAM-210: - GitHub user peihe opened a pull request:

[GitHub] beam pull request #3446: [BEAM-210] WindowingStrategy: add OnTimeBehavior to...

2017-06-26 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3446 [BEAM-210] WindowingStrategy: add OnTimeBehavior to control whether to emit empty ON_TIME pane. Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[jira] [Created] (BEAM-2522) upgrading jackson

2017-06-26 Thread Antony Mayi (JIRA)
Antony Mayi created BEAM-2522: - Summary: upgrading jackson Key: BEAM-2522 URL: https://issues.apache.org/jira/browse/BEAM-2522 Project: Beam Issue Type: Task Components: sdk-java-core

[jira] [Resolved] (BEAM-2356) support logical operators

2017-06-26 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2356. Resolution: Fixed Fix Version/s: Not applicable > support logical operators >

[jira] [Resolved] (BEAM-2191) Support Set opeators

2017-06-26 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2191. Resolution: Fixed Fix Version/s: Not applicable > Support Set opeators > > >

[jira] [Resolved] (BEAM-2325) Support Set Operator: INTERSECT, EXCEPT, UNION

2017-06-26 Thread James Xu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Xu resolved BEAM-2325. Resolution: Fixed Fix Version/s: Not applicable > Support Set Operator: INTERSECT, EXCEPT, UNION >

[GitHub] beam pull request #3445: [BEAM-2509}] Enable grpc controller in fn_api_runne...

2017-06-26 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3445 [BEAM-2509}] Enable grpc controller in fn_api_runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-2509) Fn API Runner hangs in grpc controller mode

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064104#comment-16064104 ] ASF GitHub Bot commented on BEAM-2509: -- GitHub user vikkyrk opened a pull request:

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064098#comment-16064098 ] Kenneth Knowles commented on BEAM-2140: --- [~lzljs3620320] you are correct - the decision about whether

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4219

2017-06-26 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064090#comment-16064090 ] Jingsong Lee commented on BEAM-2140: On 1: If the decision whether the window expired is output

[jira] [Commented] (BEAM-2447) Reintroduce DoFn.ProcessContinuation

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064074#comment-16064074 ] Kenneth Knowles commented on BEAM-2447: --- You have forbidden the behavior of returning {{resume()}}

[jira] [Updated] (BEAM-1962) Connection should be closed in case start() throws exception

2017-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated BEAM-1962: - Description: In JmsIO#start() : {code} try { Connection connection; if (spec.getUsername()

[jira] [Updated] (BEAM-2335) Document various maven commands for running tests

2017-06-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated BEAM-2335: - Description: In this discussion thread, various maven commands for running / not running selected tests were

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4218

2017-06-26 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2480

2017-06-26 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2447) Reintroduce DoFn.ProcessContinuation

2017-06-26 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064054#comment-16064054 ] Eugene Kirpichov commented on BEAM-2447: If the runner did not already take a checkpoint, and the

[jira] [Created] (BEAM-2521) Simplify packaging for python distributions

2017-06-26 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-2521: - Summary: Simplify packaging for python distributions Key: BEAM-2521 URL: https://issues.apache.org/jira/browse/BEAM-2521 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-2520) add UDF/UDAF in BeamSql.query/simpleQuery

2017-06-26 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2520: Summary: add UDF/UDAF in BeamSql.query/simpleQuery Key: BEAM-2520 URL: https://issues.apache.org/jira/browse/BEAM-2520 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2503) use static table name in BeamSql.simpleQuery

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064049#comment-16064049 ] ASF GitHub Bot commented on BEAM-2503: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3427: [BEAM-2503] use static table name in BeamSql.simple...

2017-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-2503] This closes #3427

2017-06-26 Thread takidau
[BEAM-2503] This closes #3427 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bd99528a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bd99528a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bd99528a Branch:

[1/2] beam git commit: use static table name PCOLLECTION in BeamSql.simpleQuery.

2017-06-26 Thread takidau
Repository: beam Updated Branches: refs/heads/DSL_SQL 8e9b930bc -> bd99528af use static table name PCOLLECTION in BeamSql.simpleQuery. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1f612049 Tree:

[jira] [Commented] (BEAM-2447) Reintroduce DoFn.ProcessContinuation

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064043#comment-16064043 ] ASF GitHub Bot commented on BEAM-2447: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3383: [BEAM-2447] Reintroduces DoFn.ProcessContinuation (...

2017-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3383 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (BEAM-2519) Record type of state in Python InMemoryUnmergedState

2017-06-26 Thread Charles Chen (JIRA)
Charles Chen created BEAM-2519: -- Summary: Record type of state in Python InMemoryUnmergedState Key: BEAM-2519 URL: https://issues.apache.org/jira/browse/BEAM-2519 Project: Beam Issue Type: Bug

[1/3] beam git commit: Bump Dataflow worker to 0623

2017-06-26 Thread jkff
Repository: beam Updated Branches: refs/heads/master 1ea1de4aa -> 95e6bbe50 Bump Dataflow worker to 0623 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2052cc76 Tree:

[3/3] beam git commit: This closes #3383: [BEAM-2447] Reintroduces DoFn.ProcessContinuation (Dataflow worker compatibility part)

2017-06-26 Thread jkff
This closes #3383: [BEAM-2447] Reintroduces DoFn.ProcessContinuation (Dataflow worker compatibility part) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/95e6bbe5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/95e6bbe5

[2/3] beam git commit: Reintroduces DoFn.ProcessContinuation (Dataflow worker compatibility part)

2017-06-26 Thread jkff
Reintroduces DoFn.ProcessContinuation (Dataflow worker compatibility part) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bec32fe9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bec32fe9 Diff:

[jira] [Created] (BEAM-2518) Support TimestampCombiner in Python streaming mode GroupByKey

2017-06-26 Thread Charles Chen (JIRA)
Charles Chen created BEAM-2518: -- Summary: Support TimestampCombiner in Python streaming mode GroupByKey Key: BEAM-2518 URL: https://issues.apache.org/jira/browse/BEAM-2518 Project: Beam Issue

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2479

2017-06-26 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3444: Implement streaming GroupByKey in Python DirectRunn...

2017-06-26 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3444 Implement streaming GroupByKey in Python DirectRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[jira] [Resolved] (BEAM-2437) quickstart.py docs is missing the path to MANIFEST.in

2017-06-26 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-2437. --- Resolution: Fixed > quickstart.py docs is missing the path to MANIFEST.in >

[jira] [Commented] (BEAM-2437) quickstart.py docs is missing the path to MANIFEST.in

2017-06-26 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063939#comment-16063939 ] Sourabh Bajaj commented on BEAM-2437: - This can be closed now. > quickstart.py docs is missing the

[jira] [Commented] (BEAM-2437) quickstart.py docs is missing the path to MANIFEST.in

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063936#comment-16063936 ] ASF GitHub Bot commented on BEAM-2437: -- Github user asfgit closed the pull request at:

[3/3] beam-site git commit: This closes #261

2017-06-26 Thread altay
This closes #261 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/3ab9c27e Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/3ab9c27e Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/3ab9c27e

[2/3] beam-site git commit: Regenerate website

2017-06-26 Thread altay
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/9d94c4bc Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/9d94c4bc Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/9d94c4bc

[GitHub] beam-site pull request #261: [BEAM-2437] Input path should be flexible in qu...

2017-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/261 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/3] beam-site git commit: [BEAM-2437] Input path should be flexible in quickstart

2017-06-26 Thread altay
Repository: beam-site Updated Branches: refs/heads/asf-site 7360cb748 -> 3ab9c27eb [BEAM-2437] Input path should be flexible in quickstart Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/2220c8ed Tree:

[GitHub] beam pull request #3443: [BEAM-2511] Implements TextIO.ReadAll

2017-06-26 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3443 [BEAM-2511] Implements TextIO.ReadAll Reads a PCollection of filenames. Part of the plan at http://s.apache.org/textio-sdf. Currently implemented pretty naively, and without SDF: expands glob, splits

[GitHub] beam pull request #3442: Splits large TextIOTest into TextIOReadTest and Tex...

2017-06-26 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3442 Splits large TextIOTest into TextIOReadTest and TextIOWriteTest R: @reuvenlax You can merge this pull request into a Git repository by running: $ git pull https://github.com/jkff/incubator-beam

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4217

2017-06-26 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2478

2017-06-26 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1265) Add streaming support to Python DirectRunner

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063816#comment-16063816 ] ASF GitHub Bot commented on BEAM-1265: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3440: [BEAM-1265] Remove old deprecated PubSub code

2017-06-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3440 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Remove old deprecated PubSub code

2017-06-26 Thread altay
rnal/dependency.py +++ b/sdks/python/apache_beam/runners/dataflow/internal/dependency.py @@ -73,7 +73,7 @@ from apache_beam.options.pipeline_options import SetupOptions # Update this version to the next version whenever there is a change that will # require changes to the execution environment. # This shou

[2/2] beam git commit: This closes #3440

2017-06-26 Thread altay
This closes #3440 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1ea1de4a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1ea1de4a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1ea1de4a Branch:

[jira] [Updated] (BEAM-2517) Document how to build Python SDK from BEAM head in contribution guide.

2017-06-26 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-2517: -- Component/s: (was: sdk-py) website > Document how to build Python

[jira] [Commented] (BEAM-2271) Release guide or pom.xml needs update to avoid releasing Python binary artifacts

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063797#comment-16063797 ] ASF GitHub Bot commented on BEAM-2271: -- GitHub user sb2nov opened a pull request:

[GitHub] beam pull request #3441: [BEAM-2271] Add more files to mvn clean

2017-06-26 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/3441 [BEAM-2271] Add more files to mvn clean Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[GitHub] beam pull request #3440: Remove old deprecated PubSub code

2017-06-26 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3440 Remove old deprecated PubSub code Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Assigned] (BEAM-2517) Document how to build Python SDK from BEAM head in contribution guide.

2017-06-26 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-2517: - Assignee: (was: Ahmet Altay) > Document how to build Python SDK from BEAM head in

[jira] [Updated] (BEAM-2517) Document how to build Python SDK from BEAM head in contribution guide.

2017-06-26 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-2517: -- Environment: (was: We should add instructions how to build Python SDK from BEAM head

[jira] [Updated] (BEAM-2517) Document how to build Python SDK from BEAM head in contribution guide.

2017-06-26 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-2517: -- Labels: starter (was: ) > Document how to build Python SDK from BEAM head in

[jira] [Created] (BEAM-2517) Document how to build Python SDK from BEAM head in contribution guide.

2017-06-26 Thread Valentyn Tymofieiev (JIRA)
Valentyn Tymofieiev created BEAM-2517: - Summary: Document how to build Python SDK from BEAM head in contribution guide. Key: BEAM-2517 URL: https://issues.apache.org/jira/browse/BEAM-2517

[jira] [Updated] (BEAM-2517) Document how to build Python SDK from BEAM head in contribution guide.

2017-06-26 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-2517: -- Description: We should add instructions how to build Python SDK from BEAM head to BEAM

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4216

2017-06-26 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063594#comment-16063594 ] Kenneth Knowles commented on BEAM-2140: --- There is an open need to be able to set a timer with an

[jira] [Comment Edited] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063594#comment-16063594 ] Kenneth Knowles edited comment on BEAM-2140 at 6/26/17 6:49 PM: There is an

[jira] [Comment Edited] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063581#comment-16063581 ] Kenneth Knowles edited comment on BEAM-2140 at 6/26/17 6:40 PM: A watermark

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063581#comment-16063581 ] Kenneth Knowles commented on BEAM-2140: --- A watermark holds constrains the output watermark, not the

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2477

2017-06-26 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063548#comment-16063548 ] Eugene Kirpichov commented on BEAM-2140: On 1: the timer should not be dropped because ProcessFn is

[jira] [Assigned] (BEAM-2437) quickstart.py docs is missing the path to MANIFEST.in

2017-06-26 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj reassigned BEAM-2437: --- Assignee: Sourabh Bajaj (was: Ahmet Altay) > quickstart.py docs is missing the path to

[jira] [Commented] (BEAM-2437) quickstart.py docs is missing the path to MANIFEST.in

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063519#comment-16063519 ] ASF GitHub Bot commented on BEAM-2437: -- GitHub user sb2nov opened a pull request:

[GitHub] beam-site pull request #261: [BEAM-2437] Input path should be flexible in qu...

2017-06-26 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam-site/pull/261 [BEAM-2437] Input path should be flexible in quickstart R: @aaltay PTAL The manifest or pom file all will be missing so we should just let the user point to any text file of choice. You

[jira] [Commented] (BEAM-2516) User reports 4 minutes to process 1 million line CSV in DirectRunner

2017-06-26 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063511#comment-16063511 ] Thomas Groh commented on BEAM-2516: --- Worth investigating. We do expect things to take notably longer

[jira] [Created] (BEAM-2516) User reports 4 minutes to process 1 million line CSV in DirectRunner

2017-06-26 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2516: - Summary: User reports 4 minutes to process 1 million line CSV in DirectRunner Key: BEAM-2516 URL: https://issues.apache.org/jira/browse/BEAM-2516 Project: Beam

[jira] [Commented] (BEAM-2514) Improve error message for missing required options of Beam pipeline

2017-06-26 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063397#comment-16063397 ] Luke Cwik commented on BEAM-2514: - This change assumes that all users are CLI users (compared to the

[GitHub] beam pull request #3439: Minor fixes for DSL SQL

2017-06-26 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/3439 Minor fixes for DSL SQL - Make the example execution runner agnostic and some minor fixes. - Enable findbugs for the profile release and fix current issues. Be sure to do all of the

[jira] [Created] (BEAM-2515) BeamSql: refactor the MockedBeamSqlTable and related tests

2017-06-26 Thread James Xu (JIRA)
James Xu created BEAM-2515: -- Summary: BeamSql: refactor the MockedBeamSqlTable and related tests Key: BEAM-2515 URL: https://issues.apache.org/jira/browse/BEAM-2515 Project: Beam Issue Type: Bug

[jira] [Comment Edited] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-26 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063224#comment-16063224 ] Guillermo Rodríguez Cano edited comment on BEAM-2490 at 6/26/17 3:07 PM:

[jira] [Commented] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-26 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063224#comment-16063224 ] Guillermo Rodríguez Cano commented on BEAM-2490: Hello [~chamikara] and [~altay], and

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063129#comment-16063129 ] Kenneth Knowles commented on BEAM-2140: --- Dropping the processing-time timer is the intended behavior

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Dataflow #3449

2017-06-26 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4215

2017-06-26 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2514) Improve error message for missing required options of Beam pipeline

2017-06-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16063047#comment-16063047 ] ASF GitHub Bot commented on BEAM-2514: -- GitHub user manuzhang opened a pull request:

[GitHub] beam pull request #3438: [BEAM-2514] Use option name in missing required val...

2017-06-26 Thread manuzhang
GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/3438 [BEAM-2514] Use option name in missing required value message Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2476

2017-06-26 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-688) Failure of beam-sdks-java-maven-archetypes-starter with undeclared dependency error

2017-06-26 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062985#comment-16062985 ] Manu Zhang commented on BEAM-688: - I'm seeing this error again on latest master. > Failure of

[jira] [Created] (BEAM-2514) Improve error message for missing required options of Beam pipeline

2017-06-26 Thread Manu Zhang (JIRA)
Manu Zhang created BEAM-2514: Summary: Improve error message for missing required options of Beam pipeline Key: BEAM-2514 URL: https://issues.apache.org/jira/browse/BEAM-2514 Project: Beam

[GitHub] beam pull request #3437: Add commons-text to shaded jar to fix SpannerIO Wri...

2017-06-26 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/beam/pull/3437 Add commons-text to shaded jar to fix SpannerIO WriteIT Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is

[jira] [Comment Edited] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062881#comment-16062881 ] Aljoscha Krettek edited comment on BEAM-2140 at 6/26/17 10:26 AM: --

[jira] [Commented] (BEAM-2140) Fix SplittableDoFn ValidatesRunner tests in FlinkRunner

2017-06-26 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16062881#comment-16062881 ] Aljoscha Krettek commented on BEAM-2140: [~lzljs3620320]/[~jkff] I looked into this again and I

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4214

2017-06-26 Thread Apache Jenkins Server
See

  1   2   >