[jira] [Commented] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-24 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140190#comment-16140190 ] Eugene Kirpichov commented on BEAM-2803: Could you quantify "very slow" - what performance are you

[jira] [Commented] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner

2017-08-24 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140070#comment-16140070 ] Aljoscha Krettek commented on BEAM-956: --- No, we still execute via

[jira] [Updated] (BEAM-2802) TextIO should allow specifying a custom delimiter

2017-08-24 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-2802: --- Description: Currently TextIO use {{\r}} {{\n}} or {{\r\n}} or a mix of the two to split a

[jira] [Commented] (BEAM-2802) TextIO should allow specifying a custom delimiter

2017-08-24 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140180#comment-16140180 ] Eugene Kirpichov commented on BEAM-2802: Please see BEAM-2586 and previous discussion of this on

[jira] [Commented] (BEAM-2790) Error while reading from Amazon S3 via Hadoop File System

2017-08-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139909#comment-16139909 ] Steve Loughran commented on BEAM-2790: -- OF course, a patch for HADOOP-14603 would make this go away

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3826

2017-08-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2724) MSEC counters should support Structured Names in Dataflow

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140292#comment-16140292 ] ASF GitHub Bot commented on BEAM-2724: -- Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-2798) rename simpleQuery to query and query to queryMulti

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140333#comment-16140333 ] ASF GitHub Bot commented on BEAM-2798: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #3752

2017-08-24 Thread mingmxu
This closes #3752 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/448a3230 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/448a3230 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/448a3230 Branch:

[GitHub] beam pull request #3752: [BEAM-2798] rename simpleQuery to query and query t...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3752 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Closed] (BEAM-2798) rename simpleQuery to query and query to queryMulti

2017-08-24 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2798. Resolution: Fixed Assignee: Xu Mingmin Fix Version/s: Not applicable > rename simpleQuery to

[jira] [Commented] (BEAM-2790) Error while reading from Amazon S3 via Hadoop File System

2017-08-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140412#comment-16140412 ] Steve Loughran commented on BEAM-2790: -- ...looks like it's only in HDFS. More specifically, it looks

[GitHub] beam pull request #3747: [BEAM-2724] Support for IOTargetName like in update...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3747 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Adding IOTargetName and unittests for CounterName

2017-08-24 Thread altay
Repository: beam Updated Branches: refs/heads/master 5181e619f -> 260c4fce8 Adding IOTargetName and unittests for CounterName Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/185daffa Tree:

[2/2] beam git commit: This closes #3747

2017-08-24 Thread altay
This closes #3747 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/260c4fce Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/260c4fce Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/260c4fce Branch:

[GitHub] beam pull request #3755: Expand SdkComponents Visibility

2017-08-24 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3755 Expand SdkComponents Visibility Make the register, toComponents, and create methods public. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]

[1/2] beam git commit: rename simpleQuery to query and query to queryMulti

2017-08-24 Thread mingmxu
Repository: beam Updated Branches: refs/heads/DSL_SQL c2acb54f6 -> 448a32306 rename simpleQuery to query and query to queryMulti Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c580b521 Tree:

[jira] [Commented] (BEAM-2790) Error while reading from Amazon S3 via Hadoop File System

2017-08-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140321#comment-16140321 ] Luke Cwik commented on BEAM-2790: - That would fix it for S3A, but I can only expect that there are other

[jira] [Updated] (BEAM-1440) Create a BigQuery source (that implements iobase.BoundedSource) for Python SDK

2017-08-24 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Jiang updated BEAM-1440: Description: Currently we have a BigQuery native source for Python SDK [1]. This can only be used by

[jira] [Commented] (BEAM-2484) Add streaming examples for Python

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140506#comment-16140506 ] ASF GitHub Bot commented on BEAM-2484: -- GitHub user davidcavazos opened a pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3827

2017-08-24 Thread Apache Jenkins Server
See

[3/3] beam git commit: Add URN registration mechanism for coders.

2017-08-24 Thread robertwb
Add URN registration mechanism for coders. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ef4239ab Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ef4239ab Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ef4239ab

[1/3] beam git commit: Closes #3746

2017-08-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/master d261d6bde -> f3de7363c Closes #3746 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f3de7363 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f3de7363 Diff:

[2/3] beam git commit: Runner API encoding of common coders.

2017-08-24 Thread robertwb
Runner API encoding of common coders. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9cc004fb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9cc004fb Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9cc004fb

[GitHub] beam pull request #3746: [BEAM-2792] Translate basic coders through the Runn...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3746 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2792) Populate All Runner API Components from the Python SDK

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140868#comment-16140868 ] ASF GitHub Bot commented on BEAM-2792: -- Github user asfgit closed the pull request at:

[jira] [Closed] (BEAM-2302) WriteFiles with runner-determined sharding and large numbers of windows causes OOM errors

2017-08-24 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax closed BEAM-2302. > WriteFiles with runner-determined sharding and large numbers of windows > causes OOM errors >

[2/2] beam git commit: This closes #3696: [BEAM-1542] Add SpannerAccessor

2017-08-24 Thread jkff
This closes #3696: [BEAM-1542] Add SpannerAccessor Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c33cb034 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c33cb034 Diff:

[GitHub] beam pull request #3696: [BEAM-1542] Make AbstractSpannerFn public

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3696 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Adds SpannerAccessor - a utility for DoFn's that use Spanner

2017-08-24 Thread jkff
Repository: beam Updated Branches: refs/heads/master f3de7363c -> c33cb0340 Adds SpannerAccessor - a utility for DoFn's that use Spanner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c9c2e816 Tree:

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140878#comment-16140878 ] ASF GitHub Bot commented on BEAM-1542: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3756: Added tests for python gaming examples

2017-08-24 Thread davidcavazos
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3756 Added tests for python gaming examples Adds unit tests for the examples added on [BEAM-2484] You can merge this pull request into a Git repository by running: $ git pull

[jira] [Assigned] (BEAM-2791) DirectRunner shuts down when there are pending event time timers

2017-08-24 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-2791: - Assignee: (was: Thomas Groh) > DirectRunner shuts down when there are pending event time

[beam-site] branch asf-site updated (7b767fe -> 6558483)

2017-08-24 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 7b767fe Prepare repository for deployment. add 658a0ed [BEAM-2800] Revamp sections 1 and 2 of DSL

[GitHub] beam pull request #3755: Expand SdkComponents Visibility

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3755 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (BEAM-2793) Include all versions in top-level pom

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2793: -- Assignee: Jason Kuster (was: Davor Bonaci) > Include all versions in top-level pom >

[jira] [Resolved] (BEAM-1809) Fix one error in TravisCI build

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-1809. Resolution: Won't Fix Fix Version/s: Not applicable Travis-CI has been fully replaced with

[jira] [Assigned] (BEAM-2303) Add SpecificData to AvroCoder

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2303: -- Assignee: (was: Davor Bonaci) > Add SpecificData to AvroCoder >

[jira] [Assigned] (BEAM-2069) Remove ResourceId.getCurrentDirectory()?

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2069: -- Assignee: (was: Davor Bonaci) > Remove ResourceId.getCurrentDirectory()? >

[jira] [Assigned] (BEAM-2302) WriteFiles with runner-determined sharding and large numbers of windows causes OOM errors

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2302: -- Assignee: Reuven Lax (was: Davor Bonaci) > WriteFiles with runner-determined sharding and

[jira] [Resolved] (BEAM-1461) duplication with StartBundle and prepareForProcessing in DoFn

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-1461. Resolution: Fixed Fix Version/s: Not applicable > duplication with StartBundle and

[jira] [Commented] (BEAM-1461) duplication with StartBundle and prepareForProcessing in DoFn

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140695#comment-16140695 ] Davor Bonaci commented on BEAM-1461: Seems complete; I'd resolve. Please reactivate if there's more

[jira] [Updated] (BEAM-2721) Augment BeamRecordType to do slicing and concatenation.

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-2721: --- Component/s: (was: sdk-java-extensions) dsl-sql > Augment BeamRecordType to do

[jira] [Assigned] (BEAM-2738) Setup shield and certificates in Elasticseach ITests backend server

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2738: -- Assignee: Etienne Chauchot (was: Davor Bonaci) > Setup shield and certificates in Elasticseach

[jira] [Assigned] (BEAM-2577) IO tests should exercise Runtime Values where supported

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2577: -- Assignee: (was: Davor Bonaci) > IO tests should exercise Runtime Values where supported >

[jira] [Assigned] (BEAM-2721) Augment BeamRecordType to do slicing and concatenation.

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2721: -- Assignee: Xu Mingmin (was: Davor Bonaci) > Augment BeamRecordType to do slicing and

[jira] [Assigned] (BEAM-448) Print Properties on validation failures in PipelineOptionsValidator

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-448: - Assignee: (was: Davor Bonaci) > Print Properties on validation failures in

[jira] [Assigned] (BEAM-910) Always explicitly specify --output for ITs

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-910: - Assignee: (was: Davor Bonaci) > Always explicitly specify --output for ITs >

[jira] [Assigned] (BEAM-601) Enable Kinesis integration tests

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-601: - Assignee: Chamikara Jayalath (was: Davor Bonaci) > Enable Kinesis integration tests >

[jira] [Assigned] (BEAM-1605) Add support for Apex cluster metrics to PerfKit Benchmarker

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1605: -- Assignee: Jason Kuster (was: Davor Bonaci) > Add support for Apex cluster metrics to PerfKit

[GitHub] beam pull request #3757: Implement cancel and wait_until_finish(duration) fo...

2017-08-24 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3757 Implement cancel and wait_until_finish(duration) for DataflowRunner R: @charlesccychen You can merge this pull request into a Git repository by running: $ git pull

[2/2] beam git commit: Expand SdkComponents Visibility

2017-08-24 Thread tgroh
Expand SdkComponents Visibility Make the register, toComponents, and create methods public. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/88575824 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/88575824 Diff:

[1/2] beam git commit: This closes #3755

2017-08-24 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 260c4fce8 -> 73c2026db This closes #3755 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/73c2026d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/73c2026d Diff:

[jira] [Assigned] (BEAM-2581) KinesisClientProvider interface needs to be public

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2581: -- Assignee: Chamikara Jayalath (was: Davor Bonaci) > KinesisClientProvider interface needs to be

[jira] [Assigned] (BEAM-2624) File-based sinks should produce a PCollection of written filenames

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2624: -- Assignee: Reuven Lax (was: Davor Bonaci) > File-based sinks should produce a PCollection of

[jira] [Assigned] (BEAM-2615) Add ViewTests with SlidingWindows

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2615: -- Assignee: Thomas Groh (was: Davor Bonaci) > Add ViewTests with SlidingWindows >

[2/2] beam git commit: This closes #3756

2017-08-24 Thread altay
This closes #3756 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d261d6bd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d261d6bd Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d261d6bd Branch:

[jira] [Commented] (BEAM-2601) FileBasedSink produces incorrect shards when writing to multiple destinations

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140688#comment-16140688 ] Davor Bonaci commented on BEAM-2601: Fixed? > FileBasedSink produces incorrect shards when writing to

[jira] [Assigned] (BEAM-2601) FileBasedSink produces incorrect shards when writing to multiple destinations

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2601: -- Assignee: Reuven Lax (was: Davor Bonaci) > FileBasedSink produces incorrect shards when

[jira] [Commented] (BEAM-2302) WriteFiles with runner-determined sharding and large numbers of windows causes OOM errors

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140689#comment-16140689 ] Davor Bonaci commented on BEAM-2302: Fixed? > WriteFiles with runner-determined sharding and large

[jira] [Resolved] (BEAM-1691) Dynamic properties supported in PipelineOptions

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-1691. Resolution: Not A Problem Fix Version/s: Not applicable > Dynamic properties supported in

[jira] [Commented] (BEAM-1691) Dynamic properties supported in PipelineOptions

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140693#comment-16140693 ] Davor Bonaci commented on BEAM-1691: I'd resolve for now; if we want to change the behavior here,

[jira] [Assigned] (BEAM-1662) Re. BEAM-974 - PubSub.read/write() .withCoder requirement should raise a more informative error in Dataflow

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1662: -- Assignee: (was: Davor Bonaci) > Re. BEAM-974 - PubSub.read/write() .withCoder requirement

[jira] [Assigned] (BEAM-728) Javadoc should clearly separate facts from runner requirements

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-728: - Assignee: (was: Davor Bonaci) > Javadoc should clearly separate facts from runner requirements

[jira] [Assigned] (BEAM-1408) outputWithTimestamp() accepts timestamps that will fail preconditions

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1408: -- Assignee: (was: Davor Bonaci) > outputWithTimestamp() accepts timestamps that will fail

[jira] [Assigned] (BEAM-1639) Catch bad FractionConsumed values in the beam SDK.

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1639: -- Assignee: (was: Davor Bonaci) > Catch bad FractionConsumed values in the beam SDK. >

[jira] [Assigned] (BEAM-449) Support PCollectionList in PAssert

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-449: - Assignee: (was: Davor Bonaci) > Support PCollectionList in PAssert >

[jira] [Assigned] (BEAM-2704) KafkaIO: NPE without key serializer set

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2704: -- Assignee: Raghu Angadi (was: Davor Bonaci) > KafkaIO: NPE without key serializer set >

[jira] [Assigned] (BEAM-2582) KinesisIO incorrectly handles closed shards

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2582: -- Assignee: Chamikara Jayalath (was: Davor Bonaci) > KinesisIO incorrectly handles closed shards

[jira] [Assigned] (BEAM-2703) KafkaIO: watermark outside the bounds of BoundedWindow

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2703: -- Assignee: Raghu Angadi (was: Davor Bonaci) > KafkaIO: watermark outside the bounds of

[jira] [Assigned] (BEAM-2605) Exception raised when using MongoDBIO.Write in streaming mode

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2605: -- Assignee: Jean-Baptiste Onofré (was: Davor Bonaci) > Exception raised when using

[jira] [Assigned] (BEAM-2121) Tests on MacOS

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2121: -- Assignee: (was: Davor Bonaci) > Tests on MacOS > -- > > Key:

[jira] [Assigned] (BEAM-2220) Move org.apache.beam.sdk.util within google-cloud-platform-core to org.apache.beam.runners.dataflow

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2220: -- Assignee: Luke Cwik (was: Davor Bonaci) > Move org.apache.beam.sdk.util within

[jira] [Assigned] (BEAM-1609) Add support for Beam Metrics API to PKB

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1609: -- Assignee: Jason Kuster (was: Davor Bonaci) > Add support for Beam Metrics API to PKB >

[jira] [Assigned] (BEAM-2650) migrate beam_it_args -> beam_it_options

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2650: -- Assignee: Chamikara Jayalath > migrate beam_it_args -> beam_it_options >

[jira] [Assigned] (BEAM-1654) Tests that UnboundedSources are executed correctly

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1654: -- Assignee: (was: Davor Bonaci) > Tests that UnboundedSources are executed correctly >

[jira] [Assigned] (BEAM-2650) migrate beam_it_args -> beam_it_options

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2650: -- Assignee: (was: Davor Bonaci) > migrate beam_it_args -> beam_it_options >

[beam-site] 03/03: This closes #299

2017-08-24 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit d00f31d424342233dcf7804a5ebe16a1de4b3a28 Merge: 7b767fe 95c0193 Author: Mergebot

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3828

2017-08-24 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-1449) Maven should be able to build and run tests across multiple languages

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1449: -- Assignee: Ahmet Altay (was: Davor Bonaci) > Maven should be able to build and run tests across

[jira] [Commented] (BEAM-2646) Problem to join in slack channel

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140680#comment-16140680 ] Davor Bonaci commented on BEAM-2646: Same thing -- in addition to emailing

[jira] [Assigned] (BEAM-2701) use a custom implementation of java.io.ObjectInputStream

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2701: -- Assignee: Luke Cwik (was: Davor Bonaci) > use a custom implementation of

[jira] [Assigned] (BEAM-2705) DoFnTester supports for StateParameter

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2705: -- Assignee: Kenneth Knowles (was: Davor Bonaci) > DoFnTester supports for StateParameter >

[jira] [Resolved] (BEAM-2646) Problem to join in slack channel

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-2646. Resolution: Information Provided Fix Version/s: Not applicable > Problem to join in slack

[jira] [Assigned] (BEAM-1448) Coder encode/decode context documentation is lacking

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1448: -- Assignee: (was: Davor Bonaci) > Coder encode/decode context documentation is lacking >

[jira] [Assigned] (BEAM-1898) Need a SerializableThrowable for PAssert to capture the point of an assertion

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1898: -- Assignee: (was: Davor Bonaci) > Need a SerializableThrowable for PAssert to capture the

[jira] [Assigned] (BEAM-1879) PTransform style guide should discuss display data

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1879: -- Assignee: Eugene Kirpichov (was: Davor Bonaci) > PTransform style guide should discuss display

[jira] [Assigned] (BEAM-1305) Support additional configuration in BigQueryServices.insertAll()

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1305: -- Assignee: (was: Davor Bonaci) > Support additional configuration in

[jira] [Assigned] (BEAM-2752) Job fails to checkpoint with kinesis stream as an input for Flink job

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2752: -- Assignee: Chamikara Jayalath (was: Davor Bonaci) > Job fails to checkpoint with kinesis stream

[jira] [Assigned] (BEAM-2639) Unbounded Source for MongoDB

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2639: -- Assignee: Jean-Baptiste Onofré (was: Davor Bonaci) > Unbounded Source for MongoDB >

[jira] [Assigned] (BEAM-1664) Support Kafka0.8.x client in KafkaIO

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1664: -- Assignee: Raghu Angadi (was: Davor Bonaci) > Support Kafka0.8.x client in KafkaIO >

[jira] [Assigned] (BEAM-1271) Develop Apache Accumulo IO

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1271: -- Assignee: Reuven Lax (was: Davor Bonaci) > Develop Apache Accumulo IO >

[jira] [Assigned] (BEAM-1271) Develop Apache Accumulo IO

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1271: -- Assignee: Wyatt Frelot (was: Reuven Lax) > Develop Apache Accumulo IO >

[jira] [Assigned] (BEAM-2358) "/test-your-pipeline" example code results in an exception

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2358: -- Assignee: Jason Kuster (was: Davor Bonaci) > "/test-your-pipeline" example code results in an

[jira] [Assigned] (BEAM-2634) Add better documentation on testing unbounded I/O scenarios

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2634: -- Assignee: (was: Davor Bonaci) > Add better documentation on testing unbounded I/O scenarios

[jira] [Assigned] (BEAM-1961) Standard IO metrics documentation

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1961: -- Assignee: (was: Davor Bonaci) > Standard IO metrics documentation >

[jira] [Assigned] (BEAM-2082) I/O Authoring overview - emphasize reading the PTransform style guide

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2082: -- Assignee: Chamikara Jayalath (was: Davor Bonaci) > I/O Authoring overview - emphasize reading

[jira] [Assigned] (BEAM-1189) Add guide for release verifiers in the release guide

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1189: -- Assignee: (was: Davor Bonaci) > Add guide for release verifiers in the release guide >

[jira] [Assigned] (BEAM-1975) Documentation around logging in different runners

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1975: -- Assignee: (was: Davor Bonaci) > Documentation around logging in different runners >

[jira] [Commented] (BEAM-998) Consider asking Apache to register Apache Beam trademark

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140717#comment-16140717 ] Davor Bonaci commented on BEAM-998: --- Re-pinged. > Consider asking Apache to register Apache Beam

  1   2   >