[2/2] incubator-beam git commit: [BEAM-372] added a test that verifies if a coder consumes bytes equal to encoded bytes

2016-07-21 Thread lcwik
[BEAM-372] added a test that verifies if a coder consumes bytes equal to encoded bytes This closes #695 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6d5e8186 Tree: http://git-wip-us.apache.org/repos/asf/

[1/2] incubator-beam git commit: minor javadoc fixes

2016-07-20 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master eb69e107d -> 64df4f20a minor javadoc fixes Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2ef6e52a Tree: http://git-wip-us.apache.org/repos/

[2/2] incubator-beam git commit: minor javadoc fixes

2016-07-20 Thread lcwik
minor javadoc fixes This closes #698 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/64df4f20 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/64df4f20 Diff: http://git-wip-us.apache.org/repo

[2/2] incubator-beam git commit: [BEAM-124] WordCountIT: Add outputs verification

2016-07-18 Thread lcwik
[BEAM-124] WordCountIT: Add outputs verification This closes #611 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/52331d96 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/52331d96 Diff: http

[1/2] incubator-beam git commit: [BEAM-124] WordCountIT: Add outputs verification

2016-07-18 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 11c2ec2b1 -> 52331d96c [BEAM-124] WordCountIT: Add outputs verification Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e09eefdd Tree: http:/

[1/2] incubator-beam git commit: Clean up Aggregator javadoc

2016-07-18 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 016c74c49 -> 8410b4779 Clean up Aggregator javadoc Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7a03e3c0 Tree: http://git-wip-us.apache.or

[2/2] incubator-beam git commit: Clean up Aggregator javadoc

2016-07-18 Thread lcwik
Clean up Aggregator javadoc This closes #675 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8410b477 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8410b477 Diff: http://git-wip-us.apache.

[1/2] incubator-beam git commit: [BEAM-462] Fix archetype project to use logging handler.

2016-07-18 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 5ec72c8c7 -> 016c74c49 [BEAM-462] Fix archetype project to use logging handler. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7ceb6fec Tree

[2/2] incubator-beam git commit: [BEAM-462] Fix reference to old PrintHandler in archetypes project

2016-07-18 Thread lcwik
[BEAM-462] Fix reference to old PrintHandler in archetypes project This closes #677 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/016c74c4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0

[1/2] incubator-beam git commit: [BEAM-465] OutgoingMessageCoder should be an AtomicCoder

2016-07-18 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master bfbfabf6d -> f776b11af [BEAM-465] OutgoingMessageCoder should be an AtomicCoder Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4c4acd37 Tree

[2/2] incubator-beam git commit: [BEAM-465] OutgoingMessageCoder should be an AtomicCoder

2016-07-18 Thread lcwik
[BEAM-465] OutgoingMessageCoder should be an AtomicCoder This closes #674 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f776b11a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f776b11a Di

[1/2] incubator-beam git commit: [BEAM-462] Replace MonitoringUtil.PrintHandler with a handler that utilizes a Java logger

2016-07-18 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master a0afd6665 -> bfbfabf6d [BEAM-462] Replace MonitoringUtil.PrintHandler with a handler that utilizes a Java logger Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/i

[2/2] incubator-beam git commit: [BEAM-462] Replace MonitoringUtil.PrintHandler with a handler that utilizes a Java logger

2016-07-18 Thread lcwik
[BEAM-462] Replace MonitoringUtil.PrintHandler with a handler that utilizes a Java logger This closes #673 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bfbfabf6 Tree: http://git-wip-us.apache.org/repos/a

[1/2] incubator-beam git commit: Upgrade to Avro 1.8.1

2016-07-15 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 695247138 -> 7a945a741 Upgrade to Avro 1.8.1 This version has some important fixes for potential memory leaks. (It does not have a fix for [AVRO-607] yet, but still has good fixes.) Project: http://git-wip-us.apache.org/repos/as

[2/2] incubator-beam git commit: [BEAM-457] Upgrade to Avro 1.8.1

2016-07-15 Thread lcwik
[BEAM-457] Upgrade to Avro 1.8.1 This closes #664 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7a945a74 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7a945a74 Diff: http://git-wip-us.ap

[1/2] incubator-beam git commit: Archetype generated projects shouldn't have SNAPSHOT version

2016-07-14 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master f0119b23a -> 2a30f5236 Archetype generated projects shouldn't have SNAPSHOT version Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5b317b85

[2/2] incubator-beam git commit: [BEAM-339] Archetype project version shouldn't be coupled to Beam version

2016-07-14 Thread lcwik
[BEAM-339] Archetype project version shouldn't be coupled to Beam version This closes #654 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2a30f523 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam

[2/2] incubator-beam git commit: [BEAM-446] Fix checkstyle error: remove unused import

2016-07-13 Thread lcwik
[BEAM-446] Fix checkstyle error: remove unused import This closes #647 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f0119b23 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f0119b23 Diff:

[1/2] incubator-beam git commit: Fix checkstyle error: remove unused import

2016-07-13 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 2596d136d -> f0119b23a Fix checkstyle error: remove unused import Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d608efb7 Tree: http://git-w

[4/4] incubator-beam git commit: [BEAM-446] Improve IOChannelUtils.resolve to accept multiple paths

2016-07-13 Thread lcwik
[BEAM-446] Improve IOChannelUtils.resolve to accept multiple paths This closes #646 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2596d136 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2

[1/4] incubator-beam git commit: fix javadoc issue

2016-07-13 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 8f5ce28dc -> 2596d136d fix javadoc issue Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1acfe33c Tree: http://git-wip-us.apache.org/repos/as

[2/4] incubator-beam git commit: remove old method and fix javadoc

2016-07-13 Thread lcwik
remove old method and fix javadoc Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7ff15aa9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7ff15aa9 Diff: http://git-wip-us.apache.org/repos/as

[3/4] incubator-beam git commit: [BEAM-446] Improve IOChannelUtils.resolve to accept multiple paths

2016-07-13 Thread lcwik
[BEAM-446] Improve IOChannelUtils.resolve to accept multiple paths Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/72c2c4a3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/72c2c4a3 Diff: http

[2/2] incubator-beam git commit: API cleanup: Remove getDataflowClient() from DataflowPipelineJob

2016-07-12 Thread lcwik
API cleanup: Remove getDataflowClient() from DataflowPipelineJob This closes #637 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1685a662 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/168

[1/2] incubator-beam git commit: Remove getDataflowClient() from DataflowPipelineJob

2016-07-12 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master f5a5eb34e -> 1685a6626 Remove getDataflowClient() from DataflowPipelineJob Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/23637cbd Tree: htt

[5/5] incubator-beam git commit: [BEAM-77] Move datastore into GCP IO package

2016-07-11 Thread lcwik
[BEAM-77] Move datastore into GCP IO package This closes #584 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cf874d42 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cf874d42 Diff: http://g

[1/5] incubator-beam git commit: Move Datastore from sdks/java/core to io/gcp

2016-07-11 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 9d7002545 -> cf874d426 http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/c2ccd685/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/V1Beta3.java --

[4/5] incubator-beam git commit: Clean up duplicate dependencies in runners core java pom

2016-07-11 Thread lcwik
Clean up duplicate dependencies in runners core java pom Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1cccbacf Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1cccbacf Diff: http://git-wip

[2/5] incubator-beam git commit: Move Datastore from sdks/java/core to io/gcp

2016-07-11 Thread lcwik
Move Datastore from sdks/java/core to io/gcp * Remove DataflowDatastoreIOTest. Dataflow runner translation of display data should be tested via code in the same module. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-

[3/5] incubator-beam git commit: Add io-gcp to top-level pom dependency management

2016-07-11 Thread lcwik
Add io-gcp to top-level pom dependency management So its version is inherited everywhere that depends on it Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/15dff04d Tree: http://git-wip-us.apache.org/repos/a

[2/4] incubator-beam git commit: Uses ThreadLocalRandom.current to generate a random hashCode

2016-07-07 Thread lcwik
Uses ThreadLocalRandom.current to generate a random hashCode Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9df033cb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9df033cb Diff: http://git

[1/4] incubator-beam git commit: Removes extra blank space

2016-07-07 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 1cb898f58 -> 66d726aa2 Removes extra blank space Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7e97cbcc Tree: http://git-wip-us.apache.org/

[4/4] incubator-beam git commit: [BEAM-408] - Fixes ProxyInvocationHandler uses inefficient Math.random() for random int

2016-07-07 Thread lcwik
[BEAM-408] - Fixes ProxyInvocationHandler uses inefficient Math.random() for random int This closes #588 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/66d726aa Tree: http://git-wip-us.apache.org/repos/asf

[3/4] incubator-beam git commit: [BEAM-408] - Fixes ProxyInvocationHandler uses inefficient Math.random() for random int

2016-07-07 Thread lcwik
[BEAM-408] - Fixes ProxyInvocationHandler uses inefficient Math.random() for random int For more information: https://issues.apache.org/jira/browse/BEAM-408 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7

[1/2] incubator-beam git commit: AvroSource: use a 64K buffer size for Snappy codec

2016-07-06 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 3bb78cb8e -> a7e8151dd AvroSource: use a 64K buffer size for Snappy codec commons-compress defaults to a 32K buffer size for Snappy. However, Avro uses xerial.snappy to write, which has a 64K buffer size. When the buffer size is t

[2/2] incubator-beam git commit: [BEAM-422] AvroSource: use a 64K buffer size for Snappy codec

2016-07-06 Thread lcwik
[BEAM-422] AvroSource: use a 64K buffer size for Snappy codec This closes #583 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a7e8151d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a7e815

[27/50] [abbrv] incubator-beam git commit: Add direct runner package-info

2016-07-06 Thread lcwik
Add direct runner package-info Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/53c8bff4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/53c8bff4 Diff: http://git-wip-us.apache.org/repos/asf/i

[36/50] [abbrv] incubator-beam git commit: Make WindowedValue like an interface, allow external implementations

2016-07-06 Thread lcwik
Make WindowedValue like an interface, allow external implementations Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f79e2bd Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9f79e2bd Diff: ht

[03/50] [abbrv] incubator-beam git commit: Enable dependency-plugin at global level

2016-07-06 Thread lcwik
Enable dependency-plugin at global level Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/38dfb634 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/38dfb634 Diff: http://git-wip-us.apache.org/r

[43/50] [abbrv] incubator-beam git commit: Fix timestamps in GroupAlsoByWindowsProperties

2016-07-06 Thread lcwik
Fix timestamps in GroupAlsoByWindowsProperties Some of the timestamps were not adjusted when BEAM-145 was fixed to respect the WindowFn's timestamps. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/151ff5f7

[25/50] [abbrv] incubator-beam git commit: Add Surefire Max Heap Size argument

2016-07-06 Thread lcwik
Add Surefire Max Heap Size argument Remove Travis Maven overrides. Fork in Travis CI. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bc8e6fee Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree

[07/50] [abbrv] incubator-beam git commit: Add StaticWindows

2016-07-06 Thread lcwik
Add StaticWindows This is a windowFn that ignores the input and always assigns to the same input. It returns the provided window as the side input window if and only if that window is present within its set of windows. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: h

[05/50] [abbrv] incubator-beam git commit: Use only WindowFn in TriggerTester

2016-07-06 Thread lcwik
Use only WindowFn in TriggerTester This change is preparatory for separating trigger syntax from implementation. Previously, the whole WindowingStrategy was passed in, but not used. Since the tester is really a test of the state machine, it will be moved to runners-core alongside the trigger impl

[17/50] [abbrv] incubator-beam git commit: DisplayDataEvaluator: Add support for source transforms

2016-07-06 Thread lcwik
DisplayDataEvaluator: Add support for source transforms Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/49bb72d9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/49bb72d9 Diff: http://git-wip-

[14/50] [abbrv] incubator-beam git commit: Move remnants of Dataflow runner from SDK to its module

2016-07-06 Thread lcwik
Move remnants of Dataflow runner from SDK to its module Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5472c97e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5472c97e Diff: http://git-wip-

[06/50] [abbrv] incubator-beam git commit: Remove TriggerBuilder backwards-compatibility adapter

2016-07-06 Thread lcwik
Remove TriggerBuilder backwards-compatibility adapter Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/62fe4ef1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/62fe4ef1 Diff: http://git-wip-us

[37/50] [abbrv] incubator-beam git commit: [BEAM-392] Rename missing references to FlinkPipelineRunner

2016-07-06 Thread lcwik
[BEAM-392] Rename missing references to FlinkPipelineRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/acec0a59 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/acec0a59 Diff: http://git-

[42/50] [abbrv] incubator-beam git commit: Replace PubsubIO and injector with TextIO in traffic examples

2016-07-06 Thread lcwik
Replace PubsubIO and injector with TextIO in traffic examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ae75a5d8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ae75a5d8 Diff: http://gi

[13/50] [abbrv] incubator-beam git commit: Increase the MESSAGES_POLLING_ATTEMPTS for slow backend starts

2016-07-06 Thread lcwik
Increase the MESSAGES_POLLING_ATTEMPTS for slow backend starts Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a53450b5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a53450b5 Diff: http://gi

[47/50] [abbrv] incubator-beam git commit: DatastoreIO: add Read/Write Transforms and version-specific class

2016-07-06 Thread lcwik
DatastoreIO: add Read/Write Transforms and version-specific class * Also move DatastoreIO to io.datastore package Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d1e38443 Tree: http://git-wip-us.apache.org/r

[44/50] [abbrv] incubator-beam git commit: Add initial microbenchmarks directory

2016-07-06 Thread lcwik
Add initial microbenchmarks directory Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b36aeb92 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b36aeb92 Diff: http://git-wip-us.apache.org/repo

[48/50] [abbrv] incubator-beam git commit: Make examples only have optional runtime deps on runners

2016-07-06 Thread lcwik
Make examples only have optional runtime deps on runners Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/023a58e7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/023a58e7 Diff: http://git-wip

[09/50] [abbrv] incubator-beam git commit: Use GatherAllPanes in PAssert

2016-07-06 Thread lcwik
Use GatherAllPanes in PAssert Instead of explicitly grouping by key, gather all the panes across the input window. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8b0cbf9a Tree: http://git-wip-us.apache.org/

[19/50] [abbrv] incubator-beam git commit: Static import Preconditions.checkX everywhere

2016-07-06 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/8b8615ea/runners/spark/src/main/java/org/apache/beam/runners/spark/io/hadoop/HadoopIO.java -- diff --git a/runners/spark/src/main/java/org/apache/beam/runners/spark/io/had

[26/50] [abbrv] incubator-beam git commit: Write: add support for setting a fixed number of shards

2016-07-06 Thread lcwik
Write: add support for setting a fixed number of shards And remove special support in Dataflow and Direct runners for it. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/da1dcf9b Tree: http://git-wip-us.apac

[34/50] [abbrv] incubator-beam git commit: Update to bigtable-client-core-0.3.0 and use bulk writes

2016-07-06 Thread lcwik
Update to bigtable-client-core-0.3.0 and use bulk writes Generally more stable, plus bulk writes bring 5x write throughput in batch jobs by more efficiently using the network. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incub

[49/50] [abbrv] incubator-beam git commit: Replace PubsubIO and injector with TextIO in beam-examples

2016-07-06 Thread lcwik
Replace PubsubIO and injector with TextIO in beam-examples Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b09de0f0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b09de0f0 Diff: http://git-w

[40/50] [abbrv] incubator-beam git commit: [BEAM-142] - BigQueryIO: don't unnecessarily initialize an ExecutorService to validate parameters

2016-07-06 Thread lcwik
[BEAM-142] - BigQueryIO: don't unnecessarily initialize an ExecutorService to validate parameters By default, BigQueryIO initializes a ExecutorContext, however AppEngine doesn't allow modification of threads to be daemon threads. Using GcsOptions.ExecutorContext to create the executorContext. P

[28/50] [abbrv] incubator-beam git commit: Update Checkpoint Documentation

2016-07-06 Thread lcwik
Update Checkpoint Documentation Checkpoint finalization is best effort. A checkpoint that is committed to durable state is permitted to be reused to start a reader, regardless of if it is finalized. Note that checkpoints which have an affect on their source (via finalize) should generally require

[46/50] [abbrv] incubator-beam git commit: DatastoreIO: add Read/Write Transforms and version-specific class

2016-07-06 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d1e38443/sdks/java/core/src/test/java/org/apache/beam/sdk/io/DatastoreIOTest.java -- diff --git a/sdks/java/core/src/test/java/org/apache/beam/sdk/io/DatastoreIOTest.java

[39/50] [abbrv] incubator-beam git commit: [BEAM-392] Update flink dependency to the most recent stable version

2016-07-06 Thread lcwik
[BEAM-392] Update flink dependency to the most recent stable version Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/721763a3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/721763a3 Diff: ht

[22/50] [abbrv] incubator-beam git commit: Add FindBugs analysis to the build

2016-07-06 Thread lcwik
Add FindBugs analysis to the build FindBugs is a static analysis tool which looks for common coding issues in Java code. See: http://findbugs.sourceforge.net/ This commit integrates FindBugs into the build process using findbugs-maven-plugin, and subscribes java-sdk-all for analysis. The codebas

[20/50] [abbrv] incubator-beam git commit: Static import Preconditions.checkX everywhere

2016-07-06 Thread lcwik
Static import Preconditions.checkX everywhere Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8b8615ea Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8b8615ea Diff: http://git-wip-us.apache.

[38/50] [abbrv] incubator-beam git commit: Replacing BigQuery direct calls with BigQueryServices abstraction

2016-07-06 Thread lcwik
Replacing BigQuery direct calls with BigQueryServices abstraction Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d71f3850 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d71f3850 Diff: http:

[45/50] [abbrv] incubator-beam git commit: Several improvements to HDFS/Hadoop interoperability

2016-07-06 Thread lcwik
Several improvements to HDFS/Hadoop interoperability * handle NullWritable in WritableCoder * update Function handling in HDFSFileSource#splitIntoBundles * add AvroHDFSFileSource * add HDFSFileSink * add SimpleAuth HDFS IO Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commi

[02/50] [abbrv] incubator-beam git commit: Remove many uses of .named methods

2016-07-06 Thread lcwik
Remove many uses of .named methods Specifically, remove uses of: - Window.named - AvroIO.named - PubSubIO.named - TextIO.named - BigQueryIO.named - Read.named Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-

[50/50] [abbrv] incubator-beam git commit: Merge master into runners-spark2 branch to keep up-to-date

2016-07-06 Thread lcwik
Merge master into runners-spark2 branch to keep up-to-date This closes #585 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/19dd6cce Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/19dd6cce

[10/50] [abbrv] incubator-beam git commit: Update test for GatherAllPanes

2016-07-06 Thread lcwik
Update test for GatherAllPanes Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c8babc1b Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c8babc1b Diff: http://git-wip-us.apache.org/repos/asf/i

[21/50] [abbrv] incubator-beam git commit: Added integration tests for BigtableRead and BigtableWrite

2016-07-06 Thread lcwik
Added integration tests for BigtableRead and BigtableWrite Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/067c92a7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/067c92a7 Diff: http://git-w

[30/50] [abbrv] incubator-beam git commit: Copy and use UnboundedReadFromBoundedSource in dataflow runner

2016-07-06 Thread lcwik
Copy and use UnboundedReadFromBoundedSource in dataflow runner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/56ec6c3e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/56ec6c3e Diff: http://g

[33/50] [abbrv] incubator-beam git commit: KafkaIO tests : change category annotation from RunnableOnService to NeedsRunner

2016-07-06 Thread lcwik
KafkaIO tests : change category annotation from RunnableOnService to NeedsRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ed32d10e Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ed32d

[31/50] [abbrv] incubator-beam git commit: Deprecate WindowedValue.valueInEmptyWindows

2016-07-06 Thread lcwik
Deprecate WindowedValue.valueInEmptyWindows Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1779bf88 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1779bf88 Diff: http://git-wip-us.apache.or

[01/50] [abbrv] incubator-beam git commit: Remove many definitions of named methods

2016-07-06 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/runners-spark2 f57e66c48 -> 19dd6ccef Remove many definitions of named methods Specifically, remove the occurrences in: - Window - AvroIO - PubsubIO - TextIO - BigQueryIO - Read Project: http://git-wip-us.apache.org/repos/as

[18/50] [abbrv] incubator-beam git commit: Static import Preconditions.checkX everywhere

2016-07-06 Thread lcwik
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/8b8615ea/sdks/java/core/src/main/java/org/apache/beam/sdk/util/InstanceBuilder.java -- diff --git a/sdks/java/core/src/main/java/org/apache/beam/sdk/util/InstanceBuilder.j

[11/50] [abbrv] incubator-beam git commit: [BEAM-377] Validate BigQueryIO.Read is properly configured

2016-07-06 Thread lcwik
[BEAM-377] Validate BigQueryIO.Read is properly configured Previously, using withoutValidation would disable all validation, leading to a NullPointerException if there wasn't a table or schema provided. The intention of the withoutValidation parameter is to bypass more expensive (and possibly inc

[24/50] [abbrv] incubator-beam git commit: Move some more easy stuff to runners-core

2016-07-06 Thread lcwik
Move some more easy stuff to runners-core Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/722bfcaf Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/722bfcaf Diff: http://git-wip-us.apache.org/

[32/50] [abbrv] incubator-beam git commit: Fix missing Override Annotations in the DirectRunner

2016-07-06 Thread lcwik
Fix missing Override Annotations in the DirectRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8f7e24a2 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8f7e24a2 Diff: http://git-wip-us.

[23/50] [abbrv] incubator-beam git commit: Added getSplitPointsConsumed() to ByteKeyRangeTracker

2016-07-06 Thread lcwik
Added getSplitPointsConsumed() to ByteKeyRangeTracker Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ef9d1955 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ef9d1955 Diff: http://git-wip-us

[12/50] [abbrv] incubator-beam git commit: pom.xml: upgrade to dataflow version v1b3-rev30-1.22.0

2016-07-06 Thread lcwik
pom.xml: upgrade to dataflow version v1b3-rev30-1.22.0 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2c53b191 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2c53b191 Diff: http://git-wip-u

[41/50] [abbrv] incubator-beam git commit: [BEAM-390] Update spark dependency to the most recent stable version

2016-07-06 Thread lcwik
[BEAM-390] Update spark dependency to the most recent stable version Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a313e337 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a313e337 Diff: ht

[35/50] [abbrv] incubator-beam git commit: Make PTransform.apply Abstract

2016-07-06 Thread lcwik
Make PTransform.apply Abstract Primitive PTransforms should create the appropriate primitive output type. Composite PTransforms should override apply. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9a17d496

[29/50] [abbrv] incubator-beam git commit: Implement getSplitPointsConsumed() in BigtableIO

2016-07-06 Thread lcwik
Implement getSplitPointsConsumed() in BigtableIO Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5211c4ad Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5211c4ad Diff: http://git-wip-us.apac

[15/50] [abbrv] incubator-beam git commit: Fix NPE in UnboundedReadFromBoundedSource

2016-07-06 Thread lcwik
Fix NPE in UnboundedReadFromBoundedSource Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/562beafb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/562beafb Diff: http://git-wip-us.apache.org/

[16/50] [abbrv] incubator-beam git commit: Explicitly set UseDummyRunner in IO, Extensions

2016-07-06 Thread lcwik
Explicitly set UseDummyRunner in IO, Extensions This mitigates test failures due to forkCount=0 in travis. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/942b6e02 Tree: http://git-wip-us.apache.org/repos/as

[08/50] [abbrv] incubator-beam git commit: Disable integration tests in parent pom

2016-07-06 Thread lcwik
Disable integration tests in parent pom Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d1d7a2c1 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d1d7a2c1 Diff: http://git-wip-us.apache.org/re

[04/50] [abbrv] incubator-beam git commit: Key with integers in GatherAllPanes

2016-07-06 Thread lcwik
Key with integers in GatherAllPanes Ensures that runners which do not support null values can handle GatherAllPanes. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/947a5425 Tree: http://git-wip-us.apache.or

[2/2] incubator-beam git commit: [BEAM-397] - Fixes Format string - it should use %n instead of \n

2016-07-06 Thread lcwik
[BEAM-397] - Fixes Format string - it should use %n instead of \n This closes #589 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1a5dd59f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1a

[1/2] incubator-beam git commit: [BEAM-397] - Fixes Format string - it should use %n instead of \n

2016-07-06 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 8147037d6 -> 1a5dd59f0 [BEAM-397] - Fixes Format string - it should use %n instead of \n It fixes format string on Coder.NonDeterministicExeption.getMessage. For more information: https://issues.apache.org/jira/browse/BEAM-397

[2/2] incubator-beam git commit: [BEAM-405] Fixes inefficient use of keySet iterator instead of entrySet iterator

2016-07-06 Thread lcwik
[BEAM-405] Fixes inefficient use of keySet iterator instead of entrySet iterator This closes #587 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8147037d Tree: http://git-wip-us.apache.org/repos/asf/incubat

[1/2] incubator-beam git commit: [BEAM-405] Fixes inefficient use of keySet iterator instead of entrySet iterator.

2016-07-06 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 9adbecb6a -> 8147037d6 [BEAM-405] Fixes inefficient use of keySet iterator instead of entrySet iterator. BiggQueryIO$StreamingWriteFn.finishBundle: Fixes inefficient use of keySet iterator instead of entrySet iterator. Project:

[2/2] incubator-beam git commit: [BEAM-142] - BigQueryIO: dont unnecessarily initialize an ExecutorService to validate parameters

2016-06-30 Thread lcwik
[BEAM-142] - BigQueryIO: dont unnecessarily initialize an ExecutorService to validate parameters This closes #526. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4a0e426a Tree: http://git-wip-us.apache.org

[1/2] incubator-beam git commit: [BEAM-142] - BigQueryIO: don't unnecessarily initialize an ExecutorService to validate parameters

2016-06-30 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master ef2c51400 -> 4a0e426a8 [BEAM-142] - BigQueryIO: don't unnecessarily initialize an ExecutorService to validate parameters By default, BigQueryIO initializes a ExecutorContext, however AppEngine doesn't allow modification of threads

[2/3] incubator-beam git commit: Move remnants of Dataflow runner from SDK to its module

2016-06-28 Thread lcwik
Move remnants of Dataflow runner from SDK to its module Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/175d7acb Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/175d7acb Diff: http://git-wip-

[3/3] incubator-beam git commit: [BEAM-362] Move some more easy stuff from SDK to appropriate modules

2016-06-28 Thread lcwik
[BEAM-362] Move some more easy stuff from SDK to appropriate modules This closes #525. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d5d30356 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tre

[1/3] incubator-beam git commit: Move some more easy stuff to runners-core

2016-06-28 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master f1be6f1cc -> d5d303566 Move some more easy stuff to runners-core Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a5a3c55d Tree: http://git-wi

[2/2] incubator-beam git commit: [BEAM-327] Add configuration for Dataflow runner System.out/err

2016-06-13 Thread lcwik
[BEAM-327] Add configuration for Dataflow runner System.out/err This closes #426. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/915bc198 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/915

[1/2] incubator-beam git commit: Add configuration for Dataflow runner System.out/err

2016-06-13 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master e1b305ea5 -> 915bc198d Add configuration for Dataflow runner System.out/err Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/874e199e Tree: ht

[1/2] incubator-beam git commit: Port cleanupDaemonThreads fix to archetype module

2016-06-13 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master be05942da -> fe5b8db6c Port cleanupDaemonThreads fix to archetype module Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/51030829 Tree: http:

[2/2] incubator-beam git commit: [BEAM-330] Port cleanupDaemonThreads fix to archetype module

2016-06-13 Thread lcwik
[BEAM-330] Port cleanupDaemonThreads fix to archetype module This closes #444. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fe5b8db6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fe5b8d

[2/2] incubator-beam git commit: [BEAM-330] Disable exec-maven-plugin cleanupDaemonThreads

2016-06-09 Thread lcwik
[BEAM-330] Disable exec-maven-plugin cleanupDaemonThreads This closes #439 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/983d467a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/983d467a D

<    1   2   3   4   5   >