GitHub user aaltay opened a pull request:
https://github.com/apache/incubator-beam/pull/787
merge master into python-sdk
Merge master branch into python-sdk branch. We will do this on a regular
basis going forward to keep python-sdk development branch in sync with the
master.
Merging changes since 6/20/2016 (#498) and there was a single non-trivial
merge conflict for .travis.yml
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/aaltay/incubator-beam python-sdk
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/787.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #787
----
commit 3bb78cb8ec11b77f6b6821fad8a614b1699c0f97
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2016-07-06T17:19:05Z
[BEAM-357] This closes #519
commit 46ab9b1d64b7f916aa6459e523484072b97ea0ad
Author: Dan Halperin <[email protected]>
Date: 2016-07-02T09:18:07Z
AvroSource: use a 64K buffer size for Snappy codec
commons-compress defaults to a 32K buffer size for Snappy.
However, Avro uses xerial.snappy to write, which has a 64K buffer size.
When the buffer size is too small, decoding data from Snappy can cause
an EOF exception rather than finishing data.
This fixes BEAM-422.
commit a7e8151ddc249047994c1835eab79f271b7f3b3b
Author: Luke Cwik <[email protected]>
Date: 2016-07-06T17:58:19Z
[BEAM-422] AvroSource: use a 64K buffer size for Snappy codec
This closes #583
commit 691a5828b45423940e850bbc64ccc5daf7599c76
Author: Pei He <[email protected]>
Date: 2016-07-02T00:45:37Z
Replace PubsubIO and injector with TextIO in AutoComplete and TriggerExample
commit 5eb7d95f397ce1226760efe6cdfcecd9fb3ae3d7
Author: Dan Halperin <[email protected]>
Date: 2016-07-07T00:24:00Z
Closes #582
commit 51427f712d58a10f1de5a3db03030a6f920510cb
Author: Pei He <[email protected]>
Date: 2016-07-06T20:24:45Z
remove runInjectorPipeline from DataflowExampleUtils
commit 1cb898f58dc77a98ef73210e00f8aa71d65303ab
Author: Dan Halperin <[email protected]>
Date: 2016-07-07T00:25:25Z
Closes #594
commit 708244bf91b4079690bbaed0c063b70e76a95794
Author: Lucas Amorim <[email protected]>
Date: 2016-07-04T22:47:39Z
[BEAM-408] - Fixes ProxyInvocationHandler uses inefficient Math.random()
for random int
For more information: https://issues.apache.org/jira/browse/BEAM-408
commit 9df033cb0921836b25ff685c55fc1a93fff4a36f
Author: Lucas Amorim <[email protected]>
Date: 2016-07-07T06:01:55Z
Uses ThreadLocalRandom.current to generate a random hashCode
commit 7e97cbcc8a6ec47bcfad17054e581a45dc248ac2
Author: Lucas Amorim <[email protected]>
Date: 2016-07-07T06:11:55Z
Removes extra blank space
commit 66d726aa2aa56f11f2ac91771941d84e64fb4e4c
Author: Luke Cwik <[email protected]>
Date: 2016-07-07T13:07:30Z
[BEAM-408] - Fixes ProxyInvocationHandler uses inefficient Math.random()
for random int
This closes #588
commit b90f71ae57309627c8e10b46b641d04b57de2253
Author: srinikhil <[email protected]>
Date: 2016-07-07T06:06:54Z
Change in documentation URL
Fixes a broken link
commit 33b18b173c8132435f6051827cdc1355693205ff
Author: Dan Halperin <[email protected]>
Date: 2016-07-07T15:35:17Z
Closes #601
commit 9c91403c7b0b7e45473b30be8019a8e07c66fd1c
Author: Scott Wegner <[email protected]>
Date: 2016-07-07T15:38:14Z
Fix BigtableIO display data label
commit 1963bde446a798f0971393bb8f0076fc933367cf
Author: Dan Halperin <[email protected]>
Date: 2016-07-07T16:32:23Z
Closes #602
commit 3875071b5289bb729ad84de97b161d679d3c3292
Author: Scott Wegner <[email protected]>
Date: 2016-06-30T23:16:14Z
Fix and file bugs for FindBugs issues
commit 1c9d16d70ad2bd55b0736ea37f9357029f39ade5
Author: Raghu Angadi <[email protected]>
Date: 2016-07-07T21:22:41Z
remove an obsolete comment in KafkaIOTest.java
Kafka 10.0 added compatible constructor for ConsumerRecord. It was not
present when I wrote this test.
https://github.com/apache/kafka/commit/4e557f8ef60d46a8870704655c9a35092f74d125
commit 155409bf6041380c309e4452719763a683d41936
Author: Dan Halperin <[email protected]>
Date: 2016-07-07T23:13:36Z
Closes #606
commit c17768f14f5a57bcc2d83613818101f3b21e7260
Author: Kenneth Knowles <[email protected]>
Date: 2016-07-08T02:41:45Z
Move example dependency on runners into a profile
Even an optional runtime dependency, such as from the examples
to a runner, does get pulled in for testing. This meant that
all the dependencies for all runners had to be resolvable in an
integration testing context. It is quite inconvient.
Explicitly excluding runners via flags such as `-pl !runners/spark`
does not work since it causes errors in dependency resolution.
This change adds a profile, active by default, that can be
explicitly disabled to avoid pulling in dependencies.
commit b9231826bb9c8084f3802206fbdd1d9f69fea3a6
Author: Ian Zhou <[email protected]>
Date: 2016-07-07T17:27:47Z
Modified addBulkOptions for simplicity
commit 290c0b77280b5fab3b656b3009bfdc897784c6b5
Author: Dan Halperin <[email protected]>
Date: 2016-07-08T04:53:35Z
Closes #603
commit a6f488f1d3f12411002f3d0b20c74fc9b2f909df
Author: Pei He <[email protected]>
Date: 2016-07-07T20:45:24Z
Rename DataflowExampleUtils and DataflowExampleOptions
commit 921c55c94f72210d010359e628f2dcfe866f84d5
Author: Dan Halperin <[email protected]>
Date: 2016-07-08T05:19:04Z
Closes #605
commit 543842cbd9d433bcef9b7962d9c71a8779e99eb5
Author: Dan Halperin <[email protected]>
Date: 2016-07-07T06:05:56Z
[BEAM-381] BoundedReader: update the range last of all
Reorders the code in some splitAtFraction calls so that the rangeTracker
update
is the last thing (besides assignment) in the function. This avoids a
potential
issue if creating the primary or residual sources happens to throw an
exception.
commit 74e1f83df651af61a98c388604d6cdd4f75d0ff5
Author: Dan Halperin <[email protected]>
Date: 2016-07-08T05:20:03Z
Closes #600
commit 5f0288b448102185bf2b469368e489481a8618aa
Author: Kenneth Knowles <[email protected]>
Date: 2016-07-08T15:48:20Z
This closes #609
commit a2b118afee886c80c3152af11c641ac5870abfaa
Author: Kenneth Knowles <[email protected]>
Date: 2016-07-08T17:01:03Z
This closes #574
commit ddf5cc27e7b4cf7df653e916a39cef2dea1b67bd
Author: Kenneth Knowles <[email protected]>
Date: 2016-07-08T16:05:29Z
Exclude AppleJavaExtensions from findbugs plugin deps
This is for a GUI component of findbugs, and is not
a real runtime dependency of our build. While it is not
distributed with any of our artifacts, it is still
one more needless thing to pull down at build time,
and one more license to be aware of.
commit a7312bee35e41071712b92ae5b5b6b117e538d33
Author: Dan Halperin <[email protected]>
Date: 2016-07-08T17:35:05Z
Closes #610
commit 12f159934ec7965c3974cda319681103a817778b
Author: Ian Zhou <[email protected]>
Date: 2016-07-01T23:14:53Z
Modified BigtableIO to support streaming
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
