GitHub user ianzhou1 opened a pull request:
https://github.com/apache/incubator-beam/pull/440
[BEAM-???] Modify range tracker to use first response as start key
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM-<Jira issue #>] Description of pull request`
- [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
Travis-CI on your fork and ensure the whole test matrix passes).
- [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
number, if there is one.
- [ ] If this contribution is large, please file an Apache
[Individual Contributor License
Agreement](https://www.apache.org/licenses/icla.txt).
---
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ianzhou1/incubator-beam beam
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-beam/pull/440.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #440
----
commit 5e1fc31c5b666ca50105a5588f7f7f68c6f527b7
Author: Aljoscha Krettek <[email protected]>
Date: 2016-05-18T15:46:34Z
[BEAM-295] Remove erroneous close() calls in Flink Create Sources
Collector.close() should only be called by internal Flink components,
not by user functions.
commit c20c9ef6b978bda01c7358c9674ba3e4f11dd3c5
Author: Mark Shields <[email protected]>
Date: 2016-05-31T21:44:20Z
Forward port changes to GC holds
Forward port changes to BEAM/pull/391 from DataflowJavaSDK/pull/289.
commit af794e1afe8f2b22432e7e0285a45f157bdac969
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2016-05-31T19:46:46Z
[BEAM-242] Set javadoc less strict around missing return or param statements
commit df0633d7b5105206928d7d30ccf62410388e46a3
Author: Davor Bonaci <[email protected]>
Date: 2016-06-01T20:13:02Z
Update pom.xml files formatting
This makes it easier to run maven-release-plugin and understand the output.
Otherwise, the release plugin will make such changes repeatedly in a release
branch.
commit 06690614e58dfae6f9509dd01cf69df59bd94f36
Author: Davor Bonaci <[email protected]>
Date: 2016-06-01T21:14:08Z
[maven-release-plugin] prepare branch release-0.1.0-incubating
commit f8cbd4d78c9b6aced6ad1375684b60707ce1c6e9
Author: Thomas Groh <[email protected]>
Date: 2016-06-01T21:28:18Z
Use Structural Value keys instead of User Values
This fixes problems with lookup by basing entirely on structural
equality.
commit 1f3dfa288f526335f52cbce9c36f9e3dd28541ff
Author: Davor Bonaci <[email protected]>
Date: 2016-06-01T22:21:41Z
[maven-release-plugin] prepare for next development iteration
commit 5c6e980098486f404df87ff080184c0ede521671
Author: JianfengQian <[email protected]>
Date: 2016-05-21T10:32:29Z
[BEAM-297] Update Flink README.md to 0.2.0-incubating-SNAPSHOT
commit 801f2d7768aba2efc12b14ff6f0d9716ed2ed1b0
Author: Thomas Groh <[email protected]>
Date: 2016-05-30T18:04:15Z
Return from awaitCompletion if Already Done
This ensures that a call to ExecutorService#awaitCompletion returns
immediately
if there are no visible updates and the executor has completed. If the
executor is
in this state, no additional visible updates will be published and the call
will hang.
This sequence generally will not happen, as calls via
InProcessPipelineResult
return if the state is already terminal, but this ensures that parallel
calls to
awaitCompletion do not hang one calling thread.
commit 8524c745eefec73c734c336cd44db18649d53f9b
Author: Davor Bonaci <[email protected]>
Date: 2016-06-02T20:21:31Z
Remove reporting section from Spark's pom.xml file
This is currently triggering Maven warnings, due to a missing version
qualifier. However, we don't run 'site', so this isn't being used at this
point. Hence, removing instead of adding the version qualifier.
commit 74ba140139b4df97182e4b4bece2a75a09fc5824
Author: Davor Bonaci <[email protected]>
Date: 2016-06-02T22:09:53Z
Move 'travis/' directory into 'testing/travis/'
commit a9fbba9fabf1897b35ad23573f4e276b22f09a6e
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2016-06-03T11:05:58Z
[BEAM-319][BEAM-320] Add distributions module responsible of packaging
source and binaries distributions.
commit d2172de8d8f320837fb80a7ea101bf16c8accbe5
Author: Jean-Baptiste Onofré <[email protected]>
Date: 2016-06-03T11:55:37Z
Use zip source distribution only (tar.gz doesn't work on Jenkins due to
UTF-8 encoding and long path name)
commit 459ecf7ae2e3c643e9ee96111b55acfe4c848f13
Author: Raghu Angadi <[email protected]>
Date: 2016-06-04T00:46:38Z
squash PR 271
commit d5ac610220dfb0ea027d1a0be1384f4742b24f2e
Author: Kenneth Knowles <[email protected]>
Date: 2016-06-06T20:07:35Z
Fix validation in PubsubIO
commit f043b488e27a823943d52014497bdc0828ac4cf1
Author: Dan Halperin <[email protected]>
Date: 2016-06-07T04:46:37Z
[BEAM-292] Write: always produce at least 1 WriteT
Write has a degenerate case wherein, if no elements were in the written
PCollection,
the finalize step will get produced with nothing to finalize. This often
prevents
correct operation, for example when a FileBasedSink produces no files
instead of one
empty file.
Catch and handle this case in Write by opening and closing an empty
Writer to produce a single WriteT.
commit a0257e16fae22f846d6f234a563a0ed62670eab8
Author: Davor Bonaci <[email protected]>
Date: 2016-06-06T20:27:50Z
[BEAM-287] Use flat groupId structure and full qualified artifactIds
commit 51ee1e8a043cbb59b41d97f400384f8154beee10
Author: Davor Bonaci <[email protected]>
Date: 2016-06-07T17:36:42Z
Add Xdoclint:missing to the Kafka connector
This makes the Javadoc build actually pass.
commit 8388c2d31f90964ad3c8f37c257262787331d259
Author: Davor Bonaci <[email protected]>
Date: 2016-06-07T17:38:20Z
Update Flink's pom.xml
Remove unnecessary version specifier.
commit aa980e701656e2aa7adf2c2510efc3aa6a8b665d
Author: Pei He <[email protected]>
Date: 2016-05-21T00:16:58Z
[BEAM-48] Code cleanup in BigQueryIO
1. Use toJsonString() to avoid try catch
2. add getTableWithDefaultProject in BigQuery.Write
commit 4dc0f59d3bb89e153cf0aecda7d502566c784bd7
Author: Thomas Groh <[email protected]>
Date: 2016-05-25T01:05:16Z
Relocate Immutability Enforcement Tests
These tests are of runner behavior rather than the model, and should be
tested as a runner test.
Stop wrapping IllegalMutationExceptions to surface failures due to
model invariant violations directly, rather than going through a
PipelineExecutionException.
commit c4867a00cd7e8d65ae6bf376858493b039a546da
Author: Thomas Groh <[email protected]>
Date: 2016-06-01T00:09:19Z
Remove DirectRunner implementations from DoFnTester
Part of the removal of runners-core from the Core SDK, and the deletion
of the DirectRunner from the core SDK.
commit 8a6e40430c55f3a7f1004a404bc3914204f17a29
Author: Maximilian Michels <[email protected]>
Date: 2016-06-03T09:13:45Z
[BEAM-287] adjust README to changed Maven layout
commit 39e8a3dc80a5cab3d1878ec2b0b5817de5eda0a0
Author: Thomas Groh <[email protected]>
Date: 2016-06-04T00:57:24Z
Remove Unnecessary Fn cloning
The ParDoInProcessEvaluator is provided clones of a DoFn when
appropriate, and should not serialize them.
commit f5410c4568e388bfcbf7b2037c8fb39edf918d4d
Author: Thomas Groh <[email protected]>
Date: 2016-06-06T18:52:58Z
Allow DoFns to be Reused
Modify the documentation of ParDo to allow DoFns to be reused for
multiple bundles in the general case. This allows DoFns which implement
start and finish bundle to be reused.
Update ParDoTest.TestDoFn to succeed if reused.
commit 49cbd0e7ea50c0ddc059168896a6a00d149bfaa2
Author: Maximilian Michels <[email protected]>
Date: 2016-06-06T10:40:50Z
[flink] improve lifecycle of ParDoBoundWrapper
commit 997d78527927e9f1425ee3e97e0685407bd7dbfb
Author: Raghu Angadi <[email protected]>
Date: 2016-06-07T16:55:34Z
KafkaIO javadoc update
commit b98eb2ec7b099953935a6ce25b20576939cdbd5b
Author: Maximilian Michels <[email protected]>
Date: 2016-06-07T11:57:33Z
[BEAM-196] provide PipelineOptions in DoFn
- fixes NPE when accessing the PipelineOptions
- adds a test to verify that the PipelineOptions are available
commit fec936f3b44ab95fddd75bab1acd0bbd65914c1d
Author: Thomas Groh <[email protected]>
Date: 2016-06-07T21:52:20Z
Reset Writer in WriteBundles.finishBundle
This allows the WriteBundles DoFn to be reused.
commit 5abc869eaf47593766609ad46f3dd123c6dba137
Author: Davor Bonaci <[email protected]>
Date: 2016-06-07T23:12:39Z
Flink: move plugin invocation to each child module
Specifying module invocation in the parent pom.xml file, causes
the release process to produce empty files for the parent pom.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
