[GitHub] incubator-beam pull request #947: [BEAM-618] Disallow NAN, INF and -INF inva...
Github user ajamato closed the pull request at: https://github.com/apache/incubator-beam/pull/947 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #947: [BEAM-618] Disallow NAN, INF and -INF inva...
Github user ajamato closed the pull request at: https://github.com/apache/incubator-beam/pull/947 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #947: [BEAM-618] Disallow NAN, INF and -INF inva...
GitHub user ajamato reopened a pull request: https://github.com/apache/incubator-beam/pull/947 [BEAM-618] Disallow NAN, INF and -INF invalid JSON values in bigquery exporter Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [x] Replace `` in the title with the actual Jira issue number, if there is one. - [x] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- Now exporting JSON will fail with invalid NAN, INF or -INF values. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ajamato/incubator-beam py_json Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/947.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #947 commit 442bed71e68524368408573ce0bcb22901d7f861 Author: Alex Amato <ajam...@ajamato2016.sea.corp.google.com> Date: 2016-09-09T00:57:28Z Set allow_nan=False on bigquery JSON encoding commit bd7f920faf41a3a203d854de626c9dcd90a90e29 Author: Alex Amato <ajam...@ajamato2016.sea.corp.google.com> Date: 2016-09-12T20:09:34Z Remove unused line commit 441b59bdf2de88cae119f0399bd38f64ecbbf96f Author: Alex Amato <ajam...@ajamato2016.sea.corp.google.com> Date: 2016-09-14T17:05:25Z Fix Lint Error --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #947: [BEAM-618] Disallow NAN, INF and -INF inva...
GitHub user ajamato opened a pull request: https://github.com/apache/incubator-beam/pull/947 [BEAM-618] Disallow NAN, INF and -INF invalid JSON values in bigquery exporter Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- Now exporting JSON will fail with invalid NAN, INF or -INF values. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ajamato/incubator-beam py_json Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/947.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #947 commit 442bed71e68524368408573ce0bcb22901d7f861 Author: Alex Amato <ajam...@ajamato2016.sea.corp.google.com> Date: 2016-09-09T00:57:28Z Set allow_nan=False on bigquery JSON encoding --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #935: [BEAM-618] Disallow NAN, INF and -INF inva...
GitHub user ajamato opened a pull request: https://github.com/apache/incubator-beam/pull/935 [BEAM-618] Disallow NAN, INF and -INF invalid JSON values in bigquery exporter You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/incubator-beam python-sdk Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/935.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #935 commit 11d78a4c1791c1dfd88f0ac348c9c07cd48cafc8 Author: Ian Zhou <ianz...@google.com> Date: 2016-06-09T21:17:14Z Modified range tracker to use first response seen as start key commit ec6d88a787dfdab064bceb70d48b2ce1c5bfa9bb Author: Thomas Groh <tg...@google.com> Date: 2016-06-14T01:34:49Z Reuse UnboundedReaders in the InProcessRunner Reuse up to a point, and then discard the reader to exercise resume from checkpoint. commit d2ceaf5e5a778fad18472ab0d7c02a14259015d7 Author: Scott Wegner <sweg...@google.com> Date: 2016-06-14T16:00:49Z Update DataflowPipelineRunner worker container version commit 90bb20ee6738c57bc25f47e2d80690fb721b562e Author: Thomas Groh <tg...@google.com> Date: 2016-06-14T22:49:34Z Explicitly set the Runner in TestFlinkPipelineRunner This ensures that the created PipelineOptions are valid if the DirectRunner is not on the classpath. commit 45e57e0612ae692418e07d9c4483321f040cb4a7 Author: Thomas Groh <tg...@google.com> Date: 2016-06-15T00:51:48Z Remove DoFnRunner from GroupAlsoByWindowsProperties DoFnRunner is a runner implementation detail, and core SDK code should instead use DoFnTester. commit 99654ca4bed6758d7128d0f0ad376e8b479d4eba Author: Thomas Groh <tg...@google.com> Date: 2016-06-15T00:52:49Z Remove the DirectPipelineRunner from the Core SDK commit d5e3dfaa864744ec9a011c51707d15f1ab68a734 Author: Scott Wegner <sweg...@google.com> Date: 2016-06-15T16:51:59Z Fix NullPointerException in AfterWatermark display data Window transforms register display data for the associated trigger function by calling its .toString() method. The AfterWatermark trigger .toString() method was not properly handling cases where there is no late firings registered. commit 340fe3ebcfef0b57b163483d7d7243ad5456ae72 Author: Scott Wegner <sweg...@google.com> Date: 2016-06-15T17:17:01Z Package javadoc for org.apache.beam.sdk.transforms.display commit 6ada1a635382fcddc42a7580e74e755839f7172e Author: Thomas Groh <tg...@google.com> Date: 2016-06-15T19:01:56Z Run NeedsRunner tests in Runner Core on the DirectRunner This ensures that all runner tests in runners/core-java are executed in the standard maven build. commit e90a1b9d74cbc06d7818bae8dfe2af81acd73222 Author: Kenneth Knowles <k...@google.com> Date: 2016-06-08T22:07:52Z Roll-forwards: Base PAssert on GBK instead of side inputs Previously PAssert - hence all RunnableOnService/NeedsRunner tests - required side input support. This created a very steep on ramp for new runners. GroupByKey is a bit more fundamental and most backends will be able to group by key in the global window very quickly. So switching the primitive used to gather all the contents of a PCollection for assertions should make it a bit easier to get early feedback during runner development. commit 0a7246d268969cb1b7f46149e38361802c95e70a Author: Scott Wegner <sweg...@google.com> Date: 2016-06-13T18:05:52Z Improve BigQueryIO validation for streaming WriteDisposition commit 605833071a7034aa3b723776a0f9e24330f64c8b Author: Pei He <pe...@google.com> Date: 2016-06-13T23:58:01Z Replace GcsPath by IOChannelFactory in WordCount. commit 5bf732cd3e598321a5c51e1239eda0fe2877a65d Author: Kenneth Knowles <k...@google.com> Date: 2016-06-14T23:04:10Z Add test for ReduceFnRunner GC time overflow commit cfa217a894575f392f1dfe1612e10e393df5c7ab Author: Kenneth Knowles <k...@google.com> Date: 2016-06-14T23:12:11Z Fix type error in Eclipse This type error occurs in my Eclipse installation. It apparently does not bother the various JDKs we test with. But this is an accurate typing, so it may help other Eclipse-using contributors, too. commit 8278e5f78f36fb48fae994ee7abcc1485db84189 Author: Kenneth Knowles <k...@google.com> Date: 2016-06-15T17:42:59Z [Spark] Elide assigning windows when WindowFn is null Previously, when translating a Window.Bound transform, the case where the WindowFn was null was missed, resulting in a NullPointerException. commit 9400fc9a699f218a7948c21639428f5f00134ec5 Author: Thomas Groh <tg...@google.com> Date: 2016-06-15T1
