[GitHub] beam pull request #1899: [BEAM-1265] Fail if --streaming option is used
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1899 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1899: [BEAM-1265] Fail if --streaming option is used
GitHub user aaltay reopened a pull request: https://github.com/apache/beam/pull/1899 [BEAM-1265] Fail if --streaming option is used Currently, none of the runners for Python SDK supports streaming. Fail at pipeline validation time if '--streaming' option is set. This is to prevent user confusion, until streaming execution is implemented. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam str Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1899.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1899 commit 099b83e78549c53ccb5998ed6218276d4f2d47f2 Author: Ahmet Altay <al...@google.com> Date: 2017-02-02T01:55:54Z Fail when --streaming option is used. Currently, none of the runners for Python SDK supports streaming. Fail at pipeline validation time if '--streaming' option is set. This is to prevent user confusion, until streaming execution is implemented. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1899: [BEAM-1265] Fail if --streaming option is used
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1899 [BEAM-1265] Fail if --streaming option is used Currently, none of the runners for Python SDK supports streaming. Fail at pipeline validation time if '--streaming' option is set. This is to prevent user confusion, until streaming execution is implemented. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam str Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1899.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1899 commit 099b83e78549c53ccb5998ed6218276d4f2d47f2 Author: Ahmet Altay <al...@google.com> Date: 2017-02-02T01:55:54Z Fail when --streaming option is used. Currently, none of the runners for Python SDK supports streaming. Fail at pipeline validation time if '--streaming' option is set. This is to prevent user confusion, until streaming execution is implemented. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1881: [BEAM-1360] Remove python-sdk links from the sdks/p...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1881 [BEAM-1360] Remove python-sdk links from the sdks/python/README.md You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam read Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1881.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1881 commit 993785701de7d02ac361a517cd832cf72f5eeae7 Author: Ahmet Altay <al...@google.com> Date: 2017-01-31T17:43:31Z Remove python-sdk links from the sdks/python/README.md --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1889: [BEAM-1319] Add conflict resolution to the Pipeline...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1889 [BEAM-1319] Add conflict resolution to the PipelineOptions internal argparse. In some instances where a PipelineOptions subclass was defined in the main session and save_main_session option is enabled, that subclass may appear multiple times in the PipelineOptions.__subclassess__() list. This is causing problems with the argparse because options are not unique any more. This change filters the subclasses by name, and pick the last unique instance of each subclass. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam opt Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1889.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1889 commit 86c173eb7991594168a53c609747ec6a91651133 Author: Ahmet Altay <al...@google.com> Date: 2017-02-01T18:39:59Z In some instances where a PipelineOptions subclass was defined in the main session and save_main_session option is enabled, that subclass may appear multiple times in the PipelineOptions.__subclassess__() list. This is causing problems with the argparse because options are not unique any more. This changes filter the subclasses by name, and pick the last unique instance of each subclass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam-site pull request #138: Add new committers to the team.
GitHub user aaltay opened a pull request: https://github.com/apache/beam-site/pull/138 Add new committers to the team. R: @davorbonaci You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam-site asf-site Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam-site/pull/138.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #138 commit f67cdd1a1b28242172b77bff33533215482d7a50 Author: Ahmet Altay <al...@google.com> Date: 2017-01-31T22:29:28Z Add new committers to the team. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1836: [BEAM-1218] Install test dependencies in the post c...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1836 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1871: Revert python-sdk only changes in travis, and clean...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1871 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1872: [BEAM-1349] Merge python-sdk to master
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1872 [BEAM-1349] Merge python-sdk to master You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/beam python-sdk Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1872.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1872 commit 0a66721b5528483536eac753d5fc8cf28844b2eb Author: Maria Garcia Herrero <mari...@google.com> Date: 2016-11-22T17:57:50Z Merge remote-tracking branch 'origin/master' into merge_master commit cc706608b281c3beeebd2487084946c06bc83f30 Author: Mark Liu <mark...@markliu-macbookpro.roam.corp.google.com> Date: 2016-11-17T17:53:01Z Support @ValidatesRunner(RunnableOnService) in Python [1/2] commit 28bfd9090b0ce33c3da0bab0220fcc1ef8a72b4b Author: Thomas Groh <tg...@google.com> Date: 2016-11-22T18:11:22Z This closes #1376 commit b4187bd91e9e53c1562ee845ffa87cc9e734006f Author: Kenneth Knowles <k...@google.com> Date: 2016-11-22T20:08:38Z This closes #1416 commit a6be102a9ebafd3e616ee6aca9a11fbb21c375d9 Author: Maria Garcia Herrero <mari...@google.com> Date: 2016-11-22T21:24:08Z Remove tests for merge commit 3b5cd0efc5f5e4b8fad34ee0d976e5e6ba501065 Author: Kenneth Knowles <k...@google.com> Date: 2016-11-22T21:56:37Z This closes #1384 commit 21f9c6d2cff052d662326ce73fdcf1fb08504dda Author: Kenneth Knowles <k...@google.com> Date: 2016-11-22T23:31:10Z This closes #1423 commit 2b69cce0f311a2ef40fdef4fe60d3e6fc13a8868 Author: Vikas Kedigehalli <vika...@google.com> Date: 2016-11-16T00:41:24Z Add DatastoreIO to Python SDK commit 9b9d016c80b9a7e73a7485d3e579ead3ada18ac6 Author: Davor Bonaci <da...@google.com> Date: 2016-11-23T18:42:17Z This closes #1398 commit 4dd19782f2624bf8aed3df8484fa314f94904571 Author: Kenneth Knowles <k...@google.com> Date: 2016-11-16T05:33:13Z Reject stateful DoFn in SparkRunner commit 413a40243a30e059476395a2dcbfc98a94bb22f2 Author: Kenneth Knowles <k...@google.com> Date: 2016-11-16T05:33:28Z Reject stateful DoFn in FlinkRunner commit 255ad9a327133ab4f05ebbceca236d5fe0006028 Author: Kenneth Knowles <k...@google.com> Date: 2016-11-21T23:41:13Z Add JUnit category for stateful ParDo tests commit 1fc8d65a079e58d740a9b954da980963f20e9edf Author: Scott Wegner <sweg...@google.com> Date: 2016-11-22T00:33:07Z Update StarterPipeline Convert StarterPipeline ParDo to MapElements. Use the new DoFn for non-outputting transforms. commit 796ba7ab75bc8d01a3a59efc29cdc17bcd26af4a Author: Kenneth Knowles <k...@google.com> Date: 2016-11-16T05:33:01Z Reject stateful DoFn in ApexRunner commit 6fa8f658abaac1d3a983bfc3b8c09422159af8aa Author: bchambers <bchamb...@google.com> Date: 2016-11-22T19:37:23Z Simplify the API for managing MetricsEnvironment 1. setCurrentContainer returns the previous MetricsEnvironment 2. setCurrentContainer(null) resets the thread local 3. scopedCurrentContainer sets the container and returns a Closeable to reset the previous container. commit f03b4fe11cb605edf216903738a6c305b3a91066 Author: Thomas Groh <tg...@google.com> Date: 2016-11-22T22:51:39Z Output Keyed Bundles in GroupAlsoByWindowEvaluator This allows reuse of keys for downstream serialization. commit dcd401ba0b5bd12343484b0df50b15b6ef10ace9 Author: Thomas Groh <tg...@google.com> Date: 2016-11-23T00:14:29Z Add TransformHierarchyTest This tests basic features of TransformHierarchy commit 6f86af612f97ad57cf4ba2cae21ba232f7494ada Author: Kenneth Knowles <k...@google.com> Date: 2016-11-23T06:16:29Z Use more natural class to find class loader in ReflectHelpers commit 2e03bb8a136078064014a0a7101960f6d2019487 Author: Thomas Weise <t...@apache.org> Date: 2016-11-22T19:38:00Z Update transitive dependencies for Apex 3.5.0 snapshot version. commit 3dbeb8edfdfe4c9e8987e4d8df4451fdb748dc07 Author: Davor Bonaci <da...@google.com> Date: 2016-11-24T00:02:41Z This closes #1432 commit d46203b7fcdc9895c9cee1d82710f48aba31a748 Author: Vikas Kedigehalli <vika...@google.com> Date: 2016-11-23T22:09:09Z datastoreio write/delete ptransform update datastore_wordcount example to include writes commit 1530a17279d098ae7459f689ef02401f5116e54e Author: Dan Halperin <dhalp...@google.com> Date: 2016-11-28T23:54:27Z Closes #1433 commit 7a059d37e71b62702e8cdeafec6956fc7e1e38c4 Author: Sourabh Bajaj <sourabhba...@google.com> Date: 2016-11-21T23:50:21Z Improve the speed of getting file sizes commit ad4dc87a472387b507545ab80dbd2fe42e02cea3 Author: D
[GitHub] beam pull request #1871: Revert python-sdk only changes in travis, and clean...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1871 Revert python-sdk only changes in travis, and clean incubator keywords. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam travis Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1871.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1871 commit d888060153101a5339a2869440ee67aaf793d987 Author: Ahmet Altay <al...@google.com> Date: 2017-01-30T20:51:15Z Revert python-sdk only changes in travis, and clean incubator keywords. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1870: Merge master into python-sdk
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1870 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1863: [BEAM-1333] Add mock time to slow bigquery unit tes...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1863 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1876: [BEAM-1349] Exclude generated egg-info files from r...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1876 [BEAM-1349] Exclude generated egg-info files from rat check. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1876.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1876 commit a4ad82e90c9015646a412a1fc7fb24876b35e009 Author: Ahmet Altay <al...@google.com> Date: 2017-01-31T02:58:31Z Exclude generated egg-info files from rat check. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam-site pull request #136: [BEAM-1349] Update documentation to remove pyth...
GitHub user aaltay opened a pull request: https://github.com/apache/beam-site/pull/136 [BEAM-1349] Update documentation to remove python-sdk branch references You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam-site asf-site Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam-site/pull/136.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #136 commit a5fe0142dd70cb1267c3bdcc008cd242428958e8 Author: Ahmet Altay <al...@google.com> Date: 2017-01-31T03:22:50Z Update documentation to remove python-sdk branch references --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1861: Merge master into python-sdk
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1861 Merge master into python-sdk You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam merger Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1861.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1861 commit 038950df02fa553cbb91f57978efe125a9ebc80f Author: Thomas Groh <tg...@google.com> Date: 2016-12-08T22:33:36Z Add Parameters to finishSpecifying Remove the need to use getProducingTransformInternal in TypedPValue. Ensure that all nodes are finished specifying before a call to TransformHierarchy#visit. This ensures that all nodes are fully specified without requiring the Pipeline or Runner to do so explicitly. commit b053be460c2e6ff486faed1b1a0996af63f93db2 Author: Thomas Groh <tg...@google.com> Date: 2016-12-20T22:23:21Z Use CountingSource in ForceStreamingTest Removes the requirement to have a FakeUnboundedSource, plus the read is fully specified. commit 7984fe3fc20160d2286433434190f35658aef158 Author: Thomas Groh <tg...@google.com> Date: 2016-12-21T23:26:18Z This closes #1582 commit 50b192dcd80f52621ea252f60d62e91626a89596 Author: Pramod Immaneni <pra...@datatorrent.com> Date: 2016-12-22T01:56:55Z BEAM-1203 Fixed exception when creating zip entries during Apex YARN launch commit aebe0675683cbc06863ea61f53efcf7aa6d0 Author: Thomas Weise <t...@apache.org> Date: 2016-12-22T02:49:08Z This closes #1684 commit 7bf86c70f43c798761533c6e921d5ae3f0b3ac9a Author: Jean-Baptiste Onofré <jbono...@apache.org> Date: 2016-09-12T16:49:36Z [BEAM-606] Create MqttIO commit b7d8c2c205f37e11f2547b9a11fe3db2c8943204 Author: Jean-Baptiste Onofré <jbono...@apache.org> Date: 2016-12-23T07:02:02Z [BEAM-606] This closes #971 commit d90c9e1485dccad85eb9db38945e274b39bf1774 Author: Pramod Immaneni <pra...@datatorrent.com> Date: 2016-12-23T06:13:39Z Adding explicit dependency to specific version of httpclient needed by Apex runner commit c2b27ff3063cc00868e43f429df0b9203d5a1883 Author: Thomas Weise <t...@apache.org> Date: 2016-12-26T18:00:59Z This closes #1693 commit 321058ff1fb5c0900de5a14ff2013f3285531488 Author: Dan Halperin <dhalp...@google.com> Date: 2016-12-21T23:32:38Z [BEAM-1201] Remove BoundedSource.producesSortedKeys Unused and unclear; for more information see the linked JIRA. commit ae46f9a8759bfde5886d72d780eb64ba324967d1 Author: Dan Halperin <dhalp...@google.com> Date: 2016-12-27T17:25:56Z Closes #1679 commit 8cb1ed5fa61816a5e27539e14e58995d4844de6e Author: sammcveety <sam.mcve...@gmail.com> Date: 2016-12-23T18:49:32Z [BEAM-551] Improve validation in PubSubIO commit ccb8b82c868d16d65de57cbdcaff119a33785bbd Author: Dan Halperin <dhalp...@google.com> Date: 2016-12-27T17:35:47Z Closes #1696 commit a3c814dd61212efe2daac8a8d810e65dfdd9a3dc Author: Davor Bonaci <da...@google.com> Date: 2016-12-27T20:59:15Z Remove "-incubating" from version identification This reverts commit 25215889381f7da61766054af68c84ffed4c0c71. commit 260bc49afb28a62637a150aa3a73d2294017940a Author: Davor Bonaci <da...@google.com> Date: 2016-12-27T21:00:09Z Update top-level NOTICE and remove incubating disclaimer commit 88e749e55a04e7f0965bb3bf6fe3f327315dfbc2 Author: Davor Bonaci <da...@google.com> Date: 2016-12-27T21:03:53Z Update README to remove incubation information commit 6b3c2f6a1e85734d85871196409f956c67ecff80 Author: Davor Bonaci <da...@google.com> Date: 2016-12-27T21:11:41Z Remove incubating references from examples commit b0d863e52237f54fb5df2ab208735a74c87ceb31 Author: Davor Bonaci <da...@google.com> Date: 2016-12-27T21:14:01Z Update top-level pom.xml to remove incubation references commit 8cfea766dfca84fe9ce647e521be485bb92022a9 Author: Davor Bonaci <da...@google.com> Date: 2016-12-27T21:17:22Z Update component READMEs to remove graduation information commit 3b304fcfa7fef110f0a4ff861901fccd9166f309 Author: Davor Bonaci <da...@google.com> Date: 2016-12-27T21:20:30Z Remove incubation references from core SDK and archetypes commit 5ba42cb251f3aef323d69a1ea42f0f1417893c5e Author: Davor Bonaci <da...@google.com> Date: 2016-12-27T21:47:55Z Update Jenkins and Travis to remove incubation references commit 339ae7df2e202441d33de780da1d681d8a6cabe7 Author: Davor Bonaci <da...@google.com> Date: 2016-12-28T00:49:15Z This closes #1701 commit cf3946e169833834e44fa271c0577f7cd5020bec Author: Jason Kuster <jasonkus...@google.com> Date: 2016
[GitHub] beam pull request #1863: [BEAM-1333] Add mock time to slow bigquery unit tes...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1863 [BEAM-1333] Add mock time to slow bigquery unit tests Unit tests, testing retries does not need to use real time. This change reduces the total tox time for unit tests from 235 seconds to 73 seconds locally. Be sure to do all of the following to help us incorporate your contribution quickly and easily: You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam bq Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1863.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1863 commit 2086c407b8c550de3d287b564079db2c623990f7 Author: Ahmet Altay <al...@google.com> Date: 2017-01-28T01:35:24Z Add mock time to slow bigquery unit tests. Unit tests, testing retries does not need to use real time. This change reduces the total tox time for unit tests from 235 seconds to 73 seconds locally. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1848: [BEAM-1319] Add conflict resolution to the Pipeline...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1848 [BEAM-1319] Add conflict resolution to the PipelineOptions internal argparse. In some instances where a PipelineOptions subclass was defined in the main session and save_main_session option is enabled, that subclass may appear multiple times in the PipelineOptions.__subclassess__() list. This is causing problems with the argparse because options are not unique any more. This changes filter the subclasses by name, and pick the last unique instance of each subclass. As an alternative option, we could use the conflict_handler='resolve' of the argparse. However, the drawback of this approach would be that allowing accidental overriding of the same option name in two different PipelineOptions subclasses. Also moves wordcount example to use PipelineOptions. This both serves as an example of using PipelineOptions, also it is already integrated with tests and will continue to test this case. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam wordo Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1848.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1848 commit b488555304f1110125598dd624077eb94ed0d0d7 Author: Ahmet Altay <al...@google.com> Date: 2017-01-26T01:48:13Z Add conflict resolution to the PipelineOptions internal argparse. In some instances where a PipelineOptions subclass was defined in the main session and save_main_session option is enabled, that subclass may appear multiple times in the PipelineOptions.__subclassess__() list. This is causing problems with the argparse because options are not unique any more. This changes filter the subclasses by name, and pick the last unique instance of each subclass. As an alternative option, we could use the conflict_handler='resolve' of the argparse. However, the drawback of this approach would be that allowing accidental overriding of the same option name in two different PipelineOptions subclasses. Also moves wordcount to use PipelineOptions. This both serves as an example of using PipelineOptions, also it is already integrated with tests and will continue to test this case. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1806: [BEAM-1288] Clean *.pyc files with mvn clean.
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1806 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1807: [BEAM-1100] Skip pylint when running outside of a g...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1807 [BEAM-1100] Skip pylint when running outside of a git repository. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam pyl Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1807.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1807 commit f2d0b2bb0c3f79f9a24d2c22a41976cd99b85e8f Author: Ahmet Altay <al...@google.com> Date: 2017-01-21T01:32:29Z Skip pylint when running outside of a git repository. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1809: [BEAM-1293] Update DataflowPipelineResult.state at ...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1809 [BEAM-1293] Update DataflowPipelineResult.state at the end of poll_for_job_completion https://github.com/apache/beam/pull/1802 exposed a bug in `poll_for_job_completion`. At the end of the wait the new `state` was not propagated to the result object, causing it to raise an exception. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam drfail Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1809.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1809 commit 56512ab442c599c64bfdb9fc6cabce95d76ee4dc Author: Ahmet Altay <al...@google.com> Date: 2017-01-21T07:43:42Z Update DataflowPipelineResult.state at the end of poll_for_job_completion. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2041: [BEAM-1218] Move google specific io clients to vend...
GitHub user aaltay reopened a pull request: https://github.com/apache/beam/pull/2041 [BEAM-1218] Move google specific io clients to vendor directory. R; @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam beam Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2041.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2041 commit 219254961e7a1425a5888a2fff4a541ab020ab42 Author: Ahmet Altay <al...@google.com> Date: 2017-02-18T00:52:57Z Move google specific io clients to vendor directory. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2041: [BEAM-1218] Move google specific io clients to vend...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/2041 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2045: [BEAM-1511] Add wildcard import back again.
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2045 [BEAM-1511] Add wildcard import back again. R: @jbonofre You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam jenk Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2045.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2045 commit 3aa4fe35dd7351f7c9e10f81b364d1b7fcd30412 Author: Ahmet Altay <al...@google.com> Date: 2017-02-19T08:15:16Z Add wildcard import back again. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2026: [BEAM-1218] Moving dataflow runner related code to ...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2026 [BEAM-1218] Moving dataflow runner related code to vendor directory R: @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam beam Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2026.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2026 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2041: [BEAM-1218] Move google specific io clients to vend...
GitHub user aaltay reopened a pull request: https://github.com/apache/beam/pull/2041 [BEAM-1218] Move google specific io clients to vendor directory. R; @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam beam Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2041.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2041 commit eed6cdebcb1f864951817a618329d6fac496331d Author: Ahmet Altay <al...@google.com> Date: 2017-02-18T00:52:57Z Move google specific io clients to vendor directory. commit ae874bbbee38e0c6fc58c7af405569bfe4d8dd07 Author: Ahmet Altay <al...@google.com> Date: 2017-02-18T01:38:12Z Remove extra imports --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2092: Use a versioned container for dataflow runner
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2092 Use a versioned container for dataflow runner R: @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam beam Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2092.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2092 commit f94ecb3c045541b1819afe54e5dea76817da Author: Ahmet Altay <al...@google.com> Date: 2017-02-23T23:57:26Z Use a versioned container for dataflow runner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2088: Upgrade dill to 0.2.6 and pin it
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2088 Upgrade dill to 0.2.6 and pin it R: @charlesccychen You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam dill Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2088.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2088 commit 2e8a4996c8a735f4ec5f624e070adadc648c6d80 Author: Ahmet Altay <al...@google.com> Date: 2017-02-23T22:00:54Z Upgrade dill to 0.2.6 and pin it Upgrade dill to the latest version and pin it. There were potential compatibility issues between 0.2.5 and 0.2.6, and keeping this as a range requirement is risky going forward. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2075: [BEAM-1504] Remove the nose-parameterized dependenc...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2075 [BEAM-1504] Remove the nose-parameterized dependency R: @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam dep Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2075.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2075 commit 5c21d08d5343c9d0dac0bc672351bd2e82e22c50 Author: Ahmet Altay <al...@google.com> Date: 2017-02-22T21:19:57Z Remove the nose-parameterized dependency --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2102: [BEAM-1218] Change the package name to apache-beam
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2102 [BEAM-1218] Change the package name to apache-beam R: @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam pypi Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2102.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2102 commit 759381e4dfcc95bb488cea70cbfbb22886bb534a Author: Ahmet Altay <al...@google.com> Date: 2017-02-24T21:29:01Z Change the package name to apache-beam Also, allow direct installations from PyPI (once the package is published.) This will eventually make sdk_location an optional argument. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam-site pull request #165: [BEAM-1549] Update quickstart to have runner sp...
GitHub user aaltay opened a pull request: https://github.com/apache/beam-site/pull/165 [BEAM-1549] Update quickstart to have runner specific examples @davorbonaci (cc: @sb2nov) You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam-site asf-site Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam-site/pull/165.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #165 commit e7721f12258b1524a75c22ed7587e5fde05883a0 Author: Ahmet Altay <al...@google.com> Date: 2017-02-24T21:52:42Z Update quickstart to have runner specific examples --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2107: [BEAM-1555] Disable newly added tests, that is fail...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2107 [BEAM-1555] Disable newly added tests, that is failing is post-commits. R: @pabloem You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam post Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2107.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2107 commit 32cd4836d2441c10fa71df4344c6b546c2c0ca3a Author: Ahmet Altay <al...@google.com> Date: 2017-02-25T04:19:49Z Disable newly added tests, that is failing is post-commits. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2105: Update python sdk readme
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2105 Update python sdk readme R: @sb2nov Removing parts, that are already merged to Beam docs. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam pypi Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2105.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2105 commit 7162964f058002db76232fd04d720ce9c3e75585 Author: Ahmet Altay <al...@google.com> Date: 2017-02-24T23:43:17Z Update python sdk readme --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2085: Fix relative path after file move
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2085 Fix relative path after file move R: @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam beam Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2085.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2085 commit aca7f184e91cad9863ab118c5050a2798d71ce73 Author: Ahmet Altay <al...@google.com> Date: 2017-02-23T17:55:16Z Fix relative path after file move --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2003: [BEAM-1485] Add some slack to the memory threshold ...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2003 [BEAM-1485] Add some slack to the memory threshold for DirectRunner oom checker R: @chamikaramj You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam flake2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2003.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2003 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2003: [BEAM-1485] Add some slack to the memory threshold ...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/2003 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2003: [BEAM-1485] Add some slack to the memory threshold ...
GitHub user aaltay reopened a pull request: https://github.com/apache/beam/pull/2003 [BEAM-1485] Add some slack to the memory threshold for DirectRunner oom checker R: @chamikaramj You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam flake2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2003.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2003 commit c7e67d0361bbc81d5d17ebe0d276724013cd5e17 Author: Ahmet Altay <al...@google.com> Date: 2017-02-14T18:21:46Z Add some slack to the memory threshold for DirectRunner oom checker. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1989: [BEAM-1468] Upgrading datatore dependency to 0.7.0 ...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1989 [BEAM-1468] Upgrading datatore dependency to 0.7.0 version R: @vikkyrk Vikas, how can I test this beyond unit tests? You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam ds Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1989.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1989 commit 6b5786969766415b9c3b62bca4283c9ab7024e71 Author: Ahmet Altay <al...@google.com> Date: 2017-02-11T03:02:25Z Upgrading to datatore 0.7.0 library --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2021: [BEAM-1218] Move runners/dataflow to runners/google...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2021 [BEAM-1218] Move runners/dataflow to runners/google_cloud_dataflow R: @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam beam Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2021.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2021 commit e123388de751b5bed72ff4c14030c8c01eb294fd Author: Ahmet Altay <al...@google.com> Date: 2017-02-16T18:57:27Z Move runners/dataflow to runners/google_cloud_dataflow commit d89acee5e6971bfa1dfd317587ad4cf23a7b7bc5 Author: Ahmet Altay <al...@google.com> Date: 2017-02-16T19:03:16Z Simple refactoring of core content from Dataflow -> Beam --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1791: [BEAM-1280] Update tests and examples to use new la...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1791 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1791: [BEAM-1280] Update tests and examples to use new la...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1791 [BEAM-1280] Update tests and examples to use new labels. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam expand Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1791.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1791 commit 03e18f0d5a51963c42a9b2fc629984c163181044 Author: Ahmet Altay <al...@google.com> Date: 2017-01-18T23:52:43Z Update tests and examples to use new labels. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1762: [BEAM-759] Implement wait_until_finish method for e...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1762 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1802: [BEAM-759] Make TestPipeline.run fail when the unde...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1802 [BEAM-759] Make TestPipeline.run fail when the underlying execution fails. Also, DataflowRunner will log the last error from its wait_until_finish method. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam expand Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1802.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1802 commit 4313d50b49c51da328ef5b6de6be33ba73e03150 Author: Ahmet Altay <al...@google.com> Date: 2017-01-20T00:13:07Z Make TestPipeline.run fail when the underlying execution fails. Also, DataflowRunner will log the last error from its wait_until_finish method. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2137: Update javadoc ant to include runners/ and exclude ...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2137 Update javadoc ant to include runners/ and exclude modules with a wildcard R: @davorbonaci (cc: @sb2nov) You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam pom Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2137.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2137 commit a6850bc7991973e6a40bddb37f7aa7d5907b6de2 Author: Ahmet Altay <al...@google.com> Date: 2017-03-02T00:04:49Z Update javadoc ant to include runners/ and exclude modules with a wildcard --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1774: [BEAM-1218] Removing some of the dataflow reference...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1774 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1762: Implement wait_until_finish method for existing run...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1762 Implement wait_until_finish method for existing runners. Implement wait_until_finish method for existing runners. Also defines the not implemented cancel() method and updates existing usages to use wait_until_finish() instead of blocking runners. Main changes are in the runners/ folder runner.py - has the APIs dataflow_runner.py, direct_runner.py modified to implement the API (moving the existing blocking code around.) Rest of the changes are mechanical to mainly convert p.run() to p.run().wait_until_finish() in tests and examples. Changed tests because they run validation after the run and need to block until completion. We may revert the changes in examples. I converted the because in the instructions we directed users to blocking runners before and this change keeps the behavior same. I have started a local post commit run (not completed yet) and it was successful with the first few tests so far and the changes are same for all tests. Remaining work after this PR: - Removing BlockingDataflowRunner. It is not used after this change with the SDK code/examples/tests. - Support for duration argument in wait_until_finish is missing. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam expand Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1762.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1762 commit c6c78a3fe15910acf2d1cc0bf244af06794dea1f Author: Ahmet Altay <al...@google.com> Date: 2017-01-10T02:23:20Z Implement wait_until_finish method for existing runners. Also defines the not implemented cancel() method and updates existing usages to use wait_until_finish() instead of blocking runners. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1762: [BEAM-759] Implement wait_until_finish method for e...
GitHub user aaltay reopened a pull request: https://github.com/apache/beam/pull/1762 [BEAM-759] Implement wait_until_finish method for existing runners. Implement wait_until_finish method for existing runners. Also defines the not implemented cancel() method and updates existing usages to use wait_until_finish() instead of blocking runners. Main changes are in the runners/ folder runner.py - has the APIs dataflow_runner.py, direct_runner.py modified to implement the API (moving the existing blocking code around.) Rest of the changes are mechanical to mainly convert p.run() to p.run().wait_until_finish() in tests and examples. Changed tests because they run validation after the run and need to block until completion. We may revert the changes in examples. I converted the because in the instructions we directed users to blocking runners before and this change keeps the behavior same. I have started a local post commit run (not completed yet) and it was successful with the first few tests so far and the changes are same for all tests. Remaining work after this PR: - Removing BlockingDataflowRunner. It is not used after this change with the SDK code/examples/tests. - Support for duration argument in wait_until_finish is missing. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam expand Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1762.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1762 commit c6c78a3fe15910acf2d1cc0bf244af06794dea1f Author: Ahmet Altay <al...@google.com> Date: 2017-01-10T02:23:20Z Implement wait_until_finish method for existing runners. Also defines the not implemented cancel() method and updates existing usages to use wait_until_finish() instead of blocking runners. commit a27773088d1ecad371725fdd5d27c5a1dd58a5cb Author: Ahmet Altay <al...@google.com> Date: 2017-01-10T22:15:36Z Fix wrong use of wait_until_complete in examples. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1762: [BEAM-759] Implement wait_until_finish method for e...
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1762 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1774: [BEAM-1218] Removing some of the dataflow reference...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1774 [BEAM-1218] Removing some of the dataflow references. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam textc Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1774.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1774 commit 024f89c8187e7871c139217a80880d96761d7b1f Author: Ahmet Altay <al...@google.com> Date: 2017-01-13T00:57:52Z Removing some of the dataflow references. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1746: [BEAM-1101] Remove the pipeline_type_check option
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1746 [BEAM-1101] Remove the pipeline_type_check option Default value is True for this option and --pipeline_type_check is a noop. (Still keeping the --no_pipeline_type_check for optionally disabling this check.) You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam expand Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1746.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1746 commit 75ce5544ba18a14df3171167f6aaa9b361b262fd Author: Ahmet Altay <al...@google.com> Date: 2017-01-06T19:19:55Z Remove the pipeline_type_check option Default value is True for this option and --pipeline_type_check is a noop. (Still keeping the --no_pipeline_type_check for optionally disabling this check.) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1746: [BEAM-1101] Remove the pipeline_type_check option
GitHub user aaltay reopened a pull request: https://github.com/apache/beam/pull/1746 [BEAM-1101] Remove the pipeline_type_check option Default value is True for this option and --pipeline_type_check is a noop. (Still keeping the --no_pipeline_type_check for optionally disabling this check.) You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam expand Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1746.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1746 commit 75ce5544ba18a14df3171167f6aaa9b361b262fd Author: Ahmet Altay <al...@google.com> Date: 2017-01-06T19:19:55Z Remove the pipeline_type_check option Default value is True for this option and --pipeline_type_check is a noop. (Still keeping the --no_pipeline_type_check for optionally disabling this check.) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1746: [BEAM-1101] Remove the pipeline_type_check option
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/1746 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #1741: [BEAM-1108] Remove obsolete teardown_policy argumen...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/1741 [BEAM-1108] Remove obsolete teardown_policy argument You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam teardown Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/1741.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1741 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1692: [BEAM-1090] Skip the test_memory_usage te...
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1692 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1685: [BEAM-1185] Remove the word 'Pipeline' fr...
GitHub user aaltay reopened a pull request: https://github.com/apache/incubator-beam/pull/1685 [BEAM-1185] Remove the word 'Pipeline' from the PipelineRunner subclasses The change is mostly mechanical, except for the runner.py (and its test). Temporarily added a way for not breaking existing users of this runners. After a grace period after the new year, I will remove that piece of code. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam expand Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1685.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1685 commit 2d35464446ec34a11b4bb12d83d930cdbf9f6e48 Author: Ahmet Altay <al...@google.com> Date: 2016-12-22T03:02:09Z Remove the word 'Pipeline' from the PipelineRunner subclasses. The change is mostly mechnanical, except for the runners.py (and its test). Temporarily added a way for not breaking existing users of this runners. After a grace period after the new year, I will remove that piece of code. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1685: [BEAM-1185] Remove the word 'Pipeline' fr...
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1685 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1688: Update python sdk pom.xml version to 0.5....
GitHub user aaltay opened a pull request: https://github.com/apache/incubator-beam/pull/1688 Update python sdk pom.xml version to 0.5.0-incubating-SNAPSHOT You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam pom Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1688.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1688 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1688: Update python sdk pom.xml version to 0.5....
GitHub user aaltay reopened a pull request: https://github.com/apache/incubator-beam/pull/1688 Update python sdk pom.xml version to 0.5.0-incubating-SNAPSHOT You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam pom Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1688.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1688 commit 4e0236d878e86a675983565ddc36bbafa9f0bb22 Author: Ahmet Altay <al...@google.com> Date: 2016-12-22T17:57:57Z Update python sdk pom.xml to 0.5.0-incubating-SNAPSHOT --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1690: Merge remote-tracking branch 'origin/mast...
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1690 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1688: Update python sdk pom.xml version to 0.5....
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1688 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1690: Merge remote-tracking branch 'origin/mast...
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1690 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2384: [BEAM-1844] Increase the memory threshold for the d...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2384 [BEAM-1844] Increase the memory threshold for the direct runner test It seems like overtime the memory usage increased, this is to prevent test failures. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam oom Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2384.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2384 commit 065a545ae098c8df81769e4c88c5031deef4494a Author: Ahmet Altay <al...@google.com> Date: 2017-03-31T00:08:00Z Increase the memory threshold for the direct runner test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2352: Add first two mobile gaming examples to Python
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2352 Add first two mobile gaming examples to Python (Reference: https://github.com/GoogleCloudPlatform/DataflowJavaSDK-examples/tree/master/src/main/java8/com/google/cloud/dataflow/examples/complete/game) Both `user_score.py` and `hourly_team_score` implementations are standalone and do not use utility classes. Next thing to do will be to convert this example into a package and extract out common bits. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam game Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2352.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2352 commit 79ea2bad413382835ae2126bc754e58d177fb94a Author: Ahmet Altay <al...@google.com> Date: 2017-03-29T00:45:11Z Add first two mobile gaming examples to Python. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2342: Add region option to Dataflow pipeline options.
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2342 Add region option to Dataflow pipeline options. R: @charlesccychen cc: @dhalperi You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam region Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2342.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2342 commit fd1190f196b0c3e3747e1482ca8e2b28a484310d Author: Ahmet Altay <al...@google.com> Date: 2017-03-28T00:09:34Z Add region option to Dataflow pipeline options. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam-site pull request #192: Simplify python quick start.
GitHub user aaltay opened a pull request: https://github.com/apache/beam-site/pull/192 Simplify python quick start. R: @chamikaramj You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam-site quick Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam-site/pull/192.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #192 commit 22026fe0b4a9483c31ed4e99350b8eb4046fac33 Author: Ahmet Altay <al...@google.com> Date: 2017-03-20T22:31:14Z Simplify python quick start. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2278: [BEAM-1218] Clean source files from dataflow/google...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2278 [BEAM-1218] Clean source files from dataflow/google references R: @chamikaramj You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam text Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2278.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2278 commit c3e8c39dee6230e178280ada651b7a1b11a92f9b Author: Ahmet Altay <al...@google.com> Date: 2017-03-21T01:14:31Z Clean source files from dataflow/google references --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam-site pull request #180: Changes to web site related to recently release...
GitHub user aaltay opened a pull request: https://github.com/apache/beam-site/pull/180 Changes to web site related to recently released Python SDK R: @davorbonaci cc: @sb2nov I will work on release guide changes on a separate PR. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam-site asf-site Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam-site/pull/180.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #180 commit 5111853bc8fc6890633a377972d28cf9a72569d1 Author: Ahmet Altay <al...@google.com> Date: 2017-03-16T19:21:08Z Changes to web site related to recently released Python SDK --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam-site pull request #182: Blog post for 0.6.0 release with python sdk
GitHub user aaltay opened a pull request: https://github.com/apache/beam-site/pull/182 Blog post for 0.6.0 release with python sdk R: @davorbonaci You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam-site asf-site Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam-site/pull/182.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #182 commit a7b14e4cb7412c6bfe8297c41c1c2030615e2f12 Author: Ahmet Altay <al...@google.com> Date: 2017-03-16T22:43:27Z Blog post for 0.6.0 release with python sdk --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam-site pull request #183: update release notes post 0.6.0 release
GitHub user aaltay opened a pull request: https://github.com/apache/beam-site/pull/183 update release notes post 0.6.0 release R: @sb2nov @davorbonaci You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam-site asf-site Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam-site/pull/183.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #183 commit abe87e9ddb362e7c24926a9b7f164d226869480b Author: Ahmet Altay <al...@google.com> Date: 2017-03-16T23:59:20Z update release notes post 0.6.0 release --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2429: Do not have empty side input names
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2429 Do not have empty side input names R: @bjchambers (cc: @robertwb ) You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam graph Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2429.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2429 commit 0fd9622e1e449a2bd7149d0888660c6a3eca8968 Author: Ahmet Altay <al...@google.com> Date: 2017-04-04T23:25:45Z Do not have empty side input names --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2394: Remove PDone
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/2394 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2484: Upgrade dependencies
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2484 Upgrade dependencies Minor version changes to use latest versions of avro, pyyaml, google-apitools, googledatastore. R: @vikkyrk @eddavisson You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam ds Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2484.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2484 commit 3628afc3ba7c5b1d779ec0cfccc29921c0f1d01c Author: Ahmet Altay <al...@google.com> Date: 2017-04-10T21:13:00Z Upgrade dependencies. Minor version changes to use latest versions of avro, pyyaml, google-apitools, googledatastore. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2394: [Proof-Of-Concept] Remove PDone
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2394 [Proof-Of-Concept] Remove PDone @chamikaramj @robertwb What do you think about this? You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam post Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2394.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2394 commit c225716f7f1618b905396115f2e691aaa697ea04 Author: Ahmet Altay <al...@google.com> Date: 2017-03-31T22:33:12Z Remove PDone --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2393: Update integration tests in post commits
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2393 Update integration tests in post commits R: @markflyhigh You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam it Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2393.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2393 commit ff3330fb69588e95612696eedeff117a4f604cd2 Author: Ahmet Altay <al...@google.com> Date: 2017-03-31T22:11:43Z Update integration tests in post commits --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2515: Revert ValueProvider class
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2515 Revert ValueProvider class This reverts commit ee92b96 and 28a0ea8 Manually resolved two minor conflicts: sdks/python/apache_beam/io/filebasedsource. sdks/python/apache_beam/runners/direct/direct_runner.p You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam undo Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2515.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2515 commit 2fcd0c33f979ef7d5f4d24cf1924ddc41574a6fd Author: Ahmet Altay <al...@google.com> Date: 2017-04-12T17:43:24Z Revert "Throw specialized exception in value providers" This reverts commit ee92b9642bb6b6e42bb701ab638c55539163bb69. commit 8fdf9aa5632d5e186e7fd41f3eac733beeb0f919 Author: Ahmet Altay <al...@google.com> Date: 2017-04-12T17:48:25Z Revert "Revert "Revert "Add ValueProvider class for FileBasedSource I/O Transforms""" This reverts commit 28a0ea86721871a97f68b573019e818217266356. Manually resolved Conflicts: sdks/python/apache_beam/io/filebasedsource.py sdks/python/apache_beam/runners/direct/direct_runner.py --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2435: Revert "Add ValueProvider class for FileBasedSource...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2435 Revert "Add ValueProvider class for FileBasedSource I/O Transforms" This reverts commit 1e2168a127fb3047fb15d231a001bbf951892e11. Break post commit tests, it is a clean rollback. R: @robertwb cc: @mariapython You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam rollb Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2435.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2435 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2545: [BEAM-802] Python templates
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2545 [BEAM-802] Python templates Re-reverts the python templates. First two commits are clean reverts of the original commits. The last commit: - Removes the concept of options id. (Except for a few places marked with TODO. Dataflow workers depend on those paths for now, I will remove them in a follow up PR.) You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam templ Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2545.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2545 commit 7a94697a57279b55f7c46bb74f7c4f9812900e62 Author: Ahmet Altay <al...@google.com> Date: 2017-04-14T21:55:25Z Revert "Revert "Revert "Revert "Add ValueProvider class for FileBasedSource I/O Transforms"""" This reverts commit 0f5c36398aa321d25b3a045cedc29203d75956f7. commit b7aee2d15cdc98c38a8de8ed4f5a23c42af4542d Author: Ahmet Altay <al...@google.com> Date: 2017-04-14T21:55:50Z Revert "Revert "Throw specialized exception in value providers"" This reverts commit 4854291fe38df7b624446311956d0ae0677f6b8c. commit 2b064906e07a89e0d4b031b8f14ba8fa7009249d Author: Ahmet Altay <al...@google.com> Date: 2017-04-14T22:33:39Z Remove options_id concept from templated runs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2534: fix the simplest typo
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2534 fix the simplest typo @tvalentyn You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam typo Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2534.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2534 commit cf77b54c49d5f57b93026204067fcf9555d2d542 Author: Ahmet Altay <al...@google.com> Date: 2017-04-13T23:59:01Z fix the simplest typo --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2524: [BEAM-1964] Pin versions in tox script
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2524 [BEAM-1964] Pin versions in tox script R: @aviemzur @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam lint Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2524.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2524 commit ce44e10b66600c9155523e1621375a1bc19b4f15 Author: Ahmet Altay <al...@google.com> Date: 2017-04-13T18:03:04Z Pin versions in tox script --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam-site pull request #175: Documentation changes for 0.6.0 release
GitHub user aaltay opened a pull request: https://github.com/apache/beam-site/pull/175 Documentation changes for 0.6.0 release R: @davorbonaci @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam-site asf-site Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam-site/pull/175.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #175 commit d6ca2944e2c127fe318ac7884140c372e61bd4f1 Author: Ahmet Altay <al...@google.com> Date: 2017-03-09T18:56:40Z Documentation changes for 0.6.0 release. commit 178cfc0befb95368c65eb5501588a1fff086e896 Author: Ahmet Altay <al...@google.com> Date: 2017-03-09T18:58:25Z One time changes for enabling pydocs on the website. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2183: Update python SDK version to the next version.
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2183 Update python SDK version to the next version. This is a gap in the release process. I am making this change manually now. @sb2nov Could you open a an issue for this. (Resolving https://issues.apache.org/jira/browse/BEAM-378 would also resolve this issue. And now I am more convinced that the pysdk should just use the version from the pom file.) R: @davorbonaci You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam pyver Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2183.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2183 commit 11e3029ed38ce4b6090b54ed2337df6c69796f39 Author: Ahmet Altay <al...@google.com> Date: 2017-03-07T21:17:22Z Update python SDK version to the next version. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2222: Add README to python tarball
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/ Add README to python tarball And, delete test created files, to avoid them being included in the tarball. R: @sb2nov (cc: @davorbonaci) You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam readme Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes # commit b0bac4972a9cbb776cdeb98c704a0b154d26e67b Author: Ahmet Altay <al...@google.com> Date: 2017-03-10T21:42:17Z Add README to python tarball. And, delete test created files, to avoid them being included in the tarball. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2225: Generate zip distribution for pyhthon
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2225 Generate zip distribution for pyhthon R: @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam zipfile Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2225.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2225 commit ed1658b22c966e3121e80cda15ab9c703625e3ba Author: Ahmet Altay <al...@google.com> Date: 2017-03-11T00:40:34Z Generate zip distribution for pyhthon --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2224: Ignore results from the tox clean up phase
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2224 Ignore results from the tox clean up phase Some temporary files are generated only under certain conditions and this should not fail tox. R: @sb2nov You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam err Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2224.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2224 commit 12016e59e84a841afcfcd55402daf7701460dcbc Author: Ahmet Altay <al...@google.com> Date: 2017-03-11T00:21:17Z Ignore results from the tox clean up phase Some temporary files are generated only under certain conditions and this should not fail tox. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2200: Cherry pick master changes to release-0.6.0 branch
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/2200 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2199: Update archetypes
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2199 Update archetypes R: @davorbonaci You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam relfix Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2199.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2199 commit e307231c4df01c6ec2c24bc7cc92bf832f6714cf Author: Ahmet Altay <al...@google.com> Date: 2017-03-08T21:32:45Z Update archetypes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2200: Cherry pick master changes to release-0.6.0 branch
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2200 Cherry pick master changes to release-0.6.0 branch You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam relfixb Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2200.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2200 commit b74e186546eafb910a013ec338cd3402878e40cf Author: Ahmet Altay <al...@google.com> Date: 2017-03-07T18:54:00Z [maven-release-plugin] prepare for next development iteration commit 0694344ee03520bae24a2b484a28927579e2bb7e Author: Ismaël MejÃa <ieme...@gmail.com> Date: 2017-03-06T08:13:31Z Change Json parsing from gson to jackson for ElasticsearchIO commit b45381dad4f8f94f4218db114089b97c740a968e Author: Jean-Baptiste Onofré <jbono...@apache.org> Date: 2017-03-07T20:43:56Z This closes #2167 commit 11e3029ed38ce4b6090b54ed2337df6c69796f39 Author: Ahmet Altay <al...@google.com> Date: 2017-03-07T21:17:22Z Update python SDK version to the next version. commit 4c3fce14c452c05c6df57914a07ef0d0890aea98 Author: Ahmet Altay <al...@google.com> Date: 2017-03-07T21:52:55Z This closes #2183 commit 7927f6507f26e23208b9243b9d2a6f539e37e82c Author: Mark Liu <mark...@google.com> Date: 2017-03-07T22:26:37Z [BEAM-1646] Remove duplicated bigquery dependency commit 0fa1d90c5c55b5bfe85daaa5c420aabbdc6b6893 Author: Ahmet Altay <al...@google.com> Date: 2017-03-07T22:55:30Z This closes #2186 commit 558731978ae8e62c59130314de9db57d253ba10f Author: Robert Bradshaw <rober...@gmail.com> Date: 2017-03-08T01:36:41Z Fix typo in proto: widow -> window. commit 690e1e27c6286ab6613f8d3487510a3e2c41f8a4 Author: Thomas Groh <tg...@google.com> Date: 2017-03-08T05:28:16Z This closes #2191 commit 9a9aaa51d8f456b7fb462d5e3283adf76a29963a Author: Davor Bonaci <da...@google.com> Date: 2017-03-07T19:57:38Z Add ServicesResourceTransformer to all shading configuration This ensures that files in META-INF/services aren't overwritten. Instead, they are concatenated. This is critical to ensure PipelineOptionsRegistrar, RunnerRegistrar, IOChannelFactoryRegistrar and FileSystemRegistrar work well for users. commit 37c17f2bd6f4eaf1281803a68c25a6eab57b9df4 Author: Davor Bonaci <da...@google.com> Date: 2017-03-08T06:57:54Z This closes #2182 commit b25ffdbd7aca3241a67548f24f2a50ca0e6cae51 Author: Kenneth Knowles <k...@google.com> Date: 2017-03-02T22:29:56Z Explicitly GBK before stateful ParDo in Dataflow batch commit c7a06a61695e431a578a6feba605bcbb399b1430 Author: Kenneth Knowles <k...@google.com> Date: 2017-03-08T02:32:32Z Upgrade Dataflow container version to beam-master-20170307 commit 1d8be97439051ae770f99dcb49c7e8486962b118 Author: Kenneth Knowles <k...@google.com> Date: 2017-03-08T18:38:12Z This closes #2147: Explicitly GBK before stateful ParDo in Dataflow batch Upgrade Dataflow container version to beam-master-20170307 Explicitly GBK before stateful ParDo in Dataflow batch commit e6ec2731bebea6e9c2a00b6010adc6607ad7a348 Author: Tibor Kiss <tibor.k...@gmail.com> Date: 2017-03-08T11:18:39Z [BEAM-1649] Fix unresolved references in Python SDK commit 29d9bd3e66748e52b61e1f28b5b56205d861473e Author: Ahmet Altay <al...@google.com> Date: 2017-03-08T18:42:23Z This closes #2194 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2236: Filling up TBDs in setup.py
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2236 Filling up TBDs in setup.py R: @davorbonaci You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam pkginfo Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2236.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2236 commit 2be79861c39283ae8a6ab222418340b14b9702ac Author: Ahmet Altay <al...@google.com> Date: 2017-03-13T21:08:50Z Filling up TBDs in setup.py --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2148: Fix tox warning for non-whitelisted find command
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2148 Fix tox warning for non-whitelisted find command R: @vikkyrk You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam warn Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2148.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2148 commit 62cdd6ad0b3a278d102114f49dff1f597c81ce01 Author: Ahmet Altay <al...@google.com> Date: 2017-03-03T00:15:38Z Fix tox warning for non-whitelisted find command --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2467: [BEAM-1124] enable test_multi_valued_singleton_side...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2467 [BEAM-1124] enable test_multi_valued_singleton_side_input test R: @markflyhigh You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam side Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2467.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2467 commit e6c7c04e7631bc995dc57447268b896c517b3b05 Author: Ahmet Altay <al...@google.com> Date: 2017-04-08T00:54:14Z enable test_multi_valued_singleton_side_input test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2441: [BEAM-1889] Do not send on_success_matcher to remot...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2441 [BEAM-1889] Do not send on_success_matcher to remote executors R: @mariapython cc: @markflyhigh You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam ons Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2441.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2441 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2461: Clean up in textio and tfrecordio
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2461 Clean up in textio and tfrecordio R: @chamikaramj You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam textio Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2461.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2461 commit 0d0d09ac9428cc46d07bfca6ffdafd1b5b304aa1 Author: Ahmet Altay <al...@google.com> Date: 2017-04-07T18:21:17Z Clean up in textio and tfrecordio --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #2661: [BEAM-2065] Increase post commit timeout from 600 s...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2661 [BEAM-2065] Increase post commit timeout from 600 seconds to 900 R: @markflyhigh You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam timeout Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/2661.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2661 commit b405a2c872759aab3c414bf5e1769220ac6ea76f Author: Ahmet Altay <al...@google.com> Date: 2017-04-24T18:25:27Z Increase post commit timeout from 600 seconds to 900 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3524: [BEAM-2570] Fix breakage after cloud-bigquery updat...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3524 [BEAM-2570] Fix breakage after cloud-bigquery updated (CP #3523) R: @markflyhigh cc: @jbonofre You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam cp7d Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3524.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3524 commit a54c2c0dfc518f9daa13d81dc9e80558df7f9dcc Author: Mark Liu <mark...@google.com> Date: 2017-07-07T22:20:12Z [BEAM-2570] Fix breakage after cloud-bigquery updated --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3474: [BEAM-2521] Select SDK distribution based on the se...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3474 [BEAM-2521] Select SDK distribution based on the selected SDK name R: @tvalentyn You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam dist2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3474.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3474 commit fdd6309ac0b5e9555cbe2bf215894e959990763a Author: Ahmet Altay <al...@google.com> Date: 2017-06-29T17:56:25Z Select SDK distribution based on the selected SDK name --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3486: [BEAM-2549] For GCS operations use an http client w...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3486 [BEAM-2549] For GCS operations use an http client with a default timeout value. R: @charlesccychen (cc: @sb2nov) Once this is in (and tested) we can consider removing the other timeout mechanism (thread based) we implemented for gcs reads. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam gcs Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3486.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3486 commit 63e8fa76dd73b2ffea485d79e07dcf99449b1c56 Author: Ahmet Altay <al...@google.com> Date: 2017-07-01T00:37:33Z For GCS operations use an http client with a default timeout value. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3504: CP #3499 - Fix PValue input in _PubSubReadEvaluator
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/3504 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3500: CP #3497
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3500 CP #3497 R: @charlesccychen cc: @jbonofre You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam release-2.1.0 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3500.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3500 commit bc7b1adb58dd40ac6352ecea9749e7f17ef2d099 Author: Ahmet Altay <al...@google.com> Date: 2017-07-05T23:11:46Z This closes #3497 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3498: [BEAM-2552] Update container version for python Dat...
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3498 [BEAM-2552] Update container version for python DataflowRunner for the 2.1.0 release R: @charlesccychen cc: @tvalentyn @jbonofre You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam vert Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3498.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3498 commit c1d131e0c5bdfe0250636f19f49311f2847be2a4 Author: Ahmet Altay <al...@google.com> Date: 2017-07-05T21:59:40Z Update container version for python DataflowRunner for the 2.1.0 release --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3500: CP #3497
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/3500 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3504: CP #3499 - Fix PValue input in _PubSubReadEvaluator
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/3504 CP #3499 - Fix PValue input in _PubSubReadEvaluator R: @charlesccychen cc: @jbonofre You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam release-2.1.0 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3504.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3504 commit 2b36f1a082c840da4eae4e99d68057fb85f609f7 Author: Charles Chen <c...@google.com> Date: 2017-07-05T23:18:51Z Fix PValue input in _PubSubReadEvaluator --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
