[GitHub] beam pull request #2213: Increase timeout for site tests

2017-03-09 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/2213 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam-site pull request #179: Add htaccess back as adding include seems to sk...

2017-03-14 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam-site/pull/179 Add htaccess back as adding include seems to skip it R: @aaltay @davorbonaci PTAL You can merge this pull request into a Git repository by running: $ git pull https://github.com/sb2nov/beam

[GitHub] incubator-beam pull request #1499: [BEAM-1082] Clean up all internal referen...

2016-12-22 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/incubator-beam/pull/1499 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] beam pull request #1268: [BEAM-877] Allow an option to not flatten record ty...

2017-01-08 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1268 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1757: Compressed file with missing last EOF create a fake...

2017-01-10 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1757 Compressed file with missing last EOF create a fake element Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1757: [BEAM-1257] Compressed text source emit an extra el...

2017-01-10 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1757 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1782: [BEAM-886] Implement annotation based NewDoFn

2017-01-16 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1782 [BEAM-886] Implement annotation based NewDoFn - Implement the new annotation based DoFn in python see https://s.apache.org/a-new-dofn - Migrate all the cases of DoFn to NewDoFn

[GitHub] beam pull request #1805: [BEAM-886] Implement Annotation based NewDoFn in py...

2017-01-20 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1805 [BEAM-886] Implement Annotation based NewDoFn in python SDK - Implement the new annotation based DoFn in python see https://s.apache.org/a-new-dofn - Handle typechecking in the NewDoFn - All

[GitHub] beam pull request #1782: [BEAM-886] Implement annotation based NewDoFn in Py...

2017-01-20 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1782 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1805: [BEAM-886] Implement Annotation based NewDoFn in py...

2017-01-21 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1805 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1842: [BEAM-886] Migrate CallableWrapperDoFn to extend Ne...

2017-01-24 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1842 [BEAM-886] Migrate CallableWrapperDoFn to extend NewDoFn - Migrate the CallableWrapperDoFn class to extend NewDoFn instead of OldDoFn - Add a test for callables such as set/list as they can not be

[GitHub] beam pull request #1845: Add snippet for reading from compressed text source...

2017-01-25 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1845 Add snippet for reading from compressed text sources R: @chamikaramj PTAL Does this need a beam issue as it is just improving documentation ? Be sure to do all of the following to

[GitHub] beam pull request #1842: [BEAM-886] Migrate CallableWrapperDoFn to extend Ne...

2017-01-26 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1842 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1854: Some performance improvements to NewDoFn but moving...

2017-01-26 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1854 Some performance improvements to NewDoFn but moving common code The NewDoFN are still slower than the Old one but this improves the performance a bit. R: @robertwb PTAL Be sure to

[GitHub] beam pull request #1854: [BEAM-886] Some performance improvements to NewDoFn...

2017-01-27 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1854 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1869: [BEAM-886] Some performance improvements to NewDoFn

2017-01-30 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1869 [BEAM-886] Some performance improvements to NewDoFn - Add types to some of variables for performance - Do minimal work in the process function by stashing the placeholders to be replaced

[GitHub] beam pull request #1885: Reduce test sizes to improve unit test speeds

2017-01-31 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1885 Reduce test sizes to improve unit test speeds R: @aaltay PTAL These changes reduce the time taken by python unittests from 85 to 36 seconds. Be sure to do all of the following to

[GitHub] beam pull request #1886: [BEAM-1365] Fix the big query regex to account for ...

2017-01-31 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1886 [BEAM-1365] Fix the big query regex to account for . in dataset name R: @chamikaramj PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #1894: [BEAM-886] Migrate CallableWrapperDoFn to use the N...

2017-02-01 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1894 [BEAM-886] Migrate CallableWrapperDoFn to use the NewDoFn type WIP Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #1896: Migrate from OldDoFn to NewDoFn

2017-02-01 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1896 Migrate from OldDoFn to NewDoFn Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #1902: Add a deprecation warning for DoFn

2017-02-01 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1902 Add a deprecation warning for DoFn WIP Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #1886: [BEAM-1365] Fix the big query regex to account for ...

2017-02-02 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1886 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1913: [BEAM-886] Rename NewDoFn to DoFn

2017-02-02 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1913 [BEAM-886] Rename NewDoFn to DoFn R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is

[GitHub] beam pull request #1917: [BEAM-886] Remove the usage of OldDoFn and clean up...

2017-02-03 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1917 [BEAM-886] Remove the usage of OldDoFn and clean up function names Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[GitHub] beam pull request #1923: [BEAM-1369] Reduce test times for two retry based t...

2017-02-05 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1923 [BEAM-1369] Reduce test times for two retry based tests R: @charlesccychen PTAL - The gcsio test was taking 2s so reducing the segment override makes it faster. - The retry test now just

[GitHub] beam pull request #1936: [BEAM-1332] Cleanup files after the tests end

2017-02-07 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1936 [BEAM-1332] Cleanup files after the tests end Snippet tests don't clean up the temporary files that are created these changes should address that. R: @aaltay PTAL Be sure to d

[GitHub] beam pull request #1942: [BEAM-1429] WindowFn assign should not access the w...

2017-02-07 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1942 [BEAM-1429] WindowFn assign should not access the window set https://github.com/apache/beam/blob/master/sdks/python/apache_beam/transforms/window.py#L97 does not really use access to multiple

[GitHub] beam pull request #1947: [BEAM-1430] PartitionFn should not access context a...

2017-02-07 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1947 [BEAM-1430] PartitionFn should not access context and just the element PartitionFn currently has access to the complete process context. We should limit the access to just the element to make it more

[GitHub] beam-site pull request #148: Add documentation to build the site with a dock...

2017-02-08 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam-site/pull/148 Add documentation to build the site with a docker container Adding documentation in the Readme to allow building the site with a docker container. This solves some of the pain we face with ruby

[GitHub] beam pull request #1951: [BEAM-1280] Remove fn_or_label argument from Map an...

2017-02-08 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1951 [BEAM-1280] Remove fn_or_label argument from Map and Filter Part 1/? for removing the fn_or_label functionality from ptransforms R: @aaltay PTAL Be sure to do all of the following to

[GitHub] beam pull request #1955: [BEAM-1185] Remove references to PipelineRunner

2017-02-08 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1955 [BEAM-1185] Remove references to PipelineRunner R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[GitHub] beam pull request #1956: [BEAM-759] Remove blocking dataflow runner

2017-02-08 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1956 [BEAM-759] Remove blocking dataflow runner R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the

[GitHub] beam pull request #1958: [Beam-1280] remove label arguments from ptransforms

2017-02-08 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1958 [Beam-1280] remove label arguments from ptransforms R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] beam pull request #1964: Get nosetests working after removing the setup.py c...

2017-02-09 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1964 Get nosetests working after removing the setup.py change This is a temporary change as we work towards getting maven to work across languages and building and testing both the python and java code

[GitHub] beam pull request #1972: Fix the usage of os.path.join in two tests

2017-02-09 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1972 Fix the usage of os.path.join in two tests R: @dhalperi PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[GitHub] beam pull request #1980: [BEAM-1464] All test should use TestPipeline

2017-02-10 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1980 [BEAM-1464] All test should use TestPipeline R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[GitHub] beam pull request #1981: [BEAM-782] support runner names to be partial or ca...

2017-02-10 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1981 [BEAM-782] support runner names to be partial or case insensitive R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #1992: [BEAM-1469] Increase the bounds on the test to redu...

2017-02-13 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1992 [BEAM-1469] Increase the bounds on the test to reduce flakiness R: @aaltay PTAL Surprisingly I ran the test 100 times in a loop and didn't see a flake Be sure to do all o

[GitHub] beam pull request #1997: [BEAM-1280] Remove passing label from Combiners

2017-02-13 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1997 [BEAM-1280] Remove passing label from Combiners R: @aaltay PTAL After this only assert_that and AsSingleton etc for SideInputs take the label as the argument. Rest should be gone

[GitHub] beam pull request #1997: [BEAM-1280] Remove passing label from PTransform in...

2017-02-13 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/1997 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2001: [BEAM-1473] Remove unused windmill proto from pytho...

2017-02-13 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2001 [BEAM-1473] Remove unused windmill proto from python sdk R: @charlesccychen PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2010: [BEAM-1185] Make examples blocking as command line ...

2017-02-14 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2010 [BEAM-1185] Make examples blocking as command line invoked R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2250: Revert "[BEAM-547] Version should be accessed from ...

2017-03-15 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2250 Revert "[BEAM-547] Version should be accessed from pom file" This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33. Be sure to do all of the following to help us incorp

[GitHub] beam pull request #2251: [BEAM-547] Fix the version picking by removing from...

2017-03-15 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2251 [BEAM-547] Fix the version picking by removing from root init Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2250: Revert "[BEAM-547] Version should be accessed from ...

2017-03-15 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/2250 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2250: Revert "[BEAM-547] Version should be accessed from ...

2017-03-15 Thread sb2nov
GitHub user sb2nov reopened a pull request: https://github.com/apache/beam/pull/2250 Revert "[BEAM-547] Version should be accessed from pom file" This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33. Be sure to do all of the following to help us incorp

[GitHub] beam pull request #2252: Revert "Add ValueProvider class for FileBasedSource...

2017-03-15 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2252 Revert "Add ValueProvider class for FileBasedSource I/O Transforms" This reverts commit 6d1c9043ab0d929e2cea8a3a68192e47a5cc55cd. Be sure to do all of the following to help us i

[GitHub] beam pull request #2251: [BEAM-547] Fix the version picking by removing from...

2017-03-15 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/2251 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2255: [BEAM-547] [BEAM-1730] Cleanup versions.py and root...

2017-03-15 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2255 [BEAM-547] [BEAM-1730] Cleanup versions.py and root init has version access Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #2280: [BEAM-1769] Travis should run all tox tests

2017-03-20 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2280 [BEAM-1769] Travis should run all tox tests Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2308: Pin the python postcommit jenkins nodes

2017-03-23 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2308 Pin the python postcommit jenkins nodes Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2350: BEAM-1441 Fix bugs in Temp IOChannelFactory in File...

2017-03-28 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2350 BEAM-1441 Fix bugs in Temp IOChannelFactory in FileIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #2382: [BEAM-1441] Fix size check for windows and improve ...

2017-03-30 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2382 [BEAM-1441] Fix size check for windows and improve error message Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam-site pull request #199: Docker server command should run non-incrementa...

2017-04-03 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam-site/pull/199 Docker server command should run non-incremental build R: @aaltay Incremental build should not be the default in running Jekyll with the Docker container. You can merge this pull

[GitHub] beam pull request #2410: [BEAM-1719] Remove test modules from PyDoc

2017-04-03 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2410 [BEAM-1719] Remove test modules from PyDoc Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam-site pull request #200: Fix the link to the apache ICLA

2017-04-03 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam-site/pull/200 Fix the link to the apache ICLA R: @davorbonaci @aaltay PTAL You can merge this pull request into a Git repository by running: $ git pull https://github.com/sb2nov/beam-site BEAM-fix-icla

[GitHub] beam pull request #2414: Update PR template with correct ICLA link

2017-04-03 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2414 Update PR template with correct ICLA link Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam-site pull request #201: [BEAM-1711] Add information about extra require...

2017-04-03 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam-site/pull/201 [BEAM-1711] Add information about extra requires in Python Quickstart R: @aaltay PTAL You can merge this pull request into a Git repository by running: $ git pull https://github.com/sb2nov

[GitHub] beam pull request #2445: [BEAM-1892] File size estimation thresholding and p...

2017-04-05 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2445 [BEAM-1892] File size estimation thresholding and process reporting Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #2456: [BEAM-778] Fix the Compressed file seek tests on wi...

2017-04-06 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2456 [BEAM-778] Fix the Compressed file seek tests on windows Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

<    1   2