[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=313862&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-313862 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 17/Sep/19 19:05 Start Date: 17/Sep/19 19:05 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 313862) Time Spent: 8h 40m (was: 8.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 8h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=313861&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-313861 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 17/Sep/19 19:05 Start Date: 17/Sep/19 19:05 Worklog Time Spent: 10m Work Description: markflyhigh commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-532358508 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 313861) Time Spent: 8.5h (was: 8h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 8.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=313469&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-313469 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 17/Sep/19 04:07 Start Date: 17/Sep/19 04:07 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-532049858 Run Portable_Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 313469) Time Spent: 8h 20m (was: 8h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 8h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=313334&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-313334 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 16/Sep/19 22:36 Start Date: 16/Sep/19 22:36 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-531984590 > Can you also update this section `Change and commit version number in release branch:` to include `gradle.properties`? This is how release manager verify changes after run cut_release_branch.sh This is added. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 313334) Time Spent: 8h (was: 7h 50m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 8h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=313335&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-313335 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 16/Sep/19 22:36 Start Date: 16/Sep/19 22:36 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-531984627 Run Java PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 313335) Time Spent: 8h 10m (was: 8h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 8h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=31&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-31 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 16/Sep/19 22:35 Start Date: 16/Sep/19 22:35 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r324914457 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +647,41 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com +* Build Python images and push to DockerHub. Review comment: It is fixed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 31) Time Spent: 7h 50m (was: 7h 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 7h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=313220&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-313220 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 16/Sep/19 17:57 Start Date: 16/Sep/19 17:57 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r324807923 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +647,41 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com +* Build Python images and push to DockerHub. Review comment: The format seems not correct on staging page: http://apache-beam-website-pull-requests.storage.googleapis.com/9510/contribute/release-guide/index.html#alternative-run-all-steps-manually-1. Can you fix it? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 313220) Time Spent: 7h 40m (was: 7.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 7h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=311784&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-311784 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 12/Sep/19 22:25 Start Date: 12/Sep/19 22:25 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323974093 ## File path: website/src/contribute/release-guide.md ## @@ -305,6 +332,7 @@ There are 2 ways to cut a release branch: either running automation script(recom DEV=${RELEASE}.dev sed -i -e "s/${DEV}/${RELEASE}/g" sdks/python/apache_beam/version.py + sed -i -e "s/${DEV}/${RELEASE}/g" gradle.properties Review comment: great catch, added. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 311784) Time Spent: 7.5h (was: 7h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 7.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=311777&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-311777 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 12/Sep/19 22:02 Start Date: 12/Sep/19 22:02 Worklog Time Spent: 10m Work Description: markflyhigh commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-531024250 Can you also update this section `Change and commit version number in release branch:` to include `gradle.properties`? This is how release manager verify changes after run cut_release_branch.sh This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 311777) Time Spent: 7h 20m (was: 7h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 7h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=311776&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-311776 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 12/Sep/19 22:01 Start Date: 12/Sep/19 22:01 Worklog Time Spent: 10m Work Description: markflyhigh commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-531024250 Can you also update this section `Change and commit version number in release branch:` to include `gradle.properties`? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 311776) Time Spent: 7h 10m (was: 7h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 7h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=311770&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-311770 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 12/Sep/19 21:49 Start Date: 12/Sep/19 21:49 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323963515 ## File path: website/src/contribute/release-guide.md ## @@ -305,6 +332,7 @@ There are 2 ways to cut a release branch: either running automation script(recom DEV=${RELEASE}.dev sed -i -e "s/${DEV}/${RELEASE}/g" sdks/python/apache_beam/version.py + sed -i -e "s/${DEV}/${RELEASE}/g" gradle.properties Review comment: should cut_release_branch.sh also need to be updated? [Here](https://github.com/apache/beam/blob/master/release/src/main/scripts/cut_release_branch.sh#L127)? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 311770) Time Spent: 7h (was: 6h 50m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 7h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=311519&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-311519 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 12/Sep/19 16:52 Start Date: 12/Sep/19 16:52 Worklog Time Spent: 10m Work Description: soyrice commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-530912262 > @soyrice I addressed your comments, PTAL. > @markflyhigh , your comments were addressed at the same commit. PTAL. LGTM! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 311519) Time Spent: 6h 50m (was: 6h 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 6h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=311072&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-311072 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 22:30 Start Date: 11/Sep/19 22:30 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-530591243 @soyrice I addressed your comments, PTAL. @markflyhigh , your comments were addressed at the same commit. PTAL. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 311072) Time Spent: 6h 40m (was: 6.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 6h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310973&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310973 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 20:21 Start Date: 11/Sep/19 20:21 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323440065 ## File path: website/src/contribute/release-guide.md ## @@ -821,7 +892,8 @@ Start the review-and-vote thread on the dev@ mailing list. Here’s an email tem [7] https://github.com/apache/beam-site/pull/... [8] https://github.com/apache/beam/pull/... [9] https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=... - +[10] https://hub.docker.com/u/apachebeam Review comment: The line you change is part of an email template (start from line 861). We put links at bottom of the email since they're referenced in above content. Do you want to reference this docker link in email? Otherwise, we can remove it. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310973) Time Spent: 6.5h (was: 6h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 6.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310864&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310864 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 17:22 Start Date: 11/Sep/19 17:22 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310864) Time Spent: 6h 20m (was: 6h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 6h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310862&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310862 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 17:18 Start Date: 11/Sep/19 17:18 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#issuecomment-530478292 Tests cleared, can we merge it? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310862) Time Spent: 6h 10m (was: 6h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 6h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310833&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310833 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 17:01 Start Date: 11/Sep/19 17:01 Worklog Time Spent: 10m Work Description: yifanzou commented on issue #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#issuecomment-530471795 Great! Will merge once all tests complete. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310833) Time Spent: 6h (was: 5h 50m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 6h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310826&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310826 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 16:53 Start Date: 11/Sep/19 16:53 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r323350969 ## File path: release/src/main/scripts/publish_docker_images.sh ## @@ -0,0 +1,77 @@ +#!/bin/bash +# +#Licensed to the Apache Software Foundation (ASF) under one or more +#contributor license agreements. See the NOTICE file distributed with +#this work for additional information regarding copyright ownership. +#The ASF licenses this file to You under the Apache License, Version 2.0 +#(the "License"); you may not use this file except in compliance with +#the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +#Unless required by applicable law or agreed to in writing, software +#distributed under the License is distributed on an "AS IS" BASIS, +#WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +#See the License for the specific language governing permissions and +#limitations under the License. +# + +# This script will generate and publish docker images for each language version to Docker Hub: +# 1. Generate images tagged with :{RELEASE} +# 2. Publish images tagged with :{RELEASE} +# 3. Tag images with :latest tag and publish. +# 4. Clearn up images. + +set -e + +source release/src/main/scripts/build_release_candidate.sh + +echo "Publish SDK docker images to Docker Hub." +echo "Do you want to proceed? [y|N]" +read confirmation +if [[ $confirmation = "y" ]]; then + echo "Publishing SDK docker images on docker hub=" + cd ~ + if [[ -d ${LOCAL_PYTHON_STAGING_DIR} ]]; then +rm -rf ${LOCAL_PYTHON_STAGING_DIR} + fi + mkdir -p ${LOCAL_PYTHON_STAGING_DIR} + cd ${LOCAL_PYTHON_STAGING_DIR} + + echo '---Cloning Beam Release Branch-' + git clone ${GIT_REPO_URL} + cd ${BEAM_ROOT_DIR} + git checkout ${RELEASE_BRANCH} + + echo '---Generating and Pushing Python images-' + ./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE} Review comment: Yes, that's another option and might be easier. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310826) Time Spent: 5h 40m (was: 5.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 5h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310827&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310827 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 16:53 Start Date: 11/Sep/19 16:53 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#issuecomment-530468644 Run Portable_Python PreCommit This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310827) Time Spent: 5h 50m (was: 5h 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 5h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310811&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310811 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 16:46 Start Date: 11/Sep/19 16:46 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323347598 ## File path: website/src/contribute/release-guide.md ## @@ -821,7 +892,8 @@ Start the review-and-vote thread on the dev@ mailing list. Here’s an email tem [7] https://github.com/apache/beam-site/pull/... [8] https://github.com/apache/beam/pull/... [9] https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=... - +[10] https://hub.docker.com/u/apachebeam Review comment: which email do you mean? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310811) Time Spent: 5.5h (was: 5h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 5.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310806&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310806 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 16:45 Start Date: 11/Sep/19 16:45 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-530465208 > Thank you. Would you like to help with 2.16 release on docker part? We can try this process in 2.16 and finalize it. Yes, of course! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310806) Time Spent: 5h 20m (was: 5h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 5h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310805&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310805 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 16:45 Start Date: 11/Sep/19 16:45 Worklog Time Spent: 10m Work Description: aaltay commented on issue #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#issuecomment-530465186 This LGTM. @yifanzou could you merge it once your comments are addressed. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310805) Time Spent: 5h 10m (was: 5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 5h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310786&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310786 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 16:33 Start Date: 11/Sep/19 16:33 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323318785 ## File path: website/src/contribute/release-guide.md ## @@ -821,7 +892,8 @@ Start the review-and-vote thread on the dev@ mailing list. Here’s an email tem [7] https://github.com/apache/beam-site/pull/... [8] https://github.com/apache/beam/pull/... [9] https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=... - +[10] https://hub.docker.com/u/apachebeam Review comment: This is not referenced in the email. Did you miss it? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310786) Time Spent: 5h (was: 4h 50m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310785&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310785 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 16:33 Start Date: 11/Sep/19 16:33 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323298281 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +646,43 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com +Build Python images and push to DockerHub +``` +./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE}_rc{RC_NUM} + +PYTHON_VER=("python2.7" "python3.5" "python3.6" "python3.7") +for ver in "${PYTHON_VER[@]}"; do + docker push apachebeam/${ver}_sdk:${RELEASE}_rc{RC_NUM} & +done +``` + +Build Java images and push to DockerHub +``` +./gradlew :sdks:java:container:dockerPush -Pdocker-tag=${RELEASE}_rc{RC_NUM} +``` + +Build Go images and push to DockerHub +``` +./gradlew :sdks:go:container:dockerPush -Pdocker-tag=${RELEASE}_rc{RC_NUM} +``` + +Clean up images from local +``` +for ver in "${PYTHON_VER[@]}"; do + docker rmi -f apachebeam/${ver}_sdk:${RELEASE}_rc{RC_NUM} +done +docker rmi -f apachebeam/java_sdk:${RELEASE}_rc{RC_NUM} +docker rmi -f apachebeam/go_sdk:${RELEASE}_rc{RC_NUM} +``` + +Verify all images are publish to DockerHub with tags: ${RELEASE}_rc{RC_NUM} + +How to find images: +1. Visit [hhttps://hub.docker.com/u/apachebeam](https://hub.docker.com/u/apachebeam) Review comment: https? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310785) Time Spent: 4h 50m (was: 4h 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310762&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310762 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 15:56 Start Date: 11/Sep/19 15:56 Worklog Time Spent: 10m Work Description: soyrice commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323282609 ## File path: website/src/contribute/release-guide.md ## @@ -81,6 +81,7 @@ Please have these credentials ready at hand, you will likely need to enter them * GPG pass phrase (see the next section); * Apache ID and Password; * GitHub ID and Password. +* DockerHub ID and Password. (You should be a member of maintainer team, please ask for help at dev@ if you are not.) Review comment: nit: ", please ask for help at" -> "; email" This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310762) Time Spent: 4h 40m (was: 4.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310763&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310763 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 15:56 Start Date: 11/Sep/19 15:56 Worklog Time Spent: 10m Work Description: soyrice commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323290547 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +646,43 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com Review comment: Do you have to stage these images in this order (Python first, Java next, and Go last)? If you do, then it's probably best to put them in a numbered list. Otherwise, let's use bullet points to make it clear that order doesn't matter. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310763) Time Spent: 4h 40m (was: 4.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310759&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310759 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 15:56 Start Date: 11/Sep/19 15:56 Worklog Time Spent: 10m Work Description: soyrice commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323323473 ## File path: website/src/contribute/release-guide.md ## @@ -1135,6 +1207,19 @@ __NOTE__: Only PMC members have permissions to do it, ping [dev@](mailto:dev@bea Make sure the download address for last release version is upldaed, [example PR](https://github.com/apache/beam-site/pull/478). +### Deploy SDK docker images to DockerHub +TODO(hannahjiang): change link to master branch after #9560 is merged. + +* Script: [publish_docker_images.sh](https://github.com/Hannah-Jiang/beam/blob/release_script_for_containers/release/src/main/scripts/publish_docker_images.sh) +* Usage +``` +./beam/release/src/main/scripts/publish_docker_images.sh +``` +Verify following points: Review comment: nit: "following points:" -> "that:" This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310759) Time Spent: 4h 20m (was: 4h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310758&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310758 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 15:56 Start Date: 11/Sep/19 15:56 Worklog Time Spent: 10m Work Description: soyrice commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323283409 ## File path: website/src/contribute/release-guide.md ## @@ -208,6 +209,32 @@ Automation Reliability](https://s.apache.org/beam-site-automation). Release manager needs to have an account with PyPI. If you need one, [register at PyPI](https://pypi.python.org/account/register/). You also need to be a maintainer (or an owner) of the [apache-beam](https://pypi.python.org/pypi/apache-beam) package in order to push a new release. Ask on the mailing list for assistance. + Login to DockerHub +Run following command manually, it will ask you to input your DockerHub ID and password if Review comment: nit: "manually, it" -> "manually. It" This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310758) Time Spent: 4h 20m (was: 4h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310761&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310761 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 15:56 Start Date: 11/Sep/19 15:56 Worklog Time Spent: 10m Work Description: soyrice commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323288365 ## File path: website/src/contribute/release-guide.md ## @@ -208,6 +209,32 @@ Automation Reliability](https://s.apache.org/beam-site-automation). Release manager needs to have an account with PyPI. If you need one, [register at PyPI](https://pypi.python.org/account/register/). You also need to be a maintainer (or an owner) of the [apache-beam](https://pypi.python.org/pypi/apache-beam) package in order to push a new release. Ask on the mailing list for assistance. + Login to DockerHub +Run following command manually, it will ask you to input your DockerHub ID and password if +authorization info cannot be found from ~/.docker/config.json file. +``` +docker login docker.io +``` +After successful login, authorization info will be stored at ~/.docker/config.json file. For example, +``` +"https://index.docker.io/v1/": { + "auth": "aGFubmFoamlhbmc6cmtkdGpmZ2hrMTIxMw==" +} +``` +Release managers should have push permission, please ask for help at dev@. Review comment: nit: ", please" -> ";" This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310761) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310760&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310760 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 15:56 Start Date: 11/Sep/19 15:56 Worklog Time Spent: 10m Work Description: soyrice commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323294506 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +646,43 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com +Build Python images and push to DockerHub +``` +./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE}_rc{RC_NUM} + +PYTHON_VER=("python2.7" "python3.5" "python3.6" "python3.7") +for ver in "${PYTHON_VER[@]}"; do + docker push apachebeam/${ver}_sdk:${RELEASE}_rc{RC_NUM} & +done +``` + +Build Java images and push to DockerHub +``` +./gradlew :sdks:java:container:dockerPush -Pdocker-tag=${RELEASE}_rc{RC_NUM} +``` + +Build Go images and push to DockerHub +``` +./gradlew :sdks:go:container:dockerPush -Pdocker-tag=${RELEASE}_rc{RC_NUM} +``` + +Clean up images from local +``` +for ver in "${PYTHON_VER[@]}"; do + docker rmi -f apachebeam/${ver}_sdk:${RELEASE}_rc{RC_NUM} +done +docker rmi -f apachebeam/java_sdk:${RELEASE}_rc{RC_NUM} +docker rmi -f apachebeam/go_sdk:${RELEASE}_rc{RC_NUM} +``` + +Verify all images are publish to DockerHub with tags: ${RELEASE}_rc{RC_NUM} Review comment: We can delete this line. It's also stated in step 3 below. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310760) Time Spent: 4.5h (was: 4h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310757&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310757 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 15:56 Start Date: 11/Sep/19 15:56 Worklog Time Spent: 10m Work Description: soyrice commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323323186 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +646,43 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com +Build Python images and push to DockerHub Review comment: Add colons or periods to the end of sentences that lead into a code fence This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310757) Time Spent: 4h 10m (was: 4h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310711&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310711 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 15:06 Start Date: 11/Sep/19 15:06 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r323296768 ## File path: website/src/contribute/release-guide.md ## @@ -1135,6 +1183,20 @@ __NOTE__: Only PMC members have permissions to do it, ping [dev@](mailto:dev@bea Make sure the download address for last release version is upldaed, [example PR](https://github.com/apache/beam-site/pull/478). + Deploy SDK docker images to DockerHub +TODO(hannahjiang): change link to master branch after #9560 is merged. + +* Script: [publish_docker_images.sh](https://github.com/Hannah-Jiang/beam/blob/release_script_for_containers/release/src/main/scripts/publish_docker_images.sh) Review comment: sg This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310711) Time Spent: 4h (was: 3h 50m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 4h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310338&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310338 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 06:37 Start Date: 11/Sep/19 06:37 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r323076674 ## File path: release/src/main/scripts/publish_docker_images.sh ## @@ -0,0 +1,77 @@ +#!/bin/bash +# +#Licensed to the Apache Software Foundation (ASF) under one or more +#contributor license agreements. See the NOTICE file distributed with +#this work for additional information regarding copyright ownership. +#The ASF licenses this file to You under the Apache License, Version 2.0 +#(the "License"); you may not use this file except in compliance with +#the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +#Unless required by applicable law or agreed to in writing, software +#distributed under the License is distributed on an "AS IS" BASIS, +#WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +#See the License for the specific language governing permissions and +#limitations under the License. +# + +# This script will generate and publish docker images for each language version to Docker Hub: +# 1. Generate images tagged with :{RELEASE} +# 2. Publish images tagged with :{RELEASE} +# 3. Tag images with :latest tag and publish. +# 4. Clearn up images. + +set -e + +source release/src/main/scripts/build_release_candidate.sh + +echo "Publish SDK docker images to Docker Hub." +echo "Do you want to proceed? [y|N]" +read confirmation +if [[ $confirmation = "y" ]]; then + echo "Publishing SDK docker images on docker hub=" + cd ~ + if [[ -d ${LOCAL_PYTHON_STAGING_DIR} ]]; then +rm -rf ${LOCAL_PYTHON_STAGING_DIR} + fi + mkdir -p ${LOCAL_PYTHON_STAGING_DIR} + cd ${LOCAL_PYTHON_STAGING_DIR} + + echo '---Cloning Beam Release Branch-' + git clone ${GIT_REPO_URL} + cd ${BEAM_ROOT_DIR} + git checkout ${RELEASE_BRANCH} + + echo '---Generating and Pushing Python images-' + ./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE} Review comment: This build steps lgtm in general. However, I'm wondering is it possible to reuse existing staged rc image instead of building another one? Rerun gradle build takes longer time and potentially has risk to introduce differences. Probably docker pull + tag + push? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310338) Time Spent: 3h 50m (was: 3h 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 3h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310339&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310339 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 06:37 Start Date: 11/Sep/19 06:37 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r323055624 ## File path: release/src/main/scripts/build_release_candidate.sh ## @@ -198,6 +200,45 @@ if [[ $confirmation = "y" ]]; then rm -rf ~/${PYTHON_ARTIFACTS_DIR} fi +echo "[Current Step]: Stage SDK docker images" +echo "Do you want to proceed? [y|N]" +read confirmation +if [[ $confirmation = "y" ]]; then + echo "Staging SDK docker images on docker hub=" + cd ~ + if [[ -d ${LOCAL_PYTHON_STAGING_DIR} ]]; then +rm -rf ${LOCAL_PYTHON_STAGING_DIR} + fi + mkdir -p ${LOCAL_PYTHON_STAGING_DIR} + cd ${LOCAL_PYTHON_STAGING_DIR} + + echo '---Cloning Beam Release Branch-' + git clone ${GIT_REPO_URL} + cd ${BEAM_ROOT_DIR} + git checkout ${RELEASE_BRANCH} + + echo '---Generating and Pushing Python images-' + ./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE}_rc${RC_NUM} + for ver in "${PYTHON_VER[@]}"; do + docker push apachebeam/${ver}_sdk:${RELEASE}_rc${RC_NUM} & + done + + echo '---Generating and Pushing Java images-' + ./gradlew :sdks:java:container:dockerPush -Pdocker-tag=${RELEASE}_rc${RC_NUM} + + echo '---Generating and Pushing Go images-' + ./gradlew :sdks:go:container:dockerPush -Pdocker-tag=${RELEASE}_rc${RC_NUM} + + rm -rf ~/${PYTHON_ARTIFACTS_DIR} Review comment: Why do we need to remove `~/python` here? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310339) Time Spent: 3h 50m (was: 3h 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 3h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310296&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310296 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 04:05 Start Date: 11/Sep/19 04:05 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r323051426 ## File path: release/src/main/scripts/publish_docker_images.sh ## @@ -0,0 +1,77 @@ +#!/bin/bash +# +#Licensed to the Apache Software Foundation (ASF) under one or more +#contributor license agreements. See the NOTICE file distributed with +#this work for additional information regarding copyright ownership. +#The ASF licenses this file to You under the Apache License, Version 2.0 +#(the "License"); you may not use this file except in compliance with +#the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +#Unless required by applicable law or agreed to in writing, software +#distributed under the License is distributed on an "AS IS" BASIS, +#WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +#See the License for the specific language governing permissions and +#limitations under the License. +# + +# This script will generate and publish docker images for each language version to Docker Hub: +# 1. Generate images tagged with :{RELEASE} +# 2. Publish images tagged with :{RELEASE} +# 3. Tag images with :latest tag and publish. +# 4. Clearn up images. + +set -e + +source release/src/main/scripts/build_release_candidate.sh + +echo "Publish SDK docker images to Docker Hub." +echo "Do you want to proceed? [y|N]" +read confirmation +if [[ $confirmation = "y" ]]; then + echo "Publishing SDK docker images on docker hub=" + cd ~ + if [[ -d ${LOCAL_PYTHON_STAGING_DIR} ]]; then +rm -rf ${LOCAL_PYTHON_STAGING_DIR} + fi + mkdir -p ${LOCAL_PYTHON_STAGING_DIR} + cd ${LOCAL_PYTHON_STAGING_DIR} + + echo '---Cloning Beam Release Branch-' + git clone ${GIT_REPO_URL} + cd ${BEAM_ROOT_DIR} + git checkout ${RELEASE_BRANCH} + + echo '---Generating and Pushing Python images-' + ./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE} + for ver in "${PYTHON_VER[@]}"; do + docker push apachebeam/${ver}_sdk:${RELEASE} + docker tag apachebeam/${ver}_sdk:${RELEASE} apachebeam/${ver}_sdk:latest + docker push apachebeam/${ver}_sdk:latest + done + + echo '---Generating and Pushing Java images-' + ./gradlew :sdks:java:container:dockerPush -Pdocker-tag=${RELEASE} + docker tag apachebeam/java_sdk:${RELEASE} apachebeam/java_sdk:latest + docker push apachebeam/java_sdk:latest + + echo '---Generating and Pushing Go images-' + ./gradlew :sdks:go:container:dockerPush -Pdocker-tag=${RELEASE} + docker tag apachebeam/go_sdk:${RELEASE} apachebeam/go_sdk:latest + docker push apachebeam/go_sdk:latest Review comment: `dockerPush` task at L60 will do both: build an image and push it to remote. (with {RELEASE} tag.) L62 is changing latest image to the most recent image, which is current one. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310296) Time Spent: 3h 40m (was: 3.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 3h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310261&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310261 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 02:19 Start Date: 11/Sep/19 02:19 Worklog Time Spent: 10m Work Description: aaltay commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r323034999 ## File path: release/src/main/scripts/set_version.sh ## @@ -78,6 +79,7 @@ else sed -i -e "s/version=.*/version=$TARGET_VERSION-SNAPSHOT/" gradle.properties sed -i -e "s/project.version = .*/project.version = '$TARGET_VERSION'/" buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy sed -i -e "s/^__version__ = .*/__version__ = '${TARGET_VERSION}.dev'/" sdks/python/apache_beam/version.py + sed -i -e "s/sdk_version=.*/sdk_version=$TARGET_VERSION.dev/" gradle.properties Review comment: Instead of sdk_version, you may want to call this python_sdk_version, this is python specific. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310261) Time Spent: 3.5h (was: 3h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 3.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310262&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310262 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 11/Sep/19 02:19 Start Date: 11/Sep/19 02:19 Worklog Time Spent: 10m Work Description: aaltay commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r323034658 ## File path: release/src/main/scripts/publish_docker_images.sh ## @@ -0,0 +1,77 @@ +#!/bin/bash +# +#Licensed to the Apache Software Foundation (ASF) under one or more +#contributor license agreements. See the NOTICE file distributed with +#this work for additional information regarding copyright ownership. +#The ASF licenses this file to You under the Apache License, Version 2.0 +#(the "License"); you may not use this file except in compliance with +#the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +#Unless required by applicable law or agreed to in writing, software +#distributed under the License is distributed on an "AS IS" BASIS, +#WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +#See the License for the specific language governing permissions and +#limitations under the License. +# + +# This script will generate and publish docker images for each language version to Docker Hub: +# 1. Generate images tagged with :{RELEASE} +# 2. Publish images tagged with :{RELEASE} +# 3. Tag images with :latest tag and publish. +# 4. Clearn up images. + +set -e + +source release/src/main/scripts/build_release_candidate.sh + +echo "Publish SDK docker images to Docker Hub." +echo "Do you want to proceed? [y|N]" +read confirmation +if [[ $confirmation = "y" ]]; then + echo "Publishing SDK docker images on docker hub=" + cd ~ + if [[ -d ${LOCAL_PYTHON_STAGING_DIR} ]]; then +rm -rf ${LOCAL_PYTHON_STAGING_DIR} + fi + mkdir -p ${LOCAL_PYTHON_STAGING_DIR} + cd ${LOCAL_PYTHON_STAGING_DIR} + + echo '---Cloning Beam Release Branch-' + git clone ${GIT_REPO_URL} + cd ${BEAM_ROOT_DIR} + git checkout ${RELEASE_BRANCH} + + echo '---Generating and Pushing Python images-' + ./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE} + for ver in "${PYTHON_VER[@]}"; do + docker push apachebeam/${ver}_sdk:${RELEASE} + docker tag apachebeam/${ver}_sdk:${RELEASE} apachebeam/${ver}_sdk:latest + docker push apachebeam/${ver}_sdk:latest + done + + echo '---Generating and Pushing Java images-' + ./gradlew :sdks:java:container:dockerPush -Pdocker-tag=${RELEASE} + docker tag apachebeam/java_sdk:${RELEASE} apachebeam/java_sdk:latest + docker push apachebeam/java_sdk:latest + + echo '---Generating and Pushing Go images-' + ./gradlew :sdks:go:container:dockerPush -Pdocker-tag=${RELEASE} + docker tag apachebeam/go_sdk:${RELEASE} apachebeam/go_sdk:latest + docker push apachebeam/go_sdk:latest Review comment: should this be push go_sdk:${RELEASE} or does it not matter? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310262) Time Spent: 3.5h (was: 3h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 3.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310199&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310199 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 23:59 Start Date: 10/Sep/19 23:59 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#issuecomment-530164610 kindly ping @markflyhigh This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310199) Time Spent: 3h 20m (was: 3h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 3h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310180&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310180 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 23:28 Start Date: 10/Sep/19 23:28 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-530158509 @markflyhigh , I addressed all your comments, PTAL. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310180) Time Spent: 3h 10m (was: 3h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310179&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310179 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 23:28 Start Date: 10/Sep/19 23:28 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-530158509 @markflyhigh , I fixed all your comments, PTAL. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310179) Time Spent: 3h (was: 2h 50m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 3h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310149&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310149 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 22:03 Start Date: 10/Sep/19 22:03 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322982688 ## File path: website/src/contribute/release-guide.md ## @@ -1135,6 +1183,20 @@ __NOTE__: Only PMC members have permissions to do it, ping [dev@](mailto:dev@bea Make sure the download address for last release version is upldaed, [example PR](https://github.com/apache/beam-site/pull/478). + Deploy SDK docker images to DockerHub +TODO(hannahjiang): change link to master branch after #9560 is merged. + +* Script: [publish_docker_images.sh](https://github.com/Hannah-Jiang/beam/blob/release_script_for_containers/release/src/main/scripts/publish_docker_images.sh) Review comment: doesn't L1187 work? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310149) Time Spent: 2h 50m (was: 2h 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 2h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310129&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310129 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 21:23 Start Date: 10/Sep/19 21:23 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r322959511 ## File path: release/src/main/scripts/build_release_candidate.sh ## @@ -20,7 +20,8 @@ # 1. Build and stage java artifacts # 2. Stage source release on dist.apache.org # 3. Stage python binaries -# 4. Create a PR to update beam-site +# 4. Stage SDK docker images Review comment: The images will be verified in two steps. 1. Tests running by `verify_release_build.sh` will test images. Jenkins build images and use them for testings. Though the tests don't directly use staging images, the images are built from the exact same codebase by calling the same gradle command. 2. For staging images, we should validate them in the same way we verify other artifacts, when we ask for votes from community. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310129) Time Spent: 2h 40m (was: 2.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 2h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310122&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310122 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 21:14 Start Date: 10/Sep/19 21:14 Worklog Time Spent: 10m Work Description: yifanzou commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r322965091 ## File path: release/src/main/scripts/build_release_candidate.sh ## @@ -20,7 +20,8 @@ # 1. Build and stage java artifacts # 2. Stage source release on dist.apache.org # 3. Stage python binaries -# 4. Create a PR to update beam-site +# 4. Stage SDK docker images Review comment: SG. Please update the template in the release sign-off sheet if staging image validation is required. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310122) Time Spent: 2.5h (was: 2h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 2.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310121&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310121 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 21:13 Start Date: 10/Sep/19 21:13 Worklog Time Spent: 10m Work Description: yifanzou commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r322965091 ## File path: release/src/main/scripts/build_release_candidate.sh ## @@ -20,7 +20,8 @@ # 1. Build and stage java artifacts # 2. Stage source release on dist.apache.org # 3. Stage python binaries -# 4. Create a PR to update beam-site +# 4. Stage SDK docker images Review comment: SG. Remember to update the template in the release sign-off sheet if staging image validation is required. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310121) Time Spent: 2h 20m (was: 2h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 2h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310116&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310116 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:59 Start Date: 10/Sep/19 20:59 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r322959511 ## File path: release/src/main/scripts/build_release_candidate.sh ## @@ -20,7 +20,8 @@ # 1. Build and stage java artifacts # 2. Stage source release on dist.apache.org # 3. Stage python binaries -# 4. Create a PR to update beam-site +# 4. Stage SDK docker images Review comment: The images will be verified in two steps. 1. Tests running by `verify_release_build.sh` will test images. Jenkins build images and use them for testings. Though the tests don't directly use staging images, the images are build from the exact same codebase by calling the same gradle command. 2. For staging images, we should validate them in the same way we verify other artifacts, when we ask for votes from community. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310116) Time Spent: 2h 10m (was: 2h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 2h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310109&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310109 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322945525 ## File path: website/src/contribute/release-guide.md ## @@ -769,13 +815,15 @@ Template: 1. Maven artifacts deployed to the staging repository of [repository.apache.org](https://repository.apache.org/content/repositories/) 1. Source distribution deployed to the dev repository of [dist.apache.org](https://dist.apache.org/repos/dist/dev/beam/) 1. Website pull request proposed to list the [release]({{ site.baseurl }}/get-started/downloads/), publish the [Java API reference manual](https://beam.apache.org/releases/javadoc/), and publish the [Python API reference manual](https://beam.apache.org/releases/pydoc/). +1. Docker images are published to [DockerHub](https://hub.docker.com/search?q=apachebeam&type=image) with tags :{RELEASE}_rc. You can (optionally) also do additional verification by: 1. Check that Python zip file contains the `README.md`, `NOTICE`, and `LICENSE` files. 1. Check hashes (e.g. `md5sum -c *.md5` and `sha1sum -c *.sha1`) 1. Check signatures (e.g. `gpg --verify apache-beam-1.2.3-python.zip.asc apache-beam-1.2.3-python.zip`) 1. `grep` for legal headers in each file. 1. Run all jenkins suites and include links to passing tests in the voting email. (Select "Run with parameters") +1. Pull docker images to make sure they are pullable. Review comment: add a command example? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310109) Time Spent: 1h 50m (was: 1h 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310110&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310110 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322934426 ## File path: website/src/contribute/release-guide.md ## @@ -208,6 +209,18 @@ Automation Reliability](https://s.apache.org/beam-site-automation). Release manager needs to have an account with PyPI. If you need one, [register at PyPI](https://pypi.python.org/account/register/). You also need to be a maintainer (or an owner) of the [apache-beam](https://pypi.python.org/pypi/apache-beam) package in order to push a new release. Ask on the mailing list for assistance. + Login to DockerHub +Run following command manually, it will ask you to input your DockerHub ID and password if +authorization info cannot be found from ~/.docker/config.json file. +``` +docker login docker.io +``` +After successful login, authorization info will be stored at ~/.docker/config.json file. For example, +```aidl Review comment: Not sure if this annotation will work for Beam website. This block didn't show up in [preview page](http://apache-beam-website-pull-requests.storage.googleapis.com/9510/contribute/release-guide/index.html) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310110) Time Spent: 2h (was: 1h 50m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 2h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310103&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310103 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322939853 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +632,38 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com +Build Python images and push to DockerHub +```aidl +./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE}_rc + +PYTHON_VER=("python2.7" "python3.5" "python3.6" "python3.7") +for ver in "${PYTHON_VER[@]}"; do + docker push apachebeam/${ver}_sdk:${RELEASE}_rc & +done +``` + +Build Java images and push to DockerHub +```aidl +./gradlew :sdks:java:container:dockerPush -Pdocker-tag=${RELEASE}_rc +``` + +Build Go images and push to DockerHub +```aidl +./gradlew :sdks:go:container:dockerPush -Pdocker-tag=${RELEASE}_rc +``` + +Clean up images from local +```aidl +for ver in "${PYTHON_VER[@]}"; do + docker rmi -f apachebeam/${ver}_sdk:${RELEASE}_rc +done +docker rmi -f apachebeam/java_sdk:${RELEASE}_rc +docker rmi -f apachebeam/go_sdk:${RELEASE}_rc +``` + +Verify all images are publish to DockerHub with tags :${RELEASE}_rc Review comment: Verify all images are publish to DockerHub with tag: `${RELEASE}_rc` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310103) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310101&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310101 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322943519 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +632,38 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com +Build Python images and push to DockerHub +```aidl +./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE}_rc + +PYTHON_VER=("python2.7" "python3.5" "python3.6" "python3.7") +for ver in "${PYTHON_VER[@]}"; do + docker push apachebeam/${ver}_sdk:${RELEASE}_rc & Review comment: should we include rc number in tag to distinguish different build for rc? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310101) Time Spent: 1h 20m (was: 1h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310102&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310102 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322956551 ## File path: website/src/contribute/release-guide.md ## @@ -1135,6 +1183,20 @@ __NOTE__: Only PMC members have permissions to do it, ping [dev@](mailto:dev@bea Make sure the download address for last release version is upldaed, [example PR](https://github.com/apache/beam-site/pull/478). + Deploy SDK docker images to DockerHub +TODO(hannahjiang): change link to master branch after #9560 is merged. + +* Script: [publish_docker_images.sh](https://github.com/Hannah-Jiang/beam/blob/release_script_for_containers/release/src/main/scripts/publish_docker_images.sh) +* Usage +```aidl +./beam/release/src/main/scripts/publish_docker_images.sh +``` +Verify following points: +* Images are published at [DockerHub](https://hub.docker.com/search?q=apachebeam&type=image) with tags :{RELEASE} and :latest. +* Images with :latest tag are pointing to current release by confirming + 1. Images with :latest tags were updated a moment ago. + 1. Size of Images with :latest tags should be same as the size of images with tag :{RELEASE}. Review comment: Should `latest` and `${RELEASE}` actually are same image? If so, how about also check DIGEST. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310102) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310106&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310106 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322946137 ## File path: website/src/contribute/release-guide.md ## @@ -1135,6 +1183,20 @@ __NOTE__: Only PMC members have permissions to do it, ping [dev@](mailto:dev@bea Make sure the download address for last release version is upldaed, [example PR](https://github.com/apache/beam-site/pull/478). + Deploy SDK docker images to DockerHub Review comment: should this title use `###` instead? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310106) Time Spent: 1.5h (was: 1h 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310100&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310100 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322942524 ## File path: website/src/contribute/release-guide.md ## @@ -769,13 +815,15 @@ Template: 1. Maven artifacts deployed to the staging repository of [repository.apache.org](https://repository.apache.org/content/repositories/) 1. Source distribution deployed to the dev repository of [dist.apache.org](https://dist.apache.org/repos/dist/dev/beam/) 1. Website pull request proposed to list the [release]({{ site.baseurl }}/get-started/downloads/), publish the [Java API reference manual](https://beam.apache.org/releases/javadoc/), and publish the [Python API reference manual](https://beam.apache.org/releases/pydoc/). +1. Docker images are published to [DockerHub](https://hub.docker.com/search?q=apachebeam&type=image) with tags :{RELEASE}_rc. Review comment: with tags: `{RELEASE}_rc`. Just realized there is a `:` in the tag. If that's the standard way to express a tag, please add it back. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310100) Time Spent: 1h 20m (was: 1h 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310104&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310104 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322948245 ## File path: website/src/contribute/release-guide.md ## @@ -1135,6 +1183,20 @@ __NOTE__: Only PMC members have permissions to do it, ping [dev@](mailto:dev@bea Make sure the download address for last release version is upldaed, [example PR](https://github.com/apache/beam-site/pull/478). + Deploy SDK docker images to DockerHub +TODO(hannahjiang): change link to master branch after #9560 is merged. + +* Script: [publish_docker_images.sh](https://github.com/Hannah-Jiang/beam/blob/release_script_for_containers/release/src/main/scripts/publish_docker_images.sh) +* Usage +```aidl +./beam/release/src/main/scripts/publish_docker_images.sh +``` +Verify following points: +* Images are published at [DockerHub](https://hub.docker.com/search?q=apachebeam&type=image) with tags :{RELEASE} and :latest. Review comment: with tags: `${RELEASE}` and `lastest` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310104) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310108&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310108 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322947548 ## File path: website/src/contribute/release-guide.md ## @@ -1135,6 +1183,20 @@ __NOTE__: Only PMC members have permissions to do it, ping [dev@](mailto:dev@bea Make sure the download address for last release version is upldaed, [example PR](https://github.com/apache/beam-site/pull/478). + Deploy SDK docker images to DockerHub +TODO(hannahjiang): change link to master branch after #9560 is merged. + +* Script: [publish_docker_images.sh](https://github.com/Hannah-Jiang/beam/blob/release_script_for_containers/release/src/main/scripts/publish_docker_images.sh) Review comment: Can you add todo here pointing to master once your changes merged? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310108) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310107&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310107 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322931816 ## File path: website/src/contribute/release-guide.md ## @@ -81,6 +81,7 @@ Please have these credentials ready at hand, you will likely need to enter them * GPG pass phrase (see the next section); * Apache ID and Password; * GitHub ID and Password. +* DockerHub ID and Password. (You should be a member of maintainer team, please ask for help at dev@ if you are not.) Review comment: Can you provide a detail guide instead of pointing to dev@? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310107) Time Spent: 1h 40m (was: 1.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310105&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310105 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 20:52 Start Date: 10/Sep/19 20:52 Worklog Time Spent: 10m Work Description: markflyhigh commented on pull request #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#discussion_r322941692 ## File path: website/src/contribute/release-guide.md ## @@ -618,6 +632,38 @@ Staging binaries Verify that files are [present](https://dist.apache.org/repos/dist/dev/beam). + Stage SDK images on hub.docker.com +Build Python images and push to DockerHub +```aidl +./gradlew :sdks:python:container:buildAll -Pdocker-tag=${RELEASE}_rc + +PYTHON_VER=("python2.7" "python3.5" "python3.6" "python3.7") +for ver in "${PYTHON_VER[@]}"; do + docker push apachebeam/${ver}_sdk:${RELEASE}_rc & +done +``` + +Build Java images and push to DockerHub +```aidl +./gradlew :sdks:java:container:dockerPush -Pdocker-tag=${RELEASE}_rc +``` + +Build Go images and push to DockerHub +```aidl +./gradlew :sdks:go:container:dockerPush -Pdocker-tag=${RELEASE}_rc +``` + +Clean up images from local +```aidl +for ver in "${PYTHON_VER[@]}"; do + docker rmi -f apachebeam/${ver}_sdk:${RELEASE}_rc +done +docker rmi -f apachebeam/java_sdk:${RELEASE}_rc +docker rmi -f apachebeam/go_sdk:${RELEASE}_rc +``` + +Verify all images are publish to DockerHub with tags :${RELEASE}_rc Review comment: Can you also provide a link/simple instruction to find those images on hub.docker.com? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310105) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=310064&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-310064 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 19:51 Start Date: 10/Sep/19 19:51 Worklog Time Spent: 10m Work Description: markflyhigh commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-530092856 Note: preview this change in http://apache-beam-website-pull-requests.storage.googleapis.com/9510/contribute/release-guide/index.html This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 310064) Time Spent: 1h 10m (was: 1h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=309941&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309941 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 16:44 Start Date: 10/Sep/19 16:44 Worklog Time Spent: 10m Work Description: yifanzou commented on pull request #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#discussion_r322850658 ## File path: release/src/main/scripts/build_release_candidate.sh ## @@ -20,7 +20,8 @@ # 1. Build and stage java artifacts # 2. Stage source release on dist.apache.org # 3. Stage python binaries -# 4. Create a PR to update beam-site +# 4. Stage SDK docker images Review comment: Do we need to verify the staging images like what we did on the release candidates? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 309941) Time Spent: 1h (was: 50m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=309933&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309933 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 10/Sep/19 16:27 Start Date: 10/Sep/19 16:27 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-530016373 R: @soyrice Cc: @markflyhigh , @yifanzou This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 309933) Time Spent: 50m (was: 40m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=309367&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309367 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 09/Sep/19 23:31 Start Date: 09/Sep/19 23:31 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [WIP][BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-529044758 Though it's WIP, I would like to give you a heads up about PR size. @soyrice This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 309367) Time Spent: 40m (was: 0.5h) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=309365&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-309365 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 09/Sep/19 23:29 Start Date: 09/Sep/19 23:29 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9506: [BEAM-8105] Docker images release scripts URL: https://github.com/apache/beam/pull/9506#issuecomment-529705785 R: @markflyhigh @yifanzou Cc: @aaltay This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 309365) Time Spent: 0.5h (was: 20m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=308218&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-308218 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 06/Sep/19 23:23 Start Date: 06/Sep/19 23:23 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #9510: [WIP][BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510#issuecomment-529044758 Though it's WIP, I would like to give you a heads up about PR size. soyrice This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 308218) Time Spent: 20m (was: 10m) > Add container publishing instruction to release manual > -- > > Key: BEAM-8105 > URL: https://issues.apache.org/jira/browse/BEAM-8105 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Hannah Jiang >Assignee: Hannah Jiang >Priority: Major > Fix For: 2.16.0 > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Work logged] (BEAM-8105) Add container publishing instruction to release manual
[ https://issues.apache.org/jira/browse/BEAM-8105?focusedWorklogId=308216&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-308216 ] ASF GitHub Bot logged work on BEAM-8105: Author: ASF GitHub Bot Created on: 06/Sep/19 23:17 Start Date: 06/Sep/19 23:17 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on pull request #9510: [WIP][BEAM-8105] update release guide with docker images URL: https://github.com/apache/beam/pull/9510 This PR is adding release procedure for docker images. Publishing docker images as part of release is tackled with following three PRs. Change default image name. (#9487 ) Add staging and publishing scripts for docker images to release procedure. (#9506) Updating release-guide.md (current PR) Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`). - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/) | --- | --- | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/) Java | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)[![Build Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/) Python | [![Build Status](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/)[![Build Status](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/)[![Build Status](https://builds.apache.org/job/beam_Post