[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[ https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390826=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390826 ] ASF GitHub Bot logged work on BEAM-9022: Author: ASF GitHub Bot Created on: 21/Feb/20 18:13 Start Date: 21/Feb/20 18:13 Worklog Time Spent: 10m Work Description: ibzib commented on pull request #10921: [BEAM-9022] publish Spark job server Docker image URL: https://github.com/apache/beam/pull/10921 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 390826) Time Spent: 3h (was: 2h 50m) > Publish spark job server container images in release process > > > Key: BEAM-9022 > URL: https://issues.apache.org/jira/browse/BEAM-9022 > Project: Beam > Issue Type: Improvement > Components: runner-spark >Reporter: Kyle Weaver >Assignee: Kyle Weaver >Priority: Major > Labels: portability-spark > Time Spent: 3h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[ https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390790=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390790 ] ASF GitHub Bot logged work on BEAM-9022: Author: ASF GitHub Bot Created on: 21/Feb/20 17:25 Start Date: 21/Feb/20 17:25 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #10921: [BEAM-9022] publish Spark job server Docker image URL: https://github.com/apache/beam/pull/10921#issuecomment-589751976 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 390790) Time Spent: 2h 50m (was: 2h 40m) > Publish spark job server container images in release process > > > Key: BEAM-9022 > URL: https://issues.apache.org/jira/browse/BEAM-9022 > Project: Beam > Issue Type: Improvement > Components: runner-spark >Reporter: Kyle Weaver >Assignee: Kyle Weaver >Priority: Major > Labels: portability-spark > Time Spent: 2h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390787=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390787
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 17:20
Start Date: 21/Feb/20 17:20
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #10921: [BEAM-9022]
publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382706172
##
File path: release/src/main/scripts/build_release_candidate.sh
##
@@ -236,6 +236,9 @@ if [[ $confirmation = "y" ]]; then
./gradlew ":runners:flink:${ver}:job-server-container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
done
+ echo '-Generating and Pushing Spark job server
image-'
+ ./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
fixed
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390787)
Time Spent: 2h 40m (was: 2.5h)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[ https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390775=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390775 ] ASF GitHub Bot logged work on BEAM-9022: Author: ASF GitHub Bot Created on: 21/Feb/20 17:08 Start Date: 21/Feb/20 17:08 Worklog Time Spent: 10m Work Description: ibzib commented on issue #10921: [BEAM-9022] publish Spark job server Docker image URL: https://github.com/apache/beam/pull/10921#issuecomment-589745386 Flake is unrelated ([BEAM-8912](https://issues.apache.org/jira/browse/BEAM-8912)) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 390775) Time Spent: 2h 20m (was: 2h 10m) > Publish spark job server container images in release process > > > Key: BEAM-9022 > URL: https://issues.apache.org/jira/browse/BEAM-9022 > Project: Beam > Issue Type: Improvement > Components: runner-spark >Reporter: Kyle Weaver >Assignee: Kyle Weaver >Priority: Major > Labels: portability-spark > Time Spent: 2h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390765=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390765
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 16:50
Start Date: 21/Feb/20 16:50
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #10921: [BEAM-9022]
publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382691092
##
File path: release/src/main/scripts/build_release_candidate.sh
##
@@ -236,6 +236,9 @@ if [[ $confirmation = "y" ]]; then
./gradlew ":runners:flink:${ver}:job-server-container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
done
+ echo '-Generating and Pushing Spark job server
image-'
+ ./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
It is documented on the Spark runner page:
https://beam.apache.org/documentation/runners/spark/
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390765)
Time Spent: 2h 10m (was: 2h)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390390=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390390
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 02:27
Start Date: 21/Feb/20 02:27
Worklog Time Spent: 10m
Work Description: Hannah-Jiang commented on pull request #10921:
[BEAM-9022] publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382366200
##
File path: release/src/main/scripts/build_release_candidate.sh
##
@@ -236,6 +236,9 @@ if [[ $confirmation = "y" ]]; then
./gradlew ":runners:flink:${ver}:job-server-container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
done
+ echo '-Generating and Pushing Spark job server
image-'
+ ./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
Then let’s add it to documentation some where. If I am a spark user, I would
really wonder which version is being supported.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390390)
Time Spent: 2h (was: 1h 50m)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 2h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[ https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390369=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390369 ] ASF GitHub Bot logged work on BEAM-9022: Author: ASF GitHub Bot Created on: 21/Feb/20 01:27 Start Date: 21/Feb/20 01:27 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #10921: [BEAM-9022] publish Spark job server Docker image URL: https://github.com/apache/beam/pull/10921#issuecomment-589454956 > > Yes! > > Great. In that case, shall we merge this first, and then I'll let you patch it into #10612? Yes, no problem. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 390369) Time Spent: 1h 50m (was: 1h 40m) > Publish spark job server container images in release process > > > Key: BEAM-9022 > URL: https://issues.apache.org/jira/browse/BEAM-9022 > Project: Beam > Issue Type: Improvement > Components: runner-spark >Reporter: Kyle Weaver >Assignee: Kyle Weaver >Priority: Major > Labels: portability-spark > Time Spent: 1h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[ https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390358=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390358 ] ASF GitHub Bot logged work on BEAM-9022: Author: ASF GitHub Bot Created on: 21/Feb/20 01:10 Start Date: 21/Feb/20 01:10 Worklog Time Spent: 10m Work Description: ibzib commented on issue #10921: [BEAM-9022] publish Spark job server Docker image URL: https://github.com/apache/beam/pull/10921#issuecomment-589450531 > Yes! Great. In that case, shall we merge this first, and then I'll let you patch it into #10612? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 390358) Time Spent: 1h 40m (was: 1.5h) > Publish spark job server container images in release process > > > Key: BEAM-9022 > URL: https://issues.apache.org/jira/browse/BEAM-9022 > Project: Beam > Issue Type: Improvement > Components: runner-spark >Reporter: Kyle Weaver >Assignee: Kyle Weaver >Priority: Major > Labels: portability-spark > Time Spent: 1h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390356=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390356
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 01:07
Start Date: 21/Feb/20 01:07
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #10921: [BEAM-9022]
publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382346713
##
File path: release/src/main/scripts/build_release_candidate.sh
##
@@ -236,6 +236,9 @@ if [[ $confirmation = "y" ]]; then
./gradlew ":runners:flink:${ver}:job-server-container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
done
+ echo '-Generating and Pushing Spark job server
image-'
+ ./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
Minor clarification to the above: Beam Spark runner supports Spark's latest
_feature_ release, i.e. `2.4.*`.
I think the plan is to create a separate module when moving to Spark 3
([BEAM-9282](https://issues.apache.org/jira/browse/BEAM-9282)). @iemejia knows
more
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390356)
Time Spent: 1.5h (was: 1h 20m)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[ https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390351=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390351 ] ASF GitHub Bot logged work on BEAM-9022: Author: ASF GitHub Bot Created on: 21/Feb/20 01:02 Start Date: 21/Feb/20 01:02 Worklog Time Spent: 10m Work Description: Hannah-Jiang commented on issue #10921: [BEAM-9022] publish Spark job server Docker image URL: https://github.com/apache/beam/pull/10921#issuecomment-589448192 > @Hannah-Jiang are we expecting to migrate Apache's repo to starting with 2.20? Yes! This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 390351) Time Spent: 1h 20m (was: 1h 10m) > Publish spark job server container images in release process > > > Key: BEAM-9022 > URL: https://issues.apache.org/jira/browse/BEAM-9022 > Project: Beam > Issue Type: Improvement > Components: runner-spark >Reporter: Kyle Weaver >Assignee: Kyle Weaver >Priority: Major > Labels: portability-spark > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[ https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390350=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390350 ] ASF GitHub Bot logged work on BEAM-9022: Author: ASF GitHub Bot Created on: 21/Feb/20 01:00 Start Date: 21/Feb/20 01:00 Worklog Time Spent: 10m Work Description: ibzib commented on issue #10921: [BEAM-9022] publish Spark job server Docker image URL: https://github.com/apache/beam/pull/10921#issuecomment-589447390 @Hannah-Jiang are we expecting to migrate Apache's repo to starting with 2.20? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 390350) Time Spent: 1h 10m (was: 1h) > Publish spark job server container images in release process > > > Key: BEAM-9022 > URL: https://issues.apache.org/jira/browse/BEAM-9022 > Project: Beam > Issue Type: Improvement > Components: runner-spark >Reporter: Kyle Weaver >Assignee: Kyle Weaver >Priority: Major > Labels: portability-spark > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390349=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390349
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 01:00
Start Date: 21/Feb/20 01:00
Worklog Time Spent: 10m
Work Description: Hannah-Jiang commented on pull request #10921:
[BEAM-9022] publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382344887
##
File path: release/src/main/scripts/build_release_candidate.sh
##
@@ -236,6 +236,9 @@ if [[ $confirmation = "y" ]]; then
./gradlew ":runners:flink:${ver}:job-server-container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
done
+ echo '-Generating and Pushing Spark job server
image-'
+ ./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
How about in future? In addition, I think users should know which spark
version is supported even if only one version is supported.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390349)
Time Spent: 1h (was: 50m)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 1h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390348=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390348
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 00:58
Start Date: 21/Feb/20 00:58
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #10921: [BEAM-9022]
publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382343820
##
File path: release/src/main/scripts/build_release_candidate.sh
##
@@ -236,6 +236,9 @@ if [[ $confirmation = "y" ]]; then
./gradlew ":runners:flink:${ver}:job-server-container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
done
+ echo '-Generating and Pushing Spark job server
image-'
+ ./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
No, the Spark runner only supports one Spark version per Beam release
(currently
[2.4.5](https://github.com/apache/beam/blob/800754399baa939232b9863b5104111c638e88aa/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy#L399)),
unlike Flink, which supports the latest three Flink versions.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390348)
Time Spent: 50m (was: 40m)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 50m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390347=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390347
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 00:58
Start Date: 21/Feb/20 00:58
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #10921: [BEAM-9022]
publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382343770
##
File path: website/src/contribute/release-guide.md
##
@@ -717,6 +717,12 @@ for ver in "${FLINK_VER[@]}"; do
done
```
+* Build Spark job server image and push to DockerHub.
+
+```
+./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
Whoops, good catch.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390347)
Time Spent: 40m (was: 0.5h)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390342=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390342
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 00:55
Start Date: 21/Feb/20 00:55
Worklog Time Spent: 10m
Work Description: Hannah-Jiang commented on pull request #10921:
[BEAM-9022] publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382341099
##
File path: release/src/main/scripts/build_release_candidate.sh
##
@@ -236,6 +236,9 @@ if [[ $confirmation = "y" ]]; then
./gradlew ":runners:flink:${ver}:job-server-container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
done
+ echo '-Generating and Pushing Spark job server
image-'
+ ./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
Don't we need to specify spark version here?
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390342)
Time Spent: 20m (was: 10m)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 20m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[
https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390344=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390344
]
ASF GitHub Bot logged work on BEAM-9022:
Author: ASF GitHub Bot
Created on: 21/Feb/20 00:55
Start Date: 21/Feb/20 00:55
Worklog Time Spent: 10m
Work Description: Hannah-Jiang commented on pull request #10921:
[BEAM-9022] publish Spark job server Docker image
URL: https://github.com/apache/beam/pull/10921#discussion_r382341388
##
File path: website/src/contribute/release-guide.md
##
@@ -717,6 +717,12 @@ for ver in "${FLINK_VER[@]}"; do
done
```
+* Build Spark job server image and push to DockerHub.
+
+```
+./gradlew "./gradlew :runners:spark:job-server:container:dockerPush"
-Pdocker-tag="${RELEASE}_rc${RC_NUM}"
Review comment:
`./gradlew` is repeated.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 390344)
Time Spent: 0.5h (was: 20m)
> Publish spark job server container images in release process
>
>
> Key: BEAM-9022
> URL: https://issues.apache.org/jira/browse/BEAM-9022
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Major
> Labels: portability-spark
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Work logged] (BEAM-9022) Publish spark job server container images in release process
[ https://issues.apache.org/jira/browse/BEAM-9022?focusedWorklogId=390339=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-390339 ] ASF GitHub Bot logged work on BEAM-9022: Author: ASF GitHub Bot Created on: 21/Feb/20 00:43 Start Date: 21/Feb/20 00:43 Worklog Time Spent: 10m Work Description: ibzib commented on pull request #10921: [BEAM-9022] publish Spark job server Docker image URL: https://github.com/apache/beam/pull/10921 **Please** add a meaningful description for your change here Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`). - [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] Update `CHANGES.md` with noteworthy changes. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). See the [Contributor Guide](https://beam.apache.org/contribute) for more tips on [how to make review process smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier). Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/) | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/) Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/) Python | [](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/)[