[
https://issues.apache.org/jira/browse/BEAM-4744?focusedWorklogId=122116&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-122116
]
ASF GitHub Bot logged work on BEAM-4744:
----------------------------------------
Author: ASF GitHub Bot
Created on: 12/Jul/18 00:44
Start Date: 12/Jul/18 00:44
Worklog Time Spent: 10m
Work Description: lukecwik opened a new pull request #5936: [BEAM-4744]
Enable parallel publishing/release
URL: https://github.com/apache/beam/pull/5936
This solves the problem where jars would overwrite each other when
specifying -Ppublishing by fixing classifiers for shadowJar and jar to not
conflict when publishing since jar by default uses null.
Note that I also fixed:
* some permissions issues of files
* javadoc issues that came up when I was attempting to publish
* the usage of :runners:google-cloud-dataflow-java:examples and
examples-streaming. This was creating an empty project that was being published
which was causing issues when attempting to perform a release.
I was able to run a publishToMavenJavaPublicationToMavenLocal in parallel
but didn't explicitly enable all the publishing plugins and remove the need for
-Ppublishing because I didn't get enough time to test it. This cut publishing
time down to about 8 mins from over 20 mins in a clean workspace on my machine.
------------------------
Follow this checklist to help us incorporate your contribution quickly and
easily:
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA
issue, if applicable. This will automatically link the pull request to the
issue.
- [ ] If this contribution is large, please file an Apache [Individual
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
It will help us expedite review of your Pull Request if you tag someone
(e.g. `@username`) to look at it.
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/lastCompletedBuild/)
| --- | --- | --- | --- | --- | ---
Java | [](https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza_Gradle/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)
| --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)
</br> [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
| --- | --- | --- | ---
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 122116)
Time Spent: 10m
Remaining Estimate: 0h
> Jars are overwritten during release with -Ppublishing
> -----------------------------------------------------
>
> Key: BEAM-4744
> URL: https://issues.apache.org/jira/browse/BEAM-4744
> Project: Beam
> Issue Type: Bug
> Components: build-system
> Reporter: Mark Liu
> Assignee: Alan Myrvold
> Priority: Blocker
> Fix For: 2.6.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> +cc [~pabloem] [~boyuanz] [~lukecwik]
> Few jars (*-shaded.jar and *-tests.jar) are missing if I run `./gradlew
> -Ppublishing :publishToMavenLocal`.
> However, I can get them through assemble and shadowJar. For example,
> `./gradlew :beam-sdks-java-core:assemble :beam-sdks-java-core:shadowJar`.
> This could be the reason why we can't run parallel build during release.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
