[jira] [Created] (GEODE-10369) Change heavy lifter instances types to E2
Sean Goller created GEODE-10369: --- Summary: Change heavy lifter instances types to E2 Key: GEODE-10369 URL: https://issues.apache.org/jira/browse/GEODE-10369 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller To reduce CI costs, we should be using E2 instances. -- This message was sent by Atlassian Jira (v8.20.7#820007)
[jira] [Created] (GEODE-9978) Remove test-container from Geode
Sean Goller created GEODE-9978: -- Summary: Remove test-container from Geode Key: GEODE-9978 URL: https://issues.apache.org/jira/browse/GEODE-9978 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller We don't use it for testing anymore. Excise it. -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Created] (GEODE-9775) CI changes in preparation for change in cloud infrastructure
Sean Goller created GEODE-9775: -- Summary: CI changes in preparation for change in cloud infrastructure Key: GEODE-9775 URL: https://issues.apache.org/jira/browse/GEODE-9775 Project: Geode Issue Type: Improvement Components: ci Affects Versions: 1.14.0, 1.13.4, 1.12.5, 1.15.0 Reporter: Sean Goller The way CI currently obtains some cloud infrastructure information will no longer be available when we migrate. This issue covers the necessary changes that can be done in advance to maintain compatibility. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GEODE-9386) google-windows-geode-builder image doesn't properly delete geode directory after dependency caching
[ https://issues.apache.org/jira/browse/GEODE-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-9386. Fix Version/s: 1.15.0 Resolution: Fixed > google-windows-geode-builder image doesn't properly delete geode directory > after dependency caching > --- > > Key: GEODE-9386 > URL: https://issues.apache.org/jira/browse/GEODE-9386 > Project: Geode > Issue Type: Bug > Components: ci >Affects Versions: 1.15.0 >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Minor > Labels: pull-request-available > Fix For: 1.15.0 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (GEODE-9386) google-windows-geode-builder image doesn't properly delete geode directory after dependency caching
[ https://issues.apache.org/jira/browse/GEODE-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller updated GEODE-9386: --- Priority: Minor (was: Major) > google-windows-geode-builder image doesn't properly delete geode directory > after dependency caching > --- > > Key: GEODE-9386 > URL: https://issues.apache.org/jira/browse/GEODE-9386 > Project: Geode > Issue Type: Bug > Components: ci >Affects Versions: 1.15.0 >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (GEODE-9386) google-windows-geode-builder image doesn't properly delete geode directory after dependency caching
[ https://issues.apache.org/jira/browse/GEODE-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-9386: -- Assignee: Sean Goller > google-windows-geode-builder image doesn't properly delete geode directory > after dependency caching > --- > > Key: GEODE-9386 > URL: https://issues.apache.org/jira/browse/GEODE-9386 > Project: Geode > Issue Type: Bug > Components: ci >Affects Versions: 1.15.0 >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-9386) google-windows-geode-builder image doesn't properly delete geode directory after dependency caching
Sean Goller created GEODE-9386: -- Summary: google-windows-geode-builder image doesn't properly delete geode directory after dependency caching Key: GEODE-9386 URL: https://issues.apache.org/jira/browse/GEODE-9386 Project: Geode Issue Type: Bug Components: ci Affects Versions: 1.15.0 Reporter: Sean Goller -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (GEODE-9192) test-container docker image is unstable due to dependencies
[ https://issues.apache.org/jira/browse/GEODE-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-9192: -- Assignee: Sean Goller > test-container docker image is unstable due to dependencies > --- > > Key: GEODE-9192 > URL: https://issues.apache.org/jira/browse/GEODE-9192 > Project: Geode > Issue Type: Bug > Components: ci >Affects Versions: 1.12.2, 1.13.2 >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Labels: pull-request-available > Fix For: 1.12.3, 1.13.3, 1.14.0, 1.15.0 > > > buildpack-scm, a docker image that our test container relies on, has become > unstable. This has caused problems for mass-test. Replace the base image with > ubuntu. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-9218) Geode has tests for TLSv1.1 which is disabled by default now
Sean Goller created GEODE-9218: -- Summary: Geode has tests for TLSv1.1 which is disabled by default now Key: GEODE-9218 URL: https://issues.apache.org/jira/browse/GEODE-9218 Project: Geode Issue Type: Bug Components: security Affects Versions: 1.12.3, 1.13.3, 1.14.0, 1.15.0 Reporter: Sean Goller According to the [Oracle JRE/JDK cryptographic roadmap|https://java.com/en/jre-jdk-cryptoroadmap.html#releasedChangesTable], TLSv1 and TLSv1.1 are disabled by default as of 11.0.11+9 and 8u291b10. This causes TLSv1.1 tests to fail. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (GEODE-9218) Geode has tests for TLSv1.1 which is disabled by default now
[ https://issues.apache.org/jira/browse/GEODE-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-9218: -- Assignee: Sean Goller > Geode has tests for TLSv1.1 which is disabled by default now > > > Key: GEODE-9218 > URL: https://issues.apache.org/jira/browse/GEODE-9218 > Project: Geode > Issue Type: Bug > Components: security >Affects Versions: 1.12.3, 1.13.3, 1.14.0, 1.15.0 >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > > According to the [Oracle JRE/JDK cryptographic > roadmap|https://java.com/en/jre-jdk-cryptoroadmap.html#releasedChangesTable], > TLSv1 and TLSv1.1 are disabled by default as of 11.0.11+9 and 8u291b10. This > causes TLSv1.1 tests to fail. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-9192) test-container docker image is unstable due to dependencies
Sean Goller created GEODE-9192: -- Summary: test-container docker image is unstable due to dependencies Key: GEODE-9192 URL: https://issues.apache.org/jira/browse/GEODE-9192 Project: Geode Issue Type: Bug Components: ci Affects Versions: 1.13.2, 1.12.2 Reporter: Sean Goller buildpack-scm, a docker image that our test container relies on, has become unstable. This has caused problems for mass-test. Replace the base image with ubuntu. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GEODE-9153) alpine-tools image fails to build
[ https://issues.apache.org/jira/browse/GEODE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-9153. Fix Version/s: 1.15.0 1.14.0 1.13.3 1.12.2 Resolution: Fixed > alpine-tools image fails to build > - > > Key: GEODE-9153 > URL: https://issues.apache.org/jira/browse/GEODE-9153 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Labels: pull-request-available > Fix For: 1.12.2, 1.13.3, 1.14.0, 1.15.0 > > > The alpine-tools docker image fails to build properly. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (GEODE-9153) alpine-tools image fails to build
[ https://issues.apache.org/jira/browse/GEODE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-9153: -- Assignee: Sean Goller > alpine-tools image fails to build > - > > Key: GEODE-9153 > URL: https://issues.apache.org/jira/browse/GEODE-9153 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Labels: pull-request-available > > The alpine-tools docker image fails to build properly. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-9153) alpine-tools image fails to build
Sean Goller created GEODE-9153: -- Summary: alpine-tools image fails to build Key: GEODE-9153 URL: https://issues.apache.org/jira/browse/GEODE-9153 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller The alpine-tools docker image fails to build properly. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-9142) Make disk size for heavy lifters parameterized
Sean Goller created GEODE-9142: -- Summary: Make disk size for heavy lifters parameterized Key: GEODE-9142 URL: https://issues.apache.org/jira/browse/GEODE-9142 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller We're running out of disk space on certain jobs. Make it so we can choose how much disk to allocate on a per job basis. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-8915) Geode pipelines need to be modified to support concourse 6.x
Sean Goller created GEODE-8915: -- Summary: Geode pipelines need to be modified to support concourse 6.x Key: GEODE-8915 URL: https://issues.apache.org/jira/browse/GEODE-8915 Project: Geode Issue Type: Improvement Components: ci Affects Versions: 1.12.1, 1.13.2, 1.14.0 Reporter: Sean Goller In order to upgrade to concourse version 6 we need to change the pipelines. This issues will cover all support branches and develop. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GEODE-8834) redis testing fails due to image pull failure
[ https://issues.apache.org/jira/browse/GEODE-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-8834. Fix Version/s: 1.14.0 Resolution: Fixed Fixed on develop. > redis testing fails due to image pull failure > - > > Key: GEODE-8834 > URL: https://issues.apache.org/jira/browse/GEODE-8834 > Project: Geode > Issue Type: Bug > Components: ci >Affects Versions: 1.12.0, 1.13.0, 1.13.1 >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Fix For: 1.14.0 > > > Redis testing uses quay.io/testingcontaiiners/ryuk:0.2.3. When acceptanceTest > tries to pull this image, it fails for some reason. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-8834) redis testing fails due to image pull failure
Sean Goller created GEODE-8834: -- Summary: redis testing fails due to image pull failure Key: GEODE-8834 URL: https://issues.apache.org/jira/browse/GEODE-8834 Project: Geode Issue Type: Bug Components: ci Affects Versions: 1.13.1, 1.13.0, 1.12.0 Reporter: Sean Goller Redis testing uses quay.io/testingcontaiiners/ryuk:0.2.3. When acceptanceTest tries to pull this image, it fails for some reason. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (GEODE-8661) Tests only use the latest heavy lifter image
[ https://issues.apache.org/jira/browse/GEODE-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-8661: -- Assignee: Sean Goller > Tests only use the latest heavy lifter image > > > Key: GEODE-8661 > URL: https://issues.apache.org/jira/browse/GEODE-8661 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > > Test jobs should pay attention to the version of the heavy-lifter image > that's being passed to them. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-8661) Tests only use the latest heavy lifter image
Sean Goller created GEODE-8661: -- Summary: Tests only use the latest heavy lifter image Key: GEODE-8661 URL: https://issues.apache.org/jira/browse/GEODE-8661 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller Test jobs should pay attention to the version of the heavy-lifter image that's being passed to them. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (GEODE-8321) Change JDK in use to BellSoft's Liberica JDK
[ https://issues.apache.org/jira/browse/GEODE-8321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17183520#comment-17183520 ] Sean Goller commented on GEODE-8321: This is not done. We've added the JDKs, but the tests don't use them yet. Another PR is incoming once we verify all tests pass using liberica. > Change JDK in use to BellSoft's Liberica JDK > > > Key: GEODE-8321 > URL: https://issues.apache.org/jira/browse/GEODE-8321 > Project: Geode > Issue Type: Improvement > Components: ci >Reporter: Sean Goller >Assignee: Ernest Burghardt >Priority: Major > Labels: pull-request-available > > Use BellSoft's Liberica variant of OpenJDK for all testing. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GEODE-8348) CI does not build benchmarks image
[ https://issues.apache.org/jira/browse/GEODE-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-8348. Resolution: Fixed > CI does not build benchmarks image > -- > > Key: GEODE-8348 > URL: https://issues.apache.org/jira/browse/GEODE-8348 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Labels: pull-request-available > > The CI infrastructure relies on the existence of a google compute image in > order to function. Currently that image is not build anywhere in CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (GEODE-8348) CI does not build benchmarks image
[ https://issues.apache.org/jira/browse/GEODE-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-8348: -- Assignee: Sean Goller > CI does not build benchmarks image > -- > > Key: GEODE-8348 > URL: https://issues.apache.org/jira/browse/GEODE-8348 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Labels: pull-request-available > > The CI infrastructure relies on the existence of a google compute image in > order to function. Currently that image is not build anywhere in CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-8348) CI does not build benchmarks image
Sean Goller created GEODE-8348: -- Summary: CI does not build benchmarks image Key: GEODE-8348 URL: https://issues.apache.org/jira/browse/GEODE-8348 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller The CI infrastructure relies on the existence of a google compute image in order to function. Currently that image is not build anywhere in CI. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-8321) Change JDK in use to BellSoft's Liberica JDK
Sean Goller created GEODE-8321: -- Summary: Change JDK in use to BellSoft's Liberica JDK Key: GEODE-8321 URL: https://issues.apache.org/jira/browse/GEODE-8321 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Use BellSoft's Liberica variant of OpenJDK for all testing. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GEODE-8317) WindowsAcceptanceTestOpenJDK8 failure command 'docker'' finished with non-zero exit value 1
[
https://issues.apache.org/jira/browse/GEODE-8317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Goller resolved GEODE-8317.
Resolution: Fixed
reverting the code that caused this bug.
> WindowsAcceptanceTestOpenJDK8 failure command 'docker'' finished with
> non-zero exit value 1
> ---
>
> Key: GEODE-8317
> URL: https://issues.apache.org/jira/browse/GEODE-8317
> Project: Geode
> Issue Type: Bug
> Components: ci
>Reporter: Mark Hanson
>Assignee: Sean Goller
>Priority: Major
>
> {noformat}
> 43:14FAILURE: Build failed with an exception.
> 07:43:14
> 07:43:14* What went wrong:
> 07:43:14Execution failed for task ':geode-assembly:docker'.
> 07:43:14> Process 'command 'docker'' finished with non-zero exit value 1
> 07:43:14
> 07:43:14* Try:
> 07:43:14Run with --stacktrace option to get the stack trace. Run with --info
> or --debug option to get more log output. Run with --scan to get full
> insights.
> 07:43:14
> 07:43:14* Get more help at https://help.gradle.org
> 07:43:14
> 07:43:14BUILD FAILED in 13m 17s
> 07:43:14
> {noformat}
>
>
> {noformat}
> =-=-=-=-=-=-=-=-=-=-=-=-=-=-= Test Results URI
> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
> http://files.apachegeode-ci.info/builds/apache-develop-main/1.14.0-build.0191/test-results/acceptanceTest/1593441997/
> =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
> Test report artifacts from this job are available at:
> http://files.apachegeode-ci.info/builds/apache-develop-main/1.14.0-build.0191/test-artifacts/1593441997/windows-acceptancetestfiles-OpenJDK8-1.14.0-build.0191.tgz
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (GEODE-8083) Add API check job to CI
Sean Goller created GEODE-8083: -- Summary: Add API check job to CI Key: GEODE-8083 URL: https://issues.apache.org/jira/browse/GEODE-8083 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller In order to combat API breaking changes, we need a CI job that compares the current API against the last release. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GEODE-7444) heavy lifters should use ssh keepalives to maintain long-running connections
[
https://issues.apache.org/jira/browse/GEODE-7444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Goller resolved GEODE-7444.
Assignee: Sean Goller
Resolution: Invalid
Turns out they're already configured to handle this out of the box.
> heavy lifters should use ssh keepalives to maintain long-running connections
>
>
> Key: GEODE-7444
> URL: https://issues.apache.org/jira/browse/GEODE-7444
> Project: Geode
> Issue Type: Improvement
> Components: ci
>Reporter: Sean Goller
>Assignee: Sean Goller
>Priority: Major
>
> Using the following configuration directives to sshd we can ensure ssh
> connections won't time out.
>
> {{ClientAliveInterval 300}}
> {{ClientAliveCountMax 2}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (GEODE-7444) heavy lifters should use ssh keepalives to maintain long-running connections
Sean Goller created GEODE-7444:
--
Summary: heavy lifters should use ssh keepalives to maintain
long-running connections
Key: GEODE-7444
URL: https://issues.apache.org/jira/browse/GEODE-7444
Project: Geode
Issue Type: Improvement
Components: ci
Reporter: Sean Goller
Using the following configuration directives to sshd we can ensure ssh
connections won't time out.
{{ClientAliveInterval 300}}
{{ClientAliveCountMax 2}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (GEODE-7392) Add tag indicating the commit under test to heavy lifters
[ https://issues.apache.org/jira/browse/GEODE-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-7392. Assignee: Sean Goller Resolution: Fixed > Add tag indicating the commit under test to heavy lifters > - > > Key: GEODE-7392 > URL: https://issues.apache.org/jira/browse/GEODE-7392 > Project: Geode > Issue Type: Improvement > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > > Currently heavy lifter instances are tagged with information about the build > in concourse it was launched by. In order to facilitate forensics from > metrics, tag the instance with the commit under test. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-7392) Add tag indicating the commit under test to heavy lifters
Sean Goller created GEODE-7392: -- Summary: Add tag indicating the commit under test to heavy lifters Key: GEODE-7392 URL: https://issues.apache.org/jira/browse/GEODE-7392 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Currently heavy lifter instances are tagged with information about the build in concourse it was launched by. In order to facilitate forensics from metrics, tag the instance with the commit under test. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (GEODE-7383) geode-ci concourse resource doesn't care about all of ci directory
[ https://issues.apache.org/jira/browse/GEODE-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-7383: -- Assignee: Sean Goller > geode-ci concourse resource doesn't care about all of ci directory > -- > > Key: GEODE-7383 > URL: https://issues.apache.org/jira/browse/GEODE-7383 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > > Currently the geode-ci concourse resource is constrained to only care about > parts of the ci directory in the repository. Because this resource does not > trigger any jobs directly, it should pay attention to the entire ci directory. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-7383) geode-ci concourse resource doesn't care about all of ci directory
Sean Goller created GEODE-7383: -- Summary: geode-ci concourse resource doesn't care about all of ci directory Key: GEODE-7383 URL: https://issues.apache.org/jira/browse/GEODE-7383 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller Currently the geode-ci concourse resource is constrained to only care about parts of the ci directory in the repository. Because this resource does not trigger any jobs directly, it should pay attention to the entire ci directory. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (GEODE-7353) Memory usage increased in UpgradeTestOpenJDK11 by 20%
[ https://issues.apache.org/jira/browse/GEODE-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959053#comment-16959053 ] Sean Goller commented on GEODE-7353: Attached a dump of the test run. > Memory usage increased in UpgradeTestOpenJDK11 by 20% > - > > Key: GEODE-7353 > URL: https://issues.apache.org/jira/browse/GEODE-7353 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Priority: Major > Attachments: upgrade-test-openjdk-11-build-1099.txt > > > On 9/24/19 between the hours of 9 and 11am PST the memory consumption of this > job jumped by approximately 20%. The log for this run is at: > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/UpgradeTestOpenJDK11/builds/1099] > Be aware this link may be dead in the future. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (GEODE-7353) Memory usage increased in UpgradeTestOpenJDK11 by 20%
[ https://issues.apache.org/jira/browse/GEODE-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller updated GEODE-7353: --- Attachment: upgrade-test-openjdk-11-build-1099.txt > Memory usage increased in UpgradeTestOpenJDK11 by 20% > - > > Key: GEODE-7353 > URL: https://issues.apache.org/jira/browse/GEODE-7353 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Priority: Major > Attachments: upgrade-test-openjdk-11-build-1099.txt > > > On 9/24/19 between the hours of 9 and 11am PST the memory consumption of this > job jumped by approximately 20%. The log for this run is at: > [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/UpgradeTestOpenJDK11/builds/1099] > Be aware this link may be dead in the future. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (GEODE-7353) Memory usage increased in UpgradeTestOpenJDK11 by 20%
Sean Goller created GEODE-7353: -- Summary: Memory usage increased in UpgradeTestOpenJDK11 by 20% Key: GEODE-7353 URL: https://issues.apache.org/jira/browse/GEODE-7353 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller On 9/24/19 between the hours of 9 and 11am PST the memory consumption of this job jumped by approximately 20%. The log for this run is at: [https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/UpgradeTestOpenJDK11/builds/1099] Be aware this link may be dead in the future. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (GEODE-7027) build-google-windows-geode-builder frequently fails to build because of rsync location instability
[ https://issues.apache.org/jira/browse/GEODE-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-7027. Resolution: Fixed > build-google-windows-geode-builder frequently fails to build because of rsync > location instability > -- > > Key: GEODE-7027 > URL: https://issues.apache.org/jira/browse/GEODE-7027 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > The build-google-windows-geode-builder job frequently fails because of > instability surrounding fetching rsync via chocolatey. Get rsync a different > way to resolve this. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Assigned] (GEODE-7027) build-google-windows-geode-builder frequently fails to build because of rsync location instability
[ https://issues.apache.org/jira/browse/GEODE-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-7027: -- Assignee: Sean Goller > build-google-windows-geode-builder frequently fails to build because of rsync > location instability > -- > > Key: GEODE-7027 > URL: https://issues.apache.org/jira/browse/GEODE-7027 > Project: Geode > Issue Type: Bug > Components: ci >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > > The build-google-windows-geode-builder job frequently fails because of > instability surrounding fetching rsync via chocolatey. Get rsync a different > way to resolve this. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (GEODE-7027) build-google-windows-geode-builder frequently fails to build because of rsync location instability
Sean Goller created GEODE-7027: -- Summary: build-google-windows-geode-builder frequently fails to build because of rsync location instability Key: GEODE-7027 URL: https://issues.apache.org/jira/browse/GEODE-7027 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller The build-google-windows-geode-builder job frequently fails because of instability surrounding fetching rsync via chocolatey. Get rsync a different way to resolve this. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (GEODE-6766) Add reaper job for benchmark instances
Sean Goller created GEODE-6766: -- Summary: Add reaper job for benchmark instances Key: GEODE-6766 URL: https://issues.apache.org/jira/browse/GEODE-6766 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Add a job that runs four times a day, which checks for free-roaming benchmark clusters and destroys them. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (GEODE-6735) Remove version number references in classes
[ https://issues.apache.org/jira/browse/GEODE-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-6735: -- Assignee: Sean Goller > Remove version number references in classes > --- > > Key: GEODE-6735 > URL: https://issues.apache.org/jira/browse/GEODE-6735 > Project: Geode > Issue Type: Improvement > Components: client/server >Reporter: Sean Goller >Assignee: Sean Goller >Priority: Major > > There are a number of classes (For example, > org.apache.geode.internal.cache.tier.sockets.command.Get70) that contain > references to specific version numbers unrelated to the class. These should > be renamed to something more related to the protocol or just versioned (Get, > Get1, Get2, etc.) in a way that doesn't reference a product version. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-6735) Remove version number references in classes
Sean Goller created GEODE-6735: -- Summary: Remove version number references in classes Key: GEODE-6735 URL: https://issues.apache.org/jira/browse/GEODE-6735 Project: Geode Issue Type: Improvement Components: client/server Reporter: Sean Goller There are a number of classes (For example, org.apache.geode.internal.cache.tier.sockets.command.Get70) that contain references to specific version numbers unrelated to the class. These should be renamed to something more related to the protocol or just versioned (Get, Get1, Get2, etc.) in a way that doesn't reference a product version. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (GEODE-4806) Replace SimpleTestSecurityManager with SimpleSecurityManager
[ https://issues.apache.org/jira/browse/GEODE-4806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-4806: -- Assignee: Sean Goller > Replace SimpleTestSecurityManager with SimpleSecurityManager > > > Key: GEODE-4806 > URL: https://issues.apache.org/jira/browse/GEODE-4806 > Project: Geode > Issue Type: Task > Components: security >Reporter: Jens Deppe >Assignee: Sean Goller >Priority: Major > Labels: starter > > These classes appear to be the same. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (GEODE-6134) Generate summary of benchmarks result as part of running the benchmarks
[ https://issues.apache.org/jira/browse/GEODE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-6134. Resolution: Fixed > Generate summary of benchmarks result as part of running the benchmarks > --- > > Key: GEODE-6134 > URL: https://issues.apache.org/jira/browse/GEODE-6134 > Project: Geode > Issue Type: Improvement > Components: benchmarks >Reporter: Dan Smith >Assignee: Sean Goller >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > We currently have a separate ./gradlew analyzeRun task. We should generate > the analysis as part of the run_against_baseline.sh script so we don't have > to keep rerunning it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (GEODE-6147) Fail benchmark junit tests if their numbers deviate too far from a baseline
[ https://issues.apache.org/jira/browse/GEODE-6147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-6147: -- Assignee: Sean Goller > Fail benchmark junit tests if their numbers deviate too far from a baseline > --- > > Key: GEODE-6147 > URL: https://issues.apache.org/jira/browse/GEODE-6147 > Project: Geode > Issue Type: Improvement > Components: benchmarks >Reporter: Dan Smith >Assignee: Sean Goller >Priority: Major > > We want to fail tests if performance gets worse. We also want a signal to > create a new baseline if performance gets better, so perhaps we should fail > tests in that case as well. > One way to do this would be to add a new system property to the > TestRunners.defaultRunner() that takes in a baseline directory. The test > itself could compare it's results with the baseline after running and fail if > it deviates too far from the baseline. > Using that, we could a new flag to the benchmark task to pass in that > baseline and cause tests that deviate to fail. > Eg > ./gradlew benchmark -Pbaseline=/some/dir > Acceptance: > run_against_baseline.sh generates a failure report if benchmarks deviate too > far from the baseline. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (GEODE-6134) Generate summary of benchmarks result as part of running the benchmarks
[ https://issues.apache.org/jira/browse/GEODE-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-6134: -- Assignee: Sean Goller > Generate summary of benchmarks result as part of running the benchmarks > --- > > Key: GEODE-6134 > URL: https://issues.apache.org/jira/browse/GEODE-6134 > Project: Geode > Issue Type: Improvement > Components: benchmarks >Reporter: Dan Smith >Assignee: Sean Goller >Priority: Major > > We currently have a separate ./gradlew analyzeRun task. We should generate > the analysis as part of the run_against_baseline.sh script so we don't have > to keep rerunning it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (GEODE-6135) Add benchmarks to geode CI
[ https://issues.apache.org/jira/browse/GEODE-6135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-6135: -- Assignee: Sean Goller (was: Helena Bales) > Add benchmarks to geode CI > -- > > Key: GEODE-6135 > URL: https://issues.apache.org/jira/browse/GEODE-6135 > Project: Geode > Issue Type: Improvement > Components: benchmarks >Reporter: Dan Smith >Assignee: Sean Goller >Priority: Major > Labels: pull-request-available > Time Spent: 2h 20m > Remaining Estimate: 0h > > Add a job to run the benchmarks to https://concourse.apachegeode-ci.info. > Initially this job doesn't need to be on the main tab, it can just output a > comparison of the current develop against a baseline revision of geode. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (GEODE-6170) Create scripts for launching benchmarks in AWS
[ https://issues.apache.org/jira/browse/GEODE-6170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller reassigned GEODE-6170: -- Assignee: Sean Goller > Create scripts for launching benchmarks in AWS > -- > > Key: GEODE-6170 > URL: https://issues.apache.org/jira/browse/GEODE-6170 > Project: Geode > Issue Type: Improvement > Components: benchmarks >Reporter: Dan Smith >Assignee: Sean Goller >Priority: Major > > We have scripts for launching benchmarks in GCP in the geode-benchmarks repo > under infrastructure/google_cloud. We should create scripts to launch > benchmarks in AWS. > These scripts should mirror the google cloud scripts for launching and > destroying clusters. We should refactor out common logic for running tests > and copying results back. > When we launch instances in AWS, we want to use > * Dedicated instances > * Create a new cluster placement group for our nodes and launch them > simultaneously in that group. See > https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/placement-groups.html > * Use an instance size that will give us a dedicated 10Gbit pipe in that > group. c5.9xlarge seems like a good option - see the AWS launch instance > wizard for other options say they gaurantee 10 Gbits/sec if placed into a > placement group. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5916) deploying examples pipeline is broken
Sean Goller created GEODE-5916: -- Summary: deploying examples pipeline is broken Key: GEODE-5916 URL: https://issues.apache.org/jira/browse/GEODE-5916 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller The meta job that deploys the examples pipeline is broken. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (GEODE-5864) Streamline and parameterize concourse environment
[ https://issues.apache.org/jira/browse/GEODE-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-5864. Resolution: Fixed > Streamline and parameterize concourse environment > - > > Key: GEODE-5864 > URL: https://issues.apache.org/jira/browse/GEODE-5864 > Project: Geode > Issue Type: Improvement > Components: ci >Reporter: Sean Goller >Priority: Major > Labels: pull-request-available > Time Spent: 9h 10m > Remaining Estimate: 0h > > In order to simplify stamping out multiple CI environments such as for > developer use, parameterize infrastructure-specific variables and remove > unnecessary vault usage. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5864) Streamline and parameterize concourse environment
Sean Goller created GEODE-5864: -- Summary: Streamline and parameterize concourse environment Key: GEODE-5864 URL: https://issues.apache.org/jira/browse/GEODE-5864 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller In order to simplify stamping out multiple CI environments such as for developer use, parameterize infrastructure-specific variables and remove unnecessary vault usage. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5718) Parameterize concourse host
Sean Goller created GEODE-5718: -- Summary: Parameterize concourse host Key: GEODE-5718 URL: https://issues.apache.org/jira/browse/GEODE-5718 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller In order to allow easier deployment to personal concourse infrastructures, derive the concourse url from a single variable that can be changed on deployment. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (GEODE-5687) Clean up pipeline deployment to better handle forks
[ https://issues.apache.org/jira/browse/GEODE-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-5687. Resolution: Fixed Fix Version/s: 1.8.0 > Clean up pipeline deployment to better handle forks > --- > > Key: GEODE-5687 > URL: https://issues.apache.org/jira/browse/GEODE-5687 > Project: Geode > Issue Type: Improvement > Components: ci >Reporter: Sean Goller >Priority: Major > Labels: pull-request-available > Fix For: 1.8.0 > > Time Spent: 20m > Remaining Estimate: 0h > > The pipeline has a lot of extra stuff in it when deployed against a > non-apache fork. If we are deploying a pipeline that does not track the > apache geode repository, remove unnecessary jobs. > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5694) Remove zip distribution
Sean Goller created GEODE-5694: -- Summary: Remove zip distribution Key: GEODE-5694 URL: https://issues.apache.org/jira/browse/GEODE-5694 Project: Geode Issue Type: Improvement Components: build Reporter: Sean Goller This causes build times to be longer than necessary, and produces a redundant artifact. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5687) Clean up pipeline deployment to better handle forks
Sean Goller created GEODE-5687: -- Summary: Clean up pipeline deployment to better handle forks Key: GEODE-5687 URL: https://issues.apache.org/jira/browse/GEODE-5687 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller The pipeline has a lot of extra stuff in it when deployed against a non-apache fork. If we are deploying a pipeline that does not track the apache geode repository, remove unnecessary jobs. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5664) Start instance script fails if instance somehow already exists
Sean Goller created GEODE-5664: -- Summary: Start instance script fails if instance somehow already exists Key: GEODE-5664 URL: https://issues.apache.org/jira/browse/GEODE-5664 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller When a CI build job involving heavy lifters is executed, if an instance already exists with the same calculated name, the job will fail permanently. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (GEODE-5591) GatewayReceiverImpl.start() retry logic is dependent on JDK's underlying C runtime
[
https://issues.apache.org/jira/browse/GEODE-5591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Goller updated GEODE-5591:
---
Description:
{{org/apache/geode/internal/cache/wan/GatewayReceiverImpl.java:66}} denotes a
string comparison that relies on the specific C runtime that the JDK is run on
top of. This code will misbehave on Alpine Linux (A popular linux distribution
for containers) because it is based on the musl libc, not the GNU libc. The
intent of the code is to throw an exception if the receiver cannot bind to the
requested address. This will not occur if the JDK is compiled against musl
libc. As an aside, the entire retry logic seems suspicious as it only retries
in situations that are static and should not change, so the reason for the code
should be re-evaluated and made more robust and not dependent on native os
information. (was:
org/apache/geode/internal/cache/wan/GatewayReceiverImpl.java:66 denotes a
string comparison that relies on the specific C runtime that the JDK is run on
top of. This code will misbehave on Alpine Linux (A popular linux distribution
for containers) because it is based on the musl libc, not the GNU libc. The
intent of the code is to throw an exception if the receiver cannot bind to the
requested address. This will not occur if the JDK is compiled against musl
libc. As an aside, the entire retry logic seems suspicious as it only retries
in situations that are static and should not change, so the reason for the code
should be re-evaluated and made more robust and not dependent on native os
information.)
> GatewayReceiverImpl.start() retry logic is dependent on JDK's underlying C
> runtime
> --
>
> Key: GEODE-5591
> URL: https://issues.apache.org/jira/browse/GEODE-5591
> Project: Geode
> Issue Type: Bug
> Components: wan
>Reporter: Sean Goller
>Priority: Major
>
> {{org/apache/geode/internal/cache/wan/GatewayReceiverImpl.java:66}} denotes a
> string comparison that relies on the specific C runtime that the JDK is run
> on top of. This code will misbehave on Alpine Linux (A popular linux
> distribution for containers) because it is based on the musl libc, not the
> GNU libc. The intent of the code is to throw an exception if the receiver
> cannot bind to the requested address. This will not occur if the JDK is
> compiled against musl libc. As an aside, the entire retry logic seems
> suspicious as it only retries in situations that are static and should not
> change, so the reason for the code should be re-evaluated and made more
> robust and not dependent on native os information.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (GEODE-5591) GatewayReceiverImpl.start() retry logic is dependent on JDK's underlying C runtime
Sean Goller created GEODE-5591: -- Summary: GatewayReceiverImpl.start() retry logic is dependent on JDK's underlying C runtime Key: GEODE-5591 URL: https://issues.apache.org/jira/browse/GEODE-5591 Project: Geode Issue Type: Bug Components: wan Reporter: Sean Goller org/apache/geode/internal/cache/wan/GatewayReceiverImpl.java:66 denotes a string comparison that relies on the specific C runtime that the JDK is run on top of. This code will misbehave on Alpine Linux (A popular linux distribution for containers) because it is based on the musl libc, not the GNU libc. The intent of the code is to throw an exception if the receiver cannot bind to the requested address. This will not occur if the JDK is compiled against musl libc. As an aside, the entire retry logic seems suspicious as it only retries in situations that are static and should not change, so the reason for the code should be re-evaluated and made more robust and not dependent on native os information. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5580) change test-container image to use alpine instead of debian
Sean Goller created GEODE-5580: -- Summary: change test-container image to use alpine instead of debian Key: GEODE-5580 URL: https://issues.apache.org/jira/browse/GEODE-5580 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller To reduce image size, use alpine for test-container image. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5548) Adjust available ram in heavy lifters
Sean Goller created GEODE-5548: -- Summary: Adjust available ram in heavy lifters Key: GEODE-5548 URL: https://issues.apache.org/jira/browse/GEODE-5548 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Reduce available memory because we don't need as much. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5545) Launch instances in an isolated VPC
Sean Goller created GEODE-5545: -- Summary: Launch instances in an isolated VPC Key: GEODE-5545 URL: https://issues.apache.org/jira/browse/GEODE-5545 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5539) Remove pr tags from all jobs.
Sean Goller created GEODE-5539: -- Summary: Remove pr tags from all jobs. Key: GEODE-5539 URL: https://issues.apache.org/jira/browse/GEODE-5539 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Given the workflow change, we no longer need workers tagged with pr. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5519) Add stackdriver monitoring to heavy-lifters
Sean Goller created GEODE-5519: -- Summary: Add stackdriver monitoring to heavy-lifters Key: GEODE-5519 URL: https://issues.apache.org/jira/browse/GEODE-5519 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller In order to properly gauge resource requirements implement stackdriver monitoring. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5516) Docker image used by gradle should run as geode user
Sean Goller created GEODE-5516: -- Summary: Docker image used by gradle should run as geode user Key: GEODE-5516 URL: https://issues.apache.org/jira/browse/GEODE-5516 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5476) Change pipeline to run all tests in external instances for performance
Sean Goller created GEODE-5476: -- Summary: Change pipeline to run all tests in external instances for performance Key: GEODE-5476 URL: https://issues.apache.org/jira/browse/GEODE-5476 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5449) Create google cloud image suitable for running jobs
Sean Goller created GEODE-5449: -- Summary: Create google cloud image suitable for running jobs Key: GEODE-5449 URL: https://issues.apache.org/jira/browse/GEODE-5449 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller In order to run more complex jobs via concourse, we need a google cloud instance image that can build geode and run tests. Establish the image and a pipeline for building it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5427) Change pr-pipeline jobs to run on separately tagged workers
Sean Goller created GEODE-5427: -- Summary: Change pr-pipeline jobs to run on separately tagged workers Key: GEODE-5427 URL: https://issues.apache.org/jira/browse/GEODE-5427 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller In order to isolate resources used by the PR pipeline, ensure all jobs run on tagged workers. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5380) Add PR pipeline to Geode
Sean Goller created GEODE-5380: -- Summary: Add PR pipeline to Geode Key: GEODE-5380 URL: https://issues.apache.org/jira/browse/GEODE-5380 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Add PR pipeline to Geode that integrates with GitHub pull requests. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5368) Building the CI docker image is unreliable
Sean Goller created GEODE-5368: -- Summary: Building the CI docker image is unreliable Key: GEODE-5368 URL: https://issues.apache.org/jira/browse/GEODE-5368 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller Currently the docker image building process attempts to fetch the docker pgp signing key from the keyservers, which works unreliably. Replace this procedure with the latest from docker, which fetches the key from docker's website directly. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (GEODE-5315) LuceneService.waitForFlushed does not wait if members have been restarted
[ https://issues.apache.org/jira/browse/GEODE-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller updated GEODE-5315: --- Attachment: GeodeLuceneWaitForFlushedTest.java > LuceneService.waitForFlushed does not wait if members have been restarted > - > > Key: GEODE-5315 > URL: https://issues.apache.org/jira/browse/GEODE-5315 > Project: Geode > Issue Type: Bug > Components: lucene >Reporter: Sean Goller >Priority: Major > Attachments: GeodeLuceneWaitForFlushedTest.java > > > We wrote a test that > * puts 10K entries, > * pauses the async event queue > * removes the same entries minus 1 > * Closes the cache in the data stores > * Recreates the cache > * calls LuceneService.waitForFlush > * Does a query to LuceneService ensuring only 1 item is in the cache > This test fails consistently, even though we would expect waitForFlush not to > return until the queue has been fully processed. Running the same test > without closing/recreating the cache succeeds consistently, so there seems to > be an interaction problem between some combination of the queue, cache > lifecycle and waitForFlush. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (GEODE-5315) LuceneService.waitForFlushed does not wait if members have been restarted
[ https://issues.apache.org/jira/browse/GEODE-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508959#comment-16508959 ] Sean Goller commented on GEODE-5315: We attached a class that exhibits the behavior. > LuceneService.waitForFlushed does not wait if members have been restarted > - > > Key: GEODE-5315 > URL: https://issues.apache.org/jira/browse/GEODE-5315 > Project: Geode > Issue Type: Bug > Components: lucene >Reporter: Sean Goller >Priority: Major > Attachments: GeodeLuceneWaitForFlushedTest.java > > > We wrote a test that > * puts 10K entries, > * pauses the async event queue > * removes the same entries minus 1 > * Closes the cache in the data stores > * Recreates the cache > * calls LuceneService.waitForFlush > * Does a query to LuceneService ensuring only 1 item is in the cache > This test fails consistently, even though we would expect waitForFlush not to > return until the queue has been fully processed. Running the same test > without closing/recreating the cache succeeds consistently, so there seems to > be an interaction problem between some combination of the queue, cache > lifecycle and waitForFlush. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5315) LuceneService.waitForFlushed does not wait if members have been restarted
Sean Goller created GEODE-5315: -- Summary: LuceneService.waitForFlushed does not wait if members have been restarted Key: GEODE-5315 URL: https://issues.apache.org/jira/browse/GEODE-5315 Project: Geode Issue Type: Bug Components: lucene Reporter: Sean Goller We wrote a test that * puts 10K entries, * pauses the async event queue * removes the same entries minus 1 * Closes the cache in the data stores * Recreates the cache * calls LuceneService.waitForFlush * Does a query to LuceneService ensuring only 1 item is in the cache This test fails consistently, even though we would expect waitForFlush not to return until the queue has been fully processed. Running the same test without closing/recreating the cache succeeds consistently, so there seems to be an interaction problem between some combination of the queue, cache lifecycle and waitForFlush. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (GEODE-5282) Split DistributedTest into multiple tasks to speed up execution
[ https://issues.apache.org/jira/browse/GEODE-5282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500641#comment-16500641 ] Sean Goller commented on GEODE-5282: To get all the test categories, check `git grep Category | grep -oE "\w+\.class" | sort | uniq` > Split DistributedTest into multiple tasks to speed up execution > --- > > Key: GEODE-5282 > URL: https://issues.apache.org/jira/browse/GEODE-5282 > Project: Geode > Issue Type: Improvement > Components: ci >Reporter: Sean Goller >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Currently Geode's Concourse runs the "distributedTest" gradle task as a > monolithic job. Split the job into multiple tasks that execute portions of > the distributedTest task in parallel to reduce execution time. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5282) Split DistributedTest into multiple tasks to speed up execution
Sean Goller created GEODE-5282: -- Summary: Split DistributedTest into multiple tasks to speed up execution Key: GEODE-5282 URL: https://issues.apache.org/jira/browse/GEODE-5282 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Currently Geode's Concourse runs the "distributedTest" gradle task as a monolithic job. Split the job into multiple tasks that execute portions of the distributedTest task in parallel to reduce execution time. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5243) Fix meta deployment for release branches
Sean Goller created GEODE-5243: -- Summary: Fix meta deployment for release branches Key: GEODE-5243 URL: https://issues.apache.org/jira/browse/GEODE-5243 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller The current meta pipeline can't be deployed properly for release branches. Fix this! -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5130) Refactor pipeline in anticipation of PR pipeline
Sean Goller created GEODE-5130: -- Summary: Refactor pipeline in anticipation of PR pipeline Key: GEODE-5130 URL: https://issues.apache.org/jira/browse/GEODE-5130 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller In order to facilitate the upcoming PR Pipeline functionality, refactor the geode pipeline to be branch-independent, and dry up configuration via templates. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (GEODE-5119) Add spruce to ci docker image
[ https://issues.apache.org/jira/browse/GEODE-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Goller resolved GEODE-5119. Resolution: Fixed > Add spruce to ci docker image > - > > Key: GEODE-5119 > URL: https://issues.apache.org/jira/browse/GEODE-5119 > Project: Geode > Issue Type: Task > Components: ci >Reporter: Sean Goller >Priority: Major > Labels: pull-request-available > Time Spent: 40m > Remaining Estimate: 0h > > In order to do more complex pipelines, we need spruce installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5119) Add spruce to ci docker image
Sean Goller created GEODE-5119: -- Summary: Add spruce to ci docker image Key: GEODE-5119 URL: https://issues.apache.org/jira/browse/GEODE-5119 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller In order to do more complex pipelines, we need spruce installed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (GEODE-5104) CI output git SHA when updating passing reference file.
[ https://issues.apache.org/jira/browse/GEODE-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444286#comment-16444286 ] Sean Goller commented on GEODE-5104: [~amb] It is. > CI output git SHA when updating passing reference file. > --- > > Key: GEODE-5104 > URL: https://issues.apache.org/jira/browse/GEODE-5104 > Project: Geode > Issue Type: Task > Components: ci >Reporter: Sean Goller >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > When concourse updates the file indicating the SHA that has passed all tests, > print it out. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5104) CI output git SHA when updating passing reference file.
Sean Goller created GEODE-5104: -- Summary: CI output git SHA when updating passing reference file. Key: GEODE-5104 URL: https://issues.apache.org/jira/browse/GEODE-5104 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller When concourse updates the file indicating the SHA that has passed all tests, print it out. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-5017) gradle-dockerized-test-plugin fails intermittently
Sean Goller created GEODE-5017: -- Summary: gradle-dockerized-test-plugin fails intermittently Key: GEODE-5017 URL: https://issues.apache.org/jira/browse/GEODE-5017 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller gradle-dockerized-test-plugin is a gradle plugin that allows the user to run tests in parallel via docker containers. Currently CI jobs that run gradle tasks that use this plugin are intermittently failing with a socket exception: java.net.SocketException: No such device (getFlags() failed) Upgrading to gradle 4.2 might resolve this issue. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4891) Update metrics script to account for API change
Sean Goller created GEODE-4891: -- Summary: Update metrics script to account for API change Key: GEODE-4891 URL: https://issues.apache.org/jira/browse/GEODE-4891 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller Concourse changed their API, fix our metrics script to account for it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4835) metrics pipeline jobs don't work
Sean Goller created GEODE-4835: -- Summary: metrics pipeline jobs don't work Key: GEODE-4835 URL: https://issues.apache.org/jira/browse/GEODE-4835 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller python 3 is not installed so the metrics jobs are failing. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4760) CI maintenance fixes needed
Sean Goller created GEODE-4760: -- Summary: CI maintenance fixes needed Key: GEODE-4760 URL: https://issues.apache.org/jira/browse/GEODE-4760 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller We should not trigger the geode resource when ci-only changes are committed. Also, we need to change the docker storage engine to overlay2 from aufs. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4688) Add metrics pipeline
Sean Goller created GEODE-4688: -- Summary: Add metrics pipeline Key: GEODE-4688 URL: https://issues.apache.org/jira/browse/GEODE-4688 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller Add a pipeline that checks the develop pipeline jobs and reports on their success rates and where they fail if applicable. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4676) Activate call stacks capture on all tests
Sean Goller created GEODE-4676: -- Summary: Activate call stacks capture on all tests Key: GEODE-4676 URL: https://issues.apache.org/jira/browse/GEODE-4676 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller Currently callstacks are only captured for AcceptanceTest and DistributedTest. Add callstacks capturing to IntegrationTest and FlakyTests. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4630) Add timestamps to test artifacts
Sean Goller created GEODE-4630: -- Summary: Add timestamps to test artifacts Key: GEODE-4630 URL: https://issues.apache.org/jira/browse/GEODE-4630 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller In order to differentiate between multiple test runs on the same build, use timestamp-based directories to subdivide. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4623) Use openjdk:8 docker image as basis for concourse docker image
Sean Goller created GEODE-4623: -- Summary: Use openjdk:8 docker image as basis for concourse docker image Key: GEODE-4623 URL: https://issues.apache.org/jira/browse/GEODE-4623 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Instead of relying on an intermediate image, build the concourse build docker image directly off of the official openjdk:8 docker image -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4616) Callstack script fails to collect callstack information
Sean Goller created GEODE-4616: -- Summary: Callstack script fails to collect callstack information Key: GEODE-4616 URL: https://issues.apache.org/jira/browse/GEODE-4616 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller The capture_call_stacks.sh script has functional errors that prevent it from capturing callstacks correctly. Fix paths and docker image generation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GEODE-4279) Move DistributedTest to a different worker type
Sean Goller created GEODE-4279: -- Summary: Move DistributedTest to a different worker type Key: GEODE-4279 URL: https://issues.apache.org/jira/browse/GEODE-4279 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller DistributedTest should run on a different worker to give it enough headroom -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GEODE-4265) Add dunit-progress analysis tool to ci docker image
Sean Goller created GEODE-4265: -- Summary: Add dunit-progress analysis tool to ci docker image Key: GEODE-4265 URL: https://issues.apache.org/jira/browse/GEODE-4265 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller In order to faciliate analyzing dunit hangs, add the dunit progress tool to the docker image. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GEODE-4247) Email does not get sent when a unit test takes too long to execute
Sean Goller created GEODE-4247: -- Summary: Email does not get sent when a unit test takes too long to execute Key: GEODE-4247 URL: https://issues.apache.org/jira/browse/GEODE-4247 Project: Geode Issue Type: Bug Components: ci Reporter: Sean Goller If a concourse task hangs and the container is killed, email is not sent out. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GEODE-4185) Create http endpoint that contains the SHA that most recently passed concourse CI
Sean Goller created GEODE-4185: -- Summary: Create http endpoint that contains the SHA that most recently passed concourse CI Key: GEODE-4185 URL: https://issues.apache.org/jira/browse/GEODE-4185 Project: Geode Issue Type: Task Components: ci Reporter: Sean Goller -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (GEODE-4023) Add precheckin tests to concourse pipeline
Sean Goller created GEODE-4023: -- Summary: Add precheckin tests to concourse pipeline Key: GEODE-4023 URL: https://issues.apache.org/jira/browse/GEODE-4023 Project: Geode Issue Type: Improvement Components: ci Reporter: Sean Goller Improve the Geode Concourse pipeline by adding those tests run by the `precheckin` gradle target. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
