[geode] branch feature/GEODE-6583 deleted (was e25ee55)
This is an automated email from the ASF dual-hosted git repository. bschuchardt pushed a change to branch feature/GEODE-6583 in repository https://gitbox.apache.org/repos/asf/geode.git. was e25ee55 rework failure detectors to prefill their history. Disable suspect initiation on loss of the shared/unordered TCPConduit connection The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
[geode-examples] branch jdbc updated (241fd88 -> 37d664f)
This is an automated email from the ASF dual-hosted git repository. jchen21 pushed a change to branch jdbc in repository https://gitbox.apache.org/repos/asf/geode-examples.git. from 241fd88 Add JDBC Connector Diagram add 37d664f Skip image files for license checking No new revisions were added by this update. Summary of changes: gradle/rat.gradle | 3 +++ 1 file changed, 3 insertions(+)
[geode] branch develop updated (f1df27b -> 6b34a5f)
This is an automated email from the ASF dual-hosted git repository. onichols pushed a change to branch develop in repository https://gitbox.apache.org/repos/asf/geode.git. from f1df27b add retry macro to all create-instance locations add 6b34a5f change number of attempts for PR jobs from 100 to 10 to match main pipeline No new revisions were added by this update. Summary of changes: ci/pipelines/pull-request/jinja.template.yml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[geode] branch develop updated (1210320 -> 117a27d)
This is an automated email from the ASF dual-hosted git repository. nnag pushed a change to branch develop in repository https://gitbox.apache.org/repos/asf/geode.git. from 1210320 Revert "GEODE-6144 use version of concourse-pipeline-resource that has fix for large number of pipelines" add 117a27d GEODE-6719 : Handling default disktore request from AppServers (#3516) No new revisions were added by this update. Summary of changes: extensions/geode-modules/build.gradle | 2 +- .../geode/modules/util/CreateRegionFunction.java | 45 +++- .../apache/geode/modules/util/RegionHelper.java| 2 +- .../util/CreateRegionFunctionJUnitTest.java| 291 + .../cache/xmlcache/RegionAttributesCreation.java | 1 + 5 files changed, 338 insertions(+), 3 deletions(-) create mode 100644 extensions/geode-modules/src/test/java/org/apache/geode/modules/util/CreateRegionFunctionJUnitTest.java
[geode] branch develop updated: add retry macro to all create-instance locations
This is an automated email from the ASF dual-hosted git repository. rhoughton pushed a commit to branch develop in repository https://gitbox.apache.org/repos/asf/geode.git The following commit(s) were added to refs/heads/develop by this push: new f1df27b add retry macro to all create-instance locations f1df27b is described below commit f1df27bc45dcff604eae25d8827b1d7d2eb5838a Author: Robert Houghton AuthorDate: Mon May 6 10:15:07 2019 -0700 add retry macro to all create-instance locations --- ci/pipelines/examples/jinja.template.yml | 6 ++ ci/pipelines/geode-build/jinja.template.yml | 10 ++ ci/pipelines/pull-request/jinja.template.yml | 5 + 3 files changed, 21 insertions(+) diff --git a/ci/pipelines/examples/jinja.template.yml b/ci/pipelines/examples/jinja.template.yml index 3e70e61..dabbdff 100644 --- a/ci/pipelines/examples/jinja.template.yml +++ b/ci/pipelines/examples/jinja.template.yml @@ -17,6 +17,7 @@ {% from 'shared_jinja.yml' import alpine_tools_config with context %} {% from 'shared_jinja.yml' import github_access with context %} +{% from 'shared_jinja.yml' import init_retry with context %} {% macro common_instance_params(test) -%} GCP_PROJECT: ((gcp-project)) @@ -84,6 +85,7 @@ jobs: trigger: true - do: - put: concourse-metadata-resource + {{ init_retry()|indent(6) }} - task: create_instance {{ alpine_tools_config()|indent(8) }} params: @@ -95,8 +97,12 @@ jobs: inputs: - name: concourse-metadata-resource - name: geode-ci + - name: attempts-log +path: old outputs: - name: instance-data + - name: attempts-log +path: new timeout: 15m attempts: 10 - task: rsync_code_up diff --git a/ci/pipelines/geode-build/jinja.template.yml b/ci/pipelines/geode-build/jinja.template.yml index c5f16b5..40d4bee 100644 --- a/ci/pipelines/geode-build/jinja.template.yml +++ b/ci/pipelines/geode-build/jinja.template.yml @@ -421,6 +421,7 @@ jobs: {{ all_gating_jobs() | indent(6) }} - do: - put: concourse-metadata-resource + {{ init_retry()|indent(6) }} - task: create_instance {{- alpine_tools_config()|indent(8) }} params: @@ -433,8 +434,12 @@ jobs: inputs: - name: concourse-metadata-resource - name: geode-ci + - name: attempts-log +path: old outputs: - name: instance-data + - name: attempts-log +path: new timeout: 15m attempts: 10 - task: rsync_code_up @@ -490,6 +495,7 @@ jobs: - put: concourse-metadata-resource - aggregate: - do: +{{ init_retry()|indent(8) }} - task: create_instance-{{java_test_version.name}} {{- alpine_tools_config()|indent(10) }} params: @@ -503,9 +509,13 @@ jobs: inputs: - name: concourse-metadata-resource - name: geode-ci +- name: attempts-log + path: old outputs: - name: instance-data-{{java_test_version.name}} path: instance-data +- name: attempts-log + path: new timeout: 15m attempts: 10 - task: rsync_code_up-{{java_test_version.name}} diff --git a/ci/pipelines/pull-request/jinja.template.yml b/ci/pipelines/pull-request/jinja.template.yml index 1d2e50e..d7d9d4a 100644 --- a/ci/pipelines/pull-request/jinja.template.yml +++ b/ci/pipelines/pull-request/jinja.template.yml @@ -229,6 +229,7 @@ jobs: get_params: {skip_download: true} - do: - put: concourse-metadata-resource +{{ init_retry()|indent(8) }} - task: create_instance-{{java_test_version.name}} {{- alpine_tools_config()|indent(10) }} params: @@ -245,8 +246,12 @@ jobs: - name: concourse-metadata-resource - name: geode - name: geode-ci +- name: attempts-log + path: old outputs: - name: instance-data +- name: attempts-log + path: new timeout: 15m attempts: 100 - task: rsync_code_up-{{java_test_version.name}}
[geode] branch develop updated (0e342fd -> 1210320)
This is an automated email from the ASF dual-hosted git repository. onichols pushed a change to branch develop in repository https://gitbox.apache.org/repos/asf/geode.git. from 0e342fd GEODE-6670: remove getCacheServers allocation add 1210320 Revert "GEODE-6144 use version of concourse-pipeline-resource that has fix for large number of pipelines" No new revisions were added by this update. Summary of changes: ci/pipelines/meta/jinja.template.yml | 1 - 1 file changed, 1 deletion(-)
[geode-examples] branch jdbc updated (1fea152 -> 241fd88)
This is an automated email from the ASF dual-hosted git repository. jchen21 pushed a change to branch jdbc in repository https://gitbox.apache.org/repos/asf/geode-examples.git. from 1fea152 Add JDBC Connector example. add 241fd88 Add JDBC Connector Diagram No new revisions were added by this update. Summary of changes: jdbc/README.md | 2 ++ jdbc/connector.svg | 1 + 2 files changed, 3 insertions(+) create mode 100644 jdbc/connector.svg
[geode] branch develop updated: GEODE-6670: remove getCacheServers allocation
This is an automated email from the ASF dual-hosted git repository. dschneider pushed a commit to branch develop in repository https://gitbox.apache.org/repos/asf/geode.git The following commit(s) were added to refs/heads/develop by this push: new 0e342fd GEODE-6670: remove getCacheServers allocation 0e342fd is described below commit 0e342fd3515e92a99c44bd05c661624d180045dd Author: Darrel Schneider AuthorDate: Mon May 6 09:08:26 2019 -0700 GEODE-6670: remove getCacheServers allocation getCacheServers now returns a canonical instance instead of creating a new instance for each call. --- .../java/org/apache/geode/internal/cache/GemFireCacheImpl.java| 7 ++- .../org/apache/geode/internal/cache/GemFireCacheImplTest.java | 8 2 files changed, 14 insertions(+), 1 deletion(-) diff --git a/geode-core/src/main/java/org/apache/geode/internal/cache/GemFireCacheImpl.java b/geode-core/src/main/java/org/apache/geode/internal/cache/GemFireCacheImpl.java index 53211a5..a512b76 100755 --- a/geode-core/src/main/java/org/apache/geode/internal/cache/GemFireCacheImpl.java +++ b/geode-core/src/main/java/org/apache/geode/internal/cache/GemFireCacheImpl.java @@ -397,6 +397,11 @@ public class GemFireCacheImpl implements InternalCache, InternalClientCache, Has * outnumber the mutative operations such as add, remove. */ private final List allCacheServers = new CopyOnWriteArrayList<>(); + /** + * Unmodifiable view of "allCacheServers". + */ + private final List unmodifiableAllCacheServers = + Collections.unmodifiableList(allCacheServers); /** * Controls updates to the list of all gateway senders @@ -3957,7 +3962,7 @@ public class GemFireCacheImpl implements InternalCache, InternalClientCache, Has @Override public List getCacheServers() { -return Collections.unmodifiableList(allCacheServers); +return this.unmodifiableAllCacheServers; } @Override diff --git a/geode-core/src/test/java/org/apache/geode/internal/cache/GemFireCacheImplTest.java b/geode-core/src/test/java/org/apache/geode/internal/cache/GemFireCacheImplTest.java index 246e757..6a3546f 100644 --- a/geode-core/src/test/java/org/apache/geode/internal/cache/GemFireCacheImplTest.java +++ b/geode-core/src/test/java/org/apache/geode/internal/cache/GemFireCacheImplTest.java @@ -554,6 +554,14 @@ public class GemFireCacheImplTest { assertThat(value).isFalse(); } + @Test + public void getCacheServersIsCanonical() { +gemFireCacheImpl = createGemFireCacheImpl(); +List list1 = gemFireCacheImpl.getCacheServers(); +List list2 = gemFireCacheImpl.getCacheServers(); +assertThat(list1).isSameAs(list2); + } + private static GemFireCacheImpl createGemFireCacheImpl() { return (GemFireCacheImpl) new InternalCacheBuilder().create(Fakes.distributedSystem()); }
[geode] 01/02: GEODE-6739: Create Concourse heavy-lift workers in the current zone
This is an automated email from the ASF dual-hosted git repository. rhoughton pushed a commit to branch develop in repository https://gitbox.apache.org/repos/asf/geode.git commit 1e46eeda20b1a28ac85d28791108f5c7d80bbdf3 Author: Robert Houghton AuthorDate: Fri May 3 13:02:14 2019 -0700 GEODE-6739: Create Concourse heavy-lift workers in the current zone GCP costs are incurred on data egress between zones, even the same region. Track our `create-instance` attempts, to put the heavy lifter in the same zone on the first attempt, and roulette only on failure Co-authored-by: Robert Houghton Co-authored-by: Helena Bales --- ci/pipelines/geode-build/jinja.template.yml | 6 ++ ci/pipelines/pull-request/jinja.template.yml | 6 ++ ci/pipelines/shared/shared_jinja.yml | 10 ++ ci/scripts/create_instance.sh| 18 ++ 4 files changed, 36 insertions(+), 4 deletions(-) diff --git a/ci/pipelines/geode-build/jinja.template.yml b/ci/pipelines/geode-build/jinja.template.yml index 4ea7643..c5f16b5 100644 --- a/ci/pipelines/geode-build/jinja.template.yml +++ b/ci/pipelines/geode-build/jinja.template.yml @@ -18,6 +18,7 @@ {% from 'shared_jinja.yml' import alpine_tools_config with context %} {% from 'shared_jinja.yml' import pipeline_prefix with context %} {% from 'shared_jinja.yml' import github_access with context %} +{% from 'shared_jinja.yml' import init_retry with context %} --- @@ -224,6 +225,7 @@ jobs: pre: ((semver-prerelease-token)) - do: - put: concourse-metadata-resource + {{ init_retry()|indent(6) }} - task: create_instance {{- alpine_tools_config()|indent(8) }} params: @@ -234,9 +236,13 @@ jobs: run: path: geode-ci/ci/scripts/create_instance.sh inputs: + - name: attempts-log +path: old - name: concourse-metadata-resource - name: geode-ci outputs: + - name: attempts-log +path: new - name: instance-data timeout: 15m attempts: 10 diff --git a/ci/pipelines/pull-request/jinja.template.yml b/ci/pipelines/pull-request/jinja.template.yml index bcec2a1..1d2e50e 100644 --- a/ci/pipelines/pull-request/jinja.template.yml +++ b/ci/pipelines/pull-request/jinja.template.yml @@ -17,6 +17,7 @@ {% from 'shared_jinja.yml' import alpine_tools_config with context %} {% from 'shared_jinja.yml' import pipeline_prefix with context %} +{% from 'shared_jinja.yml' import init_retry with context %} groups: - name: main @@ -87,6 +88,7 @@ jobs: get_params: {skip_download: true} - do: - put: concourse-metadata-resource +{{ init_retry()|indent(8) }} - task: create_instance {{- alpine_tools_config()|indent(10) }} params: @@ -103,8 +105,12 @@ jobs: - name: concourse-metadata-resource - name: geode - name: geode-ci +- name: attempts-log + path: old outputs: - name: instance-data +- name: attempts-log + path: new timeout: 15m attempts: 100 - task: rsync_code_up diff --git a/ci/pipelines/shared/shared_jinja.yml b/ci/pipelines/shared/shared_jinja.yml index 5c2d80e..080e411 100644 --- a/ci/pipelines/shared/shared_jinja.yml +++ b/ci/pipelines/shared/shared_jinja.yml @@ -38,3 +38,13 @@ username: ((github-username)) password: ((github-password)) {%- endif %} {%- endmacro %} + +{%- macro init_retry() -%} +- task: initial-output + {{- docker_config()|indent(2) }} +outputs: +- name: attempts-log +run: + path: touch + args: ['attempts-log/attempts'] +{%- endmacro %} \ No newline at end of file diff --git a/ci/scripts/create_instance.sh b/ci/scripts/create_instance.sh index 27692ff..02cc769 100755 --- a/ci/scripts/create_instance.sh +++ b/ci/scripts/create_instance.sh @@ -59,10 +59,6 @@ if [[ "${SANITIZED_BUILD_JOB_NAME}" =~ [Ww]indows ]]; then WINDOWS_PREFIX="windows-" fi -PERMITTED_ZONES=(us-central1-a us-central1-b us-central1-c us-central1-f) -ZONE=${PERMITTED_ZONES[$((${RANDOM} % 4))]} -echo "Deploying to zone ${ZONE}" - INSTANCE_NAME_STRING="${BUILD_PIPELINE_NAME}-${BUILD_JOB_NAME}-build${JAVA_BUILD_VERSION}-test${JAVA_TEST_VERSION}-job#${BUILD_NAME}" INSTANCE_NAME="heavy-lifter-$(uuidgen -n @dns -s -N "${INSTANCE_NAME_STRING}")" @@ -77,6 +73,20 @@ GCP_NETWORK=${GCP_NETWORK##*/} GCP_SUBNETWORK=$(echo ${NETWORK_INTERFACE_INFO} | jq -r '.networkInterfaces[0].subnetwork') GCP_SUBNETWORK=${GCP_SUBNETWORK##*/} +# Determine and store our attempt number +cp old/attempts new/ +echo attempt >> new/attempts +attempts=$(cat new/attempts | wc -l) +echo $attempts > /tmp/retry_number + +if [ $attempts -eq 1 ]; then + ZONE=${MY_ZONE} +else + PERMITTED_ZONES=(us-central1-a us-central1-b us-central1-c us-central1-f) +
[geode] 02/02: Removing unused file per PR comments.
This is an automated email from the ASF dual-hosted git repository. rhoughton pushed a commit to branch develop in repository https://gitbox.apache.org/repos/asf/geode.git commit 4a84bcf4d3924707dab91d72ebe917ddb87193d3 Author: Helena Bales AuthorDate: Mon May 6 08:51:29 2019 -0700 Removing unused file per PR comments. Co-authored-by: Robert Houghton Co-authored-by: Helena Bales --- ci/scripts/create_instance.sh | 1 - 1 file changed, 1 deletion(-) diff --git a/ci/scripts/create_instance.sh b/ci/scripts/create_instance.sh index 02cc769..db9476e 100755 --- a/ci/scripts/create_instance.sh +++ b/ci/scripts/create_instance.sh @@ -77,7 +77,6 @@ GCP_SUBNETWORK=${GCP_SUBNETWORK##*/} cp old/attempts new/ echo attempt >> new/attempts attempts=$(cat new/attempts | wc -l) -echo $attempts > /tmp/retry_number if [ $attempts -eq 1 ]; then ZONE=${MY_ZONE}
[geode] branch develop updated (aa63083 -> 4a84bcf)
This is an automated email from the ASF dual-hosted git repository. rhoughton pushed a change to branch develop in repository https://gitbox.apache.org/repos/asf/geode.git. from aa63083 GEODE-6687: replace ByteArrayInputStream+DataInputStream with ByteArrayDataInput (#3547) new 1e46eed GEODE-6739: Create Concourse heavy-lift workers in the current zone new 4a84bcf Removing unused file per PR comments. The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: ci/pipelines/geode-build/jinja.template.yml | 6 ++ ci/pipelines/pull-request/jinja.template.yml | 6 ++ ci/pipelines/shared/shared_jinja.yml | 10 ++ ci/scripts/create_instance.sh| 17 + 4 files changed, 35 insertions(+), 4 deletions(-)