This is an automated email from the ASF dual-hosted git repository.
maxyang pushed a change to branch sync-with-upstream
in repository https://gitbox.apache.org/repos/asf/cloudberry-gpbackup.git
at 78ca035 Revert "Revert "Change MEMORY_LIMIT to MEMORY_QUOTA in end to
end test for gp7""
This branch includes the following new commits:
new 0a53f73 Allow resize tests to work on multi-node clusters
new 64c0647 Add additional plugin tests to improve coverage
new dd70f71 Convert for backup history to use a sqlite database
new 39fc198 Wrap array access in version check to prevent panics
new 9f917f3 Add migrate-history command to backward-compatibility e2e test
new b9962be Update CI - build per platform, update images, remove GPDB4
and SLES
new 2c7b110 Add integration test for negative partition values
new 11e6b9d Skip negative index test on gpdb5 and earlier
new 72c45d1 Move CI artifacts to GCS, upload all published files
new 63133a1 Fix release pipeline bug in push-to-github
new 2479749 Update all dependencies for Go 1.19
new d9c634b Prevent trampling existing EndTime values on backup records
new aa5b255 Remove foreign key constraint on restore_plan_timestamp
new 0e2cd01 Remove malformed backup history config test
new 024fcfc Remove multiple triggers on build_gppkgs job
new 4f2b8fa Add a history migration to incremental test with old binaries
new c0fe5d1 Repair regression pipeline
new c33a9c7 Add a --no-history backup flag
new 6843468 Log a warning if legacy backup history file is still present.
new 4e3e53a Refactor restore plan historydb schema
new 4835b6e Support refactored resource groups for GPDB7
new 66548cf Update test of view definitions for GPDB7
new 5bde820 Update test strings for storageOpts and formatter
new 69f4aa4 Prefer to use gpsync to install gpbackup if it is available
new 5939227 Uncomment anti-hang code in e2e test suite
new 71a806c Correct quote foreign server name in CREATE FOREIGN TABLE
new 2f8fa5b Cleanup pg_catalog
new 5f1ddda Add explicit history migration for old backup version in e2e
test
new 12e5155 Reorder migration in new incremental tests
new 43be317 Tweak log message for migration reminder
new e6c0cd4 Do not consider deleted backups when looking for most recent
match
new cf1af7d Update branding in user-facing locations
new 1881e99 Green gate put cannot be in parallel with the gets
new 84a5300 Fix typo in update-metadata scripts
new 7253ab9 Modify filepath to be able to work with mirrors
new 8a17485 Remove TestExecutorMultiple
new c5c177f Add segment_count field to backup history database
new 9ef4afd Under certain flags, place timestamp+pid lockfile in
backup-dir
new 78bfb34 Update datadomain Vault vars
new 4f30f34 Add skip to an end to end test
new fcd0c6c Update CI artifact names
new fada3b6 Add test for delete_replica
new 8addcac Reorganize writes to history file
new 5b570d7 Handle panics from goroutines
new 60430ba Set gp_quicklz_fallback GUC for GPDB7+
new fc807b0 Fix cleanup calls in plugin_test.sh
new 2dfcba5 Add a plugin cleanup job to our CI
new d97ffef Fix hang caused by piped copy commands failing
new 7346404 Add test coverage for BackupAllTableData
new 9473841 Don't print "no data" warning for metadata-only backups
new b290ade Fix filtering of tables with inheritance
new b28ae00 Update test coverage script
new 11ff552 Fix expected error message in test
new 3b3ebcf Make directories for taking local lockfiles
new d2bb78a Update gpbackup CI to use gppkg_v2
new 9becc93 Handle missing SegmentCount for non-resize restore
new 98c7d82 restore_helper: handle files with dots in the name
new 0ec0250 Improve BackupDataForAllTables
new 5987f5f Add missing get statement to regression pipeline
new e444cc5 Update layout of the gpbackup builds
new efb42ca Fix regression pipeline usage of gppgkv2
new 8bdcb48 Change "no-inherit" flag to "no-inherits"
new f624469 Change how we install dummy_seclabel in local CI
new 3952a05 Rework the data backup test to handle flakes
new aa96aba Refactor ENXIO timeout for restore_helper agents
new f5f3f7e Remove prodataaccess for GP7 and above
new 657173c Allow gen_pipeline.py to support python2 or python3
new 81507af Reduce CI flakiness
new c0e3e66 Move ginkgorecover call
new d5eb8bc Update tests to support gp_toolkit extension
new 4a7cfb4 Fix statistics tests for GP7
new 8439916 Modify partition filtering behavior
new 0896ede Don't fail if unable to write a restore report
new d1774c9 Prevent report test flakes due to test pollution
new 0990667 Improve end-to-end test cleanup
new 11de4b5 Update resource group parameters for GPDB 7
new 9c0ac44 Explicitly create gp_toolkit in end-to-end tests
new ed05d39 Ignore public.legacy_enum in plugin tests
new 3f48845 Don't fail if unable to write an error file
new 61acef3 Fix extension tests for GPDB 7
new 7d11d77 Correctly restore tables with inherited generated columns
new 75c446d Increase test flake attempts for different size cluster
restores
new 8431432 Switch from ubuntu18.04 to ubuntu20.04
new 32672aa Add migration testing to our CI
new e4ff1f2 Update regression test artifacts
new a93f6c2 Correct the end time printed to the report file
new b2d05d1 Remove ENXIO timeout in restore agent
new 2c02f22 Refactor attribute inheritance check
new 2d36bd5 Only include table names in error_tables_metadata
new 315ce75 Update release notes URL to new format
new c905f11 Update scale perf CI
new 95fcd92 Update gpbackup-release pipeline
new 0731579 Update gen_pipeline.py
new 67405dc Implement --report-dir option for gprestore
new c82d6e5 Simplify UserSpecifiedReportDir handling. Change flag
description.
new 602d45e Modify backup directory hierarchy
new 50a22ab Remove report directory hierarchy
new 15f7265 Allow single backups to be restored without --timestamp
new 7833212 Improve name handling for table filters
new d1ced13 Update restore CI job filepath
new 3910fbf Clean up images and platform versions for ci pipeline
new f8125b4 Remove gpdb6-ubuntu test job
new 73ba6cb Rename setup-centos-env to setup-cluster-env
new 4ee50f1 Clean up defaults in regression pipeline
new 55adfda Remove unused integration test files
new c4fab02 Improve performance of index rename query
new 1fd96b2 Improve GetConstraints performance
new d291766 Point CI at DP Concourse by default
new 5b0083a Changing CLA in CONTRIBUTING.md
new 501eb8f Update gp7 external table query
new 6f71685 Add granular COPY progress reporting for GPDB 7
new 7a2ad0c Improve schema renaming for --redirect-schema
new 4f50aed Add database name to report email
new d011982 Pend logerrpersist test for now
new 1fe4006 Update object types and parallel metadata restore
new b061a47 Alter behavior of no-inherits
new 80ad058 Fix bug in redirect-schema processing
new 56fe710 Add table filters to index rename query
new 1c59908 Update gppkg name
new 78b5fb0 Add single quote escape for retrieving oid
new cd49dd4 Update scale ci to fix version issues
new c4528a5 Convert index name exchange to go code
new 6b5768f Require backup-dir if timestamp is not provided
new 5e6ee78 Update slack-alert url to work for any Concourse deployment
new 016ae26 Refactor ddboost cleanup job
new 8c64faf Drop fillfactor from storageopts for AO tables
new d8dee03 Restore perf for GPDB7 with progress bars
new 08339c0 Fix unfinished copy progress bars
new 0409a83 Add mutex sync to Tx Map
new a5417fc Add rhel9 support to gpbackup pipeline
new 40b028f Do not install zstd for test vms
new f0101dc Add final_published_file_tar_rhel9
new 044ec2f Always clean up helper processes
new 619ddd4 Improve gpbackup_manager test coverage
new e219048 Pipeline fixes
new c0fc98b Upgrade golang dependencies
new 6bb94bd Add support for section-based backup and restore
new aded5d0 Fix bugs in new directory structure
new 49900a5 Set gpdb7 test tasks to run in parallel
new 28894a5 Remove RHEL6 from CI
new a834c0c Explicitly create extension schemas when needed
new 32effa3 Fix some bugs in sections code
new a0deb6b Clean pipeline trigger conditions
new 6bf066f Restore original backup-dir structure as default
new 2badf71 Remove commented regex for file checking
new 42fffe4 Pin gpdb6 rocky8 CI image
new 448eb06 Modify weekly pipeline trigger times
new c2ca733 Revert "Pin gpdb6 rocky8 CI image"
new 710fe53 Regression test maintenance
new 9bfcf06 Use type TABLE when printing GRANT statements for views
new e483470 Update dependencies
new 2b9d2df Add attempts to 7-seg cluster tests
new a8b9790 Revert "Fix some bugs in sections code"
new 77fc94c Revert "Add support for section-based backup and restore"
new 3f36dd9 README: update integration test requirements
new defa05d Move constraints back to postdata for data load performance
new 0c22043 Integration: fix example plugin integration test to use
relative paths
new 92245fe End_to_end: fix example plugin end_to_end test to use
relative paths
new 8a02587 End_to_end: stop printing gpbackup/gprestore output
new 80c4931 Revert "Add granular COPY progress reporting for GPDB 7"
new d3c0473 Preinitialize entire channel map before using it in parallel
restore.
new 6a2fd27 Add mutex to progress bar for concurrency safe incrementing
new e896249 Fix parallel restore of non-sortable statements
new 10c5578 Allow restore of tables distributed by enum
new 2930dcd Skip localhost in copyPluginToAllHosts e2e test func
new 2782cd0 Remove GPDB4 codepaths
new 84c2a9f Partial revert "Fix cleanup calls in plugin_test.sh"
new 7ee5d93 Reasonable memory restrictions when running local minio s3
plugin test
new cabb4e8 CI: test s3 plugin using minio
new 2d3de3b Bumped pgx to v4.18.2, updated indirect dependencies
new 3177ac5 Properly dump GRANT statements for aggregate functions
new d67189a Add GRANT statements to aggregate test
new 4bb5bb7 Fix ginkgo version mismatch warning
new af19cd8 Filter out false errors for regression test
new 0efbfd8 Restrict mkfifo permissions to 0700
new 2b0ffa5 Add retries to cleanup functions
new 12bca9e e2e tests allow checking gpbackup stdout
new 6017a70 Add assertHelperCleanupLogged for e2e tests
new 5a3e122 end_to_end_suite_test.go formatting
new a4fcdf2 Renable 9-segment resize and add new end_to_end resize
restore test
new 2142387 Revamp restore pipe logic to use unique pipe names with batch
number
new f1b46ab fix helper integration tests after restore pipes revamp
new 10ca3f4 create skip file after each failed COPY command
new 4371a94 Always write nil byte before flushing pipe and log error file
creation
new f3419d6 Always check if the restore_helpers are alive before issuing
a COPY
new 7f89ed1 Check for agent errors before a copy happens
new 07fae4c Close file readers during resize restore
new 3a50066 Remove test flake reattempts around resize cluster and signal
handling
new 48f722e Remove unused gpbackup_helper --replicated-file flag
new 90ef008 Use different find command syntax for MacOS vs Linux
new 909d87f Remove go func to prevent resize cluster test hangs
new ed1cb23 Stabilize signal handler tests
new 8f421b5 Update dependencies
new fe1b976 SetLogFileVerbosity for all utilities
new 722899a Move some logs to Info or Progress so they will always show
new f20d259 Re-enable enum tests for GP7
new 1926921 Fix cleanup commands to run on mac
new 36e1bf0 Combine functions to cleanup helper files and pipes
new 3b025b3 Adjust signal handler test timing
new b1997fe Check wasTerminated more and wait for cleanup to finish always
new e6e706a Remove extra `cat -` command for restore COPY program
new 0fb4a30 Only do one batch for replicated tables on gprestore side
new 8335cfa Change MEMORY_LIMIT to MEMORY_QUOTA in end to end test for gp7
new 3301ac8 Revert "Change MEMORY_LIMIT to MEMORY_QUOTA in end to end
test for gp7"
new 65853d7 Check for "Cleanup complete" in tests
new 5dc476e Replace backoff while waiting for pipe with short static sleep
new a379159 Enable verbose logging for end to end gprestore commands
new 89daab1 Modify scale test data to better exercise discovered slowdown
new 9344de8 Move Progress log to gpbackup
new 78ca035 Revert "Revert "Change MEMORY_LIMIT to MEMORY_QUOTA in end to
end test for gp7""
The 210 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cloudberry.apache.org
For additional commands, e-mail: commits-h...@cloudberry.apache.org
