[ 
https://issues.apache.org/jira/browse/CASSANDRA-19602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17936424#comment-17936424
 ] 

Michael Semb Wever edited comment on CASSANDRA-19602 at 3/18/25 8:56 AM:
-------------------------------------------------------------------------

> Also we are getting strange errors in upgrade tests.. 

my first assumption is they're network errors (those jenkins agents are 
heterogeneous and around the world), and each split will retry once.  if the 
failure was persistent then the whole pipeline would fail.

under a separate ticket, we could make that code more robust by adding retries 
to the git update command.
{code}

     def clone_development(git_repo, version, verbose=False, alias=False):
         print_(git_repo, version)
         target_dir = directory_name(version)
         assert target_dir
         if 'github' in version:
             git_repo_name, git_branch = 
github_username_and_branch_name(version)
         elif 'local:' in version:
             git_repo_name = 'local_{}'.format(git_repo)  # add git repo 
location to distinguish cache location for differing repos
             git_branch = version.split(':')[-1]  # last token on 'local:...' 
slugs should always be branch name
         elif alias:
             git_repo_name = 
'alias_{}'.format(version.split('/')[0].split(':')[-1])
             git_branch = version.split('/')[-1]
         else:
             git_repo_name = 'apache'
             git_branch = version.split(':', 1)[1]
         local_git_cache = os.path.join(__get_dir(), '_git_cache_' + 
git_repo_name)
  
         logfile = lastlogfilename()
         logger = get_logger(logfile)
  
         try:
             # Checkout/fetch a local repository cache to reduce the number of
             # remote fetches we need to perform:
             if not os.path.exists(local_git_cache):
                 common.info("Cloning Cassandra...")
                 process = subprocess.Popen(
                     ['git', 'clone', '--bare',
                      git_repo, local_git_cache],
                     cwd=__get_dir(), stdout=subprocess.PIPE, 
stderr=subprocess.PIPE)
                 out, _, _ = log_info(process, logger)
                 assert out == 0, "Could not do a git clone"
             else:
                 common.info("Fetching Cassandra updates...")
                 process = subprocess.Popen(
                     ['git', 'fetch', '-fup', 'origin',
                      '+refs/heads/*:refs/heads/*', '+refs/tags/*:refs/tags/*'],
                      cwd=local_git_cache, stdout=subprocess.PIPE, 
stderr=subprocess.PIPE)
                 out, _, _ = log_info(process, logger)
 >               assert out == 0, "Could not update git"
{code}


was (Author: michaelsembwever):
> Also we are getting strange errors in upgrade tests.. 

my first assumption is they're network errors (those jenkins agents are 
heterogeneous and around the world), and each split will retry once.  if the 
failure was persistent then the whole pipeline would fail.

> Test Failure: jvm-dtest-upgrade failing on ClassNotFoundException 
> IsolatedExecutor
> ----------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-19602
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-19602
>             Project: Apache Cassandra
>          Issue Type: Bug
>          Components: CI
>            Reporter: Ekaterina Dimitrova
>            Priority: Normal
>             Fix For: 5.1
>
>
> As seen below plenty of java upgrade tests are failing on trunk:
> https://ci-cassandra.apache.org/job/Cassandra-trunk/1880/#showFailuresLink
> {code:java}
> Tests / jvm-dtest-upgrade jdk11 3/8 / 
> org.apache.cassandra.distributed.upgrade.ClusterMetadataUpgradeHarryTest.simpleUpgradeTest-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 3/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStorageHiddenColumnTest.testHiddenColumnWithCompactStorage-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 3/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityUpgradedCoordinatorTest.testAvailability-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 3/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeReadRepairDeleteTest.mixedModeReadRepairDeleteRow-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 3/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeReadRepairDeleteTest.mixedModeReadRepairDeletePartition-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 3/8 / 
> org.apache.cassandra.distributed.upgrade.UpgradeTest.simpleUpgradeWithNetworkAndGossipTest-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 4/8 / 
> org.apache.cassandra.distributed.upgrade.ClusterMetadataUpgradeHintsTest.upgradeWithHintsTest-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 4/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStorageImplicitNullInClusteringTest.testImplicitNullInClusteringWithCompactStorage-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 4/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeAvailabilityUpgradedReplicaTest.testAvailability-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 4/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeReadRepairWriteTest.mixedModeReadRepairInsert-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 4/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeReadRepairWriteTest.mixedModeReadRepairUpdate-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 5/8 / 
> org.apache.cassandra.distributed.upgrade.ClusterMetadataUpgradeHostIdTest.upgradeHostIdUpdateTest-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 5/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStoragePagingTest.testPagingWithCompactStorage-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 5/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeConsistencyV30Test.testConsistency-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 5/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeRepairTest.testRepairDuringMajorUpgrade-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 6/8 / 
> org.apache.cassandra.distributed.upgrade.ClusterMetadataUpgradeIgnoreHostsTest.upgradeIgnoreHostsTest-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 6/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStoragePagingWithProtocolV40Test.testPagingWithCompactStorageMultipleClusterings-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 6/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStoragePagingWithProtocolV40Test.testPagingWithCompactStorageSingleClustering-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 6/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStoragePagingWithProtocolV40Test.testPagingWithCompactStorageWithoutClustering-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 6/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeFrom3LoggedBatchTest.testSimpleStrategy-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 6/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeTTLOverflowAfterUpgradeTest.testTTLOverflowAfterUpgrade-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 7/8 / 
> org.apache.cassandra.distributed.upgrade.ClusterMetadataUpgradeIgnoreHostTest.upgradeIgnoreHostsTest-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 7/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStoragePagingWithProtocolV41Test.testPagingWithCompactStorageMultipleClusterings-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 7/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStoragePagingWithProtocolV41Test.testPagingWithCompactStorageSingleClustering-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 7/8 / 
> org.apache.cassandra.distributed.upgrade.CompactStoragePagingWithProtocolV41Test.testPagingWithCompactStorageWithoutClustering-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 7/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeFrom3ReplicationTest.testSimpleStrategy-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 7/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeTTLOverflowDuringUpgradeTest.testTTLOverflowDuringUpgrade-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 8/8 / 
> org.apache.cassandra.distributed.upgrade.ClusterMetadataUpgradeTest.simpleUpgradeTest-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 8/8 / 
> org.apache.cassandra.distributed.upgrade.DropCompactStorageNullClusteringValuesTest.testNullClusteringValues-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 8/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeFrom3UnloggedBatchTest.testSimpleStrategy-_jdk11_x86_64
> Tests / jvm-dtest-upgrade jdk11 8/8 / 
> org.apache.cassandra.distributed.upgrade.MixedModeWritetimeOrTTLTest.testWritetimeOrTTLDuringUpgrade-_jdk11_x86_64
> {code}
> It was seen in some of the logs:
> {code:java}
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.cassandra.distributed.impl.IsolatedExecutor
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to