We're running Cassandra 3.11.6 on AWS EC2 instances. These clusters have been running for a few years.
We're suddenly noticing now that on one of our clusters the nodetool command is failing on certain nodes but not on others. The failure: nodetool: Failed to connect to '...:7199' - SecurityException: 'Access denied! Invalid access level for requested MBeanServer operation.'. I suspect that this stems from some colleague I'm not in coordination with recently doing some security upgrades, but that's a bit of an academic matter for now. I've compared the jmxremote.access and jvm.options files on a host where nodetool is not working vs. a host where nodetool is working, and no meaningful differences. Any ideas? The interesting aspect of this problem is that it is occurring on some nodes in the one cluster but not others. I'll update on this thread if I find any solutions on my end.