Sometime when updated NVidia driver and CUDA on Rocky Linux systems, running nvidia-smi shows that kernel driver version mismatch. If you run dmseg It will show: NVRM: API mismatch: the client has the version aaa.bbb, butNVRM: this kernel module has the version ccc.ddd. PleaseNVRM: make sure that this kernel module and all NVIDIA driverNVRM: components […]

This sometimes happen when the automatic nvidia kernel module installation fails. The workaround is:

First, use rpm -q gpg-pubkey –qf ‘%{NAME}-%{VERSION}-%{RELEASE}\t%{SUMMARY}\n’ to identify keys from obsolete repositories, then use rpm -e gpg-pubkey-xxxxxxxx-yyyyyyyy to remove the keys that were imported from the SHA1 era. Then have the offending packages removed by rpm -q –nosignature –querybynumber xxxx where you can get the xxxx from the stderr messages from rpm -qa >/dev/null