{"id":770,"date":"2025-04-28T15:31:28","date_gmt":"2025-04-28T20:31:28","guid":{"rendered":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/?p=770"},"modified":"2025-04-28T15:31:28","modified_gmt":"2025-04-28T20:31:28","slug":"nvidia-smi-shows-api-mismatch","status":"publish","type":"post","link":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/?p=770","title":{"rendered":"NVidia-smi shows API mismatch"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Sometime when updated NVidia driver and CUDA on Rocky Linux systems, running nvidia-smi shows that kernel driver version mismatch.  If you run<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">dmseg<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It will show:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">NVRM: API mismatch: the client has the version aaa.bbb, but<br>NVRM: this kernel module has the version ccc.ddd. Please<br>NVRM: make sure that this kernel module and all NVIDIA driver<br>NVRM: components have the same version.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And aaa.bbb is not the same with ccc.ddd.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This happens that the corresponding nvidia driver was not properly registered by dkms.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Other solution suggested to reboot the server, reinstall drivers, recreate initramfs, and rmmod of corresponding nvidia mods.  These methods sometimes works.  When they are all not working, you can try<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">dkms install -m nvidia -v 570.144<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">where replacing 570.144 to your most recent installed nvidia driver version.  Then reboot the server.  This should work.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sometime when updated NVidia driver and CUDA on Rocky Linux systems, running nvidia-smi shows that kernel driver version mismatch. If you run dmseg It will show: NVRM: API mismatch: the client has the version aaa.bbb, butNVRM: this kernel module has the version ccc.ddd. PleaseNVRM: make sure that this kernel module and all NVIDIA driverNVRM: components [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21,3],"tags":[],"class_list":["post-770","post","type-post","status-publish","format-standard","hentry","category-computer-tips","category-mri-technical-support","post-blog"],"_links":{"self":[{"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=\/wp\/v2\/posts\/770","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=770"}],"version-history":[{"count":1,"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=\/wp\/v2\/posts\/770\/revisions"}],"predecessor-version":[{"id":771,"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=\/wp\/v2\/posts\/770\/revisions\/771"}],"wp:attachment":[{"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=770"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=770"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/csic.som.emory.edu\/~lzhou\/blogs\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=770"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}