I had a similar issue (but with CUDA 11.1 and TF 2.1.2) and I found the solution here: ImportError: libcublas.so.10.0: cannot open shared object file: No such file or directory · Issue #26182 · tensorflow/tensorflow · GitHub
Basically my linux was pointing to the wrong CUDA lib, so I fixed it just adding the correct version to LD_LIBRARY_PATH
LD_LIBRARY_PATH=/usr/local/cuda-10.2/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
I hope it helps! Paolo