It’s safe to delete it and the dependencies via apt autoremove. I do it on every Ubuntu install that I’m on.
I haven’t done it since 22.04, but the dependencies for Rhythmbox on 22.04 and 23.04 are nearly identical, so it should be just as safe to remove.