GitLens supports (under the alternate keychord) to press alt+, or alt+. to jump between versions of a file. I use this a lot to see what happened recently quickly, when I e.g. see an error log from a file and I need to see what recent changes happened.

Unfortunately GitLens has become too bloated, and that is the only feature I need.

I think this should be fairly easy to implement, and they keyboard shortcuts are not used by VS Code by default at this moment writing this feature request.