As the VSCode Remote SSH connection does not invoke a login shell by default (leading to a broken environment) and some students approached us asking for help, we updated our documentation outlining a step-by-step guide on making proxy jumps work the expected way.
Please have a look at https://doc.nhr.fau.de/access/ssh-vscode/
Thank you to everyone who pointed out this issue!