Oopsie: all ports filtered?

Okay it was dumb.

Turns out I was connected via the wrong VPN file.
I had not actually read the instructions and just took the first download for a .ovpn file I saw.

After downloading and connecting the starting_point_<username>.ovpn file it works just fine.