I only could do voip calls via Matrix/Element if I was in the same network. Turns out that I had to set up a turn server to get it working outside of my NAT https://matrix-org.github.io/synapse/v1.48/turn-howto.html