Great, while I wanted to install Ubuntu on a USB stick, their installer overwrote my EFI partition on my SSD instead. It showed it would write it to /dev/sda1, but wrote on /dev/nvme0n1p1. It did it on my brothers MacBook and on my Dell XPS13, so now it's not a coincidence anymore.