Turns out gnome-notes does to some degree implement CalDav. In the perferences I can choose which is the primary storage location, and there the two calendars I have set up in Evolution show up.

And when I write a new note in the gnome-notes app, it even shows up in Evolution and on my phone! Great success! But for some reason when I create a note in Evolution it does not show up in gnome-notes.