It apparently needs an additional `-mcpu=generic-rv64` in the cmdline (doesn't like default `generic`).