Thanks!

I also found I could copy existing Windows keys and then fix up the permissions with:

chmod 600 ~/.ssh/id_rsa
chmod 644 ~/.ssh/id_rsa.pub