Thank you for your help ! Your article helped me to figure out how the whole ssh system worked.
Just one thing : the private and public keys were created in the root/.ssh directory in my case, and not in the user directory. But I use the Linux subsystem for Windows, so that can be an explanation.