As I spent some time trying to get this to work, so I write my steps down, as personal knowledge base.
Docker
One of the most useful docker containers out there is jwilder's nginx-proxy. There is a companion docker container for let's encrypt which works fine.