I found this topic which is probably related : Failed to deploy new elastic beanstalk instance. Nginx Conf Failure
wasn't the problem there that no files were written in conf.d/ at init ?
Thanks for your answer anyway. I'll give a shot at deploying following the instructions from the AWS docs.