No need to make a static robots.txt file for Magento on the server anymore. You can generate or edit the robots.txt file from the Magento 2 admin with a good UI interface.  

Click to Read more