sitemap crawl error robots.txt

New Here ,
Aug 25, 2018 Aug 25, 2018

Copy link to clipboard

Copied

Hi there,

I´ve just built a website in Muse and when I try to upload / test the sitemap.xml (.xml generated by Muse) in google/webmaster tools , it shows up the following message:

¨Unable to access the network: Unable to access robots.txt. We were unable to crawl your sitemap because we were unable to download the robots.txt file from the root of your site. Make sure it is accessible or eliminate it completely.¨

Initially there was no robots.txt on the server and Muse doesn´t automatically generate one. I tried to create one with the following parameters, still the same message:

User-agent: *

Disallow:

Now there´s no robots.txt file on the server.

You can access my .xml file here: http://cristiantomafilmmaker.com/sitemap.xml

Does anyone know why this error?

Thank you.

Views

425

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines

correct answers 1 Correct Answer

Adobe Community Professional , Aug 25, 2018 Aug 25, 2018
At the moment there is no robots.txt file on your server for Google bots to find. http://cristiantomafilmmaker.com/robots.txt Muse cannot generate a robots.txt file for you.  You need to generate one separately and manually FTP it to the root of your server.   See link below.Create a robots.txt file - Search Console Help

Likes

Translate

Translate
Adobe Community Professional ,
Aug 25, 2018 Aug 25, 2018

Copy link to clipboard

Copied

LATEST

At the moment there is no robots.txt file on your server for Google bots to find.

http://cristiantomafilmmaker.com/robots.txt

Muse cannot generate a robots.txt file for you.  You need to generate one separately and manually FTP it to the root of your server.   See link below.

Create a robots.txt file - Search Console Help

Nancy O'Shea, Adobe Product User & Community Professional
Alt-Web Design & Publishing ~ Web : Print : Graphics : Media

Likes

Translate

Translate

Report

Report
Community Guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines