• Global community
    • Language:
      • Deutsch
      • English
      • Español
      • Français
      • Português
  • 日本語コミュニティ
    Dedicated community for Japanese speakers
  • 한국 커뮤니티
    Dedicated community for Korean speakers
Exit
Locked
0

Problem on the page with downloads (robots.txt enlisted pages still show up in search result)

New Here ,
Nov 13, 2017 Nov 13, 2017

Copy link to clipboard

Copied

This is the content of the file "robots.txt" that I created that in theory tells google robots not to show in the internet searches the pdf that is hosted on the page.

User-agent: *
Disallow: * .pdf $
Disallow: * .rar $

but it does not work, it finds them the same, I change the name to the pds, I upload them again to the web page and to the ftp and after 20 or 30 days I find them again.

Views

141

Translate

Translate

Report

Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines

correct answers 1 Correct answer

LEGEND , Nov 13, 2017 Nov 13, 2017

It might help to not throw in extraneous spaces. You know, in the computer world spaces are valid characters, not just hot air to be ignored.

Mylenium

Votes

Translate

Translate
LEGEND ,
Nov 13, 2017 Nov 13, 2017

Copy link to clipboard

Copied

LATEST

It might help to not throw in extraneous spaces. You know, in the computer world spaces are valid characters, not just hot air to be ignored.

Mylenium

Votes

Translate

Translate

Report

Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines