Skip to main content
LyzaLatham
Participant
June 17, 2010
Answered

Can the search engine spiders crawl RoboHelp pages?

  • June 17, 2010
  • 2 replies
  • 1357 views

I had always thought that the search engines were unable to crawl and index RoboHelp content for SEO purposes.  But several of the pages on my client's site www.numbercruncher.com are showing up in search results on Google.  Can anyone help me to understand what the constraints are for this? Or send me somewhere I can get the details?  I've been searching everywhere and not sure where else to look.

    This topic has been closed for replies.
    Correct answer Captiv8r

    Hi Lyza

    Hopefully John won't mind my offering some tidbits here that may help illustrate the issue.

    Perhaps a small experiment will help here.

    Open Google and search for the phrase: Build tags on the brew and note the top link you see. It should read February 2004.

    Click that link and note what you see.

    Now click the following link: Click here to view

    Look familiar?

    What you should be seeing is a page inside a WebHelp system. Nothing special whatsoever was done to make this happen. In other words, the Search Engines were able to index this page simply because it is available to the web. No SiteMap was created. Nothing special was done.

    Some folks are working under the assumption that because WebHelp and FlashHelp are presented using extensive Framesets, that content cannot be found. This may have been true years ago, but advances in the indexing methods overcame that issue long ago.

    Now Search Engine Optimization (SEO) is a whole different animal and there are entire companies and many consultants that profess to assist with SEO and increasing your rankings.

    Cheers... Rick

    Helpful and Handy Links

    RoboHelp Wish Form/Bug Reporting Form

    Begin learning RoboHelp HTML 7 or 8 within the day - $24.95!

    Adobe Certified RoboHelp HTML Training

    SorcerStone Blog

    RoboHelp eBooks

    2 replies

    Community Expert
    August 15, 2023

    This thread is 13 years old and even then the frameset issue wasn't an issue any more. (And even if it were, neither Webhelp nor Flashhelp are valid outputs in RH2019 New UI or above (which I'm assuming you're using).)

     

    There is nothing built in to RH that will prevent the output being crawled, as far as I'm aware, so I think you'll need to talk to your server administrator to make sure your server is publically available and isn't blocking search engine bots. Other than that, it can take some time for a site to be crawled so you might just need to wait some time. Or maybe find out if you can submit the site to the search engine - you'd need to go to a relevant forum or search engine documentation site for that information.

    johndaigle
    Legend
    June 17, 2010

    As long as the WebHelp is on the public internet it is subject to search indexing. I gather you do not want the site to be searchable.

    I haven't done this in a long time, but did find this link which may get you started on blocking search engines.

    http://www.webmasters-central.com/article-blog/search-engine-marketing/stop-search-engine-robots-indexing-your-private-folders-by-robotstxt/

    John Daigle

    Adobe Certified RoboHelp and Captivate Instructor

    www.showmethedemo.com

    John DaigleAdobe Certified RoboHelp and Captivate InstructorNewport, Oregon
    LyzaLatham
    Participant
    June 21, 2010

    Actually, we DO want them to be searchable, but thought we had to extract all the content and create PDFs or separate HTML pages so it would be indexed.

    So maybe what I need to recommend to the client is that the pages need to appear on their Site Map so the SEs can find them all?

    Captiv8r
    Captiv8rCorrect answer
    Legend
    June 21, 2010

    Hi Lyza

    Hopefully John won't mind my offering some tidbits here that may help illustrate the issue.

    Perhaps a small experiment will help here.

    Open Google and search for the phrase: Build tags on the brew and note the top link you see. It should read February 2004.

    Click that link and note what you see.

    Now click the following link: Click here to view

    Look familiar?

    What you should be seeing is a page inside a WebHelp system. Nothing special whatsoever was done to make this happen. In other words, the Search Engines were able to index this page simply because it is available to the web. No SiteMap was created. Nothing special was done.

    Some folks are working under the assumption that because WebHelp and FlashHelp are presented using extensive Framesets, that content cannot be found. This may have been true years ago, but advances in the indexing methods overcame that issue long ago.

    Now Search Engine Optimization (SEO) is a whole different animal and there are entire companies and many consultants that profess to assist with SEO and increasing your rankings.

    Cheers... Rick

    Helpful and Handy Links

    RoboHelp Wish Form/Bug Reporting Form

    Begin learning RoboHelp HTML 7 or 8 within the day - $24.95!

    Adobe Certified RoboHelp HTML Training

    SorcerStone Blog

    RoboHelp eBooks