Skip to main content
N
NuckNuck
Participating Frequently
October 7, 2010
Question

What Do You Use in Place of VSpider When Using Solr?

  • October 7, 2010
  • 1 reply
  • 2049 views

Since Verity is deprecated according to CF Documentation, what crawler do you use if you want to index dynamic pages (like vSpider would)?  Can you use Solr with vSpider or is there something better out there or bundled with CF9?

    This topic has been closed for replies.

    1 reply

    D
    Community Expert
    Dave WattsCommunity Expert
    Community Expert
    October 7, 2010

    You were probably the only person using Vspider! Most Verity users just used CFINDEX.

    Solr doesn't come with a crawler. There are plenty of crawlers that can work with Solr, though - just Google "solr crawler".

    Dave Watts, CTO, Fig Leaf Software

    http://www.figleaf.com/

    http://training.figleaf.com/

    Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on

    GSA Schedule, and provides the highest caliber vendor-authorized

    instruction at our training centers, online, or onsite.

    Dave Watts, Eidolon LLC
    A
    Adam Cameron.
    Inspiring
    October 7, 2010

    You were probably the only person using Vspider! Most Verity users just used CFINDEX.

    The problem with using <cfindex> is that the location of the document in the site's filesystem hierarchy and the infrastructure elements such nav (and even header and footer) are significant in evaluating the context of the document for the purposes of weighting it.

    Using a spider is a better approach to getting an accurate, weighted index of the website, rather than just its component data.

    --

    Adam

    D
    Community Expert
    Dave WattsCommunity Expert
    Community Expert
    October 7, 2010

    Oh, I agree! That's one reason why I use Google Search Appliance instead of Verity or Solr.

    Dave Watts, CTO, Fig Leaf Software

    http://www.figleaf.com/

    http://training.figleaf.com/

    Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on

    GSA Schedule, and provides the highest caliber vendor-authorized

    instruction at our training centers, online, or onsite.

    Dave Watts, Eidolon LLC
    Terms & ConditionsAccessibility statement
    Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices