Skip to main content
Anonymous
January 28, 2008
Question

Web Crawler... well, sort of

What would be the best method to get data from other websites? For example, let's say there's a website that lists all of their cars for sale, and with their permission they wanted to allow another website to list this data... how could you automatically get that data (with no access to their database). Literally "mine" their website
This topic is closed to new replies. Start a new post to keep the conversation going.

3 replies

Newsgroup_User
Inspiring
January 28, 2008
Google "screen scraping"....

--
Murray --- ICQ 71997575
Adobe Community Expert
(If you *MUST* email me, don't LAUGH when you do so!)
==================
http://www.projectseven.com/go - DW FAQs, Tutorials & Resources
http://www.dwfaq.com - DW FAQs, Tutorials & Resources
==================


"jsteinmann" <webforumsuser@macromedia.com> wrote in message
news:fnl3jr$g4g$1@forums.macromedia.com...
> What would be the best method to get data from other websites? For
> example,
> let's say there's a website that lists all of their cars for sale, and
> with
> their permission they wanted to allow another website to list this data...
> how
> could you automatically get that data (with no access to their database).
> Literally "mine" their website
>

Translate
Anonymous
January 28, 2008
I was curious what methods or ways others found best. There is a lot of information available, but it's inconsistent and seems to vary. Some say grab the get or post via html, some say us curl, others have software solutions you can buy, etc. What's the easiest way to grab data from a repeating recordset displayed on a page?
Translate
Terms & ConditionsAccessibility statement
Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices