Exit
  • Global community
    • Language:
      • Deutsch
      • English
      • Español
      • Français
      • Português
  • 日本語コミュニティ
  • 한국 커뮤니티
0

Web Crawler... well, sort of

Guest
Jan 28, 2008 Jan 28, 2008
What would be the best method to get data from other websites? For example, let's say there's a website that lists all of their cars for sale, and with their permission they wanted to allow another website to list this data... how could you automatically get that data (with no access to their database). Literally "mine" their website
TOPICS
Server side applications
323
Translate
Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines
LEGEND ,
Jan 28, 2008 Jan 28, 2008
Google "screen scraping"....

--
Murray --- ICQ 71997575
Adobe Community Expert
(If you *MUST* email me, don't LAUGH when you do so!)
==================
http://www.projectseven.com/go - DW FAQs, Tutorials & Resources
http://www.dwfaq.com - DW FAQs, Tutorials & Resources
==================


"jsteinmann" <webforumsuser@macromedia.com> wrote in message
news:fnl3jr$g4g$1@forums.macromedia.com...
> What would be the best method to get data from other websites? For
> example,
> let's say there's a website that lists all of their cars for sale, and
> with
> their permission they wanted to allow another website to list this data...
> how
> could you automatically get that data (with no access to their database).
> Literally "mine" their website
>

Translate
Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines
Guest
Jan 28, 2008 Jan 28, 2008
I was curious what methods or ways others found best. There is a lot of information available, but it's inconsistent and seems to vary. Some say grab the get or post via html, some say us curl, others have software solutions you can buy, etc. What's the easiest way to grab data from a repeating recordset displayed on a page?
Translate
Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines
LEGEND ,
Jan 29, 2008 Jan 29, 2008
LATEST
I think you use the file operations to open the external page as a text
file, and read out the elements continaining the info you want.

--
Murray --- ICQ 71997575
Adobe Community Expert
(If you *MUST* email me, don't LAUGH when you do so!)
==================
http://www.projectseven.com/go - DW FAQs, Tutorials & Resources
http://www.dwfaq.com - DW FAQs, Tutorials & Resources
==================


"jsteinmann" <webforumsuser@macromedia.com> wrote in message
news:fnlf6v$st0$1@forums.macromedia.com...
>I was curious what methods or ways others found best. There is a lot of
> information available, but it's inconsistent and seems to vary. Some say
> grab
> the get or post via html, some say us curl, others have software solutions
> you
> can buy, etc. What's the easiest way to grab data from a repeating
> recordset
> displayed on a page?
>

Translate
Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines