I'm trying to read a page with cfhttp and extract code from it using #find. I've done this before and it works fine. The problem is that the page I'm trying to read has lots of embedded AJAX mechanisms — when I use my browser's "inspect" function on particular attributes I can see all the code, but when I simply say "show page code" (or use cfhttp) I just get the top-level static code without the sub-components that load when the page loads (the code of which are visible when I select elements and click "inspect" using the browser's debug tools).
Thanks in advance for anyone's help or advice.
Not really, that is what the browser is designed to do. It has all the gear in it to parse the JS etc so the page works as intended.
CFHTTP is just doing a request and you will get what ever the request reads, just like cURL etc.
Thanks for replying. That's a bummer.
So maybe load a page locally, and then read it? Or is that kind of client-side browser manipulation beyond coldfusion's capabilities?
I'm trying to scrape a big bunch of data from a web resource.
Dave Watts, Eidolon LLC