reading source from a web page

[Corey]

Re: reading source from a web page

Sounds pretty simple. Shouldn't have a problem doing that using one of the two techniques above... Sleep is for the weak and the morally bankrupt.

Corey Milner
Creative Director, Indigo Rose Software

[TJ_Tigger]

Re: reading source from a web page

I will have to take a look at this tonight. We have an internal web page that is populated dynamically based on a zip code of our customer base. The web page is controlled by another group and I was hoping to take data from their page and rework the data for my uses using AMS. If I could do this I could offer it to my training co-workers. I want to grab the page and a extract from it the customers identification number and their company name. The page is dynamic as in there is no .html file for me to download directly.

I don't want to do any screen scrapers, but would like to grab the html source code that is generated.

I will look more at what you have Corey when I have a chance. Off to training I go. Fourth week on the road and I am beat!!

[Corey]

Re: reading source from a web page

OK I see what you mean by "dynamic", you mean "created at runtime" such as http://www.mysite.com/myscript.cgi?action=1726 , in that case another "two cents" would be that two options would be:

1. Read the file into a variable or array such as with a PHP "file" function (or ASP, javascript, VB, etc.) and then return it to your app.

2. Save a generated instance of that page locally and read it using a TEXT FILE > READ action...

Just throwing out ideas...

BTW Tigg if you're trying to make a brute-force media grabber that's simple, I've done a few of those in my day such as the one here which grabs Enerchems stock data from the TSE and then strips all of the TSEs branding from it before returning it to Enerchem's site for re-branded display (You can even generate your own custom charts [img]/ubbthreads/images/icons/smile.gif[/img] )...

http://enerchem.com/charts.php

Or this one which does the same for their news headlines from the CNE...

http://enerchem.com/index.php?page=news (BTW this page as you can see is created at runtime as is most of this site, this whole site is only about 3-4 pages believe it or not, I did that on purpose...)

Is that what you're trying to do?

Corey Milner
Creative Director, Indigo Rose Software

[Worm]

Re: reading source from a web page

Tig,

Is this from a local file, or one on a remote server?

[Corey]

Re: reading source from a web page

Yep that's easy as pie. Just use a TEXT FILE > READ action and point it at your .html page. [img]/ubbthreads/images/icons/tongue.gif[/img]

Corey Milner
Creative Director, Indigo Rose Software

[TJ_Tigger]

Is it possible to read the soure (html code) from a dynamically loaded web page? There is not a file per se to download, but once the page is loaded, there is code associated with the page. Would it be possible with AMS to grab that source.html for the page that was loaded. I want to navigate to a page an load the source code for the page and then parse that? What do you think?