How hard is it to pull data from a table on a web site?
edcentric
near Milwaukee, Wisconsin Icrontian
I check a web site each morning.
http://www.nrc.gov/reading-rm/doc-collections/event-status/reactor-status/ps.html
Right now I need to keep a manual list of which reactors are down.
I would like to either have the data in a table for the last week so that I could see when one goes off-line. Or better yet, to create a list (exception report) of which ones have decreased in out put since the day before.
How do I write a prog to use the data?
Or am I stuck?
A good share of our business is with the nuc plants. Knowing who is having reliability problems tells me who to be calling.
http://www.nrc.gov/reading-rm/doc-collections/event-status/reactor-status/ps.html
Right now I need to keep a manual list of which reactors are down.
I would like to either have the data in a table for the last week so that I could see when one goes off-line. Or better yet, to create a list (exception report) of which ones have decreased in out put since the day before.
How do I write a prog to use the data?
Or am I stuck?
A good share of our business is with the nuc plants. Knowing who is having reliability problems tells me who to be calling.
0
Comments
If you DO need region limiting info, then four tables, one per region, would be easiest first breakout of data. Then import data fro each region into each region's corresponding table.
BTW, OOo files are ARCHIVES, gzip type, and the contents is XML, the other file is font and format specs. Winzip and gzip are close enough that you can extract the contents file from the OOo ARCHIVE and have your data, and you can in fact strip the surrounding HTML calls for gifs, etc., in OOo Write or Mozilla's Composer for that matter.
PHP not needed for simple first table formatting and create with a two-cell per row table.
The only problem is that I haven't programed since....'76.
Is there a volunter to help me actually do this? About all that I can offer in return is a package of good Brats or a Cheese Head.
I don't need the regional info. One large table would be fine. I don't need to automaticaly highlight changes. Just building a table would do.
How automated could it be?
Straight Man, you up for this?
Gnome, don't take pictures. I don't want to hear that you need bail.
Sorry to make you come here for a change of topic but I am curious to know what you were programming in 1976 since I take a very layman's interest in the history of computing.
BTW I don't like it when I need info and people start chiming in on my thread with off topics when I need (somtimes desperately) info. So if you blow me off I won't be insulted.
I regret that I didn't keep a box of Hollerith cards. There were some terminals where you could submit a program in batch and then step through it on the screen. We had a space war game (Tiger?) that was three boxes full of cards. We only ran it on stolen accounts.
It could be broken into files for time periods. Though for ease of analysis I would like to have at least 4 months worth of data together.
Do you have some ideas? I am interested.
It's fairly easy to get the data from the site and put it in a table or database, but the only way to make it update at a regular interval is to make it a windows scheduled task, or have it run at startup...but that can be figured out once the program is finished. If you have microsoft access, I can make the program put the data in an access database for easy viewing. Another possibility is to create a GUI for the program that lets you view individual plants history, or view by regions, etc.
Ideally the program would be able to handle the addition of a new power plant to the page, and assorted other things that I'm sure I haven't thought of yet.
Since this is my quarter break, and I'll be rediculously bored for a week, I've started messing with it. I've finished the grabbing and parsing of the data from the site.
Go for it, schwaip. No, Edcentric, I will be too busy for months to do this for you (we cannot get anyone to even bid on a screen cage for Lanai for us, looks like I and my brother Chris will be building the screen cage we lost during Charley, plus hanging gutter and fascia and new soffit and reworking old salvageable soffit, and maybe PAINTING part of outside of house and part of inside-- plus building my business here), but simply decided to outline roughly the process needed and let someone maybe volunteer.
Are you using VBA plus Access, Schwaip???? An Office VBA Project could do this decently..... Including trending if it were an Access+Excel VBA app or a Crystal Reports report from Access plus Excel processing (actually, Crystal Reports Dev version could do the pull-and-calc from Access or probably a Paradox scheduled Export report file, but I only have Pro and I use Paradox and not Access, and Quattro Pro or OOo's spreadhseet and not MS Office at all right now-- in fact, last full version of MS Office I used for anything major was Office '97.).
edit: I found that the data for recent weeks was in the same format, and added that to the database. This is what a graph looks like now.
Things to do:
highlight those plants which have gone down in production and/or create a report that lists them.
drop me an email.
It sort of updates on weekends, sometimes the numbers are reported and sometimes not. I have never figured that out. Usually not though.
Only as often as you've told someone to use memtest.