EOC Stats Fubar?!

[profdlp]

Guess what I just saw:

[TBonZ]

I'm getting the more generic error page.

[fatcat]

they are just updating the stats...just wait 20-30 mins and it will be fine. updates are every 3 hrs central time and last 15-30 mins

[mmonnin]

At first I thought it was a joke but I guess not.

Damn now who is doing this?

[profdlp]

they are just updating the stats...just wait 20-30 mins and it will be fine. updates are every 3 hrs central time and last 15-30 mins
Yeah, I know about the updates. Look at the line in red in the picture I posted. :hrm:

[mmonnin]

Yeah I checked another teams stats and their's didnt have that.

I am going to send an email to him to find out whats up.

[TBonZ]

Ok, I just got the error, this is not good. We need to find out what's going on here.

EDIT - Here we go - http://forums.extremeoverclocking.com/showthread.php?threadid=79105

[csimon]

I checked it earlier and all i got was the red X's and stats below that...now this.

[Straight_Man]

WELL, it seems they are updating on the half hour after the hour local to THEM, Central Standard Time, not every three hours on the hour. So, we are getting in looking a half-hour AFTER, and the stats update run is running, and server only can run so many "We're Updating!" pages WHILE updating.

Try looking at 7:30 or 10:30 their time, not 6:00-7:00 their time or 9:00-10:00 their time, they are also feeding stats to folks in UK (FutureMark) I THINK and server is busy doing that also. Server load and stats feeds part of it, rapid stats changes and large recalcs as more and more folks take up folding takes longer, too....

Server there cannot just tell 1,000 of us its updating and simultaneously DO it.... :( :D

[TBonZ]

Hey Ageek, there is server load problems but this is about our Team page being singled out and blocked because a script is accessing our stats and lot's of it.

Follow the link above.

[mmonnin]

I posted and am emailing Jason.

[profdlp]

I posted and am emailing Jason.
I posted, too. You type faster than I do. :smiles:

[mmonnin]

Mine was shorter.;)

[Straight_Man]

Um, I can get in if I do as I said, REGULARLY and normally-- only time I have gotten that, 2-3 minutes later when retry I get that it is updating and not on the hour. Today and yesterday and day before, the 6:00 PM CST fetch and calc was from 6:34-7:14 PM. When they are busy, I use Statsman. Lots of us, lots of accesses by our team members as we all have been told where EOC's server is, and it can only gen so many instances of any one script at once. And while updating, NO feed stats scripts are run to end users surfing in.

Lessee, we have HOW many members it is tracking??? 400-some??? And how many look at half after the exact hour??? Look at 1.5 hours after the update "hour" instead. I have always been able to get in that way, about 90% of the time, even the last 3-5 days.

//EDIT/ADD: IF this is about S-M's server not being able to pick up, the offset in their pickup is busying out their server such that is cannot feed on the half hour as it is doing its pickup and calculation for a 400+memebr team plus most of the UK teams. FutureMark.co.uk is busy at same exact time frame +-10 minutes. Offset our pickups one hour to 1.5 hours, lower load there, problem maybe solved. Works for end users and derivative servers, find low load times.

John.

John.

[Necropolis]

This is a bit worrying. What do the sig generators run off? Not that I am pointing fingers but we have to start by looking somewhere.

[TBonZ]

Found what was killing the server... (Post #1)


Well, I'm sure many of you often find the folding stats with a server overloaded message...

I was noticing in the logs that one particular team had an enormous amount of hits... more than if every person on their team visited daily...

Well, find out it has to be a script hitting 16 pages all at the same time (no doubt just for the data)...

-From the owner of eoc stats.

[fatcat]

Yeah, I know about the updates. Look at the line in red in the picture I posted. :hrm:

well...i stand corrected...i see the sigs are showing the server is down now

[mmonnin]

Our stats DO NOT run off of his pages. Ours update every 2.5 hours or so his do every 3 hours. And I think ours was around before his.

[Camman]

Kinda ridiculous to block our whole team's stats in an effort to do this, someone could just as easily do this and target ANOTHER teams stats and there would be no way to find them.

[profdlp]

Our stats DO NOT run off of his pages. Ours update every 2.5 hours or so his do every 3 hours. And I think ours was around before his.
Yes - we get the data straight from Stanford, same as EOC.

This is one clown, from one IP, doing this. Either through ignorance, or something else...

It is not The Team doing it.

[Necropolis]

All we need is the IP then. We can check it against visitors to the forum and see if its anyone who visits here.

[Straight_Man]

Ok, thanks, Marc. That clears that up, but simply he has offset high load times from what is on "picking up" page. His (EOC admin's) server is not picking up starting at 6:00 CST, it is starting at about one-half hour AFTER the hour. EVERY 3 hours. And 400 people checking once to twice a day in evening US time is a LOT of hits in US evening time. Sheer numbers of team members make that so.

John.

[profdlp]

Ok, thanks, Marc. That clears that up, but simply he has offset high load times from what is on "picking up" page. His (EOC admin's) server is not picking up starting at 6:00 CST, it is starting at about one-half hour AFTER the hour. EVERY 3 hours. And 400 people checking once to twice a day in evening US time is a LOT of hits in US evening time. Sheer numbers of team members make that so.

John.
The problem is more complex than just heavy traffic. I know I'm in the habit of checking the stats every time they update, assuming I'm on the computer. I look at my own, and those near me in the standings. I do not try to view all 16 pages at the same time. I doubt anyone else does either. :-/

[mmonnin]

We dont have 400 active folders on the team let alone 400 ppl you check the stats.

[muddocktor]

I'm presently getting the stats updating message with the commodore 64 on it presently.

We definitely need for Jason to get in touch with us about the offending IP's or any other info he can give us so that we can get to the bottom of this. We definitely don't need to be known as the team that killed the rainbow stats. :rant:

[mmonnin]

Thats the normal update message. The error message when we try to access out individual stats with everyones dailies on it.

[TheBaron]

this is slightly aggravating.
i think we should make the best of it though
(runs off to make more comps start folding, in an effort to usurp the team)

[Camman]

yeah it is pretty aggravating that they would block our whole team, even though this stunt could be pulled by...welll....ANYONE who looks at the stats...ANYONE who has an internet connection, but sure, why not ban our whole team.

I'll be using these stats from now on
http://stats.zerothelement.com/cgi-bin/folding3/render-users.pl?team=93

used to use em when EOC was down, forgot all about it though, better layout than EOC anyway

[pseudonym]

Dear god people, don't get peeved about this. You're still folding right??? You're not losing points right??? Then who really cares? It'll be fixed in due time, just give the guy who puts time and effort into this thing a chance.

[TheSmJ]

Doesn't matter. It was back again eariler today, so I imagine whoever/whatever it was, it's been fixed.

You would think it would be easier to block the IP, but whatever.

[TheSmJ]

Noo.. nevermind. We're still blocked.

Any word from Jason?

[mmonnin]

Nope. Dont really expect anything until tomorrow as its late.

[csimon]

3:45 am cst and mine is working hehe ...it's nice to be on vacation!!! :fold:

[Enverex]

It's probably easier to just block the whole team. When you are busy doing other things and someone starts hitting up your site, you normally take the easiest route to stop them. I know I do (at least until I have time to do it a better way).

I don't get it, why don't you all just use another site temporarily, some people seem to be acting like it's the end of the world...

[GnomeWizardd]

I think S-M should have our own stats page like eoc

[a2jfreak]

If I had the time I'd work on coding something, but unfortunately I don't have the time right now.

I think S-M should have our own stats page like eoc

[Lincoln]

Our sigs make a single query (not 16) to Stanford every 2.5 hours or so. It would be ridiculously inefficient to try and get stats from EOC.

Gnome, we actually do have a very very rudimentary text version of team stats around here somewhere that runs off the same files and updates as the sigs. One of my (many many many) long term goals is to redesign the GUI for it and add a little functionality. Too many other projects going on right now though, and it's not worth doing until I have time to make it better than EOC anyway.

[profdlp]

...Too many other projects going on right now though, and it's not worth doing until I have time to make it better than EOC anyway.
Right now, EOC is useless to us. Who knows how long we'll be locked out.

Keebs, we know you've got your hands full. What you do for Team 93 is already way more than anyone could ask.

I'd give it a shot myself, but have absolutely no idea how to do it. :confused:

Can we get a volunteer from the audience? :wave:

[csimon]

I have time right now but no knowledge of coding.

[Enverex]

I have time and know how to code, but what I do lack the knowledge of is how to to pull information off other pages. When you get the page it is probably a looped process of strpos'ing to the correct place for each user via their username and getting the stats, but it's not the type of coding that I normally do...

[kanezfan]

mmonin, check your PMs

[mmonnin]

Thank you kanez!

[csimon]

Is this the link to the EOC website ...http://www.extremeoverclocking.com?

[pythagoras]

Thats the one

Regards

John.

[csimon]

looks like the entire website is fubar at the moment. :scratch:

[Black Hawk]

Works for me...

[mmonnin]

Its good now. Yes thats their website.

[Lincoln]

I have time and know how to code, but what I do lack the knowledge of is how to to pull information off other pages. When you get the page it is probably a looped process of strpos'ing to the correct place for each user via their username and getting the stats, but it's not the type of coding that I normally do...

I think the info retrieval is already built. From what I can tell, it is all sitting in files already on the server. The only trick would be to add any additional info you want to calculate during the retrieval process and change the way it all displays. (But, I have to add, this is a lot of conjecture from me since I haven't really taken a close look at this part of the operation and I don't have the software configured to connect to the server from here at home.)

[EOC_Jason]

I shifted the time by one hour since before the updates occured at the same time stanford did, now I start updating after they are complete...

The actual time starts at 1am CST, 4am, ... and it has been lasting about 45min-1hr to update (because of server load).

However, the "server overloaded" page gets displayed before the check for the "stats processing", so technically stats could be processing but it display the other page (it was a quick fix to an issue).

WELL, it seems they are updating on the half hour after the hour local to THEM, Central Standard Time, not every three hours on the hour. So, we are getting in looking a half-hour AFTER, and the stats update run is running, and server only can run so many "We're Updating!" pages WHILE updating.

Try looking at 7:30 or 10:30 their time, not 6:00-7:00 their time or 9:00-10:00 their time, they are also feeding stats to folks in UK (FutureMark) I THINK and server is busy doing that also. Server load and stats feeds part of it, rapid stats changes and large recalcs as more and more folks take up folding takes longer, too....

Server there cannot just tell 1,000 of us its updating and simultaneously DO it.... :( :D

[mmonnin]

Welcome to the forums Jason!

[EOC_Jason]

Thanks...

Also, since I have the two IPs that are hitting the server so much blocked, I *just* changed your team's setting so you guys should be able to view it now... I'm pretty sure those two IPs are static, I'll be watching the logs for any more insane requests... ;)

I'm sorry for the inconvience, but the load was making the server go ape, and I figured that would get someones attention. I'm just happy this got resolved so quickly.

Oh yeah, as for data that gets processed incase you are wondering... There's 2,000 teams, and some 65,000+ individuals who get updated.

[witenoiz]

Jason you do great work!! ;D I was climbing the walls when you moved :banghead: and your stats page was down for a couple of weeks. And then this! :rolleyes: Can we say it was FU but not BAR. :ukflag: Thanks Jack

[Enverex]

Are you allowed to disclose either of those IP addresses for checking against S-Ms user-logs?

[AuthorityAction]

Are you allowed to disclose either of those IP addresses for checking against S-Ms user-logs?

mmonnin has the 2 IPs.