UTAStats - Feb 2009

Discussion in 'Forum & Community Announcements' started by '//3iRd(o), Feb 7, 2009.

  1. '//3iRd(o)

    '//3iRd(o) Administrator

    Joined:
    Sep 19, 2001
    Messages:
    5,440
    Location:
    Dorset, UK
    Hey - it wouldn't be any fun if UTStats didn't break a server every 6 months, would it? :P

    Yes, yes, it's time again to say goodnight to UTStats for a while. It's still currently kindly hosted by pinny; but there is a problem with one of the disks on the server, so in order to avoid trashing the remaining disk and losing it completely, we have frozen updates and are in the process of backing up the data to another location.

    Whether this will actually give us the kick up the arse to finally do something about the behemoth that is UTStats and possibly translate the log data into a newer system is another question though. We had little interest from the community in fixing the current system, so having the time and expertise to migrate to a different system is unlikely.

    So.. UTAStats will be offline again until further notice.

    Update to follow :soon:



    note: While we appreciate posts declaring your undying love for UTAStats, please keep chat posts to a minimal; if your post doesn't contribute a way of solving the stats problem, then it will likely be deleted.
     
    Last edited: Feb 18, 2009
  2. Mido

    Mido i want rep

    Joined:
    Sep 25, 2001
    Messages:
    5,734
    Location:
    Tilburg, NL
  3. Cyborg

    Cyborg I am the liquor

    Joined:
    Oct 14, 2008
    Messages:
    1,293
    Location:
    Portugal
    oke gl
     
  4. Thrasher (_!_)

    Thrasher (_!_) =]死か栄光[=

    Joined:
    Feb 21, 2002
    Messages:
    6,200
    Location:
    Staffs,UK
    What services does it require to be hosted?
     
  5. brajan

    brajan <b>League Adm</b><b>inistrator</b><br /><b>For</b>

    Joined:
    Feb 25, 2004
    Messages:
    5,415
    Location:
    /dev/null
    Fucking HUGE :rofl:
    I seriously never seen any other web app consuming that much of server resources.
    Infinite loops doesn't count :P
    On the other side i'm surprised it still works at all with all those millions(!) of records in database
     
  6. Thrasher (_!_)

    Thrasher (_!_) =]死か栄光[=

    Joined:
    Feb 21, 2002
    Messages:
    6,200
    Location:
    Staffs,UK
    :lol: I have plenty of web space and MySQL etc but limited CPU power :-/
     
  7. Op1uM

    Op1uM Fakenicker!

    Joined:
    Jul 25, 2002
    Messages:
    3,163
    i don't care since i'm "still" banned from it :p
    :fingers:
     
  8. Moon

    Moon Boom HEADSHOT!

    Joined:
    May 30, 2002
    Messages:
    16,329
    Chill the fuck down opi :P
     
  9. endgegner

    endgegner The Saviour of UTA. Worship me as DJ worships sofa

    Joined:
    Mar 5, 2006
    Messages:
    6,589
    Opi is a cheater and should be banned from UTA for being French and refusing to surrender to me.
     
  10. endgegner

    endgegner The Saviour of UTA. Worship me as DJ worships sofa

    Joined:
    Mar 5, 2006
    Messages:
    6,589
    Question:

    Would it be possible to "start over" and delete things such as: Public game records, pug matches, public game users and leave: league matches (from the past year maybe?) and leage users stats. Or would it even be possible to host the old stats somewhere else (such as Thrasher's space) and just host the stats post-pinny's server being back up on pinny's server?

    Those are the only work-arounds I can suggest which you guys have prolly already thought of. Unfortunately now I'm all poor and also don't have the leet skillz to fix them myself :( Stats are very nice though and there's a very big portion of the community who enjoys them, so I'd strongly encourage anyone with the skills to donate your time to fixing it as UTA and UTA admins have donated so much time/money to UTA over the past 9 years :)
     
  11. brajan

    brajan <b>League Adm</b><b>inistrator</b><br /><b>For</b>

    Joined:
    Feb 25, 2004
    Messages:
    5,415
    Location:
    /dev/null
    And that's the problem. It's not really a matter of space but cpu/memory consumption.
     
  12. Torp

    Torp Hai

    Joined:
    Dec 23, 2004
    Messages:
    3,161
    Location:
    Milan, Italy
    Public stats shouldn't really be on there. Not useful in the slightest and probably take up more space than anything else.

    Similar to Smant's idea. Records stay for 2 months and then are archived or deleted? No one really checks up on stats that are months old so there isn't a need for them to be saved.

    iNzanE has some stats for .de servers in ctf NW. That holds 3 public servers which are full 12 hours of the day. Maybe they have a better method of storing the data?

    http://www.inzane.de/mod/utstats/
     
  13. w1sh

    w1sh `//

    Joined:
    Sep 26, 2003
    Messages:
    2,446
    As it has already been said, you might as well just remove the public stats, they don't really show much and I doubt anyone really looks at them on a regular basis. Just keep stats for league games and pugs, and delete them after a couple of months if they are using up too much space.
     
  14. pinhead

    pinhead Cenobite

    Joined:
    Jun 16, 2002
    Messages:
    1,926
    Location:
    The Netherlands
    I think the bottleneck was more the Hard drive than the CPU/RAM tbh. I've always had massive iowait on the server; meaning that the CPU is doing hardly anything, except waiting for the HD to finish reading data.
    My server was running 7200rpm HD's too, so that wasn't really optimal in any way for such a web application. I'm probably waiting till SSD's get cheap and get 2 of those. After that I'll probably be able to host the utastats again. Though, this will probably still be a very long time from now, read 'more than a year'. Unless ofcourse someone is kind enough to give me 2 decent HD's. :x
     
  15. endgegner

    endgegner The Saviour of UTA. Worship me as DJ worships sofa

    Joined:
    Mar 5, 2006
    Messages:
    6,589
    Delete pugs too, because probably people look at publics/pugs just as often and pug is prolly taking up a lot of space too. You just think people look at pug more because that's what you play and that's what you look at/ people in #utapug link to.
     
  16. pinhead

    pinhead Cenobite

    Joined:
    Jun 16, 2002
    Messages:
    1,926
    Location:
    The Netherlands
    Seriously, it's so pointless to ask for "deleting" stuff, since it's not even possible.
    We can only "stop adding" stuff.
    And even then, the database will keep on staying huge. So in comparison it makes little difference, hence why we didn't stop adding stuff.
    Also just having pug and league matches makes no difference, since it will be big too again in a few years and we'll have the same stupid problem.
    The only way to make it better is to change the way the data is imported within the database. But since no one cared to do this over the past 6 months I doubt one will show up now...

    So to me personally it seems :wave: utastats.
     
  17. w1sh

    w1sh `//

    Joined:
    Sep 26, 2003
    Messages:
    2,446
    Not really Smantie, who wants to see individual map statistics anyway? Half of the time people are faking on publics as well. I play publics btw.

    Pug statistics are shown as a full game.
     
  18. '//3iRd(o)

    '//3iRd(o) Administrator

    Joined:
    Sep 19, 2001
    Messages:
    5,440
    Location:
    Dorset, UK
    I'm sure I'll think of something - as usual :P

    As pinny has hinted going through past stats and weeding out matches only would be a ridiculously huge task, so realistically we would only process say, from Jan 2009 onwards, just sticking to pug & league matches.

    Will look at it if I have time in the evenings.
     
    Last edited: Feb 8, 2009
  19. doh

    doh hodlike

    Joined:
    Oct 21, 2001
    Messages:
    2,033
    Location:
    Denmark
    The disk is only the bottleneck when your system doesn't have enough memory to cache the whole thing.
    When it ran on bacon (before it was virtualized) it was just grinding the CPU (but finishing in fair amount of time), along with eating up all the memory.
     
  20. endgegner

    endgegner The Saviour of UTA. Worship me as DJ worships sofa

    Joined:
    Mar 5, 2006
    Messages:
    6,589
    Doh / Timo:

    Can you provide us with an estimate of realistically optimal specifications for hosting UTA Stats? (i.e. hdd capacity, memory, supported structures)
     
  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.