TAKP Magelo data

Discussion in 'General Discussion' started by solar, Apr 12, 2023.

  1. solar

    solar Administrator Staff Member

    Messages:
    1,198
    Daily dump available here: https://www.takproject.net/magelo/export/

    This data is unbuffed stats for displaying on character profiles.
    Characters that are anonymous or roleplay at the time the export is made are not included.
    There are some additional stat breakdowns besides what is displayed on Magelo.
    HP and mana regeneration numbers are included for standing/sitting/resting. Resting happens if you sit for 1 minute.
    ac_avoidance and ac_mitigation are the 2 stats thare are summarized into the AC value on the character sheet.
    ac_total = (ac_avoidance + ac_mitigation) * 1000 / 847
    STR/STA/etc are broken down into base, item and AA contribution.
    Inventory data is included in the second file.

    Simple example:
    Code:
    [ Only registered users can see the bbcode. Click Here To Register... ]
     
    Tryfan, kai4785, Mokli and 5 others like this.
  2. Saenayil

    Saenayil People Like Me

    Messages:
    391
    Amazing! Thanks Solar
     
    showstring likes this.
  3. Mokli

    Mokli I Feel Loved

    Messages:
    2,461
    Would you and/or Lenas entertain a Magelo ranking page if any of us would work on it using this? I imagine to most looking at this, it doesn't mean much as they are not coders.

    I guess we could just host a page elsewhere outselves, but would be nice it if was on TAKP magelo somewhere
     
    Last edited: Apr 12, 2023
    Break and Pithy like this.
  4. Break

    Break People Like Me

    Messages:
    622
    This is so cool. Thanks!

    Edit: I'm not sure I understand how to use this dataset. It's opening in a page rather than giving me the option to download it. Is that intended? I'm on Firefox if that makes any difference.

    Edit2: Nevermind. I just did a save as when right clicking, and it downloaded.
     
    Last edited: Apr 12, 2023
  5. solar

    solar Administrator Staff Member

    Messages:
    1,198
    If you make something cool, can just make a thread for it here and we can probably include it somewhere.

    Bank slots are included, take a look at the second file.

    It's just a spreadsheet file. You can sort it and filter it in Excel if you want to rank by one of the columns, or can use some kind of HTML table control to visualize it in a browser for real simple tabular viewing. Sorting it with command line tools was just my nerd way of doing it.
    I noticed some have been scraping data page by page, I think somebody made a tool to figure out what they can make out of Dozekar materials too? Anyway, this should make it easier for people to try things like that, without waiting on one of the TAKP devs to be interested in doing it.
     
    Cadsuane, necra and Tryfan like this.
  6. Aithne

    Aithne Member

    Messages:
    51
    Yeah i just found them, thanks :-D

    Tinkered a bit with the files directly without using a database to import. Here a tiny snippet to find items and who has them:

    Code:
    [ Only registered users can see the bbcode. Click Here To Register... ]
     
  7. solar

    solar Administrator Staff Member

    Messages:
    1,198
    Maybe someone could make a census page about which races/classes/religions are being played? Something fancy with pretty charts and things to click on for filtering maybe?
     
  8. Aithne

    Aithne Member

    Messages:
    51
    866 Wood Elf Druid Tunare
    836 Halfling Druid Karana
    769 High Elf Enchanter Agnostic
    713 Iksar Necromancer Cazic Thule
    662 Iksar Monk Cazic Thule
    606 Wood Elf Ranger Tunare
    604 Gnome Magician Agnostic
    553 Vah Shir Beastlord Agnostic
    529 Dark Elf Cleric Innoruuk
    494 Half-Elf Bard Agnostic
    494 Iksar Shaman Cazic Thule
    480 Barbarian Shaman The Tribunal
    465 High Elf Cleric Tunare
    457 Dark Elf Enchanter Agnostic
    422 Dwarf Cleric Brell Serilis
    367 Iksar Beastlord Cazic Thule
    366 Ogre Warrior Rallos Zek
    352 Ogre Beastlord Rallos Zek
    350 Dwarf Paladin Brell Serilis
    346 Halfling Ranger Karana
    344 Ogre Shaman Rallos Zek
    340 Dark Elf Necromancer Innoruuk
    332 Ogre Warrior Agnostic
    330 Wood Elf Bard Agnostic
    314 High Elf Paladin Tunare
    310 Halfling Cleric Bristlebane
    310 Human Warrior Agnostic
    306 Dark Elf Shadow Knight Innoruuk
    304 Gnome Enchanter Agnostic
    297 Vah Shir Bard Agnostic
    294 Dark Elf Magician Agnostic
    272 Human Monk Agnostic
    248 Human Bard Agnostic
    246 Gnome Necromancer Bertoxxulous
    229 Human Monk Quellious
    229 Iksar Shadow Knight Cazic Thule
    227 Ogre Shadow Knight Cazic Thule
    218 High Elf Magician Agnostic
    215 Vah Shir Shaman Agnostic
    213 Barbarian Warrior Agnostic
    206 Barbarian Beastlord The Tribunal
    199 Ogre Shadow Knight Rallos Zek
    192 Gnome Wizard Agnostic
    179 Barbarian Beastlord Mithaniel Marr
    179 Gnome Shadow Knight Bertoxxulous
    175 Human Magician Agnostic
    170 Dark Elf Wizard Solusek Ro
    165 Dark Elf Wizard Agnostic
    164 Iksar Warrior Cazic Thule
    163 Dwarf Warrior Agnostic
    162 Human Enchanter Agnostic
    161 Troll Shaman Innoruuk
    156 Erudite Necromancer Cazic Thule
    156 Half-Elf Ranger Tunare
    155 Gnome Magician Brell Serilis
    151 Gnome Warrior Agnostic
    150 Halfling Paladin Karana
    147 Erudite Magician Agnostic
    138 Human Paladin Mithaniel Marr
    135 Dark Elf Magician Innoruuk
    132 Gnome Wizard Solusek Ro
    131 Troll Beastlord Cazic Thule
    129 Halfling Warrior Agnostic
    126 Erudite Enchanter Agnostic
    124 Troll Shaman Cazic Thule
    121 Erudite Shadow Knight Cazic Thule
    121 Vah Shir Warrior Agnostic
    118 Halfling Rogue Agnostic
    114 Gnome Paladin Brell Serilis
    112 Troll Shadow Knight Cazic Thule
    107 Barbarian Rogue Agnostic
    105 Human Ranger Tunare
    103 Halfling Rogue Bristlebane
    102 Gnome Cleric Brell Serilis
    100 Dark Elf Warrior Agnostic
    100 High Elf Magician Tunare
    99 Dwarf Rogue Agnostic
    99 Vah Shir Rogue Agnostic
    97 Half-Elf Ranger Karana
    96 High Elf Enchanter Tunare
    95 Barbarian Warrior Rallos Zek
    95 Wood Elf Warrior Agnostic
    92 High Elf Wizard Agnostic
    85 Gnome Rogue Agnostic
    84 Half-Elf Paladin Tunare
    78 Human Druid Tunare
    77 Dark Elf Warrior Rallos Zek
    77 Troll Beastlord Innoruuk
    76 Erudite Wizard Agnostic
    76 Half-Elf Druid Tunare
    73 Human Druid Karana
    73 Human Wizard Agnostic
    72 Troll Warrior Agnostic
    71 Halfling Warrior Rallos Zek
    70 Dark Elf Enchanter Innoruuk
    68 Gnome Cleric Bertoxxulous
    67 Erudite Paladin Prexus
    67 Human Necromancer Bertoxxulous
    66 Dwarf Warrior Brell Serilis
    66 Human Ranger Karana
    65 Dark Elf Wizard Innoruuk
    65 Halfling Rogue Brell Serilis
    64 High Elf Wizard Solusek Ro
    64 Human Cleric Rodcet Nife
    63 Wood Elf Bard Tunare
    62 Erudite Wizard Solusek Ro
    62 Troll Shadow Knight Innoruuk
    58 Half-Elf Warrior Agnostic
    55 Barbarian Warrior The Tribunal
    55 Wood Elf Rogue Agnostic
    54 Human Shadow Knight Bertoxxulous
    53 Human Paladin Karana
    52 Dark Elf Rogue Agnostic
    52 Dwarf Rogue Bristlebane
    51 Human Rogue Agnostic
    50 Wood Elf Warrior Tunare
    47 Human Warrior Rallos Zek
    46 Erudite Cleric Cazic Thule
    46 Half-Elf Druid Karana
    45 Gnome Cleric Bristlebane
    43 Half-Elf Rogue Agnostic
    43 Troll Warrior Rallos Zek
    42 Human Wizard Solusek Ro
    41 Human Necromancer Innoruuk
    41 Human Shadow Knight Innoruuk
    40 Human Cleric Innoruuk
    39 Gnome Warrior Rallos Zek
    38 Half-Elf Bard Veeshan
    38 Human Cleric Erollsi Marr
    37 High Elf Enchanter Erollsi Marr
    36 Erudite Magician Quellious
    34 Gnome Enchanter Brell Serilis
    34 Half-Elf Bard Bristlebane
    32 Dark Elf Warrior Innoruuk
    32 Human Paladin Rodcet Nife
    32 Wood Elf Bard Veeshan
    32 Wood Elf Warrior Rallos Zek
    31 Barbarian Rogue Bristlebane
    30 Human Cleric Mithaniel Marr
    29 Erudite Magician Prexus
    28 Erudite Cleric Prexus
    28 Gnome Rogue Bristlebane
    28 High Elf Wizard Tunare
    27 Dwarf Rogue Brell Serilis
    27 Erudite Paladin Quellious
    27 Wood Elf Bard Rallos Zek
    26 Dark Elf Rogue Bristlebane
    26 Erudite Enchanter Quellious
    26 Gnome Magician Bertoxxulous
    26 Half-Elf Bard Tunare
    25 Half-Elf Bard Rallos Zek
    24 Half-Elf Paladin Karana
    24 Wood Elf Rogue Bristlebane
    23 Human Paladin Erollsi Marr
    22 Erudite Cleric Quellious
    22 Human Bard Veeshan
    21 Wood Elf Rogue Tunare
    20 High Elf Magician Erollsi Marr
    20 Human Cleric Karana
    19 Gnome Wizard Brell Serilis
    19 High Elf Magician Karana
    18 Half-Elf Paladin Mithaniel Marr
    17 Halfling Warrior Brell Serilis
    17 Wood Elf Bard Bristlebane
    16 Dark Elf Rogue Innoruuk
    16 Human Bard Bristlebane
    16 Ogre Warrior Cazic Thule
    16 Wood Elf Bard Erollsi Marr
    15 Gnome Rogue Brell Serilis
    15 Human Magician Karana
    14 Erudite Enchanter Prexus
    14 Gnome Warrior Brell Serilis
    14 Half-Elf Paladin Rodcet Nife
    14 Half-Elf Rogue Bristlebane
    14 Human Warrior Rodcet Nife
    13 Barbarian Rogue The Tribunal
    13 Gnome Enchanter Bertoxxulous
    13 Human Magician Mithaniel Marr
    12 High Elf Magician Mithaniel Marr
    12 Human Bard Rallos Zek
    12 Human Cleric Bertoxxulous
    12 Human Rogue Bristlebane
    11 Half-Elf Warrior Rallos Zek
    11 Human Enchanter Erollsi Marr
    11 Human Enchanter Karana
    11 Troll Warrior Cazic Thule
    10 Erudite Wizard Quellious
    10 Half-Elf Paladin Erollsi Marr
    10 High Elf Enchanter Karana
    10 High Elf Enchanter Mithaniel Marr
    10 High Elf Wizard Erollsi Marr
    10 Troll Warrior Innoruuk
    9 Half-Elf Warrior Tunare
    9 Human Bard Quellious
    9 Wood Elf Bard Karana
    8 Half-Elf Bard Karana
    8 Wood Elf Bard Quellious
    7 Erudite Wizard Prexus
    7 Half-Elf Bard Erollsi Marr
    7 Human Bard Mithaniel Marr
    6 Half-Elf Bard Quellious
    6 Half-Elf Rogue Tunare
    6 High Elf Wizard Karana
    6 Human Bard Erollsi Marr
    6 Human Bard Karana
    6 Human Enchanter Mithaniel Marr
    6 Human Magician Erollsi Marr
    6 Human Rogue Bertoxxulous
    5 Gnome Rogue Bertoxxulous
    5 Human Bard The Tribunal
    5 Human Magician Innoruuk
    5 Human Magician Rodcet Nife
    5 Human Warrior Erollsi Marr
    5 Human Wizard Rodcet Nife
    5 Wood Elf Bard Brell Serilis
    5 Wood Elf Warrior Karana
    4 Human Enchanter Bertoxxulous
    4 Human Warrior Mithaniel Marr
    4 Human Wizard Innoruuk
    4 Wood Elf Bard Mithaniel Marr
    4 Wood Elf Bard Rodcet Nife
    3 Gnome Wizard Bertoxxulous
    3 Half-Elf Bard Solusek Ro
    3 Half-Elf Rogue Karana
    3 High Elf Wizard Mithaniel Marr
    3 Human Bard Tunare
    3 Human Enchanter Innoruuk
    3 Human Rogue Karana
    3 Human Warrior Karana
    3 Human Wizard Mithaniel Marr
    2 Half-Elf Bard Mithaniel Marr
    2 Half-Elf Bard Prexus
    2 Human Bard Rodcet Nife
    2 Human Enchanter Rodcet Nife
    2 Human Rogue Rodcet Nife
    2 Human Warrior Bertoxxulous
    2 Human Warrior Innoruuk
    2 Human Wizard Karana
    2 Wood Elf Bard Solusek Ro
    2 Wood Elf Rogue Karana
    1 Gnome Warrior Bertoxxulous
    1 Half-Elf Bard Rodcet Nife
    1 Half-Elf Bard The Tribunal
    1 Half-Elf Rogue Bertoxxulous
    1 Half-Elf Rogue Erollsi Marr
    1 Half-Elf Rogue Rodcet Nife
    1 Half-Elf Warrior Bertoxxulous
    1 Half-Elf Warrior Innoruuk
    1 Half-Elf Warrior Karana
    1 Half-Elf Warrior Mithaniel Marr
    1 Half-Elf Warrior Rodcet Nife
    1 Half-Elf Warrior The Tribunal
    1 Human Bard Brell Serilis
    1 Human Bard Prexus
    1 Human Magician Bertoxxulous
    1 Human Rogue Erollsi Marr
    1 Human Rogue Innoruuk
    1 Human Wizard Bertoxxulous
    1 Wood Elf Bard Prexus
    1 Wood Elf Bard The Tribunal
     
    pivoo and Neealana like this.
  9. Aithne

    Aithne Member

    Messages:
    51
    Sorry for not being pretty :-D
     
  10. Ganter

    Ganter Active Member

    Messages:
    113
    Half of those are your alts
     
    Tryfan, Elroz, pivoo and 4 others like this.
  11. Savok

    Savok Active Member

    Messages:
    71
    Hmm, 1 of 17 Bristlebane Wood Elf Bards on the server. Can anyone do a quick table with top 10 per class by HPs?
     
  12. Mechaike

    Mechaike Well-Known Member

    Messages:
    215
    Now i'm curious if those low digit numbers are traders, hah. Remove level 1s, Org!
     
  13. showstring

    showstring I Feel Loved

    Messages:
    3,339
    For those wondering how to view the data, here's simple instructions.

    1. Right click the linked .txt files -> Save As -> and download them to a location of your choice.

    2. Rename the extension from .txt to .csv so it just natively opens in MS Excel

    upload_2023-4-13_8-51-49.png

    3. Inside Excel, click on the down arrow above column A to select entire column A, then click on Data -> Text to Columns

    upload_2023-4-13_8-53-6.png

    4. Choose the "Delimited" option, and select "Tab" as the Delimiter (usually selected by default), and click Finish

    upload_2023-4-13_8-54-9.png

    5. It will take a moment to process the data, and afterwards you'll see the data presented in a readable column format which you can perform your normal Excel functions on.

    Eg: go to the hp_max column and Sort -> Largest to Smallest

    when prompted, make sure you select "expand the selection" so it shuffles all the data accordingly, not just the single column

    upload_2023-4-13_8-57-7.png
     
  14. solar

    solar Administrator Staff Member

    Messages:
    1,198
    Without renaming it, File->Open, Next, Next, Finish does it for me.
     
  15. showstring

    showstring I Feel Loved

    Messages:
    3,339
    yeah the file format is the same, .txt and .csv interchangeable
    .csv just says "some kind of delimited data in plaintext format" versus "just whatever text"
     
  16. Savok

    Savok Active Member

    Messages:
    71
    Can't you just save it as an Excel sheet for me?
     
  17. Manstache

    Manstache Active Member

    Messages:
    210
    Are there zero of any race/class/deity combos?
     
  18. kai4785

    kai4785 People Like Me

    Messages:
    321
    This surprised me. I didn't expect to find the players with the most mana to not be FT capped. Even though there's 2 players below the 15 cap on this list, there's more than 2 that seem to regen at a lower rate than the rest (40 sitting, 21 standing).
    For example, how is it that Baily, with 30 worn FT has a sitting and standing regen rate that's 15 lower than everyone else? Is this a character with only like 100 meditate skill?

    Code:
    [ Only registered users can see the bbcode. Click Here To Register... ]
     
  19. showstring

    showstring I Feel Loved

    Messages:
    3,339
    refer to
    I'm guessing basically if the char sits for 1 minute before they camp, and then the dump gets taken, they'll have the "resting" regen value, even tho I don't think this feature exists in our client?
     
  20. solar

    solar Administrator Staff Member

    Messages:
    1,198
    I think they were naked when it took the snapshot but it's weird that it's out of sync on the total mana which seems to include items. Good find, I'll check it out.
     
  21. showstring

    showstring I Feel Loved

    Messages:
    3,339
    any chance you would consider only excluding ANON chars from the exports?
    that's the only one that prevents people's magelo from being viewed

    atm it's excluding /role people too which is a lot
     
  22. solar

    solar Administrator Staff Member

    Messages:
    1,198
    Looks like it's a bug in calculating the capped regen value. I think the only 2 stats in this that are affected are mana_regen_sitting_total and mana_regen_standing_total but it's actually a bug in the bonus calculation not the file export part so will fix it for next patch. Thank you for finding it!

    Sure, will include /role characters.
     
    pivoo, Tryfan, kai4785 and 2 others like this.
  23. Bailyvaz

    Bailyvaz Member

    Messages:
    20
    I guess I need to train up my meditate skill some more :)
     
    pivoo and Pithy like this.
  24. showstring

    showstring I Feel Loved

    Messages:
    3,339
    What's some of the rarest items people discovered?
    Some stuff I found interesting:

    1x Possessed Sacrificial Cleaver
    0x Possessed Sacrificial Club
    3x Skull Shaped Wand
    3x Bone Ring of Disharmony
    1x Acrylia Embedded Visor
    0x Robe of Invocation
    0x Scalecracker

    pretty much no Ring of Fear loot or Inner AC loot, which is not surprising :)

    I count 8 Abashis (one person is Anon but I know they got it)
     
    Last edited: Apr 14, 2023
  25. Break

    Break People Like Me

    Messages:
    622
    4 x White Chain Bridles (man, some people just burning DKP to get rich!)
    5 x Black Chain Bridles (horse bug + plat > fashion + speed)
    134 x Pristine Forest Drakeling Scales (aren't these the scales that everyone always complains about?)
    18 x Spell: Remove Greater Curse (honestly didn't expect more than a handful of these unmemmed)

    Edit: Since Rimi is always complaining about this particular item. 15 x Memory.
     
    Last edited: Apr 13, 2023
  26. showstring

    showstring I Feel Loved

    Messages:
    3,339
    another small request, would you please be able to include date/time of most recent export on the new site?
    so people can see when it's been refreshed

    would this also be possible for the general takp allaclone site? I'm not sure when the last sync was done. for example I couldn't find this item on takp allaclone:
    185923 29 32002 Zyzzix's Click Stick
     
  27. Smudge

    Smudge People Like Me

    Messages:
    258
    2x Molten Ring of Incineration
     
  28. showstring

    showstring I Feel Loved

    Messages:
    3,339
    0x Bottomless Box

    might be only one on server on /anon char that I know of then
     
  29. Smudge

    Smudge People Like Me

    Messages:
    258
    Water Sprinkler of Nem Ankh - 370
    Staff of the Four - 220
    Singing Short Sword - 215
    Nature Walker's Scimitar - 210
    Spear of Fate - 181
    Orb of Mastery - 157*
    Staff of the Serpent - 139
    Swiftwind, Earthcaller - 135, 92
    Celestial Fists - 121
    Ragebringer - 116
    Claw of the Savage Spirit - 114
    Jagged Blade of War, Blade of Tactics, Blade of Strategy - 36, 42, 42
    Scythe of the Shadowed Soul - 29
    Innoruuk's Curse - 21
    Fiery Defender - 17
     
    pivoo, Frosst and kai4785 like this.
  30. kai4785

    kai4785 People Like Me

    Messages:
    321
    lol, what's the asterisk on Mage epic?
    And, uh, 3 of those Singing Short Swords are me.
    also, lol @ Swiftwind vs Earthcaller. Stupid Inny.