1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.
  2. Hemos actualizado nuestra Política de Privacidad acorde con la nueva RGPD. +Info // We've updated our Privacy Policy to comply with the GDPR. +Info
    Dismiss Notice

Spreadsheet / Raw Infinity Army Data

Discussion in 'Infinity Army' started by Whirl, Apr 10, 2018.

  1. Whirl

    Whirl Member

    Joined:
    Feb 21, 2018
    Messages:
    7
    Likes Received:
    6
    Hi,

    I'm relatively new to Infinity; I've got both the Android app installed and I'm using the army builder via Chrome quite a lot.

    What I've thought would be really useful, is if we could search through every single unit much like you would do in a spreadsheet, where you could filter or sort by different characteristics etc. I know you can do this to some extent within the army builder now, but this is always limited by faction and doesn't quite allow for all the things you can do via spreadsheet - e.g. formulas, percentages etc. (yes I would go there :nerd_face: ).

    It would really help me learn about all the units out there (not just in Aleph). Has anyone else thought of this and/or found a way to get to the raw data behind the army list builder - is there an API hidden somewhere?

    Thanks
     
    xagroth likes this.
  2. toadchild

    toadchild EI Aspect

    Joined:
    Feb 22, 2017
    Messages:
    2,535
    Likes Received:
    4,827
    I haven't really looked into how Army 6 is implemented, but I don't think there's an API that you can use.

    If you're not averse to doing some scripting of your own, the data I use for the MayaNet iPad army builder is available here in JSON format. It would take some work to turn it into a spreadsheet, but it's probably more accessible than scraping Army.
     
    Alfy, Pierzasty and xagroth like this.
  3. Whirl

    Whirl Member

    Joined:
    Feb 21, 2018
    Messages:
    7
    Likes Received:
    6
    Thanks I'll take a look - where did you get all this data from?
     
  4. toadchild

    toadchild EI Aspect

    Joined:
    Feb 22, 2017
    Messages:
    2,535
    Likes Received:
    4,827
    The project goes back many years and has had several owners but it’s all manually entered.

    We’re still in the process of updating with the latest NA2 stuff.
     
  5. Whirl

    Whirl Member

    Joined:
    Feb 21, 2018
    Messages:
    7
    Likes Received:
    6
    line 2746 of the merc_units.json file has an invalid trailing comma }, should be just } I think

    trying to validate / export the files through powershell and that one threw an error. I'll post my script when I'm done
     
  6. toadchild

    toadchild EI Aspect

    Joined:
    Feb 22, 2017
    Messages:
    2,535
    Likes Received:
    4,827
    There may be a couple of those; the tool I was using used to be much stricter but then with a version change defaulted to being permissive. There are some units that are represented in kind of weird ways, so if you run into any issues please feel free to PM me.

    Also if you have any minor bugfixes like that, feel free to submit a pull request on bitbucket and I'll incorporate them. Or just let me know and I'll fix them myself. :-)
     
  7. Whirl

    Whirl Member

    Joined:
    Feb 21, 2018
    Messages:
    7
    Likes Received:
    6
    I've managed to get a simple csv going (see the drive link below), but without any children unit types or costs yet.

    https://drive.google.com/open?id=1VF41VmtoULAC6vt1bH5hPSklfB_DcV-t

    Be warned - the powershell script is pretty fugly at the moment, so once I've finished getting the main functionality in there I'll have a go at refactoring it properly.
     
    xagroth and toadchild like this.
  8. xagroth

    xagroth Mournful Echo

    Joined:
    Nov 23, 2017
    Messages:
    5,708
    Likes Received:
    4,591
    Can't wait to have the finished spreadsheet to run it through MicroStrategy... mmmm....
     
  9. Whirl

    Whirl Member

    Joined:
    Feb 21, 2018
    Messages:
    7
    Likes Received:
    6
    Belgrim and toadchild like this.
  10. Whirl

    Whirl Member

    Joined:
    Feb 21, 2018
    Messages:
    7
    Likes Received:
    6
    Minor fix to the spreadsheet as the specs, bsws and ccws weren't always fully populated.
     
  11. Whirl

    Whirl Member

    Joined:
    Feb 21, 2018
    Messages:
    7
    Likes Received:
    6
    Now comes the whole point in doing this - I've added "effective wounds", "visibility", "lieutenant" and "MSV" columns to the end of the dataset. It's currently sorted by ID, but becomes much more powerful if you start sorting by cost for example.
     
    Alfy likes this.
  12. Alfy

    Alfy Well-Known Member

    Joined:
    Jul 11, 2019
    Messages:
    85
    Likes Received:
    160
    Hi. Sorry, but the link does not work anymore. Do you still use it, and if yes, could you provide a new link? It's a great tool and I was thinking of using it to sort/filter units I own and perhaps adding columns for which faction/sectorial the unit is available for.
     
  13. toadchild

    toadchild EI Aspect

    Joined:
    Feb 22, 2017
    Messages:
    2,535
    Likes Received:
    4,827
    Sure thing - new URL is here: https://bitbucket.org/toadchild/infinitydata/src/master/
     
    xagroth likes this.
  14. Alfy

    Alfy Well-Known Member

    Joined:
    Jul 11, 2019
    Messages:
    85
    Likes Received:
    160
    Thanks a bunch!
     
  15. Space Ranger

    Space Ranger Well-Known Member

    Joined:
    Apr 27, 2018
    Messages:
    2,164
    Likes Received:
    1,646
    Here's my version in Excel. I agree about seeing everything in a spread sheet. Makes a huge difference I think. Being able to filter by specialist, under 25pts, and 0 SWC, etc is fantastic.

    https://drive.google.com/open?id=13SbinjbEPveqmzMEPz9WazkVOc0o9v_j

    Edit: Sorry if it doesn't make sense on a few things. The first column is marked if it has a cube or not. Then there's a lot of abbreviations.
     
    #15 Space Ranger, Aug 26, 2019
    Last edited: Aug 27, 2019
    xagroth and Alfy like this.