Four ways I tried to ingest data for my League of Legends hobby project

Thanks for the question! I just checked the data as it's a very interesting point. When we re-read the ladder in 2 hours - about 84% players are still on the same page and 16% are moved to the other division. We're storing their games per-player, not per-page, so they can pop up on other pages we read, but this depends on luck as we're not reading all pages. But even if we're loosing those players - we still don't loose games because after each pass most servers still have 15–40k players waiting with new games, far more than our match API limit can fetch, so losing some just means picking someone else