Comments - Mr.Radar

I'm not sure about the technical details of this project. You can view the code we use on GitHub (https://github.com/ArchiveTeam/gamefront-grab) and you can ask our main project programmer arkiver on our IRC channel #archiveteam on EFNet.

The Internet Archive's normal scraping doesn't usually dig that deeply into sites but this was a special scrape specifically to grab GameFront-hosted files. To clarify, the ArchiveTeam is not officially associated with the Internet Archive though our aims are similar and the IA is nice enough to host our data dumps (you can grab the raw archive files here: Archive.org) and even incorporate them into the WayBack Machine. You can view the progress we've made on the GameFront grab here Tracker.archiveteam.org (and yes, we have grabbed over 28 TB of data from them).

Hi, I'm a member of a group called the ArchiveTeam which archives websites that are about to close. We actually put GameFront on our deathwatch list last year after they stopped posting news updates. Late last year we scraped the files they were hosting and every file that we've saved (which should be the vast majority of them) is available through the Internet Archive WayBack Machine (for example: Web.archive.org). That's not to say that you shouldn't make your own archives of content you care about (you definitely should!) but rest assured that there is a backup if all else fails.