Data sources

Accessing the full data set:

If the IPFS Desktop Client doesn't work on your computer, you can simply use the download links below to download and save copies of the databases to your hard disk. Then you can open them with SQLite Browser.

Please see this blog post for a detailed example of how to access the data.

Keyword data

We have already processed the NAA document descriptions and Traces of War monument descriptions using the Rapid Automatic Keyword Extraction algorithm. Specifically, we have used the Python rake-nltk library to perform keyword extraction. The phrases and scores are stored in the same database. You can use these for searching and/or attempting to determine which monuments correspond to specific Anzacs.

Mapping data

The cemetery database and the Traces of War database both contain map coordinates. Traces of War contains monuments about every country and service. To focus on Anzac-related monuments, it may be useful to use the keyword data or the proximity of Anzac graves to filter the data set.

Using other databases

We've provided a pgloader configuration to import all the SQLite tables into PostgreSQL.

Please see this blog post for a detailed example of how to access the data.

Copyright

Please note each database has slightly different copyright rules and even within the databases, the copyright may vary. For example, some of these sites have a range of photographs with different copyright on each one. The copyright on some older photos has expired.

The raw tables in the IPFS cloud are similar to the databases in a search engine like Google. We feel that accessing them this way democratises analysis of the data.

The Australian Government has a strong commitment to Open Data initiatives.

Youtube provides an interesting guide to the fair use doctrine for copyrighted works.

Download links

Source CSV SQLite XLS
CWGC cemeteries
(Copyright information)
Download Download
CWGC casualties
(Copyright information)
Download Download
AWM People
(Copyright information)
Download
AWM Roll of Honour
(Copyright information)
Download
NAA
(Copyright information)
Download
TracesOfWar.com
(Copyright information (Some photos are Creative Commons))
Download