data.wa.gov.au

target:http://datawagovau.readthedocs.org/en/latest/?badge=latest alt:Documentation Status

This repository contains instructions to setup and deploy a data portal based on CKAN, plus some infrastructure to automate the information pipelines along the pyramid of data - information - knowledge - wisdom.

Deployment documents the setup of a virtual machine, ready for the install of CKAN and the Data Science Workbench. GovHack 2015 contains the history of this project as a GovHack submission in July 2015. The last two chapters illustrate an alternative source install for CKAN and the workbench packages. Installing from source is superseded by datacats and docker, but might be advatageous for systems with single-sign-on and shared authentication.

• Deployment
  • AWS EC2 instance
  • Folder structure
  • Docker
  • Web servers
  • Routing
  • Web domain
  • Virtualenv
  • Github SSH keys
  • Disaster recovery
  • Result
• CKAN
  • Directories and symlinks
  • Datacats install
  • Datacats environments
  • Reverse proxy the datacats environment
  • Extensions
  • Modify datacats containers
  • Config
  • PyCSW
• Disaster Recovery
  • Examples
  • Backup & Restore
  • Archive
• Operations
  • Quality Assurance (ckanext-qa)
  • Geo-referencing a dataset (ckanext-spatial)
  • Adding a static page (ckanext-pages)
  • CKAN to CKAN Harvesting (ckanext-harvest)
  • Harvesting between catalogues with custom CKAN dataset schemas
  • Harvesting WMS
  • Custom WMS harvesting
  • Mint DOIs (ckanext-doi)
  • Media gallery (ckan-galleries)
  • Harvesting WMS notes
  • data.wa.gov.au theming extension
  • Contribute to Datacats
• Data Science Workbench
  • RStudio Server
  • RShiny Server
  • OpenRefine
  • IPython Notebook Server
  • Quantum GIS Server
  • QGIS plugin idea: CKAN dataset shopping basket
  • Taverna
  • Map
• GovHack 2015
  • Disclaimer
  • Details
  • Future directions
• CKAN Source install
  • Install system dependencies
  • virtualenv
  • Clone CKAN code from custom fork
  • Database
  • SolR
  • Data store and datapusher
  • Spatial referencing
  • Custom dataset schema
  • Multi-tenant install
• RStudio and RShiny package install
  • Nginx