CKAN Data Hub

Open Knowledge Foundation CKAN Team

www.ckan.org, www.okfn.org, www.thedatahub.org

The Open Knowledge Foundation A community-based, not-for-profit. The Foundation now has projects and partnerships throughout the world and is especially active in Europe. We build tools and communities to create, use and share open knowledge - content and data that everyone can use, share and build on.

We believe that by creating an open knowledge commons and developing tools and communities around this we can make a significant contribution to improving governance, research and the economy.

CKAN Team - Professional Services ● CKAN originally developed for our own use in running http://thedatahub.org/

● Demand from others led to creation of a CKAN professional services team within the Foundation

● 10 full-time developers and support staff (currently expanding). Team has many years experience of providing software solutions to government, non-profit and commercial sector. 2+ years of providing CKAN-based to others.

● Growing open source community - several deployments by other organizations

● Developing a CKAN partnership programme to build up a robust set of professional high quality providers of CKAN-based solutions and services

CKAN[.org] - OpenSource Data Platform - Open source software for running data hubs and data portals in development since 2006 (now at v1.5) - Making it quick and easy for everyone from governments to individuals to publish, find and use data.

CKAN Deployments Dozens of official and community deployments around the world

Data.Gov.UK - UK Gov Official Portal - Official UK gov data portal launched in beta Sept 2009. 7500+ datasets, dozens of publishing departments - Powered by CKAN. OKF CKAN team have been involved in design and implementation since the beginning and continue to be full-time engaged - Rich authorization and workflow requirements

Data Greater Manchester - datagm.org.uk - Grouping of 14 municipal organizations in Greater Manchester area - SaaS solution, with customization and training provided by OKF CKAN - Went from final agreement to launch in less than a month

PublicData.eu ● PublicData.eu is a research prototype of a pan-European data catalogue ● Portal includes all instances of CKAN (such as data.gov.uk), France’s Data Publica, Swedens OpenGov.se, CSI Piemonte’s Dati Piemonte and several municipal catalogues, including those of London, Paris and Vienna. ● Categorization is based on taxonomy normalization, yielding a common set of dataset categories based on EUROVOC. This allows topical navigation across multiple dataset languages.

IATI Registry - http://iatiregistry.org/ - Intl Aid Transparency Initiative index of data published on international development activities to encourage transparency. - SaaS CKAN deployment with hosting and support arrangement in place. - Customized theme and publisher workflow - Phase I completed with launch Autumn 2010. Currently working on phase II with further custom development around importer tools

Helsinki Region Infoshare - http://data.hri.fi - Data hub for Helsinki region in Finland (local transit authority, city government etc) - Initial version of data hub developed by local project owner with support and technical assistance from CKAN team - Local development team have now taken on maintenance and development of the hub (and have joined our partner program)

Walkthrough of CKAN Functionality

CKAN Architecture and Hosting.

● Linux, Apache, Postgres and Python. ● Cloud VM Hosting. ● Our own hosting provider, or other providers such as Amazon EC2. ● Federated structure: easily set up new instances with common search.

Search and Download ● Find data field or Search hyper link, full text search support. ● Search results easily refined via data labels/ tags

Publisher Tools ● We are quite flexible in terms of authorization and publishing. ● There are many meta data and publishing options available when defining a data set. ● Rich authorization

Uploading and Storage ● Upload data to storage (either local or in the cloud) ● Integration with structured data store with data API and support for visualizations and data viewing

Authorization of a Data Set

Visualizing data We can present and explorer data in CKAN including visualization.

Statistics Extension CKAN can give you over all statistics about

● The level activity on your data hub ● Largest groups ● Most viewed data packages ● Who owns the most data packages and more.

Dataset view This is an example of what comes to a view when looking at a dataset. The hyperlinks to the right can be used to get different tag views etc.

Dataset Edit Each dataset meta data can be edited in many ways. There are different information views on the right. These can be customized for each individual instance.

Theming and form customization ● CKAN can customize your theme to include your logo and page design. ● Gallery of themes can be found http://www.flickr. com/photos/okfn/sets/72157627852549350/ ● The user web form can be customized to include ○ Multiple language metadata entry ○ Adaptation to your own metadata schema ○ Your own layout and design ○ Groups, tags, links to publisher information ○ Appropirate CKAN extension fields

Geospatial ● CKAN has advanced geospatial features covering discovery, search and view. These features are used to power the UK’s INSPIRE portal at data.gov.uk.

Moderated Edits

Interoperability, Standards Support

Other Features and Extensions CKAN extensions provide a way to extend CKAN without having to alter the core CKAN codebase and operate just like extensions / plugins in other software systems.

● Reporting ○ stats extension, provides statistics about the dataset catalogue. ○ Full usage metrics with Google Analytics. ● Visual customisation ● Data analysis ● Open access to catalogue ● Different languages - current work in Europe ● http://ckan.org/features/