This CKAN Extension demonstrates some common patterns for customising a CKAN instance. | This CKAN Extension demonstrates some common patterns for customising a CKAN instance. |
It comprises: | It comprises: |
* A CKAN Extension "plugin" at ``ckanext/example/plugin.py`` which, when | * A CKAN Extension "plugin" at ``ckanext/example/plugin.py`` which, when |
loaded, overrides various settings in the core ``ini``-file to provide: | loaded, overrides various settings in the core ``ini``-file to provide: |
* A path to local customisations of the core templates and stylesheets | * A path to local customisations of the core templates and stylesheets |
* A "stream filter" that replaces arbitrary strings in rendered templates | * A "stream filter" that replaces arbitrary strings in rendered templates |
* A "route" to override and extend the default behaviour of a core CKAN page | * A "route" to override and extend the default behaviour of a core CKAN page |
* A custom Pylons controller for overriding some core CKAN behaviour | * A custom Pylons controller for overriding some core CKAN behaviour |
* A custom Package edit form | * A custom Package edit form |
* A custom Group edit form | |
* A plugin that allows for custom forms to be used for datasets based on | |
their "type". | |
* A custom User registration and edition form | * A custom User registration and edition form |
* Some simple template customisations | * Some simple template customisations |
Installation | Installation |
============ | ============ |
To install this package, from your CKAN virtualenv, run the following from your CKAN base folder (e.g. ``pyenv/``):: | To install this package, from your CKAN virtualenv, run the following from your CKAN base folder (e.g. ``pyenv/``):: |
pip install -e git+https://github.com/okfn/ckanext-example#egg=ckanext-example | pip install -e git+https://github.com/okfn/ckanext-example#egg=ckanext-example |
Then activate it by setting ``ckan.plugins = example`` in your main ``ini``-file. | Then activate it by setting ``ckan.plugins = example`` in your main ``ini``-file. |
Orientation | Orientation |
=========== | =========== |
* Examine the source code, starting with ``ckanext/example/plugin.py`` | * Examine the source code, starting with ``ckanext/example/plugin.py`` |
* To understand the nuts and bolts of this file, which is a CKAN | * To understand the nuts and bolts of this file, which is a CKAN |
*Extension*, read in conjunction with the "Extension | *Extension*, read in conjunction with the "Extension |
documentation": http://docs.ckan.org/en/latest/plugins.html | documentation": http://docs.ckan.org/en/latest/plugins.html |
* One thing the extension does is set the values of | * One thing the extension does is set the values of |
``extra_public_paths`` and ``extra_template_paths`` in the CKAN | ``extra_public_paths`` and ``extra_template_paths`` in the CKAN |
config, which are "documented | config, which are "documented |
here": http://docs.ckan.org/en/latest/configuration.html#extra-template-paths | here": http://docs.ckan.org/en/latest/configuration.html#extra-template-paths |
* These are set to point at directories within | * These are set to point at directories within |
``ckanext/example/theme/`` (in this package). Here we: | ``ckanext/example/theme/`` (in this package). Here we: |
* override the home page HTML ``ckanext/example/theme/templates/home/index.html`` | * override the home page HTML ``ckanext/example/theme/templates/home/index.html`` |
* provide some extra style by serving ``extra.css`` (which is loaded using the ``ckan.template_head_end`` option | * provide some extra style by serving ``extra.css`` (which is loaded using the ``ckan.template_head_end`` option |
* customise the navigation and header of the main template in the file ``layout.html``. | * customise the navigation and header of the main template in the file ``layout.html``. |
The latter file is a great place to make global theme alterations. | The latter file is a great place to make global theme alterations. |
It uses the _layout template_ pattern "described in the Genshi | It uses the _layout template_ pattern "described in the Genshi |
documentation":http://genshi.edgewall.org/wiki/GenshiTutorial#AddingaLayoutTemplate. | documentation":http://genshi.edgewall.org/wiki/GenshiTutorial#AddingaLayoutTemplate. |
This allows you to use Xpath selectors to override snippets of HTML | This allows you to use Xpath selectors to override snippets of HTML |
globally. | globally. |
* The custom package edit form at ``package_form.py`` follows a deprecated | |
way to make a form (using FormAlchemy). This part of the Example Theme needs | |
updating. In the meantime, follow the instructions at: | |
http://readthedocs.org/docs/ckan/en/latest/forms.html | |
import os, logging | |
from ckan.authz import Authorizer | |
import ckan.logic.action.create as create | |
import ckan.logic.action.update as update | |
import ckan.logic.action.get as get | |
from ckan.logic.converters import date_to_db, date_to_form, convert_to_extras,\ | |
convert_from_extras, convert_to_tags, convert_from_tags | |
from ckan.logic import NotFound, NotAuthorized, ValidationError | |
from ckan.logic import tuplize_dict, clean_dict, parse_params | |
import ckan.logic.schema as default_schema | |
from ckan.logic.schema import package_form_schema, group_form_schema | |
import ckan.logic.validators as val | |
from ckan.lib.base import BaseController, render, c, model, abort, request | |
from ckan.lib.base import redirect, _, config, h | |
from ckan.lib.package_saver import PackageSaver | |
from ckan.lib.field_types import DateType, DateConvertError | |
from ckan.lib.navl.dictization_functions import Invalid | |
from ckan.lib.navl.dictization_functions import validate, missing | |
from ckan.lib.navl.dictization_functions import DataError, flatten_dict, unflatten | |
from ckan.plugins import IDatasetForm, IGroupForm, IConfigurer, IConfigurable | |
from ckan.plugins import implements, SingletonPlugin | |
from ckan.lib.navl.validators import (ignore_missing, | |
not_empty, | |
empty, | |
ignore, | |
keep_extras, | |
) | |
log = logging.getLogger(__name__) | |
class ExampleGroupForm(SingletonPlugin): | |
"""This plugin demonstrates how a class packaged as a CKAN | |
extension might extend CKAN behaviour by providing custom forms | |
based on the type of a Group. | |
In this case, we implement two extension interfaces to provide custom | |
forms for specific types of group. | |
- ``IConfigurer`` allows us to override configuration normally | |
found in the ``ini``-file. Here we use it to specify where the | |
form templates can be found. | |
- ``IGroupForm`` allows us to provide a custom form for a dataset | |
based on the 'type' that may be set for a group. Where the | |
'type' matches one of the values in group_types then this | |
class will be used. | |
""" | |
implements(IGroupForm, inherit=True) | |
implements(IConfigurer, inherit=True) | |
def update_config(self, config): | |
""" | |
This IConfigurer implementation causes CKAN to look in the | |
```templates``` directory when looking for the group_form() | |
""" | |
here = os.path.dirname(__file__) | |
rootdir = os.path.dirname(os.path.dirname(here)) | |
template_dir = os.path.join(rootdir, 'ckanext', | |
'example', 'theme', 'templates') | |
config['extra_template_paths'] = ','.join([template_dir, | |
config.get('extra_template_paths', '')]) | |
def group_form(self): | |
""" | |
Returns a string representing the location of the template to be | |
rendered. e.g. "forms/group_form.html". | |
""" | |
return 'forms/group_form.html' | |
def group_types(self): | |
""" | |
Returns an iterable of group type strings. | |
If a request involving a group of one of those types is made, then | |
this plugin instance will be delegated to. | |
There must only be one plugin registered to each group type. Any | |
attempts to register more than one plugin instance to a given group | |
type will raise an exception at startup. | |
""" | |
return ["testgroup"] | |
def is_fallback(self): | |
""" | |
Returns true iff this provides the fallback behaviour, when no other | |
plugin instance matches a group's type. | |
As this is not the fallback controller we should return False. If | |
we were wanting to act as the fallback, we'd return True | |
""" | |
return False | |
def form_to_db_schema(self): | |
""" | |
Returns the schema for mapping group data from a form to a format | |
suitable for the database. | |
""" | |
return group_form_schema() | |
def db_to_form_schema(self): | |
""" | |
Returns the schema for mapping group data from the database into a | |
format suitable for the form (optional) | |
""" | |
return {} | |
def check_data_dict(self, data_dict): | |
""" | |
Check if the return data is correct. | |
raise a DataError if not. | |
""" | |
def setup_template_variables(self, context, data_dict): | |
""" | |
Add variables to c just prior to the template being rendered. | |
""" | |
class ExampleDatasetForm(SingletonPlugin): | |
"""This plugin demonstrates how a theme packaged as a CKAN | |
extension might extend CKAN behaviour. | |
In this case, we implement three extension interfaces: | |
- ``IConfigurer`` allows us to override configuration normally | |
found in the ``ini``-file. Here we use it to specify where the | |
form templates can be found. | |
- ``IDatasetForm`` allows us to provide a custom form for a dataset | |
based on the type_name that may be set for a package. Where the | |
type_name matches one of the values in package_types then this | |
class will be used. | |
""" | |
implements(IDatasetForm, inherit=True) | |
implements(IConfigurer, inherit=True) | |
implements(IConfigurable) | |
def update_config(self, config): | |
""" | |
This IConfigurer implementation causes CKAN to look in the | |
```templates``` directory when looking for the package_form() | |
""" | |
here = os.path.dirname(__file__) | |
rootdir = os.path.dirname(os.path.dirname(here)) | |
template_dir = os.path.join(rootdir, 'ckanext', | |
'example', 'theme', 'templates') | |
config['extra_template_paths'] = ','.join([template_dir, | |
config.get('extra_template_paths', '')]) | |
def configure(self, config): | |
""" | |
Adds our new vocabulary to the database if it doesn't | |
already exist. | |
""" | |
self.vocab_name = u'example_vocab' | |
v = model.Vocabulary.get(self.vocab_name) | |
if not v: | |
log.info("Adding vocab %s" % self.vocab_name) | |
vocab = model.Vocabulary(self.vocab_name) | |
model.Session.add(vocab) | |
model.Session.commit() | |
def package_form(self): | |
""" | |
Returns a string representing the location of the template to be | |
rendered. e.g. "package/new_package_form.html". | |
""" | |
return 'forms/dataset_form.html' | |
def is_fallback(self): | |
""" | |
Returns true iff this provides the fallback behaviour, when no other | |
plugin instance matches a package's type. | |
As this is not the fallback controller we should return False. If | |
we were wanting to act as the fallback, we'd return True | |
""" | |
return True | |
def package_types(self): | |
""" | |
Returns an iterable of package type strings. | |
If a request involving a package of one of those types is made, then | |
this plugin instance will be delegated to. | |
There must only be one plugin registered to each package type. Any | |
attempts to register more than one plugin instance to a given package | |
type will raise an exception at startup. | |
""" | |
return ["example_dataset_form"] | |
def setup_template_variables(self, context, data_dict=None): | |
""" | |
Adds variables to c just prior to the template being rendered that can | |
then be used within the form | |
""" | |
c.licences = [('', '')] + model.Package.get_license_options() | |
c.publishers = [('Example publisher', 'Example publisher 2')] | |
c.is_sysadmin = Authorizer().is_sysadmin(c.user) | |
c.resource_columns = model.Resource.get_columns() | |
## This is messy as auths take domain object not data_dict | |
pkg = context.get('package') or c.pkg | |
if pkg: | |
c.auth_for_change_state = Authorizer().am_authorized( | |
c, model.Action.CHANGE_STATE, pkg) | |
def form_to_db_schema(self): | |
""" | |
Returns the schema for mapping package data from a form to a format | |
suitable for the database. | |
""" | |
schema = package_form_schema() | |
schema.update({ | |
'published_by': [not_empty, unicode, convert_to_extras], | |
'vocab_tag_string': [ignore_missing, convert_to_tags(self.vocab_name)], | |
}) | |
return schema | |
def db_to_form_schema(self): | |
""" | |
Returns the schema for mapping package data from the database into a | |
format suitable for the form (optional) | |
""" | |
schema = package_form_schema() | |
schema.update({ | |
'tags': { | |
'__extras': [keep_extras] | |
}, | |
'vocab_tag_string': [convert_from_tags(self.vocab_name), ignore_missing], | |
'published_by': [convert_from_extras, ignore_missing], | |
}) | |
return schema | |
def check_data_dict(self, data_dict): | |
""" | |
Check if the return data is correct and raises a DataError if not. | |
""" | |
return | |
import os | import os |
from logging import getLogger | from logging import getLogger |
from genshi.filters.transform import Transformer | from genshi.filters.transform import Transformer |
from ckan.plugins import implements, SingletonPlugin | from ckan.plugins import implements, SingletonPlugin |
from ckan.plugins import IConfigurer | from ckan.plugins import IConfigurer |
from ckan.plugins import IGenshiStreamFilter | from ckan.plugins import IGenshiStreamFilter |
from ckan.plugins import IRoutes | from ckan.plugins import IRoutes |
log = getLogger(__name__) | log = getLogger(__name__) |
class ExamplePlugin(SingletonPlugin): | class ExamplePlugin(SingletonPlugin): |
"""This plugin demonstrates how a theme packaged as a CKAN | """This plugin demonstrates how a theme packaged as a CKAN |
extension might extend CKAN behaviour. | extension might extend CKAN behaviour. |
In this case, we implement three extension interfaces: | In this case, we implement three extension interfaces: |
- ``IConfigurer`` allows us to override configuration normally | - ``IConfigurer`` allows us to override configuration normally |
found in the ``ini``-file. Here we use it to specify the site | found in the ``ini``-file. Here we use it to specify the site |
title, and to tell CKAN to look in this package for templates | title, and to tell CKAN to look in this package for templates |
and resources that customise the core look and feel. | and resources that customise the core look and feel. |
- ``IGenshiStreamFilter`` allows us to filter and transform the | - ``IGenshiStreamFilter`` allows us to filter and transform the |
HTML stream just before it is rendered. In this case we use | HTML stream just before it is rendered. In this case we use |
it to rename "frob" to "foobar" | it to rename "frob" to "foobar" |
- ``IRoutes`` allows us to add new URLs, or override existing | - ``IRoutes`` allows us to add new URLs, or override existing |
URLs. In this example we use it to override the default | URLs. In this example we use it to override the default |
``/register`` behaviour with a custom controller | ``/register`` behaviour with a custom controller |
""" | """ |
implements(IConfigurer, inherit=True) | implements(IConfigurer, inherit=True) |
implements(IGenshiStreamFilter, inherit=True) | implements(IGenshiStreamFilter, inherit=True) |
implements(IRoutes, inherit=True) | implements(IRoutes, inherit=True) |
def update_config(self, config): | def update_config(self, config): |
"""This IConfigurer implementation causes CKAN to look in the | """This IConfigurer implementation causes CKAN to look in the |
```public``` and ```templates``` directories present in this | ```public``` and ```templates``` directories present in this |
package for any customisations. | package for any customisations. |
It also shows how to set the site title here (rather than in | It also shows how to set the site title here (rather than in |
the main site .ini file), and causes CKAN to use the | the main site .ini file), and causes CKAN to use the |
customised package form defined in ``package_form.py`` in this | customised package form defined in ``package_form.py`` in this |
directory. | directory. |
""" | """ |
here = os.path.dirname(__file__) | here = os.path.dirname(__file__) |
rootdir = os.path.dirname(os.path.dirname(here)) | rootdir = os.path.dirname(os.path.dirname(here)) |
our_public_dir = os.path.join(rootdir, 'ckanext', | our_public_dir = os.path.join(rootdir, 'ckanext', |
'example', 'theme', 'public') | 'example', 'theme', 'public') |
template_dir = os.path.join(rootdir, 'ckanext', | template_dir = os.path.join(rootdir, 'ckanext', |
'example', 'theme', | 'example', 'theme', |
'templates') | 'templates') |
# set our local template and resource overrides | # set our local template and resource overrides |
config['extra_public_paths'] = ','.join([our_public_dir, | config['extra_public_paths'] = ','.join([our_public_dir, |
config.get('extra_public_paths', '')]) | config.get('extra_public_paths', '')]) |
config['extra_template_paths'] = ','.join([template_dir, | config['extra_template_paths'] = ', |