11 years agojuly 2013 scraper fixes
Maxious []
july 2013 scraper fixes


Former-commit-id: addfa455308e9c96c33cbf6912605410bc86b27b

11 years agofix sitemap
Maxious []
fix sitemap


Former-commit-id: d535c0ad88506027f2f39848b858342624aaa9a6

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr

Conflicts:
documents/sitemap.xml.php

Former-commit-id: 0480844aebe20a3af30b1c98aa192a5a823fb4d6

11 years agoexclude document viewer
Maxious []
exclude document viewer


Former-commit-id: 3f93fcc7e6c4209f6f2b628c2e031cccff7fd3b9

11 years agoupdate semantic markup, add publicbodies.org csv export
Maxious []
update semantic markup, add publicbodies.org csv export


Former-commit-id: 8e2ac6b28cd4442a1d781a68ba9aa046efa64b21

11 years agofix sitemap
Maxious []
fix sitemap


Former-commit-id: ddc69719d5b15a16ac0ec2110cd9fdd9fb44cc0e

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 4734f5390c1e31ca41d2ae836d07ccbe262876e8

11 years agomore export fixes
Maxious []
more export fixes


Former-commit-id: 4ca7f1f81d51d7c094d904b6aa1e176cf5958630

11 years agoadd a logo
Alex Sadleir []
add a logo


Former-commit-id: 0f4593b3734665dd51c44ba3275ce0057cac829a

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Alex Sadleir []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 3df5c7f8ae2e72a7e4ef02c533d19f602f90e201

11 years agoAdd public ranking listing, link charts better
Alex Sadleir []
Add public ranking listing, link charts better


Former-commit-id: 889d2d51a7712e7454f582b671b6142d619ad672

11 years agohandle invalid input in file size and description markup for datagov import
Maxious []
handle invalid input in file size and description markup for datagov import


Former-commit-id: 6c34fd9f8a95d5075ab5fb36f9ee2721736dcaec

11 years agofix licence and format for datagov file upload
Maxious []
fix licence and format for datagov file upload


Former-commit-id: cf8e294aa2638dd43963d93dc03caf2e301fce41

11 years agoreally use temp file upload and filter bad datasets
Maxious []
really use temp file upload and filter bad datasets


Former-commit-id: 45b3fbcaa1090a68577d8da6e8e69fb1048cc1e1

11 years agouse tempfile for datagov resource upload
Maxious []
use tempfile for datagov resource upload


Former-commit-id: 80eae32f084aac5c6ff933def7e5cb072c21b8fc

11 years agoload datasets into scrapr then into ckan filestore
Alex Sadleir []
load datasets into scrapr then into ckan filestore


Former-commit-id: ef39f297007c1ad1e7edee2c2819723b076ae3f4

11 years agotool to check datagov resources
Alex Sadleir []
tool to check datagov resources


Former-commit-id: f406384c3ba09ba04f639abb5731511ddf02b88b

11 years agofix broken urls on datagov export
Maxious []
fix broken urls on datagov export


Former-commit-id: 3c41d2694ab3235f5b6e99681b28dc21dda4e617

11 years agopreprod loading datgov
Maxious []
preprod loading datgov


Former-commit-id: 8ef7c117df568d7a28eeb28264803656527501d9

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 795219845b9651051af38601d3b6b92fc0ed0d93

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 49a3d73556fe6378d4b2863cbfa4d74190523969

11 years agobe permissive with datagov resource file size
Maxious []
be permissive with datagov resource file size


Former-commit-id: c0a71c3c09369965e8748c2a8f7062eb2abbe01a

11 years agoadd other metadata for datagov export into extras field
Maxious []
add other metadata for datagov export into extras field


Former-commit-id: 61e2fdc722dda1cf0c837d247706df1c272a4459

11 years agocleanse data group/org name for datagov
Maxious []
cleanse data group/org name for datagov


Former-commit-id: 864798958ce17be8aab36096ea9ed641e6415467

11 years agoseperate out datagov group export
Maxious []
seperate out datagov group export


Former-commit-id: 99e1c6857169fca0816c1b14cf90f5c31b5aa72f

11 years agocache org ids while importing datagov
Alex Sadleir []
cache org ids while importing datagov


Former-commit-id: 3bb1449efe6725785ffb74bfe250e27913e47885

11 years agoGroups migrated from datagov
Alex Sadleir []
Groups migrated from datagov


Former-commit-id: 3aeee877b6cbf00b3303cddd31ca4790fb66f24c

11 years agoExperimental organization support
Alex Sadleir []
Experimental organization support


Former-commit-id: 0c86e9a2a6e066dc3f1550e7915892d9649ec125

11 years agoenforce valid package url
Alex Sadleir []
enforce valid package url


Former-commit-id: 26accf46eff2958223ffae9a1234d4291379bce4

11 years agoExperimental organization support
Alex Sadleir []
Experimental organization support


Former-commit-id: 8d69f7e95445481fa0fff75ee0def014614268c8

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Alex Sadleir []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr

Conflicts:
documents/genericScrapers.py
documents/runScrapers.sh

Former-commit-id: a6f8697ed080934b51ab7b63a3d4428ff5ccdb2b

11 years agodatagov fixes
Alex Sadleir []
datagov fixes


Former-commit-id: ed3ba96db4beeb126f802a3168476e27f298aeb8

11 years agoscraper fixes
Maxious []
scraper fixes


Former-commit-id: 7dbe6fcea0360db2b17d5c5e4a34f632e3fb3e06

11 years agoignore CSIRO disclog formatting
Maxious []
ignore CSIRO disclog formatting


Former-commit-id: 225487e3a636c4cf2758c6ad60437c748bc1df7c

11 years agoscraoer fxies
Maxious []
scraoer fxies


Former-commit-id: e590ab23de1740c86b174b7ae55da837875155de

11 years agoerror reporting features
Maxious []
error reporting features


Former-commit-id: 4458096bdd46a0e420126ab910fbf68cbdd986f0

11 years agoadd dataqld
Alex Sadleir []
add dataqld


Former-commit-id: 421bd9295854615553f74ab2a00773dcdc878775

11 years agofinished gazette parser
Alex Sadleir []
finished gazette parser


Former-commit-id: 65e9b38b538386e7cab79cc166878d1b19090cb6

11 years agobeginning gazette
Maxious []
beginning gazette


Former-commit-id: f853fcb1ec8fa48819367abd692d0f576974b9cf

11 years agobeginning of export merge
Maxious []
beginning of export merge


Former-commit-id: 121a09aa3f9417f0512b4cb138190070dc9da890

11 years agouse markdown for export
Alex Sadleir []
use markdown for export


Former-commit-id: d6e889dd374b721688275bc44b94427deb8caf03

11 years agoexport no-html and licence
Alex Sadleir []
export no-html and licence


Former-commit-id: 39dafe9fefec609588df4f189c2364dae8edd246

11 years agoimport
Maxious []
import


Former-commit-id: 997dc9ece51a37dc25779ca4125d0960cdc195c9

11 years agoexport
Maxious []
export


Former-commit-id: 613905452e6bd6709f8810fd6b6ed709d2f4e5fb

11 years agoMerge branch 'master' of ssh://maxious.lambdacomplex.org/git/disclosr