8 years agoupdate semantic markup, add publicbodies.org csv export
Maxious []
update semantic markup, add publicbodies.org csv export


Former-commit-id: 8e2ac6b28cd4442a1d781a68ba9aa046efa64b21

9 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 4734f5390c1e31ca41d2ae836d07ccbe262876e8

9 years agomore export fixes
Maxious []
more export fixes


Former-commit-id: 4ca7f1f81d51d7c094d904b6aa1e176cf5958630

9 years agoadd a logo
Alex Sadleir []
add a logo


Former-commit-id: 0f4593b3734665dd51c44ba3275ce0057cac829a

9 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Alex Sadleir []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 3df5c7f8ae2e72a7e4ef02c533d19f602f90e201

9 years agoAdd public ranking listing, link charts better
Alex Sadleir []
Add public ranking listing, link charts better


Former-commit-id: 889d2d51a7712e7454f582b671b6142d619ad672

9 years agohandle invalid input in file size and description markup for datagov import
Maxious []
handle invalid input in file size and description markup for datagov import


Former-commit-id: 6c34fd9f8a95d5075ab5fb36f9ee2721736dcaec

9 years agofix licence and format for datagov file upload
Maxious []
fix licence and format for datagov file upload


Former-commit-id: cf8e294aa2638dd43963d93dc03caf2e301fce41

9 years agoreally use temp file upload and filter bad datasets
Maxious []
really use temp file upload and filter bad datasets


Former-commit-id: 45b3fbcaa1090a68577d8da6e8e69fb1048cc1e1

9 years agouse tempfile for datagov resource upload
Maxious []
use tempfile for datagov resource upload


Former-commit-id: 80eae32f084aac5c6ff933def7e5cb072c21b8fc

9 years agoload datasets into scrapr then into ckan filestore
Alex Sadleir []
load datasets into scrapr then into ckan filestore


Former-commit-id: ef39f297007c1ad1e7edee2c2819723b076ae3f4

9 years agotool to check datagov resources
Alex Sadleir []
tool to check datagov resources


Former-commit-id: f406384c3ba09ba04f639abb5731511ddf02b88b

9 years agofix broken urls on datagov export
Maxious []
fix broken urls on datagov export


Former-commit-id: 3c41d2694ab3235f5b6e99681b28dc21dda4e617

9 years agopreprod loading datgov
Maxious []
preprod loading datgov


Former-commit-id: 8ef7c117df568d7a28eeb28264803656527501d9

9 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 795219845b9651051af38601d3b6b92fc0ed0d93

9 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 49a3d73556fe6378d4b2863cbfa4d74190523969

9 years agobe permissive with datagov resource file size
Maxious []
be permissive with datagov resource file size


Former-commit-id: c0a71c3c09369965e8748c2a8f7062eb2abbe01a

9 years agoadd other metadata for datagov export into extras field
Maxious []
add other metadata for datagov export into extras field


Former-commit-id: 61e2fdc722dda1cf0c837d247706df1c272a4459

9 years agocleanse data group/org name for datagov
Maxious []
cleanse data group/org name for datagov


Former-commit-id: 864798958ce17be8aab36096ea9ed641e6415467

9 years agoseperate out datagov group export
Maxious []
seperate out datagov group export


Former-commit-id: 99e1c6857169fca0816c1b14cf90f5c31b5aa72f

9 years agocache org ids while importing datagov
Alex Sadleir []
cache org ids while importing datagov


Former-commit-id: 3bb1449efe6725785ffb74bfe250e27913e47885

9 years agoGroups migrated from datagov
Alex Sadleir []
Groups migrated from datagov


Former-commit-id: 3aeee877b6cbf00b3303cddd31ca4790fb66f24c

9 years agoExperimental organization support
Alex Sadleir []
Experimental organization support


Former-commit-id: 0c86e9a2a6e066dc3f1550e7915892d9649ec125

9 years agoenforce valid package url
Alex Sadleir []
enforce valid package url


Former-commit-id: 26accf46eff2958223ffae9a1234d4291379bce4

9 years agoExperimental organization support
Alex Sadleir []
Experimental organization support


Former-commit-id: 8d69f7e95445481fa0fff75ee0def014614268c8

9 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Alex Sadleir []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr

Conflicts:
documents/genericScrapers.py
documents/runScrapers.sh

Former-commit-id: a6f8697ed080934b51ab7b63a3d4428ff5ccdb2b

9 years agodatagov fixes
Alex Sadleir []
datagov fixes


Former-commit-id: ed3ba96db4beeb126f802a3168476e27f298aeb8

9 years agoscraper fixes
Maxious []
scraper fixes


Former-commit-id: 7dbe6fcea0360db2b17d5c5e4a34f632e3fb3e06

9 years agoignore CSIRO disclog formatting
Maxious []
ignore CSIRO disclog formatting


Former-commit-id: 225487e3a636c4cf2758c6ad60437c748bc1df7c

9 years agoscraoer fxies
Maxious []
scraoer fxies


Former-commit-id: e590ab23de1740c86b174b7ae55da837875155de

9 years agoerror reporting features
Maxious []
error reporting features


Former-commit-id: 4458096bdd46a0e420126ab910fbf68cbdd986f0

9 years agoadd dataqld
Alex Sadleir []
add dataqld


Former-commit-id: 421bd9295854615553f74ab2a00773dcdc878775

9 years agofinished gazette parser
Alex Sadleir []
finished gazette parser


Former-commit-id: 65e9b38b538386e7cab79cc166878d1b19090cb6

9 years agobeginning gazette
Maxious []
beginning gazette


Former-commit-id: f853fcb1ec8fa48819367abd692d0f576974b9cf

9 years agobeginning of export merge
Maxious []
beginning of export merge


Former-commit-id: 121a09aa3f9417f0512b4cb138190070dc9da890

9 years agouse markdown for export
Alex Sadleir []
use markdown for export


Former-commit-id: d6e889dd374b721688275bc44b94427deb8caf03

9 years agoexport no-html and licence
Alex Sadleir []
export no-html and licence


Former-commit-id: 39dafe9fefec609588df4f189c2364dae8edd246

9 years agoimport
Maxious []
import


Former-commit-id: 997dc9ece51a37dc25779ca4125d0960cdc195c9

9 years agoexport
Maxious []
export


Former-commit-id: 613905452e6bd6709f8810fd6b6ed709d2f4e5fb

9 years agoMerge branch 'master' of ssh://maxious.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://maxious.lambdacomplex.org/git/disclosr

Conflicts:
documents/genericScrapers.py

Former-commit-id: fd782edf0c10bd013c7246ec174f7a5696976167

9 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: c2b6c469cb5be191b38608b3462f6430c1be55e1

9 years agofix scraper interval
Maxious []
fix scraper interval


Former-commit-id: 3028cb06efbf3c9d8a9f903943fab75d89156535

9 years agofix budget figure format
Alex Sadleir []
fix budget figure format


Former-commit-id: 16331ce9803668eac5155ef7b9a8621a3d62619d

9 years agofix bootstrap default index
Alex Sadleir []
fix bootstrap default index


Former-commit-id: cd8acd7a19085ce9c471324148b8a5192a79b2ae

9 years agoadd bubble tree