11 years agoload datasets into scrapr then into ckan filestore
Alex Sadleir []
load datasets into scrapr then into ckan filestore


Former-commit-id: ef39f297007c1ad1e7edee2c2819723b076ae3f4

11 years agotool to check datagov resources
Alex Sadleir []
tool to check datagov resources


Former-commit-id: f406384c3ba09ba04f639abb5731511ddf02b88b

11 years agofix broken urls on datagov export
Maxious []
fix broken urls on datagov export


Former-commit-id: 3c41d2694ab3235f5b6e99681b28dc21dda4e617

11 years agopreprod loading datgov
Maxious []
preprod loading datgov


Former-commit-id: 8ef7c117df568d7a28eeb28264803656527501d9

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 795219845b9651051af38601d3b6b92fc0ed0d93

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 49a3d73556fe6378d4b2863cbfa4d74190523969

11 years agobe permissive with datagov resource file size
Maxious []
be permissive with datagov resource file size


Former-commit-id: c0a71c3c09369965e8748c2a8f7062eb2abbe01a

11 years agoadd other metadata for datagov export into extras field
Maxious []
add other metadata for datagov export into extras field


Former-commit-id: 61e2fdc722dda1cf0c837d247706df1c272a4459

11 years agocleanse data group/org name for datagov
Maxious []
cleanse data group/org name for datagov


Former-commit-id: 864798958ce17be8aab36096ea9ed641e6415467

11 years agoseperate out datagov group export
Maxious []
seperate out datagov group export


Former-commit-id: 99e1c6857169fca0816c1b14cf90f5c31b5aa72f

11 years agocache org ids while importing datagov
Alex Sadleir []
cache org ids while importing datagov


Former-commit-id: 3bb1449efe6725785ffb74bfe250e27913e47885

11 years agoGroups migrated from datagov
Alex Sadleir []
Groups migrated from datagov


Former-commit-id: 3aeee877b6cbf00b3303cddd31ca4790fb66f24c

11 years agoExperimental organization support
Alex Sadleir []
Experimental organization support


Former-commit-id: 0c86e9a2a6e066dc3f1550e7915892d9649ec125

11 years agoenforce valid package url
Alex Sadleir []
enforce valid package url


Former-commit-id: 26accf46eff2958223ffae9a1234d4291379bce4

11 years agoExperimental organization support
Alex Sadleir []
Experimental organization support


Former-commit-id: 8d69f7e95445481fa0fff75ee0def014614268c8

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Alex Sadleir []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr

Conflicts:
documents/genericScrapers.py
documents/runScrapers.sh

Former-commit-id: a6f8697ed080934b51ab7b63a3d4428ff5ccdb2b

11 years agodatagov fixes
Alex Sadleir []
datagov fixes


Former-commit-id: ed3ba96db4beeb126f802a3168476e27f298aeb8

11 years agoscraper fixes
Maxious []
scraper fixes


Former-commit-id: 7dbe6fcea0360db2b17d5c5e4a34f632e3fb3e06

11 years agoignore CSIRO disclog formatting
Maxious []
ignore CSIRO disclog formatting


Former-commit-id: 225487e3a636c4cf2758c6ad60437c748bc1df7c

11 years agoscraoer fxies
Maxious []
scraoer fxies


Former-commit-id: e590ab23de1740c86b174b7ae55da837875155de

11 years agoerror reporting features
Maxious []
error reporting features


Former-commit-id: 4458096bdd46a0e420126ab910fbf68cbdd986f0

11 years agoadd dataqld
Alex Sadleir []
add dataqld


Former-commit-id: 421bd9295854615553f74ab2a00773dcdc878775

11 years agofinished gazette parser
Alex Sadleir []
finished gazette parser


Former-commit-id: 65e9b38b538386e7cab79cc166878d1b19090cb6

11 years agobeginning gazette
Maxious []
beginning gazette


Former-commit-id: f853fcb1ec8fa48819367abd692d0f576974b9cf

11 years agobeginning of export merge
Maxious []
beginning of export merge


Former-commit-id: 121a09aa3f9417f0512b4cb138190070dc9da890

11 years agouse markdown for export
Alex Sadleir []
use markdown for export


Former-commit-id: d6e889dd374b721688275bc44b94427deb8caf03

11 years agoexport no-html and licence
Alex Sadleir []
export no-html and licence


Former-commit-id: 39dafe9fefec609588df4f189c2364dae8edd246

11 years agoimport
Maxious []
import


Former-commit-id: 997dc9ece51a37dc25779ca4125d0960cdc195c9

11 years agoexport
Maxious []
export


Former-commit-id: 613905452e6bd6709f8810fd6b6ed709d2f4e5fb

11 years agoMerge branch 'master' of ssh://maxious.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://maxious.lambdacomplex.org/git/disclosr

Conflicts:
documents/genericScrapers.py

Former-commit-id: fd782edf0c10bd013c7246ec174f7a5696976167

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: c2b6c469cb5be191b38608b3462f6430c1be55e1

11 years agofix scraper interval
Maxious []
fix scraper interval


Former-commit-id: 3028cb06efbf3c9d8a9f903943fab75d89156535

11 years agofix budget figure format
Alex Sadleir []
fix budget figure format


Former-commit-id: 16331ce9803668eac5155ef7b9a8621a3d62619d

11 years agofix bootstrap default index
Alex Sadleir []
fix bootstrap default index


Former-commit-id: cd8acd7a19085ce9c471324148b8a5192a79b2ae

11 years agoadd bubble tree
Alex Sadleir []
add bubble tree


Former-commit-id: 7afbec2676978f74d47cb7178d648a437c620b34

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Alex Sadleir []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: 088e2ae92a5b5e95f28dcf62ec219255cd70e1b1

11 years agoadd rtk ausbudget import
Alex Sadleir []
add rtk ausbudget import


Former-commit-id: d3c7a3150e694b11c6ff5fcde0626c3bc31de9ea

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr

Conflicts:
documents/genericScrapers.py

Former-commit-id: 492c708ed8d0d1b30bb7c8f672b9e101a7d44f89

11 years agoscraper fixes
maxious []
scraper fixes


Former-commit-id: 7c09d22a257167842febb35ef0a1605548e871c2

11 years agobeginning datagov scraper
Alex Sadleir []
beginning datagov scraper


Former-commit-id: a8775a64a3cdda480e4433742ed7ea6ca6a437ef

11 years agofix wcag validation tester
Alex Sadleir []
fix wcag validation tester


Former-commit-id: 7194cc6a6482caa4c20ac597289ff96b748223c3

11 years agoMerge branch 'master' of ssh://maxious.lambdacomplex.org/git/disclosr
Maxious []
Merge branch 'master' of ssh://maxious.lambdacomplex.org/git/disclosr


Former-commit-id: e293a60b8963cd5221cb092a37ff8779fb8c7191

11 years agodisable diffing for now
Maxious []
disable diffing for now


Former-commit-id: 145b72d8e4e5766e0659785c9291aa5d482ca40b

11 years agoMerge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr
Alex Sadleir []
Merge branch 'master' of ssh://apples.lambdacomplex.org/git/disclosr


Former-commit-id: b6c8a547ade7d55b43dbb7019988a3aeeef20537

11 years agoexport all