projects / disclosr.git / commitdiff
search:
summary | shortlog | log | commit | commitdiff | tree
unified | plain
Employee headcount data importer
Employee headcount data importer


Former-commit-id: 1919555a49e1a2f5961fe6a113fec2264b004293

file:a/about.php -> file:b/about.php
<?php <?php
include_once('include/common.inc.php'); include_once('include/common.inc.php');
include_header(); include_header();
?> ?>
<div class="foundation-header"> <div class="foundation-header">
<h1><a href="about.php">About/FAQ</a></h1> <h1><a href="about.php">About/FAQ</a></h1>
<h4 class="subheader">Lorem ipsum.</h4> <h4 class="subheader">Lorem ipsum.</h4>
</div> </div>
<h2> What is this? </h2> <h2> What is this? </h2>
Disclosr is a project to monitor Australian Federal Government agencies Disclosr is a project to monitor Australian Federal Government agencies
compliance with their <a href="http://www.oaic.gov.au/publications/other_operational/foi_policy_frequently_asked_questions.html#_Toc291837571">"proactive disclosure requirements"</a>. compliance with their <a href="http://www.oaic.gov.au/publications/other_operational/foi_policy_frequently_asked_questions.html#_Toc291837571">"proactive disclosure requirements"</a>.
OGRE (Open Government Realization Evaluation) is a ranking of compliance with these requirements. OGRE (Open Government Realization Evaluation) is a ranking of compliance with these requirements.
Prometheus is the agent which polls agency websites to assess compliance. Prometheus is the agent which polls agency websites to assess compliance.
   
<h2> Open everything </h2> <h2> Open everything </h2>
All documents released CC-BY 3 AU All documents released CC-BY 3 AU
Open source git @ Open source git @
   
<h2>Organisational Data Sources</h2> <h2>Organisational Data Sources</h2>
   
http://www.comlaw.gov.au/Browse/Results/ByTitle/AdministrativeArrangementsOrders/Current/Ad/0 defines departments http://www.comlaw.gov.au/Browse/Results/ByTitle/AdministrativeArrangementsOrders/Current/Ad/0 defines departments
Agencies can be found in the Schedule to an Appropriation Bill (budget), Schedule to FMA Regulations and/or Public Service Act.<br> Agencies can be found in the Schedule to an Appropriation Bill (budget), Schedule to FMA Regulations and/or Public Service Act.<br>
   
http://www.finance.gov.au/publications/flipchart/docs/FMACACFlipchart.pdf summarises these. view-source:https://www.tenders.gov.au/?event=public.advancedsearch.home is great for the suspended/active status<br> http://www.finance.gov.au/publications/flipchart/docs/FMACACFlipchart.pdf summarises these. view-source:https://www.tenders.gov.au/?event=public.advancedsearch.home is great for the suspended/active status<br>
   
  Fraud in gov depts by Fairfax Media http://www.smh.com.au/national/public-service-keeps-fraud-cases-private-20110923-1kpdr.html
   
When defining the hierachy, this system is designed towards monitoring accountablity. Thus large agencies that have registered their own ABN When defining the hierachy, this system is designed towards monitoring accountablity. Thus large agencies that have registered their own ABN
and have their own accountablity mechanisms/website receive a seperate record as a child of their department. and have their own accountablity mechanisms/website receive a seperate record as a child of their department.
Some small agencies will choose to simply rely on their parent department's accountablity measures.<br> Some small agencies will choose to simply rely on their parent department's accountablity measures.<br>
   
This flows through to organisation name and other/past names. A department that completely accounts for an agency will list that agency as an other child name. This flows through to organisation name and other/past names. A department that completely accounts for an agency will list that agency as an other child name.
As agencies themselves shift between departments, there may be scope for providing time ranges but typically the newest hierarchy will be the one recorded. As agencies themselves shift between departments, there may be scope for providing time ranges but typically the newest hierarchy will be the one recorded.
A department/agency name will be the newest active name assigned to that ABN.<br> A department/agency name will be the newest active name assigned to that ABN.<br>
   
ABN information is derived from the ABR. This is the definitive umpire about which former name should be linked to which current name. ABN information is derived from the ABR. This is the definitive umpire about which former name should be linked to which current name.
For example "Department of Transport and Regional Services" became "Department of Infrastructure, Transport, Regional Development and Local Government" (same ABN) For example "Department of Transport and Regional Services" became "Department of Infrastructure, Transport, Regional Development and Local Government" (same ABN)
however it later split into "Department of Infrastructure and Transport" (same ABN) however it later split into "Department of Infrastructure and Transport" (same ABN)
and "Department of Regional Australia, Regional Development and Local Government" (new ABN).<br> and "Department of Regional Australia, Regional Development and Local Government" (new ABN).<br>
   
Statistical information from http://www.apsc.gov.au/stateoftheservice/1011/statsbulletin/section1.html#t2total https://www.apsedii.gov.au/apsedii/CustomQueryx33.shtml Statistical information from http://www.apsc.gov.au/stateoftheservice/1011/statsbulletin/section1.html#t2total https://www.apsedii.gov.au/apsedii/CustomQueryx33.shtml
and individual annual reports.<br> and individual annual reports.<br>
   
<h2>Webpage Assessment</h2> <h2>Webpage Assessment</h2>
Much due care has been put into correctly recording disclosure URLs. Typically the "About", "Corporate", "Publications" and "Sitemap" sections are checked at the very least. Much due care has been put into correctly recording disclosure URLs. Typically the "About", "Corporate", "Publications" and "Sitemap" sections are checked at the very least.
Occasionally it is nessicary to use a site or Google search. In several rare cases, there is a secret "Disclosure" navigation menu you can find if you find one of the mandatory publishing obligations in that category (seriously).<br> Occasionally it is nessicary to use a site or Google search. In several rare cases, there is a secret "Disclosure" navigation menu you can find if you find one of the mandatory publishing obligations in that category (seriously).<br>
Some rules about leniency:<br> Some rules about leniency:<br>
<ul> <ul>
<li>An empty FOI disclosure log counts, a page outlining what the FOI Act is does not.</li> <li>An empty FOI disclosure log counts, a page outlining what the FOI Act is does not.</li>
<li>A disclosure log in PDF or Word format counts :(</li> <li>A disclosure log in PDF or Word format counts :(</li>
<li>An empty File/Record list counts (although that's very minimalistic that you have no files, electronic or paper)</li> <li>An empty File/Record list counts (although that's very minimalistic that you have no files, electronic or paper)</li>
<li>Only a current information publication scheme page counts, not a s.9 FOI Act page or an organisation chart.</li> <li>Only a current information publication scheme page counts, not a s.9 FOI Act page or an organisation chart.</li>
<li>If there isn't a page easily listing all current and past Annual Reports, the most current one (html, pdf) counts.</li> <li>If there isn't a page easily listing all current and past Annual Reports, the most current one (html, pdf) counts.</li>
<li>Consultancy contracts might not need it's own webpage (if in Annual Report), grants/appointments might not apply to all organisations but Legal Services Expenditure (and all other obligations) does need a webpage. </li> <li>Consultancy contracts might not need it's own webpage (if in Annual Report), grants/appointments might not apply to all organisations but Legal Services Expenditure (and all other obligations) does need a webpage. </li>
   
<h2>Open Government Scoring</h2> <h2>Open Government Scoring</h2>
+1 point for every true Has... attribute<br> +1 point for every true Has... attribute<br>
-1 point for every false Has... (ie. Has Not) attribute</br> -1 point for every false Has... (ie. Has Not) attribute</br>
   
Don't like this? Make your own score, suggest a better scoring mechanism.</br> Don't like this? Make your own score, suggest a better scoring mechanism.</br>
   
<?php <?php
include_footer(); include_footer();
?> ?>
file:b/admin/0203apsemployees.csv (new)
  "Agriculture, Fisheries & Forestry",3530
  Attorney-Generals,708
  Administrative Appeals Tribunal,108
  AUSTRAC,60
  Australian Crime Commission,225
  Australian Customs Service,4934
  Australian Protective Service,1124
  CrimTrac Agency,34
  Family Court of Australia,574
  Federal Court of Australia,221
  Federal Magistrates Service,46
  Federal Privacy Commissioner,32
  HREOC,79
  ITSA,227
  National Native Title Tribunal,241
  Office of the D.P.P.,403
  Office of Film & Literature Class,39
  Office of the Parl. Counsel,45
  Communications IT & the Arts,776
  Aust. Broadcasting Authority,114
  Aust. Communications Authority,391
  Aust. National Maritime Museum,90
  National Archives of Australia,363
  National Library of Australia,443
  National Museum of Australia,185
  NOIE,160
  Defence,18231
  Defence Housing Authority,661
  DEST,1464
  Australian Research Council,50
  DEWR,2055
  EOWA,11
  Australian Industrial Registry,185
  Comcare,300
  NOHSC,89
  Environment and Heritage,1271
  Australian Greenhouse Office,167
  Bureau of Meteorology,1403
  GBRMPA,153
  National Oceans Office,31
  Family and Community Services,4832
  Aust. Institute of Family Studies,39
  Centrelink,25147
  Finance and Administration,771
  Australian Electoral Comm.,729
  ComSuper,338
  Foreign Affairs & Trade,2763
  ACIAR,44
  Health & Ageing,5137
  Aust. Institute of Health & Welfare,152
  ARPANSA,126
  FSANZ,110
  PSR,25
  DIMIA,4089
  Aboriginal Hostels Ltd.,341
  ATSIC,1072
  AIATSIS,62
  Torres Strait Regional Authority,30
  Industry Tourism & Resources,2691
  Prime Minister & Cabinet,344
  ANAO,278
  Commonwealth Ombudsman,78
  Office of National Assessments,47
  APS Commission,164
  Transport & Regional Services,945
  National Capital Authority,76
  Treasury,906
  Australian Bureau of Statistics,3024
  ACCC,446
  ASIC,1048
  Australian Taxation Office,20238
  Productivity Commission,197
  Veterans Affairs,2335
  Australian War Memorial,215
 
file:b/admin/0304apsemployees.csv (new)
  "Agriculture, Fisheries and Forestry",3928
  Attorney-General's,781
  Administrative Appeals Tribunal,117
  AUSTRAC,61
  Australian Crime Commission,315
  Australian Customs Service,4736
  Australian Protective Service,1234
  CrimTrac Agency,44
  Family Court of Australia,608
  Federal Court of Australia,238
  Federal Magistrates Service,56
  Federal Privacy Commissioner,29
  HREOC,84
  ITSA,240
  National Native Title Tribunal,243
  Office of the D.P.P.,416
  Office of Film & Literature Class.,37
  Office of Parliamentary Counsel,46
  Communications IT & the Arts,607
  Aust. Broadcasting Authority,114
  Aust. Communications Authority,407
  Australian Film Commission,176
  AGIMO,95
  Aust. National Maritime Museum,93
  National Archives of Australia,386
  National Library of Australia,438
  National Museum of Australia,186
  Defence,18301
  Defence Housing Authority,679
  DEST,1684
  Australian Research Council,53
  DEWR,2171
  Australian Industrial Registry,188
  Comcare,325
  EOWA,10
  NOHSC,89
  Environment and Heritage,1276
  Australian Greenhouse Office,166
  Bureau of Meteorology,1371
  GBRMPA,162
  National Oceans Office,39
  Family and Community Services,4818
  Aust. Institute of Family Studies,38
  Centrelink,24904
  Finance and Administration,895
  Australian Electoral Comm.,765
  ComSuper,329
  Foreign Affairs and Trade,2809
  ACIAR,40
  Health and Ageing,5365
  Aust. Institute of Health & Welfare,157
  ARPANSA,117
  FSANZ,104
  National Blood Authority,33
  OPSR,27
  DIMIA,4487
  Aboriginal Hostels Ltd.,291
  AIATSIS,59
  ATSIC,24
  ATSIS,1109
  Torres Strait Regional Authority,34
  "Industry, Tourism & Resources",2878
  Prime Minister & Cabinet,372
  ANAO,287
  APS Commission,172
  Commonwealth Ombudsman,82
  Office of National Assessments,51
  Transport & Regional Services,885
  National Capital Authority,68
  Treasury,984
  Australian Bureau of Statistics,2866
  ACCC,450
  ASIC,1137
  Australian Taxation Office,20501
  Productivity Commission,183
  Veterans' Affairs,2356
  Australian War Memorial,196
 
file:b/admin/0405apsemployees.csv (new)
  "Agriculture, Fisheries & Forestry ",1297
  AQIS,3028
  Attorney-Generals ,1011
  Administrative Appeals Tribunal,154
  AUSTRAC,137
  Australian Crime Commission,412
  Australian Customs Service,5054
  Commonwealth DPP,451
  CrimTrac Agency,51
  Family Court of Australia,737
  Federal Court of Australia,403
  Federal Magistrates Service,102
  Federal Privacy Commissioner,40
  HREOC,95
  ITSA,275
  National Native Title Tribunal,265
  Office of Film & Literature Class,41
  Office of the Parl. Counsel,43
  "Communications, IT & the Arts ",804
  Aust. Broadcasting Authority,106
  Aust. Communications Authority,416
  Australian Film Commission,167
  Aust. National Maritime Museum,114
  National Archives of Australia,514
  National Library of Australia,523
  National Museum of Australia,260
  Defence ,18638
  Defence Housing Authority,685
  DEST ,2001
  Australian Research Council,71
  Questacon,211
  DEWR ,3141
  Australian Industrial Registry,202
  Comcare,384
  EOWA,28
  Environment & Heritage ,1852
  Bureau of Meteorology,1442
  GBRMPA,170
  ORER,11
  Family & Community Services ,1949
  Aust. Institute of Family Studies,66
  Finance & Administration ,1297
  Australian Electoral Comm.,808
  Commonwealth Grants Commission,40
  ComSuper,393
  Foreign Affairs & Trade ,2468
  ACIAR,47
  AusAID,615
  Health & Ageing ,4220
  Aust. Institute of Health & Welfare,215
  ARPANSA,130
  FSANZ,121
  National Blood Authority,40
  Professional Services Review,18
  Human Services ,37
  Centrelink,25317
  Child Support Agency,3238
  CRS Australia,1998
  Immigration ,5769
  Aboriginal Hostels Ltd.,458
  AIATSIS,116
  Migration Review Tribunal,132
  Refugee Review Tribunal,176
  Torres Strait Regional Authority,48
  "Industry, Tourism & Resources ",1906
  Geoscience Australia,635
  IP Australia,821
  NOPSA,28
  Prime Minister & Cabinet ,402
  ANAO,313
  Australian Public Service Commission,211
  Commonwealth Ombudsman,113
  National Water Commission,27
  Office of National Assessments,93
  Transport & Regional Services ,1178
  National Capital Authority,91
  Treasury ,885
  Australian Bureau of Statistics,3095
  ACCC,509
  AOFM,33
  ASIC,1494
  Australian Taxation Office,23417
  National Competition Council,11
  Productivity Commission,200
  Royal Australian Mint,117
  Veterans Affairs ,2655
  Australian War Memorial,310
 
file:b/admin/0506apsemployees.csv (new)
  "Agriculture, Fisheries & Forestry",1498
  AQIS,3289
  Attorney-Generals,1226
  Administrative Appeals Tribunal,156
  AUSTRAC,141
  Australian Crime Commission,425
  Australian Customs Service,5574
  CrimTrac Agency,53
  Family Court of Australia,765
  Federal Court of Australia,412
  Federal Magistrates Service,112
  Federal Privacy Commissioner,44
  HREOC,102
  ITSA,270
  National Native Title Tribunal,244
  Commonwealth DPP,469
  Office of Film & Literature Class,49
  Office of the Parl. Counsel,46
  "Communications, IT & the Arts",833
  Australian Communications & Media Authority,497
  Australian Film Commission,255
  Australian National Maritime Museum,107
  Australian Sports Anti-Doping Authority,46
  National Archives of Australia,467
  National Library of Australia,499
  National Museum of Australia,301
  Defence,19791
  Defence Housing Authority,699
  DEST,2359
  AIATSIS,128
  Australian Research Council,69
  Questacon,230
  DEWR,3853
  Australian Building and Construction Commission,85
  Australian Fair Pay Commission,11
  Australian Industrial Registry,175
  Comcare,379
  EOWA,30
  Office of Workplace Services,188
  Environment & Heritage,2060
  Bureau of Meteorology,1404
  GBRMPA,172
  ORER,11
  FaCSIA,2589
  Aboriginal Hostels Ltd.,489
  Australian Institute of Family Studies,53
  Torres Strait Regional Authority,72
  Finance & Administration,1409
  Australian Electoral Commission,790
  Commonwealth Grants Commission,41
  ComSuper,435
  Foreign Affairs & Trade,2551
  ACIAR,50
  AusAID,706
  Health & Ageing,4301
  Australian Institute of Health & Welfare,203
  ARPANSA,136
  FSANZ,125
  National Blood Authority,52
  Professional Services Review,14
  Human Services,5545
  Centrelink,26549
  Medicare Australia,5393
  Immigration,6341
  Migration Review Tribunal,103
  Refugee Review Tribunal,161
  "Industry, Tourism & Resources",1979
  Geoscience Australia,669
  IP AUSTRALIA,888
  NOPSA,34
  Prime Minister & Cabinet,590
  ANAO,308
  Australian Public Service Commission,253
  Commonwealth Ombudsman,141
  National Water Commission,45
  Office of National Assessments,122
  Transport & Regional Services,1327
  National Capital Authority,95
  Treasury,915
  Australian Bureau of Statistics,3511
  ACCC,582
  AOFM,39
  ASIC,1540
  Australian Taxation Office,22568
  National Competition Council,9
  Productivity Commission,205
  Royal Australian Mint,145
  Veterans Affairs,2521
  Australian War Memorial,316
 
file:b/admin/0607apsemployees.csv (new)
  "Agriculture, Fisheries & Forestry",4951
  Attorney-Generals,1504
  Administrative Appeals Tribunal,162
  AUSTRAC,247
  ACLEI,6
  Australian Crime Commission,554
  Australian Customs Service,5904
  CrimTrac Agency,81
  Family Court of Australia,727
  Federal Court of Australia,401
  Federal Magistrates Court,160
  Federal Privacy Commissioner,58
  HREOC,116
  ITSA,285
  National Native Title Tribunal,244
  Commonwealth DPP,497
  Office of the Parl. Counsel,48
  "Communications, IT & the Arts",914
  ACMA,552
  Australian Film Commission,244
  Aust. National Maritime Museum,109
  ASADA,55
  National Archives of Australia,465
  National Library of Australia,521
  National Museum of Australia,282
  Defence,21177
  Defence Housing Australia,699
  DEST,2470
  AIATSIS,114
  Australian Research Council,73
  Questacon,231
  DEWR,3862
  ABCC,128
  Australian Fair Pay Commission,28
  Australian Industrial Registry,175
  Comcare,426
  EOWA,21
  Office of Workplace Services,303
  Environment & Water Resources,2292
  Bureau of Meteorology,1451
  GBRMPA,171
  ORER,11
  FaCSIA,3099
  Aboriginal Hostels Ltd.,491
  Aust. Institute of Family Studies,59
  Torres Strait Regional Authority,76
  Finance & Administration,1514
  Australian Electoral Commission,886
  Commonwealth Grants Commission,41
  ComSuper,595
  Future Fund Management Agency,12
  Foreign Affairs & Trade,2784
  ACIAR,52
  AusAID,775
  Austrade,515
  Health & Ageing,4830
  Aust. Institute of Health & Welfare,211
  ARPANSA,134
  Cancer Australia,26
  FSANZ,131
  National Blood Authority,50
  NHMRC,221
  Professional Services Review,16
  Human Services,6433
  Centrelink,27296
  Medicare Australia,5959
  Immigration,6788
  MRT/RRT,304
  "Industry, Tourism & Resources",2075
  Geoscience Australia,682
  IP AUSTRALIA,913
  NOPSA,42
  Prime Minister & Cabinet,711
  ANAO,330
  Australian Public Service Commission,250
  Commonwealth Ombudsman,153
  National Water Commission,32
  Office of National Assessments,133
  Transport & Regional Services,1330
  National Capital Authority,106
  Treasury,996
  Australian Bureau of Statistics,3167
  ACCC,647
  AOFM,33
  ASIC,1664
  Australian Taxation Office,23110
  National Competition Council,9
  Productivity Commission,207
  Royal Australian Mint,181
  Veterans' Affairs,2401
  Australian War Memorial,293
 
file:b/admin/0708apsemployees.csv (new)
  "Agriculture, Fisheries & Forestry",4785
  APVMA,130
  Export Wheat Commission,15
  Attorney-General's,1420
  Administrative Appeals Tribunal,114
  ACLEI,11
  AUSTRAC,332
  Australian Crime Commission,495
  Australian Customs Service,6106
  CrimTrac Agency,138
  Family Court of Australia,558
  Federal Court of Australia,261
  Federal Magistrates Court,141
  HREOC,93
  ITSA,270
  National Capital Authority,47
  National Native Title Tribunal,217
  Commonwealth DPP,509
  Office of the Parl. Counsel,50
  DBCDE,559
  ACMA,569
  Climate Change,218
  ORER,10
  Defence,20819
  Defence Housing Australia,565
  DEEWR,5619
  ABCC,137
  Australian Fair Pay Commission,25
  Australian Industrial Registry,157
  AIATSIS,48
  Comcare,469
  Office of the Workplace Ombudsman,365
  Workplace Authority,610
  "Environment, Water, Heritage and the Arts",2333
  Australian Film Commission,256
  Aust. National Maritime Museum,105
  Bureau of Meteorology,1265
  GBRMPA,184
  National Library of Australia,444
  National Museum of Australia,226
  National Water Commission,29
  FaHCSIA,2810
  Aboriginal Hostels Ltd.,362
  EOWA,17
  Torres Strait Regional Authority,36
  Finance & Deregulation,1349
  Australian Electoral Comm.,697
  ComSuper,533
  Future Fund Management Agency,38
  National Archives of Australia,390
  Foreign Affairs & Trade,2665
  ACIAR,32
  AusAID,801
  AUSTRADE,485
  Health & Ageing,4445
  Aust. Institute of Health & Welfare,228
  Australian Sports Anti-Doping Authority,60
  ARPANSA,132
  Cancer Australia,22
  FSANZ,118
  National Blood Authority,44
  NHMRC,209
  Private Health Insurance Ombudsman,11
  Professional Services Review,19
  Human Services,5951
  Centrelink,25416
  Medicare Australia,5593
  Immigration,6495
  RRT and MRT,270
  Infrastructure,1225
  DIISR,1656
  Australian Research Council,87
  IP AUSTRALIA,968
  Questacon,82
  Prime Minister & Cabinet,483
  Aust. Institute of Family Studies,42
  ANAO,307
  Australian Public Service Commission,201
  Commonwealth Ombudsman,155
  Federal Privacy Commissioner,61
  OIGIS,9
  Office of National Assessments,96
  "Resources, Energy and Tourism",329
  Geoscience Australia,611
  NOPSA,49
  Treasury,973
  Australian Bureau of Statistics,2858
  ACCC,658
  AOFM,30
  ASIC,1451
  Australian Taxation Office,22486
  Commonwealth Grants Commission,39
  National Competition Council,7
  Productivity Commission,179
  Royal Australian Mint,146
  Veterans' Affairs,2250
  Australian War Memorial,228
 
file:b/admin/0809apsemployees.csv (new)
  "Agriculture, Fisheries & Forestry",5168
  Australian Fisheries Management Authority,260
  APVMA,161
  Wheat Exports Australia,17
  Attorney-General's,1663
  Administrative Appeals Tribunal,155
  ACLEI,18
  AUSTRAC,343
  Australian Crime Commission,527
  Australian Customs and Border Protection Service,6031
  CrimTrac Agency,187
  Family Court of Australia,669
  Federal Court of Australia,376
  Federal Magistrates Court,213
  HREOC,122
  ITSA,294
  National Capital Authority,58
  National Native Title Tribunal,246
  Commonwealth DPP,614
  Office of Parliamentary Counsel,50
  DBCDE,651
  ACMA,624
  Climate Change,415
  ORER,21
  Defence,21152
  Defence Housing Australia,728
  DEEWR,5996
  ABCC,156
  Australian Fair Pay Commission Secretariat,29
  Australian Industrial Registry,203
  Comcare,570
  Office of the Workplace Ombudsman,484
  Workplace Authority,470
  "Environment, Water, Heritage and the Arts",3392
  Australian National Maritime Museum,119
  Bureau of Meteorology,1545
  GBRMPA,241
  Murray Darling Basin Authority,235
  National Library of Australia,513
  National Museum of Australia,295
  National Film and Sound Archive,235
  National Water Commission,48
  Screen Australia,78
  FaHCSIA,3455
  Aboriginal Hostels Ltd.,519
  EOWA,31
  Torres Strait Regional Authority,77
  Finance & Deregulation,1706
  Australian Electoral Commission,805
  ComSuper,574
  Future Fund Management Agency,57
  National Archives of Australia,506
  Foreign Affairs & Trade,2984
  ACIAR,48
  AusAID,981
  AUSTRADE,524
  Health & Ageing,4912
  Australian Institute of Health & Welfare,265
  AOTDTA,15
  Australian Sports Anti-Doping Authority,60
  ARPANSA,152
  Cancer Australia,25
  FSANZ,123
  National Blood Authority,42
  NHMRC,238
  Private Health Insurance Ombudsman,10
  Professional Services Review,30
  Human Services,6620
  Centrelink,27973
  Medicare Australia,5844
  Immigration & Citizenship,7052
  MRT & RRT,273
  Infrastructure,1279
  DIISR,1843
  AIATSIS,119
  Australian Research Council,107
  IP AUSTRALIA,1049
  Questacon,233
  Prime Minister & Cabinet,647
  Australian Institute of Family Studies,75
  ANAO,365
  Australian Public Service Commission,241
  Commonwealth Ombudsman,168
  Federal Privacy Commissioner,64
  OIGIS,13
  Office of National Assessments,148
  Old Parliament House,88
  "Resources, Energy and Tourism",401
  Geoscience Australia,745
  NOPSA,54
  Treasury,1103
  Australian Bureau of Statistics,2871
  ACCC,787
  AOFM,36
  ASIC,1882
  Australian Taxation Office,23505
  Commonwealth Grants Commission,46
  National Competition Council,9
  Productivity Commission,183
  Royal Australian Mint,197
  Veterans' Affairs,2165
  Australian War Memorial,313
 
file:b/admin/0910apsemployees.csv (new)
  National Competition Council,9
  Private Health Insurance Ombudsman,12
  OIGIS,12
  Wheat Exports Australia,13
  Cancer Australia,19
  ACLEI,20
  ORER,25
  Professional Services Review,30
  AOTDTA,31
  AOFM,35
  EOWA,36
  Commonwealth Grants Commission,40
  National Blood Authority,46
  ACIAR,51
  NOPSA,51
  Office of the Parl. Counsel,54
  National Water Commission,57
  Office of the Privacy Commissioner,58
  National Capital Authority,60
  ASADA,69
  Future Fund Management Agency,70
  Aust. Institute of Family Studies,76
  Torres Strait Regional Authority,82
  Old Parliament House,95
  Screen Australia,102
  Australian Transport Safety Bureau,107
  Safe Work Australia,109
  Australian Research Council,109
  Human Rights Commission,124
  AIATSIS,126
  FSANZ,130
  Aust. National Maritime Museum,132
  Office of National Assessments,146
  ABCC,151
  ARPANSA,152
  APVMA,155
  Commonwealth Ombudsman,156
  Administrative Appeals Tribunal,165
  Royal Australian Mint,171
  CrimTrac Agency,185
  Federal Magistrates Court,186
  Productivity Commission,196
  Questacon,218
  National Native Title Tribunal,223
  AFMA,225
  National Film and Sound Archive,232
  GBRMPA,237
  Australian Public Service Commission,247
  NHMRC,249
  MRT & RRT,273
  Australian War Memorial,291
  Fair Work Australia,299
  National Museum of Australia,312
  Murray Darling Basin Authority,314
  AUSTRAC,318
  ITSA,321
  Federal Court of Australia,360
  ANAO,367
  Aust. Institute of Health & Welfare,383
  "Resources, Energy and Tourism",454
  National Archives of Australia,504
  National Library of Australia,540
  Australian Crime Commission,543
  Aboriginal Hostels Ltd.,556
  Commonwealth DPP,558
  AUSTRADE,563
  ComSuper,587
  Comcare,593
  Defence Housing Australia,630
  Family Court of Australia,660
  ACMA,663
  Prime Minister & Cabinet,680
  DBCDE,715
  Geoscience Australia,723
  ACCC,804
  Australian Electoral Commission,922
  Office of the Fair Work Ombudsman,969
  Climate Change and Energy Efficiency,1019
  AusAID,1037
  IP AUSTRALIA,1050
  Infrastructure,1105
  Treasury,1133
  Bureau of Meteorology,1656
  Attorney-General's,1707
  Finance & Deregulation,1841
  DIISR,2072
  ASIC,2080
  Veterans' Affairs,2144
  "Environment, Water, Heritage and the Arts",3115
  Foreign Affairs & Trade,3160
  Australian Bureau of Statistics,3332
  FaHCSIA,3685
  "Agriculture, Fisheries & Forestry",4892
  Health & Ageing,5232
  Medicare Australia,5695
  Customs,5940
  DEEWR,6054
  Human Services,6607
  Immigration & Citizenship,7014
  Defence,21458
  Australian Taxation Office,24070
  Centrelink,27312
 
file:b/admin/1011apsemployees.csv (new)
  "Agriculture, Fisheries and Forestry",5219
  Australian Fisheries Management Authority,227
  APVMA,165
  Wheat Exports Australia,13
  Attorney-General's,1618
  Administrative Appeals Tribunal,162
  ACLEI,27
  AUSTRAC,332
  Australian Crime Commission,635
  Aust. Customs & Border Prot. Service,5767
  Aust. Human Rights Commission,139
  Commonwealth DPP,514
  CrimTrac Agency,181
  Family Court of Australia,670
  Federal Court of Australia,362
  Federal Magistrates Court,195
  ITSA,344
  National Native Title Tribunal,176
  Office of the Parl. Counsel,55
  DBCDE,700
  ACMA,662
  Climate Change and Energy Efficiency,984
  ORER,44
  Defence,22481
  Defence Housing Australia,614
  DEEWR,5468
  ABCC,150
  Comcare,667
  Fair Work Australia,310
  Office of the Fair Work Ombudsman,955
  Safe Work Australia,121
  FaHCSIA,3500
  Aboriginal Hostels Ltd.,563
  EOWA,34
  Torres Strait Regional Authority,107
  Finance and Deregulation,1964
  Australian Electoral Commission,913
  ComSuper,545
  Future Fund Management Agency,80
  Foreign Affairs and Trade,3354
  ACIAR,50
  AusAID,1245
  AUSTRADE,546
  Health and Ageing,5396
  Aust. Institute of Health and Welfare,393
  AOTDTA,33
  ARPANSA,162
  Cancer Australia,22
  FSANZ,133
  National Blood Authority,50
  NHMRC,248
  Private Health Insurance Ombudsman,14
  Professional Services Review,30
  Human Services,6443
  Centrelink,25225
  Medicare Australia,5842
  Immigration and Citizenship,7903
  MRT RRT,283
  Infrastructure,1001
  Australian Transport Safety Bureau,109
  DIISR,3594
  AIATSIS,136
  Australian Research Council,112
  Prime Minister and Cabinet,1140
  Aust. Institute of Family Studies,81
  ANAO,360
  Aust. National Maritime Museum,127
  Australian Public Service Commission,332
  Australian Sports Anti-Doping Authority,67
  Commonwealth Ombudsman,183
  National Archives of Australia,494
  National Library of Australia,494
  National Museum of Australia,287
  National Film and Sound Archive,235
  Office of the Australian Information Commissioner,86
  OIGIS,13
  Office of National Assessments,148
  Old Parliament House,92
  Screen Australia,35
  Regional Australia,336
  National Capital Authority,69
  "Resources, Energy and Tourism",1262
  NOPSA,60
  "Sustainability, Environment, Water, Population and Communities",2949
  Bureau of Meteorology,1775
  GBRMPA,266
  Murray Darling Basin Authority,314
  National Water Commission,74
  Treasury,1397
  Australian Bureau of Statistics,3540
  ACCC,825
  ASIC,1905
  Australian Taxation Office,24902
  National Competition Council,9
  Productivity Commission,203
  Veterans' Affairs,2146
  Australian War Memorial,302
 
file:a/admin/import.php (deleted)
<?php  
 
require_once '../include/common.inc.php';  
try {  
$server->create_db('disclosr-agencies');  
} catch (SetteeRestClientException $e) {  
setteErrorHandler($e);  
}  
$db = $server->get_db('disclosr-agencies');  
createAgencyDesignDoc();  
$conn = new PDO("pgsql:dbname=contractDashboard;user=postgres;password=snmc;host=localhost");  
$namesQ = 'select agency.abn, string_agg("agencyName",\'|\') as names from agency inner join agency_nametoabn on agency.abn::text = agency_nametoabn.abn group by agency.abn;';  
$abntonames = Array();  
foreach ($conn->query($namesQ) as $row) {  
$abntonames[$row['abn']] = explode("|", $row['names']);  
}  
$result = $conn->query("select * from agency");  
while ($agency = $result->fetch(PDO::FETCH_ASSOC)) {  
$agency['_id'] = md5($agency['abn']);  
$agency['otherNames'] = $abntonames[$agency['abn']];  
if (sizeof($abntonames[$agency['abn']]) == 1)  
$agency['name'] = $abntonames[$agency['abn']][0];  
$agency["lastScraped"] = "1/1/1970";  
$agency["scrapeDepth"] = 1;  
try {  
$doc = $db->save($agency);  
//print_r($doc);  
echo $agency['abn'] . " imported \n<br>";  
} catch (SetteeRestClientException $e) {  
setteErrorHandler($e);  
}  
}  
?>  
 
file:b/admin/importAPSCEmployees.php (new)
  <?php
 
  require_once '../include/common.inc.php';
 
  $db = $server->get_db('disclosr-agencies');
  $rows = $db->get_view("app", "byName")->rows;
  $nametoid = Array();
  $sums = Array();
  foreach ($rows as $row) {
  $nametoid[trim($row->key)] = $row->value;
  }
  $employeeCSVs = Array("2002-2003" => "0203apsemployees.csv",
  "2003-2004" => "0304apsemployees.csv",
  "2004-2005" => "0405apsemployees.csv",
  "2005-2006" => "0506apsemployees.csv",
  "2006-2007" => "0607apsemployees.csv",
  "2007-2008" => "0708apsemployees.csv",
  "2008-2009" => "0809apsemployees.csv",
  "2009-2010" => "0910apsemployees.csv",
  "2010-2011" => "1011apsemployees.csv"
  );
  foreach ($employeeCSVs as $timePeriod => $employeeCSV) {
  echo $employeeCSV . "<br>" . PHP_EOL;
  $row = 1;
  if (($handle = fopen($employeeCSV, "r")) !== FALSE) {
  while (($data = fgetcsv($handle, 1000, ",")) !== FALSE) {
  //print_r($data);
  $name = trim($data[0]);
  if (isset($nametoid[$name])) {
  $id = $nametoid[$name];
  //echo $id . "<br>" . PHP_EOL;
  @$sums[$id][$timePeriod] += $data[1];
  } else {
  echo "<br>ERROR NAME MISSING FROM ID LIST<br><bR>" . PHP_EOL;
 
  die();
 
  }
  }
  fclose($handle);
  }
  }
  foreach ($sums as $id => $sum) {
  echo $id. "<br>" . PHP_EOL;
  $doc = $db->get($id);
  // print_r($doc);
  if (isset($doc->statistics)) $doc->statistics = Array();
  foreach ($sum as $timePeriod => $value) {
  $doc->statistics["employees"][$timePeriod] = Array("value"=>$value, "source"=>"http://apsc.gov.au/stateoftheservice/");
  }
  $db->save($doc);
  }
  // employees: timeperiod, source = apsc state of service, value
  ?>
 
file:b/admin/importContractDashboardAgencies.php (new)
  <?php
 
  require_once '../include/common.inc.php';
  try {
  $server->create_db('disclosr-agencies');
  } catch (SetteeRestClientException $e) {
  setteErrorHandler($e);
  }
  $db = $server->get_db('disclosr-agencies');
  createAgencyDesignDoc();
  $conn = new PDO("pgsql:dbname=contractDashboard;user=postgres;password=snmc;host=localhost");
  $namesQ = 'select agency.abn, string_agg("agencyName",\'|\') as names from agency inner join agency_nametoabn on agency.abn::text = agency_nametoabn.abn group by agency.abn;';
  $abntonames = Array();
  foreach ($conn->query($namesQ) as $row) {
  $abntonames[$row['abn']] = explode("|", $row['names']);
  }
  $result = $conn->query("select * from agency");
  while ($agency = $result->fetch(PDO::FETCH_ASSOC)) {
  $agency['_id'] = md5($agency['abn']);
  $agency['otherNames'] = $abntonames[$agency['abn']];
  if (sizeof($abntonames[$agency['abn']]) == 1)
  $agency['name'] = $abntonames[$agency['abn']][0];
  $agency["lastScraped"] = "1/1/1970";
  $agency["scrapeDepth"] = 1;
  try {
  $doc = $db->save($agency);
  //print_r($doc);
  echo $agency['abn'] . " imported \n<br>";
  } catch (SetteeRestClientException $e) {
  setteErrorHandler($e);
  }
  }
  ?>
 
file:b/admin/importDirectoryUUIDs.php (new)
  <?php
  // http://gold.gov.au/reports/department/index.xml
  require_once '../include/common.inc.php';
  try {
  $server->create_db('disclosr-agencies');
  } catch (SetteeRestClientException $e) {
  setteErrorHandler($e);
  }
  $db = $server->get_db('disclosr-agencies');
  createAgencyDesignDoc();
 
  ?>
 
file:b/admin/importGov2RegisterRSSFacebookTwitter.php (new)
  <?php
 
  require_once '../include/common.inc.php';
  try {
  $server->create_db('disclosr-agencies');
  } catch (SetteeRestClientException $e) {
  setteErrorHandler($e);
  }
  $db = $server->get_db('disclosr-agencies');
  createAgencyDesignDoc();
 
  // twitter https://docs.google.com/spreadsheet/fm?id=tsJVd9EYoAjbl014y3qMgWg.03918275400592898296.8568379511161083736&hl=en&fmcmd=5&gid=0
  // RSS https://docs.google.com/spreadsheet/fm?id=tbqjwIDHKHiVYF_glJ93GgA.03918275400592898296.8789688748524615194&authkey=CJDP-uQG&hl=en_GB&fmcmd=5&gid=0
  // facebook https://docs.google.com/spreadsheet/fm?id=tkcqoo9wrgzNWmoANuVhsBw.03918275400592898296.3040387705062056060&authkey=CKzl7r0I&hl=en_GB&fmcmd=5&gid=0
  ?>
 
file:a/include/couchdb.inc.php -> file:b/include/couchdb.inc.php
<?php <?php
   
include $basePath . "schemas/schemas.inc.php"; include $basePath . "schemas/schemas.inc.php";
   
require ($basePath . 'couchdb/settee/src/settee.php'); require ($basePath . 'couchdb/settee/src/settee.php');
   
function createDocumentsDesignDoc() { function createDocumentsDesignDoc() {
/*"views": { /*"views": {
"web_server": { "web_server": {
"map": "function(doc) {\n emit(doc.web_server, 1);\n}", "map": "function(doc) {\n emit(doc.web_server, 1);\n}",
"reduce": "function (key, values, rereduce) {\n return sum(values);\n}" "reduce": "function (key, values, rereduce) {\n return sum(values);\n}"
}, },
"byAgency": { "byAgency": {
"map": "function(doc) {\n emit(doc.agencyID, 1);\n}", "map": "function(doc) {\n emit(doc.agencyID, 1);\n}",
"reduce": "function (key, values, rereduce) {\n return sum(values);\n}" "reduce": "function (key, values, rereduce) {\n return sum(values);\n}"
}, },
"byURL": { "byURL": {
"map": "function(doc) {\n emit(doc.url, doc);\n}" "map": "function(doc) {\n emit(doc.url, doc);\n}"
}, },
"agency": { "agency": {
"map": "function(doc) {\n emit(doc.agencyID, doc);\n}" "map": "function(doc) {\n emit(doc.agencyID, doc);\n}"
}, },
"byWebServer": { "byWebServer": {
"map": "function(doc) {\n emit(doc.web_server, doc);\n}" "map": "function(doc) {\n emit(doc.web_server, doc);\n}"
} }
}*/ }*/
} }
   
function createAgencyDesignDoc() { function createAgencyDesignDoc() {
global $db; global $db;
$obj = new stdClass(); $obj = new stdClass();
$obj->_id = "_design/" . urlencode("app"); $obj->_id = "_design/" . urlencode("app");
$obj->language = "javascript"; $obj->language = "javascript";
$obj->views->all->map = "function(doc) { emit(doc._id, doc); };"; $obj->views->all->map = "function(doc) { emit(doc._id, doc); };";
$obj->views->byABN->map = "function(doc) { emit(doc.abn, doc); };"; $obj->views->byABN->map = "function(doc) { emit(doc.abn, doc); };";
$obj->views->byCanonicalName->map = "function(doc) { $obj->views->byCanonicalName->map = "function(doc) {
if (doc.parentOrg || doc.orgType == 'FMA-DepartmentOfState') { if (doc.parentOrg || doc.orgType == 'FMA-DepartmentOfState') {
emit(doc.name, doc); emit(doc.name, doc);
} }
};"; };";
$obj->views->byDeptStateName->map = "function(doc) { $obj->views->byDeptStateName->map = "function(doc) {
if (doc.orgType == 'FMA-DepartmentOfState') { if (doc.orgType == 'FMA-DepartmentOfState') {
emit(doc.name, doc._id); emit(doc.name, doc._id);
} }
};"; };";
$obj->views->parentOrgs->map = "function(doc) { $obj->views->parentOrgs->map = "function(doc) {
if (doc.parentOrg) { if (doc.parentOrg) {
emit(doc._id, doc.parentOrg); emit(doc._id, doc.parentOrg);
} }
};"; };";
$obj->views->byName->map = 'function(doc) { $obj->views->byName->map = 'function(doc) {
if (typeof(doc["status"]) == "undefined" || doc["status"] != "suspended") { if (typeof(doc["status"]) == "undefined" || doc["status"] != "suspended") {
emit(doc.name, doc._id); emit(doc.name, doc._id);
  if (typeof(doc.shortName) != "undefined" && doc.shortName != doc.name) {
  emit(doc.shortName, doc._id);
  }
for (name in doc.otherNames) { for (name in doc.otherNames) {
if (doc.otherNames[name] != "" && doc.otherNames[name] != doc.name) { if (doc.otherNames[name] != "" && doc.otherNames[name] != doc.name) {
emit(doc.otherNames[name], doc._id); emit(doc.otherNames[name], doc._id);
  }
  }
  for (name in doc.foiBodies) {
  if (doc.foiBodies[name] != "" && doc.foiBodies[name] != doc.name) {
  emit(doc.foiBodies[name], doc._id);
} }
} }
} }
};'; };';
   
$obj->views->foiEmails->map = "function(doc) { $obj->views->foiEmails->map = "function(doc) {
emit(doc._id, doc.foiEmail); emit(doc._id, doc.foiEmail);
};"; };";
   
$obj->views->byLastModified->map = "function(doc) { emit(doc.metadata.lastModified, doc); }"; $obj->views->byLastModified->map = "function(doc) { emit(doc.metadata.lastModified, doc); }";
$obj->views->getActive->map = 'function(doc) { if (doc.status == "active") { emit(doc._id, doc); } };'; $obj->views->getActive->map = 'function(doc) { if (doc.status == "active") { emit(doc._id, doc); } };';
$obj->views->getSuspended->map = 'function(doc) { if (doc.status == "suspended") { emit(doc._id, doc); } };'; $obj->views->getSuspended->map = 'function(doc) { if (doc.status == "suspended") { emit(doc._id, doc); } };';
$obj->views->getScrapeRequired->map = "function(doc) { $obj->views->getScrapeRequired->map = "function(doc) {
   
var lastScrape = Date.parse(doc.metadata.lastScraped); var lastScrape = Date.parse(doc.metadata.lastScraped);
   
var today = new Date(); var today = new Date();
   
if (!lastScrape || lastScrape.getTime() + 1000 != today.getTime()) { if (!lastScrape || lastScrape.getTime() + 1000 != today.getTime()) {
emit(doc._id, doc); emit(doc._id, doc);
} }
   
};"; };";
$obj->views->showNamesABNs->map = "function(doc) { emit(doc._id, {name: doc.name, abn: doc.abn}); };"; $obj->views->showNamesABNs->map = "function(doc) { emit(doc._id, {name: doc.name, abn: doc.abn}); };";
$obj->views->getConflicts->map = "function(doc) { $obj->views->getConflicts->map = "function(doc) {
if (doc._conflicts) { if (doc._conflicts) {
emit(null, [doc._rev].concat(doc._conflicts)); emit(null, [doc._rev].concat(doc._conflicts));
} }
}"; }";
// http://stackoverflow.com/questions/646628/javascript-startswith // http://stackoverflow.com/questions/646628/javascript-startswith
$obj->views->scoreHas->map = 'if(!String.prototype.startsWith){ $obj->views->scoreHas->map = 'if(!String.prototype.startsWith){
String.prototype.startsWith = function (str) { String.prototype.startsWith = function (str) {
return !this.indexOf(str); return !this.indexOf(str);
} }
} }
if(!String.prototype.endsWith){ if(!String.prototype.endsWith){
String.prototype.endsWith = function(suffix) { String.prototype.endsWith = function(suffix) {
    return this.indexOf(suffix, this.length - suffix.length) !== -1;     return this.indexOf(suffix, this.length - suffix.length) !== -1;
}; };
} }
function(doc) { function(doc) {
if (typeof(doc["status"]) == "undefined" || doc["status"] != "suspended") { if (typeof(doc["status"]) == "undefined" || doc["status"] != "suspended") {
for(var propName in doc) { for(var propName in doc) {
if(typeof(doc[propName]) != "undefined" && (propName.startsWith("has") || propName.endsWith("URL"))) { if(typeof(doc[propName]) != "undefined" && (propName.startsWith("has") || propName.endsWith("URL"))) {
emit(propName, 1); emit(propName, 1);
} }
} }
emit("total", 1); emit("total", 1);
} }
}'; }';
$obj->views->scoreHas->map = 'if(!String.prototype.startsWith){ $obj->views->scoreHas->map = 'if(!String.prototype.startsWith){
String.prototype.startsWith = function (str) { String.prototype.startsWith = function (str) {
return !this.indexOf(str); return !this.indexOf(str);
} }
} }
if(!String.prototype.endsWith){ if(!String.prototype.endsWith){
String.prototype.endsWith = function(suffix) { String.prototype.endsWith = function(suffix) {
    return this.indexOf(suffix, this.length - suffix.length) !== -1;     return this.indexOf(suffix, this.length - suffix.length) !== -1;
}; };
} }
function(doc) { function(doc) {
if (typeof(doc["status"]) == "undefined" || doc["status"] != "suspended") { if (typeof(doc["status"]) == "undefined" || doc["status"] != "suspended") {
for(var propName in doc) { for(var propName in doc) {
if(typeof(doc[propName]) != "undefined" && (propName.startsWith("has") || propName.endsWith("URL"))) { if(typeof(doc[propName]) != "undefined" && (propName.startsWith("has") || propName.endsWith("URL"))) {
emit(propName, 1); emit(propName, 1);
} }
} }
emit("total", 1); emit("total", 1);
} }
}'; }';
$obj->views->scoreHas->reduce = 'function (key, values, rereduce) { $obj->views->scoreHas->reduce = 'function (key, values, rereduce) {
return sum(values); return sum(values);
}'; }';
$obj->views->fieldNames->map = ' $obj->views->fieldNames->map = '
function(doc) { function(doc) {
for(var propName in doc) { for(var propName in doc) {
emit(propName, doc._id); emit(propName, doc._id);
} }
}'; }';
$obj->views->fieldNames->reduce = 'function (key, values, rereduce) { $obj->views->fieldNames->reduce = 'function (key, values, rereduce) {
return values.length; return values.length;
}'; }';
// allow safe updates (even if slightly slower due to extra: rev-detection check). // allow safe updates (even if slightly slower due to extra: rev-detection check).
return $db->save($obj, true); return $db->save($obj, true);
} }
   
if (php_uname('n') == "vanille") { if (php_uname('n') == "vanille") {
$serverAddr = 'http://192.168.178.21:5984/'; $serverAddr = 'http://192.168.178.21:5984/';
} else } else
if (php_uname('n') == "KYUUBEY") { if (php_uname('n') == "KYUUBEY") {
   
$serverAddr = 'http://192.168.1.148:5984/'; $serverAddr = 'http://192.168.1.148:5984/';
} else { } else {
$serverAddr = 'http://127.0.0.1:5984/'; $serverAddr = 'http://127.0.0.1:5984/';
} }
$server = new SetteeServer($serverAddr); $server = new SetteeServer($serverAddr);
function setteErrorHandler($e) { function setteErrorHandler($e) {
echo $e->getMessage() . "<br>" . PHP_EOL; echo $e->getMessage() . "<br>" . PHP_EOL;
} }
Unnamed repository; edit this file to name it for gitweb.
GitPHP by Chris Han