2013-03-24 05:01:56
Alex Sadleir
1
geo
2013-03-01 01:11:15
Maxious
2
2013-04-03 12:20:29
Alex Sadleir
3
R
4
5
- tools.disclo.gs - how to use data
2013-03-01 01:11:15
Maxious
6
- developer tools inc. linked data
2013-03-06 04:05:46
Maxious
7
- gephi -> neo4j
2013-03-24 05:01:56
Alex Sadleir
8
- neo4j lets you build on, do massive queries of who is friends with who
9
- don't use network viz if what you actually have is a tree/hierarchy with no interconnections http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/
2013-03-01 01:11:15
Maxious
10
- http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
2013-03-24 05:01:56
Alex Sadleir
11
- postgis/quantum gis
2013-03-07 22:18:14
Maxious
12
- (google earth is alright but many limitations) NASA World Wind?
2013-03-21 11:02:25
Maxious
13
- ABS statistical areas
2013-03-07 22:18:14
Maxious
14
- base layers like agri, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
2013-03-21 11:02:25
Maxious
15
- can do nearest/isin/union queries - personal geocoder
2013-03-07 22:18:14
Maxious
16
- cloudmade geocoder, google maps my maps
2013-03-21 11:02:25
Maxious
17
2013-03-07 22:18:14
Maxious
18
- scraperwiki with new pytemplate libraries
2013-03-06 04:05:46
Maxious
19
- makes an API for your data to get in sqlite/json/csv
20
2013-04-28 09:46:26
Alex Sadleir
21
- govhack library
2013-03-07 22:18:14
Maxious
22
- https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
2013-04-12 05:52:11
Maxious
23
- http://drawingbynumbers.org/toolsandresources
2013-03-01 01:11:15
Maxious
24
- http://wmbriggs.com/blog/?p=6465
25
- http://ofps.oreilly.com/titles/9781449339739/k_00000002.html list of d3 alternatives
2013-03-03 10:00:40
maxious
26
- http://craigkerstiens.com/2012/10/01/understanding-postgres-performance/
2013-03-01 01:11:15
Maxious
27
- https://github.com/clips/pattern for easy NLP/network analysis/data mining
2013-03-07 22:18:14
Maxious
28
- https://github.com/theodi/open-data-tech-review/wiki othr cleanup/linked data toola
29
- http://selection.datavisualization.ch/ data viz tools catalog
2013-03-01 01:11:15
Maxious
30
- manipulating data - grep/find replace/sed/regex
2013-03-24 05:01:56
Alex Sadleir
31
- d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
2013-03-01 01:11:15
Maxious
32
- Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
33
- how to make an xkcd chart http://bl.ocks.org/3914862
2013-03-03 10:00:40
maxious
34
2013-03-01 01:11:15
Maxious
35
- data viz
36
- http://k2company.com/blog/2012/09/06/toolbox-for-learning-machine-learning-and-data-science/
37
- http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.html google fusion tutorial
38
- andrewharvey4.wordpress.com postgis/asgs tutorial
39
- http://www.slideshare.net/maxdemarzi/etl-into-neo4j
40
41
- http://www.twotorials.com/ for R
42
- http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
43
- http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
2013-04-03 12:20:29
Alex Sadleir
44
- http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
45
- http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
46
- http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
2013-03-01 01:11:15
Maxious
47
48
- http://dydra.com/
49
- http://selection.datavisualization.ch/ data viz tools list
50
- http://nodexl.codeplex.com/ network graphs for excel
2013-04-03 12:20:29
Alex Sadleir
51
- http://sunfoundation.tumblr.com/
2013-03-01 01:11:15
Maxious
52
- analysing - linked data tools
2013-04-03 12:20:29
Alex Sadleir
53
- http://govcampau.wikispaces.com/useful+tools
2013-03-01 01:11:15
Maxious
54
- http://linkeddata.org/home
55
56
2013-04-03 12:20:29
Alex Sadleir
57
Welcome to the GovHack toolkit. This page provides all the information you need to prepare hackfest entries.
2013-03-01 01:11:15
Maxious
58
These tools can be used to make entries like: mobile apps, web apps, data visualisations/infographics
59
60
2013-04-28 09:46:26
Alex Sadleir
61
# General Data Hacking and Programming References {#general-data-hacking-and-programming-references}
2013-03-24 05:01:56
Alex Sadleir
62
## The basics of being a data scientist
2013-03-01 01:11:15
Maxious
63
2013-03-03 10:00:40
maxious
64
* Have a hypothesis � even if you’re making a tool/api that helps people with their questions too, remember what the objective of that is.
2013-04-03 12:20:29
Alex Sadleir
65
* Find the people and tools you need to prove/show/find. This rest of this page will help with the latter.
2013-03-01 01:11:15
Maxious
66
* Analyse and present results � were they what you expected? Do they help explain to others what you have found out? Can present as a interactive data visualisation or a web/mobile application or just a infographic/motion graphics video that tells a story.
2013-03-24 05:01:56
Alex Sadleir
67
Please note, there are a combination of Analysis and Visualisation tools in each of the major categories below.
2013-03-01 01:11:15
Maxious
68
2013-04-15 04:13:09
Maxious
69
70
[![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f-300x199.gif "Data Journalism Diagram")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f.gif)</dt>
2013-03-01 01:11:15
Maxious
71
Illustration from Data Journalism Handbook, CC BY-SA 3.0</dd>
72
2013-04-03 12:20:29
Alex Sadleir
73
2013-03-01 01:11:15
Maxious
74
The best high level reference is the �Understanding Data� and �Delivering Data� chapters of the Data Journalism Handbook which is available online for free at
75
76
[datajournalismhandbook.org](http://datajournalismhandbook.org/)
77
78
You can learn the technical skills from scratch in Visualize This: The FlowingData Guide to Design, Visualization, and Statistics by Nathan Yau or for more advanced
2013-04-28 09:46:26
Alex Sadleir
79
2013-03-01 03:43:59
Maxious
80
practical advice check out Data Analysis with Open Source Tools by Philipp K. Janert
2013-04-03 12:20:29
Alex Sadleir
81
2013-03-01 03:43:59
Maxious
82
For further reading in this space
83
2013-04-03 12:20:29
Alex Sadleir
84
[http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/](http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/)
85
86
87
88
**Statistics**
89
90
[http://greenteapress.com/thinkstats/html/index.html](http://greenteapress.com/thinkstats/html/index.html)
91
92
**Programming**
93
94
Programming is valuable skill for manipulating and displaying data.
95
96
Basic tutorials for a variety of languages are available for free online or you can learn
97
98
interactively with websites like [http://www.codecademy.com/](http://www.codecademy.com/#!/exercises/0\. for JavaScript or [http://www.learnpython.org/ ](http://www.learnpython.org/)or [http://tryruby.org](http://tryruby.org/)
2013-03-24 05:01:56
Alex Sadleir
99
100
[https://developer.mozilla.org/en/JavaScript](https://developer.mozilla.org/en/JavaScript) –\. especially for web applications and visualisations, you’ll need a basic understanding of JS. Common libraries like prototype or jQuery can help
2013-04-28 09:46:26
Alex Sadleir
101
2012-09-29 13:05:38
Maxious
102
**Accessibility/User Experience**
103
2013-04-28 09:46:26
Alex Sadleir
104
WCAG guidelines not only make a web app accessible but make it a better experience for all users! Even if not making an app, good to consider these things to do and not do: [http://www.w3.org/TR/WCAG/](http://www.w3.org/TR/WCAG/)
105
106
## Who can be a hack day participant
107
- roles; coder, designer UX/graphics
108
109
## Definitions
110
- definitions, open licence reuse permissive hacker hack data journalism data bis UCX etc.
111
112
113
## key datasets
114
- key datasets, directory.gov.au gazetter/AEC electorates/suburbs/postcodes/LGAs
115
116
## examples
117
2013-03-07 22:18:14
Maxious
118
## The Open Budget
119
2013-04-05 12:04:13
Maxious
120
## WeatherTree weather API
2013-04-01 08:05:26
Alex Sadleir
121
2013-04-05 12:04:13
Maxious
122
## PlanningAlerts
2013-04-20 01:29:05
Alex Sadleir
123
2013-04-11 12:42:26
maxious
124
[![Planning Alerts Screenshot](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1-300x221.png "Planning Alerts Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1.png)Description: Planning Alerts takes data from local government development applications and sends alerts to users based on what applications are lodged in their area.
2013-04-05 12:04:13
Maxious
125
2013-04-20 01:29:05
Alex Sadleir
126
Programming Language: Ruby
2012-09-29 13:05:38
Maxious
127
128
Source Control: [Git](https://github.com/openaustralia/planningalerts-app)
2013-04-28 09:46:26
Alex Sadleir
129
2013-02-27 10:12:02
Alex Sadleir
130
Issue Tracking: [Atlassian JIRA](http://tickets.openaustraliafoundation.org.au/browse/PA/)
131
132
## LobbyLens
133
134
[![](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium-300x180.png "LobbyLens screenshot")](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium.png)
2013-03-03 10:00:40
maxious
135
136
Description: Displays connections between government contracts, business details, politician responsibilities, lobbyists, clients of lobbyists, political donors and the location of these entities.
2013-04-12 05:52:11
Maxious
137
138
Programing Language: PHP
139
140
Source Control: SVN (Subversion)
141
142
Issue Tracking: A whiteboard
2013-04-20 01:29:05
Alex Sadleir
143
2013-03-01 04:32:26
Maxious
144
## Bus.lambdacomplex.org
2013-04-12 05:52:11
Maxious
145
2013-03-24 05:01:56
Alex Sadleir
146
[![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae-300x253.jpg "Bus.lambda screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae.jpg)
2013-03-01 04:32:26
Maxious
147