edits
[tools.git] / index.md
Alex Sadleir 1 Welcome to the GovHack toolkit. This page provides all the information you need to prepare hackfest entries.
Maxious 2 These tools can be used to make entries like: mobile apps, web apps, data visualisations/infographics
Alex Sadleir 3
4
5 # General Data Hacking and Programming References {#general-data-hacking-and-programming-references}
Maxious 6 ## The basics of being a data scientist
Maxious 7
Alex Sadleir 8 * Have a hypothesis � even if you’re making a tool/api that helps people with their questions too, remember what the objective of that is.
9 * Find the people and tools you need to prove/show/find. This rest of this page will help with the latter.
Maxious 10 * Analyse and present results � were they what you expected? Do they help explain to others what you have found out? Can present as a interactive data visualisation or a web/mobile application or just a infographic/motion graphics video that tells a story.
Alex Sadleir 11 Please note, there are a combination of Analysis and Visualisation tools in each of the major categories below.
Maxious 12
Maxious 13
Maxious 14 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f-300x199.gif "Data Journalism Diagram")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f.gif)</dt>
Maxious 15 Illustration from Data Journalism Handbook, CC BY-SA 3.0</dd>
Maxious 16
Maxious 17
Maxious 18 The best high level reference is the �Understanding Data� and �Delivering Data� chapters of the Data Journalism Handbook which is available online for free at
Maxious 19
20 [datajournalismhandbook.org](http://datajournalismhandbook.org/)
21
Maxious 22 You can learn the technical skills from scratch in Visualize This: The FlowingData Guide to Design, Visualization, and Statistics by Nathan Yau or for more advanced
23
Alex Sadleir 24 practical advice check out Data Analysis with Open Source Tools by Philipp K. Janert
Maxious 25
Maxious 26 For further reading in this space
27
maxious 28 [http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/](http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/)
Maxious 29
Maxious 30
31 **Statistics**
Maxious 32
Alex Sadleir 33 [http://greenteapress.com/thinkstats/html/index.html](http://greenteapress.com/thinkstats/html/index.html)
Maxious 34
35 **Programming**
maxious 36
Maxious 37 Programming is valuable skill for manipulating and displaying data.
38
39 Basic tutorials for a variety of languages are available for free online or you can learn
40
41 interactively with websites like [http://www.codecademy.com/](http://www.codecademy.com/#!/exercises/0\. for JavaScript or [http://www.learnpython.org/ ](http://www.learnpython.org/)or [http://tryruby.org](http://tryruby.org/)
42
43 [https://developer.mozilla.org/en/JavaScript](https://developer.mozilla.org/en/JavaScript) &#8211\. especially for web applications and visualisations, you&#8217;ll need a basic understanding of JS. Common libraries like prototype or jQuery can help
44
45 **Accessibility/User Experience**
Alex Sadleir 46
47 WCAG guidelines not only make a web app accessible but make it a better experience for all users! Even if not making an app, good to consider these things to do and not do: [http://www.w3.org/TR/WCAG/](http://www.w3.org/TR/WCAG/)
48
Maxious 49 ## Who can be a hack day participant
50 - roles; coder, designer UX/graphics
51
52 ## Definitions
Alex Sadleir 53 - definitions, open licence reuse permissive hacker hack data journalism data bis UCX etc.
Maxious 54
Alex Sadleir 55
Maxious 56 ## key datasets
57 - key datasets, directory.gov.au gazetter/AEC electorates/suburbs/postcodes/LGAs
58
Alex Sadleir 59 ## examples
Maxious 60
61 ## The Open Budget
62
Alex Sadleir 63 ## WeatherTree weather API
64
Maxious 65 ## PlanningAlerts
maxious 66
Alex Sadleir 67 [![Planning Alerts Screenshot](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1-300x221.png "Planning Alerts Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1.png)Description: Planning Alerts takes data from local government development applications and sends alerts to users based on what applications are lodged in their area.
Maxious 68
Alex Sadleir 69 Programming Language: Ruby
Maxious 70
71 Source Control: [Git](https://github.com/openaustralia/planningalerts-app)
72
73 Issue Tracking: [Atlassian JIRA](http://tickets.openaustraliafoundation.org.au/browse/PA/)
74
75 ## LobbyLens
76
77 [![](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium-300x180.png "LobbyLens screenshot")](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium.png)
78
Alex Sadleir 79 Description: Displays connections between government contracts, business details, politician responsibilities, lobbyists, clients of lobbyists, political donors and the location of these entities.
Maxious 80
81 Programing Language: PHP
82
83 Source Control: SVN (Subversion)
84
Maxious 85 Issue Tracking: A whiteboard
86
Alex Sadleir 87 ## Bus.lambdacomplex.org
Maxious 88
89 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae-300x253.jpg "Bus.lambda screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae.jpg)
Alex Sadleir 90
91 Description: Online Canberra Bus Timetables and Trip Planner.
92
93 Programing Language: PHP/Ruby
94
95 Source Control: Git
96
97 Issue Tracking: Github
98
99
100 ## Developer Tools For Your Computer {#developer-tools-for-your-computer}
101
102 server admin / technical tools
103 many projects will require some kind of internet presence, webpage etc.
104 - css framework like bootstrap or zurb foundation
Alex Sadleir 105 video tools, youtube video editor/slideshow, FOSS video editing tools
106 - http://ubuntu-tutorials.com/2008/11/11/relaying-postfix-smtp-via-smtpgmailcom/
107 - amon
Maxious 108
109 ### Source Control &#8211\. Git / Subversion
maxious 110
111 [![](http://www.govhack.org/wp-content/uploads/Screenshot-at-2012-04-29-172132-300x235.png "Git Screenshot")](http://progit.org/book/)
112
113 [http://progit.org/book/](http://progit.org/book/)
114
115 [http://svnbook.red-bean.com/](http://svnbook.red-bean.com/)
116
117 [http://tortoisesvn.net/](http://tortoisesvn.net/)
118
119 [http://code.google.com/p/tortoisegit/](http://code.google.com/p/tortoisegit/)
120
121 ### Task Tracking -
122
123 Issue/task trackers allow you to outline the tasks required for your project and assign them to people to do.
Maxious 124
125 [Trello](https://trello.com/) and [Workflowy](https://workflowy.com/) are free, lightweight project management tools suitable for a rapid project!
Maxious 126
Alex Sadleir 127 ## Hosted Developer Tools {#hosted-developer-tools}
Maxious 128
129 Can get many tools (source control, issue tracking) combined into one service cloud hosted so no setup required.
130
131 ### Github
maxious 132 Git obviously but svn/hg interfaces are possible. Provide their own GUI for Windows/OSX or use the variety of Git capable tools
Alex Sadleir 133
Maxious 134 ### Sourceforge
Alex Sadleir 135
Alex Sadleir 136 Subversion, Git, Mercurial, Bazaar, CVS, issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
Maxious 137
138 You can create your own Sourceforge project at [http://sourceforge.net/](http://sourceforge.net/)
Alex Sadleir 139
Alex Sadleir 140 ### Google Code Project Hosting
141
142 Git, Mercurial, and Subversion code. Issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
143
144 You can host your Google Code project and get access to developer tools, APIs and documentation at [http://code.google.com/](http://code.google.com/)
maxious 145
146
147
148 # API Development {#api-development}
149
150
Maxious 151 So an API isn&#8217;t just an XML file ![;)](http://www.govhack.org/wp-includes/images/smilies/icon_wink.gif)
152
Maxious 153 A good web based data API:
154
155 * Is logically organised
156 * Can filter returned data
157 * Can return results in different open formats (CSV/JSON etc.)
Alex Sadleir 158 * Is efficient and responsive by using caching and databases appropriately
Alex Sadleir 159 * Handles errors gracefully
Maxious 160 * Monitors and controls access (to show benefit realised of API and prevent abuse)
161 * Provides appropriate documentation with examples
Alex Sadleir 162
maxious 163 Some people like sensis [http://](http://developers.sensis.com.au/)[developers.sensis.com.<wbr>au</wbr>](http://developers.sensis.com.au/)[/](http://developers.sensis.com.au/) use a provider like[http://](http://mashery.com/)[mashery.com](http://mashery.com/)[/](http://mashery.com/) or [https](https://apigee.com/)[://](https://apigee.com/)[apigee.com](https://apigee.com/) or [http://](http://apiaxle.com/)[apiaxle.com](http://apiaxle.com/)[/](http://apiaxle.com/) or [http://www.3scale.net/](http://www.3scale.net/) which handles making a good API for them.
164
165 Atlassian have a great page on what makes a good API [https](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[://](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[developer.atlassian.<wbr>com</wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[/display/REST/](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[Atlassian](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[+<wbr>REST+API+Design+Guidelines+<wbr>version+1</wbr></wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)
Alex Sadleir 166
167 API
168 - howto.gov api tutorial
169 - http://shancarter.com/data_converter/
170 - http://training.sunlightfoundation.com/module/data-visualizations-google-docs/
171 - api documentation
172 - WSDL or http://swagger.wordnik.com/ or https://github.com/mashery/iodocs
173 - http://symfony.com/ https://github.com/FriendsOfSymfony/FOSRestBundle http://williamdurand.fr/2012/08/02/rest-apis-with-symfony2-the-right-way/ https://github.com/nelmio/NelmioApiDocBundle better apis https://github.com/liip/LiipHelloBundle
Alex Sadleir 174 - https://github.com/elc/rapi_doc https://github.com/Pajk/apipie-rails
Alex Sadleir 175 -
176 http://amberonrails.com/building-stripes-api/
177
178
179 # Infographics and Data Visualisation {#data-visualisation}
180
181 Infographics try to contextualise charts and graphs to tell a story. Data vis builds on this to find new ways to design insight.
182
183 Most of the categories to follow have visualisation tools specific to their purpose.
Alex Sadleir 184
Alex Sadleir 185 You can find some data visualisation &#8220;essential&#8221\. tools below:
186
187 [http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/](http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/)
188
189 Also check out [http://thejit.org](http://thejit.org/) &amp; [http://www.senchalabs.org/<wbr>philogl/</wbr>](http://www.senchalabs.org/philogl/) (contributed by Matt Adcock)
190
191 Have to use visual art concepts, good color schemes http://www.r-bloggers.com/the-paul-tol-21-color-salute/
192
193
194 - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
Maxious 195 - http://drawingbynumbers.org/toolsandresources
Alex Sadleir 196
Alex Sadleir 197 examples - http://sunfoundation.tumblr.com/
198 tools - http://selection.datavisualization.ch/ data viz tools catalog
Maxious 199
Alex Sadleir 200
201
202 # Mobile
203 html5 jquery mobile like directory.gov.au
204 - android datviz
205 - http://code.google.com/p/afreechart/ http://code.google.com/p/snowdon/ http://code.google.com/p/chartdroid/ http://androidplot.com/ http://code.google.com/p/achartengine/
206
207
208
209 # Geographical Data Tools {#geographical-data-tools}
Alex Sadleir 210
Alex Sadleir 211 Check out the[ GeoRabble Boundary Mapper&#8217;s Cookbook](http://georabble.org/2012/05/31/the-boundary-mappers-cookbook/) to see how you can tie all these things together!
Maxious 212
Alex Sadleir 213 ## Key datasets
Alex Sadleir 214 - base layers like agri http://agri.openstreetmap.org/, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
215 ASGS including suburbs/postcodes
Maxious 216 - andrewharvey4.wordpress.com postgis/asgs tutorial
Alex Sadleir 217 ## Wrangling
218
219 ### Converting
220 There are many spatial data formats and often the one your tool requires is not the one the dataset is provided in
221 Online
222 - http://converter.mygeodata.eu/vector kml exporter for shp
223 or locally using GDAL
Alex Sadleir 224
225 ### geocoding
226 cloudmade, google (but you must display on a Google Map).
maxious 227
228 Easiest way to do is with a Google Spreadsheet/Fusion Table http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.htm
Maxious 229
230
231 ## Analysis
232
Maxious 233
234 ### PostGIS
Maxious 235
Maxious 236 [![](http://www.govhack.org/wp-content/uploads/postgisexample-300x130.jpg "postgisexample")](http://www.govhack.org/wp-content/uploads/postgisexample.jpg)PostGIS is an extension for the PostgreSQL database server that allows you to store and manipulate geospatial data on a large scale. For example finding which points are in an area or what points are closest . It is also very useful for storing geospatial data because it can convert between all major formats including ESRI Shape files and Google Earth/Maps KML.
237
238 ### Quantum GIS
239
240 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88-300x160.jpg "QGIS Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88.jpg)QGIS is a graphical desktop application that allows viewing and editing of geospatial data. Some good base maps are available by adding the WMS layer/server [http://irs.gis-lab.info/](http://irs.gis-lab.info/)
Maxious 241
Maxious 242 ## Visualisation
243
Maxious 244 ### Layar and other augmented reality tools
Maxious 245
Maxious 246 ### Google Fusion Tables/ChartsBin/[OpenHeatMap](http://www.openheatmap.com/)
247
248 [![](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot-300x168.jpg "fusiontablesscreenshot")](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot.jpg)Input a numerical values and areas to a spreadsheet and maps are produced
249
250 ### [Cartographer.js](http://cartographer.visualmotive.com/)
251
Alex Sadleir 252 [![](http://www.govhack.org/wp-content/uploads/cartographerjs-300x187.png "cartographerjs screenshot")](http://www.govhack.org/wp-content/uploads/cartographerjs.png)Input data as JSON and maps are produced.
253 See also d3 maps.
254 - http://bost.ocks.org/mike/map/
255
256
257 ### OpenLayers/Google Maps/[Leaflet](http://leaflet.cloudmade.com/)
258
259 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1-300x173.jpg "OpenLayers Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1.jpg)Display points and different layers. Leaflet is the easiest to use if you just want to show points with popups when clicked on.
maxious 260 There are wrappers for Google maps like http://hpneo.github.com/gmaps/examples.html and Mapstraction that can make it easier to use too.
261
262 ### NASA World Wind/Google Earth
263
Alex Sadleir 264 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4-300x261.jpg "WorldWind screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4.jpg)Google Earth provides 3\. viewing of KML/GML files which represent points and shapes, both through a desktop application and a web plugin. These can be extended with interactive features that allow you to view by timeline or have animated tours between different points. You can also develop and customise your own viewer with the open source [NASA World Wind toolkit.](http://goworldwind.org/demos/)
265
Maxious 266 ###
267
268 # Tabular Data Tools {#tabular-data-tools}
269
Alex Sadleir 270 ## Wrangling
Maxious 271
272 Tabular data may have duplicate entries or incorrect formats (varying ways to enter dates/phonenumbers etc.). There are tools to quickly fix common problems
273
274 [DataWrangler](http://vis.stanford.edu/wrangler/)/[Google Refine](http://code.google.com/p/google-refine/)
275
276 [![](http://www.govhack.org/wp-content/uploads/google_refine_interface.png "google_refine_interface")](http://www.govhack.org/wp-content/uploads/google_refine_interface.png)Clean up duplicate or inconsistent data entries.
Alex Sadleir 277
Maxious 278 Can also use general purpose tools; grep/awk/sed
279 regex http://www.regexper.com/ http://www.debuggex.com/?re=&str=
280
281 ## Analysis
Alex Sadleir 282
283 ### Excel / Calc
284
285 Great basic analysis and viewing. Older versions can be limited to 6500\. or so rows. Eg [http://www.tcij.org/training-material/car/data-mining/3474](http://www.tcij.org/training-material/car/data-mining/3474)
Alex Sadleir 286
287
Maxious 288 ### PostgreSQL/MySQL
289
maxious 290 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg "SQL screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg)Next step up, large datasets can be manipulated/extracted efficiently for example [http://www.postgresql.org/docs/8.4/static/tutorial-window.html](http://www.postgresql.org/docs/8.4/static/tutorial-window.html) , no built-in data visualisation though.
291
292 ### [Miso Dataset](http://misoproject.com/dataset/)
293
Maxious 294 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38-293x300.png "miso screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38.png)Javascript data transformation library � especially good if you want to use the output for javascript interactive visualisations because the transformations can be done on-the-fly by users.
295
296 ### R Statistical Language
297
Alex Sadleir 298 [![](http://www.govhack.org/wp-content/uploads/rstudio-windows-300x249.png "rstudio-windows")](http://www.govhack.org/wp-content/uploads/rstudio-windows.png)Advanced data analysis, can find and visualise trends in large datasets. Some reference resources to learn the language [http://cran.r-project.org/doc/manuals/R-intro.html ](http://cran.r-project.org/doc/manuals/R-intro.html)There are also some addons that provide graphical interfaces that make it easier to use such as Rattle [http://rattle.togaware.com/](http://rattle.togaware.com/) , RStudio [http://rstudio.org/](http://rstudio.org/) or Deducer [http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual](http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual)
Maxious 299
Maxious 300 - http://blog.yhathq.com/posts/10-R-packages-I-wish-I-knew-about-earlier.html
301 - excel -> R/rattle/ deducer? http://www.r-bloggers.com/updates-to-the-deducer-family-of-packages/
302 - http://www.twotorials.com/ for R
303 - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
304 - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
Alex Sadleir 305 - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
306 - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
307
308
309 ## Visualisation
310
311 ### [Tableau Desktop](http://www.tableausoftware.com/)
312
Alex Sadleir 313 Create visualisations from various data formats by dragging and dropping. Free trial available on website. [![](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot-300x190.jpg "Tableau Screenshot")](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot.jpg)
314
315 ### [Flotr2](http://www.humblesoftware.com/flotr2/)/[Google Chart Tools](https://developers.google.com/chart/)
316
317 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce-300x199.jpg "flotr2 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce.jpg)Javascript based charts for webpages.
318
Maxious 319 ### D3.js (Data-Driven Documents)
320
Maxious 321 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020-300x277.jpg "d3 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020.jpg)Javascript visualisations that are more interactive or intricate than charts. Can be hard to learn but there are examples and easier to use premade visualisations such as [word clouds](http://www.jasondavies.com/wordcloud/), [realtime filtering of barcharts](http://square.github.com/crossfilter/), or [bubble trees for comparing amount sizes](https://github.com/okfn/bubbletree).
322 d3
323 - http://datadrivenjournalism.net/resources/data_driven_documents_defined
324 - http://www.benmcmahen.com/blog/posts/50eb57d55a94d35262000001 d3 svg
325 - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
Alex Sadleir 326 - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
327 - how to make an xkcd chart http://bl.ocks.org/3914862
Maxious 328
329 ### Processing.js
330
331 # Unstructured (text documents, webpages, metadata, tweets etc) Data Tools
332
333 ## wranglying
Alex Sadleir 334 Scraperwiki pytemplate scrapy
335
336 Overviewer/ Jigsaw
337 http://www.cc.gatech.edu/gvu/ii/jigsaw/
338 - opennlp/nltk / https://github.com/clips/pattern
339 - lucene/solr
340 - http://www.r-bloggers.com/simple-text-mining-with-r/
341 - http://blog.josephwilk.net/ruby/latent-semantic-analysis-in-ruby.html similar terms usually found together
342
Maxious 343 # Graph (relationships and networks) Data Tools {#graph-relationships-and-networks-data-tools}
344
345 - http://www.slideshare.net/OReillyStrata/visualizing-networks-beyond-the-hairball
Maxious 346 - http://blog.sciencenet.cn/blog-554179-622011.html SNA tools catalog
347 - https://github.com/jacomyal/osdc2012-sigmajs-demo sigmajs filtering/searching
348
349
350 ## Analysis
351
Alex Sadleir 352 ### R
Alex Sadleir 353
Alex Sadleir 354 - http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
355
356
357 ### Neo4j / OrientDB
Maxious 358
Alex Sadleir 359 [![](http://www.govhack.org/wp-content/uploads/webadmin-data-300x127.png "Neo4\. web admin screenshot")](http://www.govhack.org/wp-content/uploads/webadmin-data.png)Help understand relationships � how is X connected to Y and via what other entities they both are connected to. Imports and exports
360
361 - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
Maxious 362
Alex Sadleir 363 http://www.orientdb.org/
Maxious 364
Alex Sadleir 365 Both can be accessed using a preexisting tool like Gremlin or by writing a simple Java/Python/Ruby application. Queries can be tested in the built in data browser.
Maxious 366
Alex Sadleir 367
Maxious 368
maxious 369 ### [NetworkX](http://networkx.lanl.gov/index.html)
Alex Sadleir 370
371 [![](http://www.govhack.org/wp-content/uploads/chess_masters-300x300.png "NetworkX")](http://www.govhack.org/wp-content/uploads/chess_masters.png)
372
373 NetworkX is a social network analysis library for python. Many advanced analyses built in like finding communities within a graph. Also good for converting data into graphs.
374
375
376 ## Visualisation
Maxious 377 ### Tree/Hierarchy visualisation
378 - don't use network viz if what you actually have is a tree/hierarchy with no interconnections http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/d3 for Trees and Hierarchies
379 http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
Alex Sadleir 380
381 ### NodeXL for Microsoft Excel
Alex Sadleir 382 - http://nodexl.codeplex.com/ network graphs for excel
Maxious 383
384 ### [Graphviz](http://www.graphviz.org/)
385
386 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d-300x184.png "Graphviz Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d.png)Classic directed graph visualisation tool, can even [generate images online without installing](http://ashitani.jp/gv/) or use in webpages with [javascript port of software](http://code.google.com/p/canviz/). File format [�dot� very easy to learn](http://en.wikipedia.org/wiki/DOT_language)
387
388 ### Gephi
389
Maxious 390 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05-300x195.jpg "Gephi Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05.jpg)Desktop graph editor and renderer. Many good automatic layout algorithms even for very large graphs.
Maxious 391
Maxious 392 ### [sigma.js](http://sigmajs.org/)
393
394 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3-300x130.jpg "Sigma.js Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3.jpg)Javascript graph viewer, can use GEXF files exported from tools like neo4j, gephi and NetworkX.
Alex Sadleir 395