edits
[tools.git] / index.md
Alex Sadleir 1 Welcome to the GovHack toolkit. This page provides all the information you need to prepare hackfest entries.
Maxious 2 These tools can be used to make entries like: mobile apps, web apps, data visualisations/infographics
Alex Sadleir 3
4
5 # General Data Hacking and Programming References {#general-data-hacking-and-programming-references}
Maxious 6 ## The basics of being a data scientist
Maxious 7
Alex Sadleir 8 * Have a hypothesis - even if you're making a tool/api that helps people with their questions too, remember what the objective of that is.
9 * Find the people and tools you need to prove/show/find. This rest of this page will help with the latter.
Maxious 10 * Analyse and present results - were they what you expected? Do they help explain to others what you have found out? Can present as a interactive data visualisation or a web/mobile application or just a infographic/motion graphics video that tells a story.
Alex Sadleir 11 Please note, there are a combination of Analysis and Visualisation tools in each of the major categories below.
Maxious 12
Maxious 13
Maxious 14 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f-300x199.gif "Data Journalism Diagram")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f.gif)</dt>
Maxious 15 Illustration from Data Journalism Handbook, CC BY-SA 3.0</dd>
Maxious 16
Maxious 17
Maxious 18 The best high level reference is the 'Understanding Data' and 'Delivering Data' chapters of the Data Journalism Handbook which is available online for free at
Maxious 19
20 [datajournalismhandbook.org](http://datajournalismhandbook.org/)
Alex Sadleir 21
Maxious 22 You can learn the technical skills from scratch in Visualize This: The FlowingData Guide to Design, Visualization, and Statistics by Nathan Yau or for more advanced
Maxious 23
Maxious 24 practical advice check out Data Analysis with Open Source Tools by Philipp K. Janert
25
maxious 26 For further reading in this space
Maxious 27
Maxious 28 [http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/](http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/)
29
Maxious 30
Alex Sadleir 31 **Statistics**
Maxious 32
33 [http://greenteapress.com/thinkstats/html/index.html](http://greenteapress.com/thinkstats/html/index.html)
maxious 34
Maxious 35 **Programming**
36
37 Programming is valuable skill for manipulating and displaying data.
38
39 Basic tutorials for a variety of languages are available for free online or you can learn
40
41 interactively with websites like [http://www.codecademy.com/](http://www.codecademy.com/#!/exercises/0). for JavaScript or [http://www.learnpython.org/ ](http://www.learnpython.org/)or [http://tryruby.org](http://tryruby.org/)
42
43 [https://developer.mozilla.org/en/JavaScript](https://developer.mozilla.org/en/JavaScript) - especially for web applications and visualisations, you'll need a basic understanding of JS. Common libraries like prototype or jQuery can help
Alex Sadleir 44
45 **Accessibility/User Experience**
46
Maxious 47 WCAG guidelines not only make a web app accessible but make it a better experience for all users! Even if not making an app, good to consider these things to do and not do: [http://www.w3.org/TR/WCAG/](http://www.w3.org/TR/WCAG/)
48
49 ## Who can be a hack day participant
50 - roles; coder, designer UX/graphics
Alex Sadleir 51
Maxious 52 ## Definitions
Alex Sadleir 53 - definitions, open licence reuse permissive hacker hack data journalism data bis UCX etc.
Maxious 54
55 ## key datasets
56 - key datasets, directory.gov.au gazetter/AEC electorates/suburbs/postcodes/LGAs
Alex Sadleir 57
Maxious 58 ## examples
59
60 ## The Open Budget
Alex Sadleir 61
Alex Sadleir 62 ## WeatherTree weather API
Maxious 63
maxious 64 ## PlanningAlerts
Alex Sadleir 65
Maxious 66 [![Planning Alerts Screenshot](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1-300x221.png "Planning Alerts Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1.png)Description: Planning Alerts takes data from local government development applications and sends alerts to users based on what applications are lodged in their area.
Alex Sadleir 67
Maxious 68 Programming Language: Ruby
Maxious 69
Maxious 70 Source Control: [Git](https://github.com/openaustralia/planningalerts-app)
Maxious 71
72 Issue Tracking: [Atlassian JIRA](http://tickets.openaustraliafoundation.org.au/browse/PA/)
Alex Sadleir 73
Maxious 74 ## LobbyLens
75
76 [![](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium-300x180.png "LobbyLens screenshot")](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium.png)
77
78 Description: Displays connections between government contracts, business details, politician responsibilities, lobbyists, clients of lobbyists, political donors and the location of these entities.
Maxious 79
80 Programing Language: PHP
81
Alex Sadleir 82 Source Control: SVN (Subversion)
Maxious 83
Alex Sadleir 84 Issue Tracking: A whiteboard
Maxious 85
Maxious 86 ## Bus.lambdacomplex.org
87
88 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae-300x253.jpg "Bus.lambda screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae.jpg)
89
90 Description: Online Canberra Bus Timetables and Trip Planner.
91
92 Programing Language: PHP/Ruby
93
94 Source Control: Git
95
96 Issue Tracking: Github
97
98
99 ## Developer Tools For Your Computer {#developer-tools-for-your-computer}
100
101 server admin / technical tools
Alex Sadleir 102 many projects will require some kind of internet presence, webpage etc.
Alex Sadleir 103 - css framework like bootstrap or zurb foundation
104 video tools, youtube video editor/slideshow, FOSS video editing tools
Alex Sadleir 105 - http://ubuntu-tutorials.com/2008/11/11/relaying-postfix-smtp-via-smtpgmailcom/
Maxious 106 - amon
107
Alex Sadleir 108 ### Source Control
109 Git / Subversion
110
111 [![](http://www.govhack.org/wp-content/uploads/Screenshot-at-2012-04-29-172132-300x235.png "Git Screenshot")](http://progit.org/book/)
112
113 [http://progit.org/book/](http://progit.org/book/)
114
115 [http://svnbook.red-bean.com/](http://svnbook.red-bean.com/)
116
117 [http://tortoisesvn.net/](http://tortoisesvn.net/)
118
119 [http://code.google.com/p/tortoisegit/](http://code.google.com/p/tortoisegit/)
120
121 ### Task Tracking -
Maxious 122
123 Issue/task trackers allow you to outline the tasks required for your project and assign them to people to do.
Maxious 124
Alex Sadleir 125 [Trello](https://trello.com/) and [Workflowy](https://workflowy.com/) are free, lightweight project management tools suitable for a rapid project!
Maxious 126
Alex Sadleir 127 ## Hosted Developer Tools {#hosted-developer-tools}
maxious 128
Maxious 129 Can get many tools (source control, issue tracking) combined into one service cloud hosted so no setup required.
Alex Sadleir 130
Maxious 131 ### Github
132 Git obviously but svn/hg interfaces are possible. Provide their own GUI for Windows/OSX or use the variety of Git capable tools
Alex Sadleir 133
Alex Sadleir 134 ### Sourceforge
135
136 Subversion, Git, Mercurial, Bazaar, CVS, issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
137
138 You can create your own Sourceforge project at [http://sourceforge.net/](http://sourceforge.net/)
maxious 139
140 ### Google Code Project Hosting
Maxious 141
142 Git, Mercurial, and Subversion code. Issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
143
144 You can host your Google Code project and get access to developer tools, APIs and documentation at [http://code.google.com/](http://code.google.com/)
145
Maxious 146
147
Maxious 148 # API Development {#api-development}
Maxious 149
Alex Sadleir 150
Maxious 151 So an API isn't just an XML file ![;)](http://www.govhack.org/wp-includes/images/smilies/icon_wink.gif)
Alex Sadleir 152
maxious 153 A good web based data API:
154
Maxious 155 * Is logically organised
156 * Can filter returned data
maxious 157 * Can return results in different open formats (CSV/JSON etc.)
Maxious 158 * Is efficient and responsive by using caching and databases appropriately
Alex Sadleir 159 * Handles errors gracefully
160 * Monitors and controls access (to show benefit realised of API and prevent abuse)
161 * Provides appropriate documentation with examples
162
Alex Sadleir 163 Some people like sensis [http://](http://developers.sensis.com.au/)[developers.sensis.com.<wbr>au</wbr>](http://developers.sensis.com.au/)[/](http://developers.sensis.com.au/) use a provider like[http://](http://mashery.com/)[mashery.com](http://mashery.com/)[/](http://mashery.com/) or [https](https://apigee.com/)[://](https://apigee.com/)[apigee.com](https://apigee.com/) or [http://](http://apiaxle.com/)[apiaxle.com](http://apiaxle.com/)[/](http://apiaxle.com/) or [http://www.3scale.net/](http://www.3scale.net/) which handles making a good API for them.
Alex Sadleir 164
165 Atlassian have a great page on what makes a good API [https](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[://](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[developer.atlassian.<wbr>com</wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[/display/REST/](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[Atlassian](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[+<wbr>REST+API+Design+Guidelines+<wbr>version+1</wbr></wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)
166
167 API
168 - howto.gov api tutorial
169 - http://shancarter.com/data_converter/
170 - http://training.sunlightfoundation.com/module/data-visualizations-google-docs/
171 - api documentation
172 - WSDL or http://swagger.wordnik.com/ or https://github.com/mashery/iodocs
Alex Sadleir 173 - http://symfony.com/ https://github.com/FriendsOfSymfony/FOSRestBundle http://williamdurand.fr/2012/08/02/rest-apis-with-symfony2-the-right-way/ https://github.com/nelmio/NelmioApiDocBundle better apis https://github.com/liip/LiipHelloBundle
Alex Sadleir 174 - https://github.com/elc/rapi_doc https://github.com/Pajk/apipie-rails
175 -
176 http://amberonrails.com/building-stripes-api/
177
178
179 # Infographics and Data Visualisation {#data-visualisation}
180
181 Infographics try to contextualise charts and graphs to tell a story. Data vis builds on this to find new ways to design insight.
182
183 Most of the categories to follow have visualisation tools specific to their purpose.
Maxious 184
Alex Sadleir 185 You can find some data visualisation tools below:
Alex Sadleir 186
187 [http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/](http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/)
Maxious 188
Alex Sadleir 189 Also check out [http://thejit.org](http://thejit.org/) &amp; [http://www.senchalabs.org/<wbr>philogl/</wbr>](http://www.senchalabs.org/philogl/) (contributed by Matt Adcock)
190
191 Have to use visual art concepts, good color schemes http://www.r-bloggers.com/the-paul-tol-21-color-salute/
192
193
194 - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
195 - http://drawingbynumbers.org/toolsandresources
196
197 examples - http://sunfoundation.tumblr.com/
198 tools - http://selection.datavisualization.ch/ data viz tools catalog
Maxious 199
Alex Sadleir 200
Maxious 201
Alex Sadleir 202 # Mobile
Alex Sadleir 203 bom water, nz gov budget
204 html5 jquery mobile like directory.gov.au
Maxious 205 - android datviz
Maxious 206 - http://code.google.com/p/afreechart/ http://code.google.com/p/snowdon/ http://code.google.com/p/chartdroid/ http://androidplot.com/ http://code.google.com/p/achartengine/
Alex Sadleir 207
208
maxious 209
Alex Sadleir 210 # Geographical Data Tools {#geographical-data-tools}
maxious 211
Alex Sadleir 212 Check out the[ GeoRabble Boundary Mapper's Cookbook](http://georabble.org/2012/05/31/the-boundary-mappers-cookbook/) to see how you can tie all these things together!
Alex Sadleir 213
Alex Sadleir 214 ## Key datasets
215 - base layers like agri http://agri.openstreetmap.org/, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
maxious 216 ASGS including suburbs/postcodes
217 - andrewharvey4.wordpress.com postgis/asgs tutorial
Maxious 218 ## Wrangling
Maxious 219
Maxious 220 ### Converting
maxious 221 There are many spatial data formats and often the one your tool requires is not the one the dataset is provided in
Maxious 222 Online
223 - http://converter.mygeodata.eu/vector kml exporter for shp
maxious 224 or locally using GDAL
225
226 ### geocoding
Maxious 227 cloudmade, google (but you must display on a Google Map).
228
Maxious 229 Easiest way to do is with a Google Spreadsheet/Fusion Table http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.htm
Maxious 230
231
Maxious 232 ## Analysis
Maxious 233
Maxious 234
235 ### PostGIS
236
237 [![](http://www.govhack.org/wp-content/uploads/postgisexample-300x130.jpg "postgisexample")](http://www.govhack.org/wp-content/uploads/postgisexample.jpg)PostGIS is an extension for the PostgreSQL database server that allows you to store and manipulate geospatial data on a large scale. For example finding which points are in an area or what points are closest . It is also very useful for storing geospatial data because it can convert between all major formats including ESRI Shape files and Google Earth/Maps KML.
Maxious 238
Maxious 239 ### Quantum GIS
Maxious 240
241 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88-300x160.jpg "QGIS Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88.jpg)QGIS is a graphical desktop application that allows viewing and editing of geospatial data. Some good base maps are available by adding the WMS layer/server [http://irs.gis-lab.info/](http://irs.gis-lab.info/)
242
243 ## Visualisation
244
245 ### Layar and other augmented reality tools
Alex Sadleir 246
247 ### Google Fusion Tables/ChartsBin/[OpenHeatMap](http://www.openheatmap.com/)
248
249 [![](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot-300x168.jpg "fusiontablesscreenshot")](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot.jpg)Input a numerical values and areas to a spreadsheet and maps are produced
250
251 ### [Cartographer.js](http://cartographer.visualmotive.com/)
Maxious 252
253 [![](http://www.govhack.org/wp-content/uploads/cartographerjs-300x187.png "cartographerjs screenshot")](http://www.govhack.org/wp-content/uploads/cartographerjs.png)Input data as JSON and maps are produced.
254 See also d3 maps.
255 - http://bost.ocks.org/mike/map/
maxious 256
Maxious 257
maxious 258 ### OpenLayers/Google Maps/[Leaflet](http://leaflet.cloudmade.com/)
259
260 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1-300x173.jpg "OpenLayers Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1.jpg)Display points and different layers. Leaflet is the easiest to use if you just want to show points with popups when clicked on.
Alex Sadleir 261 There are wrappers for Google maps like http://hpneo.github.com/gmaps/examples.html and Mapstraction that can make it easier to use too.
262
Maxious 263 ### NASA World Wind/Google Earth
264
265 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4-300x261.jpg "WorldWind screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4.jpg)Google Earth provides 3\. viewing of KML/GML files which represent points and shapes, both through a desktop application and a web plugin. These can be extended with interactive features that allow you to view by timeline or have animated tours between different points. You can also develop and customise your own viewer with the open source [NASA World Wind toolkit.](http://goworldwind.org/demos/)
266
Maxious 267 ###
268
269 # Tabular Data Tools {#tabular-data-tools}
270
271 ## Wrangling
272
Alex Sadleir 273 Tabular data may have duplicate entries or incorrect formats (varying ways to enter dates/phonenumbers etc.). There are tools to quickly fix common problems
Maxious 274
275 [DataWrangler](http://vis.stanford.edu/wrangler/)/[Google Refine](http://code.google.com/p/google-refine/)
Alex Sadleir 276
Maxious 277 [![](http://www.govhack.org/wp-content/uploads/google_refine_interface.png "google_refine_interface")](http://www.govhack.org/wp-content/uploads/google_refine_interface.png)Clean up duplicate or inconsistent data entries.
278
279 Can also use general purpose tools; grep/awk/sed
Alex Sadleir 280 regex http://www.regexper.com/ http://www.debuggex.com/?re=&str=
281
282 ## Analysis
283
Alex Sadleir 284 ### Excel / Calc
285
Maxious 286 Great basic analysis and viewing. Older versions can be limited to 6500\. or so rows. Eg [http://www.tcij.org/training-material/car/data-mining/3474](http://www.tcij.org/training-material/car/data-mining/3474)
287
Maxious 288 ### PostgreSQL/MySQL
289
290 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg "SQL screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg)Next step up, large datasets can be manipulated/extracted efficiently for example [http://www.postgresql.org/docs/8.4/static/tutorial-window.html](http://www.postgresql.org/docs/8.4/static/tutorial-window.html) , no built-in data visualisation though.
291
292 ### [Miso Dataset](http://misoproject.com/dataset/)
293
294 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38-293x300.png "miso screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38.png)Javascript data transformation library - especially good if you want to use the output for javascript interactive visualisations because the transformations can be done on-the-fly by users.
295
296 ### R Statistical Language
297
298 [![](http://www.govhack.org/wp-content/uploads/rstudio-windows-300x249.png "rstudio-windows")](http://www.govhack.org/wp-content/uploads/rstudio-windows.png)Advanced data analysis, can find and visualise trends in large datasets. Some reference resources to learn the language [http://cran.r-project.org/doc/manuals/R-intro.html ](http://cran.r-project.org/doc/manuals/R-intro.html)There are also some addons that provide graphical interfaces that make it easier to use such as Rattle [http://rattle.togaware.com/](http://rattle.togaware.com/) , RStudio [http://rstudio.org/](http://rstudio.org/) or Deducer [http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual](http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual)
299
300 - http://blog.yhathq.com/posts/10-R-packages-I-wish-I-knew-about-earlier.html
301 - excel -> R/rattle/ deducer? http://www.r-bloggers.com/updates-to-the-deducer-family-of-packages/
302 - http://www.twotorials.com/ for R
Maxious 303 - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
maxious 304 - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
Maxious 305 - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
Maxious 306 - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
Maxious 307
308
309 ## Visualisation
Alex Sadleir 310
Maxious 311 ### [Tableau Desktop](http://www.tableausoftware.com/)
Maxious 312
313 Create visualisations from various data formats by dragging and dropping. Free trial available on website. [![](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot-300x190.jpg "Tableau Screenshot")](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot.jpg)
Maxious 314
Maxious 315 ### [Flotr2](http://www.humblesoftware.com/flotr2/)/[Google Chart Tools](https://developers.google.com/chart/)
316
317 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce-300x199.jpg "flotr2 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce.jpg)Javascript based charts for webpages.
Alex Sadleir 318
319 ### D3.js (Data-Driven Documents)
Maxious 320
Alex Sadleir 321 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020-300x277.jpg "d3 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020.jpg)Javascript visualisations that are more interactive or intricate than charts. Can be hard to learn but there are examples and easier to use premade visualisations such as [word clouds](http://www.jasondavies.com/wordcloud/), [realtime filtering of barcharts](http://square.github.com/crossfilter/), or [bubble trees for comparing amount sizes](https://github.com/okfn/bubbletree).
Maxious 322 d3
Maxious 323 - http://datadrivenjournalism.net/resources/data_driven_documents_defined
324 - http://www.benmcmahen.com/blog/posts/50eb57d55a94d35262000001 d3 svg
325 - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
Alex Sadleir 326 - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
327 - how to make an xkcd chart http://bl.ocks.org/3914862
Maxious 328
329 ### Processing.js
330
331 # Unstructured (text documents, webpages, metadata, tweets etc) Data Tools
Maxious 332
Maxious 333 ## wranglying
334 Scraperwiki pytemplate scrapy
Maxious 335
336 Overviewer/ Jigsaw
337 http://www.cc.gatech.edu/gvu/ii/jigsaw/
338 - opennlp/nltk / https://github.com/clips/pattern
Maxious 339 - lucene/solr
Maxious 340 - http://www.r-bloggers.com/simple-text-mining-with-r/
341 - http://blog.josephwilk.net/ruby/latent-semantic-analysis-in-ruby.html similar terms usually found together
342
343 # Graph (relationships and networks) Data Tools {#graph-relationships-and-networks-data-tools}
344
345 - http://www.slideshare.net/OReillyStrata/visualizing-networks-beyond-the-hairball
346 - http://blog.sciencenet.cn/blog-554179-622011.html SNA tools catalog
347 - https://github.com/jacomyal/osdc2012-sigmajs-demo sigmajs filtering/searching
Maxious 348
349
350 ## Analysis
351
352 ### R
Alex Sadleir 353
354 - http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
Maxious 355
356
Maxious 357 ### Neo4j / OrientDB
358
Alex Sadleir 359 [![](http://www.govhack.org/wp-content/uploads/webadmin-data-300x127.png "Neo4\. web admin screenshot")](http://www.govhack.org/wp-content/uploads/webadmin-data.png)Help understand relationships - how is X connected to Y and via what other entities they both are connected to. Imports and exports
Maxious 360
361 - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
362
363 http://www.orientdb.org/
Alex Sadleir 364
Maxious 365 Both can be accessed using a preexisting tool like Gremlin or by writing a simple Java/Python/Ruby application. Queries can be tested in the built in data browser.
366
367
Alex Sadleir 368
maxious 369 ### [NetworkX](http://networkx.lanl.gov/index.html)
Maxious 370
Alex Sadleir 371 [![](http://www.govhack.org/wp-content/uploads/chess_masters-300x300.png "NetworkX")](http://www.govhack.org/wp-content/uploads/chess_masters.png)
372
373 NetworkX is a social network analysis library for python. Many advanced analyses built in like finding communities within a graph. Also good for converting data into graphs.
Maxious 374
Maxious 375
Alex Sadleir 376 ## Visualisation
377 ### Tree/Hierarchy visualisation
378 - don't use network viz if what you actually have is a tree/hierarchy with no interconnections http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/d3 for Trees and Hierarchies
Maxious 379 http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
380
Alex Sadleir 381 ### NodeXL for Microsoft Excel
Maxious 382 - http://nodexl.codeplex.com/ network graphs for excel
Alex Sadleir 383
Maxious 384 ### [Graphviz](http://www.graphviz.org/)
maxious 385
Alex Sadleir 386 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d-300x184.png "Graphviz Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d.png)Classic directed graph visualisation tool, can even [generate images online without installing](http://ashitani.jp/gv/) or use in webpages with [javascript port of software](http://code.google.com/p/canviz/). File format ["dot" very easy to learn](http://en.wikipedia.org/wiki/DOT_language)
387
Maxious 388 ### Gephi
Alex Sadleir 389
390 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05-300x195.jpg "Gephi Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05.jpg)Desktop graph editor and renderer. Many good automatic layout algorithms even for very large graphs.
391
392 ### [sigma.js](http://sigmajs.org/)
Maxious 393
394 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3-300x130.jpg "Sigma.js Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3.jpg)Javascript graph viewer, can use GEXF files exported from tools like neo4j, gephi and NetworkX.
395