editz master
[tools.git] / index.md
Alex Sadleir 1 Welcome to the GovHack toolkit. This page provides all the information you need to prepare hackfest entries.
Maxious 2 These tools can be used to make entries like: mobile apps, web apps, data visualisations/infographics
Alex Sadleir 3
4
5 # General Data Hacking and Programming References {#general-data-hacking-and-programming-references}
Maxious 6 ## The basics of being a data scientist
Maxious 7
Alex Sadleir 8 * Have a hypothesis - even if you're making a tool/api that helps people with their questions too, remember what the objective of that is.
9 * Find the people and tools you need to prove/show/find. This rest of this page will help with the latter.
Maxious 10 * Analyse and present results - were they what you expected? Do they help explain to others what you have found out? Can present as a interactive data visualisation or a web/mobile application or just a infographic/motion graphics video that tells a story.
Alex Sadleir 11 Please note, there are a combination of Analysis and Visualisation tools in each of the major categories below.
Maxious 12
Maxious 13
Maxious 14 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f-300x199.gif "Data Journalism Diagram")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f.gif)</dt>
Maxious 15 Illustration from Data Journalism Handbook, CC BY-SA 3.0</dd>
Maxious 16
Maxious 17
Maxious 18 The best high level reference is the 'Understanding Data' and 'Delivering Data' chapters of the Data Journalism Handbook which is available online for free at
Maxious 19
Maxious 20 [datajournalismhandbook.org](http://datajournalismhandbook.org/)
21
Alex Sadleir 22 You can learn the technical skills from scratch in Visualize This: The FlowingData Guide to Design, Visualization, and Statistics by Nathan Yau or for more advanced
Maxious 23
Maxious 24 practical advice check out Data Analysis with Open Source Tools by Philipp K. Janert
Maxious 25
26 For further reading in this space
maxious 27
Maxious 28 [http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/](http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/)
Maxious 29
30
Maxious 31 **Statistics**
Alex Sadleir 32
Maxious 33 [http://greenteapress.com/thinkstats/html/index.html](http://greenteapress.com/thinkstats/html/index.html)
34
maxious 35 **Programming**
Maxious 36
37 Programming is valuable skill for manipulating and displaying data.
38
39 Basic tutorials for a variety of languages are available for free online or you can learn
40
41 interactively with websites like [http://www.codecademy.com/](http://www.codecademy.com/#!/exercises/0). for JavaScript or [http://www.learnpython.org/ ](http://www.learnpython.org/)or [http://tryruby.org](http://tryruby.org/)
42
43 [https://developer.mozilla.org/en/JavaScript](https://developer.mozilla.org/en/JavaScript) - especially for web applications and visualisations, you'll need a basic understanding of JS. Common libraries like prototype or jQuery can help
44
Alex Sadleir 45 **Accessibility/User Experience**
46
47 WCAG guidelines not only make a web app accessible but make it a better experience for all users! Even if not making an app, good to consider these things to do and not do: [http://www.w3.org/TR/WCAG/](http://www.w3.org/TR/WCAG/)
Maxious 48
49 ## Who can be a hack day participant
50 - roles; coder, designer UX/graphics
51
Alex Sadleir 52 ## Definitions
Maxious 53 - definitions, open licence reuse permissive hacker hack data journalism data bis UCX etc.
Alex Sadleir 54
Maxious 55 ## key datasets
56 - key datasets, directory.gov.au gazetter/AEC electorates/suburbs/postcodes/LGAs
57
Alex Sadleir 58 ## examples
Maxious 59
60 ## The Open Budget
61
Alex Sadleir 62 ## WeatherTree weather API
Alex Sadleir 63
Maxious 64 ## PlanningAlerts
maxious 65
Alex Sadleir 66 [![Planning Alerts Screenshot](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1-300x221.png "Planning Alerts Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1.png)Description: Planning Alerts takes data from local government development applications and sends alerts to users based on what applications are lodged in their area.
Maxious 67
Alex Sadleir 68 Programming Language: Ruby
Maxious 69
Maxious 70 Source Control: [Git](https://github.com/openaustralia/planningalerts-app)
Maxious 71
Maxious 72 Issue Tracking: [Atlassian JIRA](http://tickets.openaustraliafoundation.org.au/browse/PA/)
73
Alex Sadleir 74 ## LobbyLens
Maxious 75
76 [![](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium-300x180.png "LobbyLens screenshot")](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium.png)
77
78 Description: Displays connections between government contracts, business details, politician responsibilities, lobbyists, clients of lobbyists, political donors and the location of these entities.
79
Maxious 80 Programing Language: PHP
81
Maxious 82 Source Control: SVN (Subversion)
83
Maxious 84 Issue Tracking: A whiteboard
Alex Sadleir 85
Maxious 86 ## Bus.lambdacomplex.org
Alex Sadleir 87
Maxious 88 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae-300x253.jpg "Bus.lambda screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae.jpg)
Maxious 89
90 Description: Online Canberra Bus Timetables and Trip Planner.
91
92 Programing Language: PHP/Ruby
93
94 Source Control: Git
95
96 Issue Tracking: Github
97
98
99 ## Developer Tools For Your Computer {#developer-tools-for-your-computer}
100
101 server admin / technical tools
102 many projects will require some kind of internet presence, webpage etc.
103 - css framework like bootstrap or zurb foundation
104 video tools, youtube video editor/slideshow, FOSS video editing tools
Alex Sadleir 105 - http://ubuntu-tutorials.com/2008/11/11/relaying-postfix-smtp-via-smtpgmailcom/
Alex Sadleir 106 - amon
107
Alex Sadleir 108 ### Source Control
Maxious 109 Git / Subversion
110
Alex Sadleir 111 [![](http://www.govhack.org/wp-content/uploads/Screenshot-at-2012-04-29-172132-300x235.png "Git Screenshot")](http://progit.org/book/)
112
113 [http://progit.org/book/](http://progit.org/book/)
114
115 [http://svnbook.red-bean.com/](http://svnbook.red-bean.com/)
116
117 [http://tortoisesvn.net/](http://tortoisesvn.net/)
118
119 [http://code.google.com/p/tortoisegit/](http://code.google.com/p/tortoisegit/)
120
121 ### Task Tracking -
122
123 Issue/task trackers allow you to outline the tasks required for your project and assign them to people to do.
Maxious 124
125 [Trello](https://trello.com/) and [Workflowy](https://workflowy.com/) are free, lightweight project management tools suitable for a rapid project!
Maxious 126
Alex Sadleir 127 ## Hosted Developer Tools {#hosted-developer-tools}
Maxious 128
Alex Sadleir 129 Can get many tools (source control, issue tracking) combined into one service cloud hosted so no setup required.
maxious 130
Maxious 131 ### Github
Alex Sadleir 132 Git obviously but svn/hg interfaces are possible. Provide their own GUI for Windows/OSX or use the variety of Git capable tools
Maxious 133
134 ### Sourceforge
Alex Sadleir 135
Alex Sadleir 136 Subversion, Git, Mercurial, Bazaar, CVS, issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
137
138 You can create your own Sourceforge project at [http://sourceforge.net/](http://sourceforge.net/)
139
140 ### Google Code Project Hosting
maxious 141
142 Git, Mercurial, and Subversion code. Issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
Maxious 143
144 You can host your Google Code project and get access to developer tools, APIs and documentation at [http://code.google.com/](http://code.google.com/)
145
146
147
Maxious 148 # API Development {#api-development}
149
Maxious 150
Maxious 151 So an API isn't just an XML file ![;)](http://www.govhack.org/wp-includes/images/smilies/icon_wink.gif)
Alex Sadleir 152
Maxious 153 A good web based data API:
Alex Sadleir 154
maxious 155 * Is logically organised
156 * Can filter returned data
Maxious 157 * Can return results in different open formats (CSV/JSON etc.)
158 * Is efficient and responsive by using caching and databases appropriately
maxious 159 * Handles errors gracefully
Maxious 160 * Monitors and controls access (to show benefit realised of API and prevent abuse)
Alex Sadleir 161 * Provides appropriate documentation with examples
162
163 Some people like sensis [http://](http://developers.sensis.com.au/)[developers.sensis.com.<wbr>au</wbr>](http://developers.sensis.com.au/)[/](http://developers.sensis.com.au/) use a provider like[http://](http://mashery.com/)[mashery.com](http://mashery.com/)[/](http://mashery.com/) or [https](https://apigee.com/)[://](https://apigee.com/)[apigee.com](https://apigee.com/) or [http://](http://apiaxle.com/)[apiaxle.com](http://apiaxle.com/)[/](http://apiaxle.com/) or [http://www.3scale.net/](http://www.3scale.net/) which handles making a good API for them.
164
Alex Sadleir 165 Atlassian have a great page on what makes a good API [https](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[://](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[developer.atlassian.<wbr>com</wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[/display/REST/](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[Atlassian](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[+<wbr>REST+API+Design+Guidelines+<wbr>version+1</wbr></wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)
Alex Sadleir 166
167 API
168 - howto.gov api tutorial
169 - http://shancarter.com/data_converter/
170 - http://training.sunlightfoundation.com/module/data-visualizations-google-docs/
171 - api documentation
172 - WSDL or http://swagger.wordnik.com/ or https://github.com/mashery/iodocs
173 - http://symfony.com/ https://github.com/FriendsOfSymfony/FOSRestBundle http://williamdurand.fr/2012/08/02/rest-apis-with-symfony2-the-right-way/ https://github.com/nelmio/NelmioApiDocBundle better apis https://github.com/liip/LiipHelloBundle
174 - https://github.com/elc/rapi_doc https://github.com/Pajk/apipie-rails
Alex Sadleir 175 -
Alex Sadleir 176 http://amberonrails.com/building-stripes-api/
177
178
179 # Infographics and Data Visualisation {#data-visualisation}
180
181 Infographics try to contextualise charts and graphs to tell a story. Data vis builds on this to find new ways to design insight.
182
183 Most of the categories to follow have visualisation tools specific to their purpose.
184
185 You can find some data visualisation tools below:
Maxious 186
Alex Sadleir 187 [http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/](http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/)
Alex Sadleir 188
189 Also check out [http://thejit.org](http://thejit.org/) &amp; [http://www.senchalabs.org/<wbr>philogl/</wbr>](http://www.senchalabs.org/philogl/) (contributed by Matt Adcock)
Maxious 190
Alex Sadleir 191 Have to use visual art concepts, good color schemes http://www.r-bloggers.com/the-paul-tol-21-color-salute/
192
193
194 - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
195 - http://drawingbynumbers.org/toolsandresources
196
197 examples - http://sunfoundation.tumblr.com/
198 tools - http://selection.datavisualization.ch/ data viz tools catalog
199
200
Maxious 201
Alex Sadleir 202 # Mobile
Maxious 203 bom water, nz gov budget
Alex Sadleir 204 html5 jquery mobile like directory.gov.au
Alex Sadleir 205 - android datviz
206 - http://code.google.com/p/afreechart/ http://code.google.com/p/snowdon/ http://code.google.com/p/chartdroid/ http://androidplot.com/ http://code.google.com/p/achartengine/
Maxious 207
Maxious 208
Alex Sadleir 209
210 # Geographical Data Tools {#geographical-data-tools}
maxious 211
Alex Sadleir 212 Check out the[ GeoRabble Boundary Mapper's Cookbook](http://georabble.org/2012/05/31/the-boundary-mappers-cookbook/) to see how you can tie all these things together!
maxious 213
Alex Sadleir 214 ## Key datasets
Alex Sadleir 215 - base layers like agri http://agri.openstreetmap.org/, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
Alex Sadleir 216 ASGS including suburbs/postcodes
217 - andrewharvey4.wordpress.com postgis/asgs tutorial
maxious 218 ## Wrangling
219
Maxious 220 ### Converting
Maxious 221 There are many spatial data formats and often the one your tool requires is not the one the dataset is provided in
Maxious 222 Online
maxious 223 - http://converter.mygeodata.eu/vector kml exporter for shp
Maxious 224 or locally using GDAL
225
maxious 226 ### geocoding
227 cloudmade, google (but you must display on a Google Map).
228
Maxious 229 Easiest way to do is with a Google Spreadsheet/Fusion Table http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.htm
230
Maxious 231
Maxious 232 ## Analysis
233
Maxious 234
Maxious 235 ### PostGIS
Maxious 236
237 [![](http://www.govhack.org/wp-content/uploads/postgisexample-300x130.jpg "postgisexample")](http://www.govhack.org/wp-content/uploads/postgisexample.jpg)PostGIS is an extension for the PostgreSQL database server that allows you to store and manipulate geospatial data on a large scale. For example finding which points are in an area or what points are closest . It is also very useful for storing geospatial data because it can convert between all major formats including ESRI Shape files and Google Earth/Maps KML.
238
239 ### Quantum GIS
Maxious 240
Maxious 241 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88-300x160.jpg "QGIS Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88.jpg)QGIS is a graphical desktop application that allows viewing and editing of geospatial data. Some good base maps are available by adding the WMS layer/server [http://irs.gis-lab.info/](http://irs.gis-lab.info/)
Maxious 242
243 ## Visualisation
244
Maxious 245 ### Layar and other augmented reality tools
246
247 ### Google Fusion Tables/ChartsBin/[OpenHeatMap](http://www.openheatmap.com/)
Maxious 248
249 [![](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot-300x168.jpg "fusiontablesscreenshot")](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot.jpg)Input a numerical values and areas to a spreadsheet and maps are produced
250
Alex Sadleir 251 ### [Cartographer.js](http://cartographer.visualmotive.com/)
252
253 [![](http://www.govhack.org/wp-content/uploads/cartographerjs-300x187.png "cartographerjs screenshot")](http://www.govhack.org/wp-content/uploads/cartographerjs.png)Input data as JSON and maps are produced.
254 See also d3 maps.
255 - http://bost.ocks.org/mike/map/
256
Maxious 257
258 ### OpenLayers/Google Maps/[Leaflet](http://leaflet.cloudmade.com/)
259
260 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1-300x173.jpg "OpenLayers Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1.jpg)Display points and different layers. Leaflet is the easiest to use if you just want to show points with popups when clicked on.
maxious 261 There are wrappers for Google maps like http://hpneo.github.com/gmaps/examples.html and Mapstraction that can make it easier to use too.
Maxious 262
maxious 263 ### NASA World Wind/Google Earth
264
265 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4-300x261.jpg "WorldWind screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4.jpg)Google Earth provides 3\. viewing of KML/GML files which represent points and shapes, both through a desktop application and a web plugin. These can be extended with interactive features that allow you to view by timeline or have animated tours between different points. You can also develop and customise your own viewer with the open source [NASA World Wind toolkit.](http://goworldwind.org/demos/)
Alex Sadleir 266
267 ###
Maxious 268
269 # Tabular Data Tools {#tabular-data-tools}
270
271 ## Wrangling
Maxious 272
273 Tabular data may have duplicate entries or incorrect formats (varying ways to enter dates/phonenumbers etc.). There are tools to quickly fix common problems
274
275 [DataWrangler](http://vis.stanford.edu/wrangler/)/[Google Refine](http://code.google.com/p/google-refine/)
276
277 [![](http://www.govhack.org/wp-content/uploads/google_refine_interface.png "google_refine_interface")](http://www.govhack.org/wp-content/uploads/google_refine_interface.png)Clean up duplicate or inconsistent data entries.
Alex Sadleir 278
Maxious 279 Can also use general purpose tools; grep/awk/sed
280 regex http://www.regexper.com/ http://www.debuggex.com/?re=&str=
Alex Sadleir 281
Maxious 282 ## Analysis
283
284 ### Excel / Calc
Alex Sadleir 285
286 Great basic analysis and viewing. Older versions can be limited to 6500\. or so rows. Eg [http://www.tcij.org/training-material/car/data-mining/3474](http://www.tcij.org/training-material/car/data-mining/3474)
287
288 ### PostgreSQL/MySQL
Alex Sadleir 289
290 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg "SQL screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg)Next step up, large datasets can be manipulated/extracted efficiently for example [http://www.postgresql.org/docs/8.4/static/tutorial-window.html](http://www.postgresql.org/docs/8.4/static/tutorial-window.html) , no built-in data visualisation though.
Maxious 291
292 ### [Miso Dataset](http://misoproject.com/dataset/)
Maxious 293
294 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38-293x300.png "miso screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38.png)Javascript data transformation library - especially good if you want to use the output for javascript interactive visualisations because the transformations can be done on-the-fly by users.
295
296 ### R Statistical Language
297
298 [![](http://www.govhack.org/wp-content/uploads/rstudio-windows-300x249.png "rstudio-windows")](http://www.govhack.org/wp-content/uploads/rstudio-windows.png)Advanced data analysis, can find and visualise trends in large datasets. Some reference resources to learn the language [http://cran.r-project.org/doc/manuals/R-intro.html ](http://cran.r-project.org/doc/manuals/R-intro.html)There are also some addons that provide graphical interfaces that make it easier to use such as Rattle [http://rattle.togaware.com/](http://rattle.togaware.com/) , RStudio [http://rstudio.org/](http://rstudio.org/) or Deducer [http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual](http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual)
299
300 - http://blog.yhathq.com/posts/10-R-packages-I-wish-I-knew-about-earlier.html
301 - excel -> R/rattle/ deducer? http://www.r-bloggers.com/updates-to-the-deducer-family-of-packages/
302 - http://www.twotorials.com/ for R
303 - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
304 - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
305 - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
306 - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
307
Maxious 308
maxious 309 ## Visualisation
Maxious 310
Maxious 311 ### [Tableau Desktop](http://www.tableausoftware.com/)
Maxious 312
313 Create visualisations from various data formats by dragging and dropping. Free trial available on website. [![](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot-300x190.jpg "Tableau Screenshot")](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot.jpg)
314
Alex Sadleir 315 ### [Flotr2](http://www.humblesoftware.com/flotr2/)/[Google Chart Tools](https://developers.google.com/chart/)
Maxious 316
Maxious 317 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce-300x199.jpg "flotr2 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce.jpg)Javascript based charts for webpages.
318
Maxious 319 ### D3.js (Data-Driven Documents)
Maxious 320
321 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020-300x277.jpg "d3 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020.jpg)Javascript visualisations that are more interactive or intricate than charts. Can be hard to learn but there are examples and easier to use premade visualisations such as [word clouds](http://www.jasondavies.com/wordcloud/), [realtime filtering of barcharts](http://square.github.com/crossfilter/), or [bubble trees for comparing amount sizes](https://github.com/okfn/bubbletree).
322 d3
Alex Sadleir 323 - http://datadrivenjournalism.net/resources/data_driven_documents_defined
324 - http://www.benmcmahen.com/blog/posts/50eb57d55a94d35262000001 d3 svg
Maxious 325 - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
Alex Sadleir 326 - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
Maxious 327 - how to make an xkcd chart http://bl.ocks.org/3914862
Maxious 328
329 ### Processing.js
330
Alex Sadleir 331 # Unstructured (text documents, webpages, metadata, tweets etc) Data Tools
332
Maxious 333 ## wranglying
334 Scraperwiki pytemplate scrapy
335
336 Overviewer/ Jigsaw
Maxious 337 http://www.cc.gatech.edu/gvu/ii/jigsaw/
Maxious 338 - opennlp/nltk / https://github.com/clips/pattern
339 - lucene/solr
340 - http://www.r-bloggers.com/simple-text-mining-with-r/
Maxious 341 - http://blog.josephwilk.net/ruby/latent-semantic-analysis-in-ruby.html similar terms usually found together
342
343 # Graph (relationships and networks) Data Tools {#graph-relationships-and-networks-data-tools}
344
Maxious 345 - http://www.slideshare.net/OReillyStrata/visualizing-networks-beyond-the-hairball
Maxious 346 - http://blog.sciencenet.cn/blog-554179-622011.html SNA tools catalog
347 - https://github.com/jacomyal/osdc2012-sigmajs-demo sigmajs filtering/searching
348
349
350 ## Analysis
351
352 ### R
353
Maxious 354 - http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
355
356
Maxious 357 ### Neo4j / OrientDB
358
359 [![](http://www.govhack.org/wp-content/uploads/webadmin-data-300x127.png "Neo4\. web admin screenshot")](http://www.govhack.org/wp-content/uploads/webadmin-data.png)Help understand relationships - how is X connected to Y and via what other entities they both are connected to. Imports and exports
Alex Sadleir 360
361 - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
Maxious 362
363 http://www.orientdb.org/
Maxious 364
365 Both can be accessed using a preexisting tool like Gremlin or by writing a simple Java/Python/Ruby application. Queries can be tested in the built in data browser.
Maxious 366
367
Alex Sadleir 368
Maxious 369 ### [NetworkX](http://networkx.lanl.gov/index.html)
370
371 [![](http://www.govhack.org/wp-content/uploads/chess_masters-300x300.png "NetworkX")](http://www.govhack.org/wp-content/uploads/chess_masters.png)
372
Alex Sadleir 373 NetworkX is a social network analysis library for python. Many advanced analyses built in like finding communities within a graph. Also good for converting data into graphs.
Maxious 374
375
376 ## Visualisation
Alex Sadleir 377 ### Tree/Hierarchy visualisation
maxious 378 - don't use network viz if what you actually have is a tree/hierarchy with no interconnections http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/d3 for Trees and Hierarchies
Maxious 379 http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
Alex Sadleir 380
381 ### NodeXL for Microsoft Excel
382 - http://nodexl.codeplex.com/ network graphs for excel
Maxious 383
Maxious 384 ### [Graphviz](http://www.graphviz.org/)
Alex Sadleir 385
386 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d-300x184.png "Graphviz Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d.png)Classic directed graph visualisation tool, can even [generate images online without installing](http://ashitani.jp/gv/) or use in webpages with [javascript port of software](http://code.google.com/p/canviz/). File format ["dot" very easy to learn](http://en.wikipedia.org/wiki/DOT_language)
387
Maxious 388 ### Gephi
Maxious 389
390 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05-300x195.jpg "Gephi Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05.jpg)Desktop graph editor and renderer. Many good automatic layout algorithms even for very large graphs.
Alex Sadleir 391
Maxious 392 ### [sigma.js](http://sigmajs.org/)
Alex Sadleir 393
Maxious 394 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3-300x130.jpg "Sigma.js Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3.jpg)Javascript graph viewer, can use GEXF files exported from tools like neo4j, gephi and NetworkX.
maxious 395