edits
[tools.git] / index.md
Alex Sadleir 1 Welcome to the GovHack toolkit. This page provides all the information you need to prepare hackfest entries.
Maxious 2 These tools can be used to make entries like: mobile apps, web apps, data visualisations/infographics
Alex Sadleir 3
4
5 # General Data Hacking and Programming References {#general-data-hacking-and-programming-references}
Maxious 6 ## The basics of being a data scientist
Maxious 7
Alex Sadleir 8 * Have a hypothesis � even if you’re making a tool/api that helps people with their questions too, remember what the objective of that is.
9 * Find the people and tools you need to prove/show/find. This rest of this page will help with the latter.
Maxious 10 * Analyse and present results � were they what you expected? Do they help explain to others what you have found out? Can present as a interactive data visualisation or a web/mobile application or just a infographic/motion graphics video that tells a story.
Alex Sadleir 11 Please note, there are a combination of Analysis and Visualisation tools in each of the major categories below.
Maxious 12
Maxious 13
Maxious 14 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f-300x199.gif "Data Journalism Diagram")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f.gif)</dt>
Maxious 15 Illustration from Data Journalism Handbook, CC BY-SA 3.0</dd>
Maxious 16
Maxious 17
Maxious 18 The best high level reference is the �Understanding Data� and �Delivering Data� chapters of the Data Journalism Handbook which is available online for free at
Maxious 19
20 [datajournalismhandbook.org](http://datajournalismhandbook.org/)
Alex Sadleir 21
Maxious 22 You can learn the technical skills from scratch in Visualize This: The FlowingData Guide to Design, Visualization, and Statistics by Nathan Yau or for more advanced
Maxious 23
Maxious 24 practical advice check out Data Analysis with Open Source Tools by Philipp K. Janert
25
maxious 26 For further reading in this space
Maxious 27
Maxious 28 [http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/](http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/)
29
Maxious 30
Alex Sadleir 31 **Statistics**
Maxious 32
33 [http://greenteapress.com/thinkstats/html/index.html](http://greenteapress.com/thinkstats/html/index.html)
maxious 34
Maxious 35 **Programming**
36
37 Programming is valuable skill for manipulating and displaying data.
38
39 Basic tutorials for a variety of languages are available for free online or you can learn
40
41 interactively with websites like [http://www.codecademy.com/](http://www.codecademy.com/#!/exercises/0\. for JavaScript or [http://www.learnpython.org/ ](http://www.learnpython.org/)or [http://tryruby.org](http://tryruby.org/)
42
43 [https://developer.mozilla.org/en/JavaScript](https://developer.mozilla.org/en/JavaScript) &#8211\. especially for web applications and visualisations, you&#8217;ll need a basic understanding of JS. Common libraries like prototype or jQuery can help
Alex Sadleir 44
45 **Accessibility/User Experience**
46
Maxious 47 WCAG guidelines not only make a web app accessible but make it a better experience for all users! Even if not making an app, good to consider these things to do and not do: [http://www.w3.org/TR/WCAG/](http://www.w3.org/TR/WCAG/)
48
49 ## Who can be a hack day participant
50 - roles; coder, designer UX/graphics
Alex Sadleir 51
Maxious 52 ## Definitions
Alex Sadleir 53 - definitions, open licence reuse permissive hacker hack data journalism data bis UCX etc.
Maxious 54
55
56 ## key datasets
Alex Sadleir 57 - key datasets, directory.gov.au gazetter/AEC electorates/suburbs/postcodes/LGAs
Maxious 58
59 ## examples
60
Alex Sadleir 61 ## The Open Budget
Alex Sadleir 62
Maxious 63 ## WeatherTree weather API
maxious 64
Alex Sadleir 65 ## PlanningAlerts
Maxious 66
Alex Sadleir 67 [![Planning Alerts Screenshot](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1-300x221.png "Planning Alerts Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1.png)Description: Planning Alerts takes data from local government development applications and sends alerts to users based on what applications are lodged in their area.
Maxious 68
Maxious 69 Programming Language: Ruby
Maxious 70
Maxious 71 Source Control: [Git](https://github.com/openaustralia/planningalerts-app)
72
Alex Sadleir 73 Issue Tracking: [Atlassian JIRA](http://tickets.openaustraliafoundation.org.au/browse/PA/)
Maxious 74
75 ## LobbyLens
76
77 [![](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium-300x180.png "LobbyLens screenshot")](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium.png)
78
Maxious 79 Description: Displays connections between government contracts, business details, politician responsibilities, lobbyists, clients of lobbyists, political donors and the location of these entities.
80
81 Programing Language: PHP
Alex Sadleir 82
Maxious 83 Source Control: SVN (Subversion)
Alex Sadleir 84
Maxious 85 Issue Tracking: A whiteboard
Maxious 86
87 ## Bus.lambdacomplex.org
88
89 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae-300x253.jpg "Bus.lambda screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae.jpg)
90
91 Description: Online Canberra Bus Timetables and Trip Planner.
92
93 Programing Language: PHP/Ruby
94
95 Source Control: Git
96
97 Issue Tracking: Github
98
99
100 ## Developer Tools For Your Computer {#developer-tools-for-your-computer}
101
Alex Sadleir 102 server admin / technical tools
Alex Sadleir 103 many projects will require some kind of internet presence, webpage etc.
104 - css framework like bootstrap or zurb foundation
Alex Sadleir 105 video tools, youtube video editor/slideshow, FOSS video editing tools
Maxious 106 - http://ubuntu-tutorials.com/2008/11/11/relaying-postfix-smtp-via-smtpgmailcom/
107 - amon
Alex Sadleir 108
109 ### Source Control &#8211\. Git / Subversion
110
111 [![](http://www.govhack.org/wp-content/uploads/Screenshot-at-2012-04-29-172132-300x235.png "Git Screenshot")](http://progit.org/book/)
112
113 [http://progit.org/book/](http://progit.org/book/)
114
115 [http://svnbook.red-bean.com/](http://svnbook.red-bean.com/)
116
117 [http://tortoisesvn.net/](http://tortoisesvn.net/)
118
119 [http://code.google.com/p/tortoisegit/](http://code.google.com/p/tortoisegit/)
120
121 ### Task Tracking -
Maxious 122
123 Issue/task trackers allow you to outline the tasks required for your project and assign them to people to do.
Maxious 124
Alex Sadleir 125 [Trello](https://trello.com/) and [Workflowy](https://workflowy.com/) are free, lightweight project management tools suitable for a rapid project!
Maxious 126
Alex Sadleir 127 ## Hosted Developer Tools {#hosted-developer-tools}
maxious 128
Maxious 129 Can get many tools (source control, issue tracking) combined into one service cloud hosted so no setup required.
Alex Sadleir 130
Maxious 131 ### Github
132 Git obviously but svn/hg interfaces are possible. Provide their own GUI for Windows/OSX or use the variety of Git capable tools
Alex Sadleir 133
Alex Sadleir 134 ### Sourceforge
135
136 Subversion, Git, Mercurial, Bazaar, CVS, issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
137
138 You can create your own Sourceforge project at [http://sourceforge.net/](http://sourceforge.net/)
maxious 139
140 ### Google Code Project Hosting
Maxious 141
142 Git, Mercurial, and Subversion code. Issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
143
144 You can host your Google Code project and get access to developer tools, APIs and documentation at [http://code.google.com/](http://code.google.com/)
145
Maxious 146
147
Maxious 148 # API Development {#api-development}
Maxious 149
Alex Sadleir 150
Maxious 151 So an API isn&#8217;t just an XML file ![;)](http://www.govhack.org/wp-includes/images/smilies/icon_wink.gif)
Alex Sadleir 152
maxious 153 A good web based data API:
154
Maxious 155 * Is logically organised
156 * Can filter returned data
maxious 157 * Can return results in different open formats (CSV/JSON etc.)
Maxious 158 * Is efficient and responsive by using caching and databases appropriately
Alex Sadleir 159 * Handles errors gracefully
160 * Monitors and controls access (to show benefit realised of API and prevent abuse)
161 * Provides appropriate documentation with examples
162
Alex Sadleir 163 Some people like sensis [http://](http://developers.sensis.com.au/)[developers.sensis.com.<wbr>au</wbr>](http://developers.sensis.com.au/)[/](http://developers.sensis.com.au/) use a provider like[http://](http://mashery.com/)[mashery.com](http://mashery.com/)[/](http://mashery.com/) or [https](https://apigee.com/)[://](https://apigee.com/)[apigee.com](https://apigee.com/) or [http://](http://apiaxle.com/)[apiaxle.com](http://apiaxle.com/)[/](http://apiaxle.com/) or [http://www.3scale.net/](http://www.3scale.net/) which handles making a good API for them.
Alex Sadleir 164
165 Atlassian have a great page on what makes a good API [https](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[://](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[developer.atlassian.<wbr>com</wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[/display/REST/](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[Atlassian](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[+<wbr>REST+API+Design+Guidelines+<wbr>version+1</wbr></wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)
166
167 API
168 - howto.gov api tutorial
169 - http://shancarter.com/data_converter/
170 - http://training.sunlightfoundation.com/module/data-visualizations-google-docs/
171 - api documentation
172 - WSDL or http://swagger.wordnik.com/ or https://github.com/mashery/iodocs
Alex Sadleir 173 - http://symfony.com/ https://github.com/FriendsOfSymfony/FOSRestBundle http://williamdurand.fr/2012/08/02/rest-apis-with-symfony2-the-right-way/ https://github.com/nelmio/NelmioApiDocBundle better apis https://github.com/liip/LiipHelloBundle
Alex Sadleir 174 - https://github.com/elc/rapi_doc https://github.com/Pajk/apipie-rails
175 -
176 http://amberonrails.com/building-stripes-api/
177
178
179 # Infographics and Data Visualisation {#data-visualisation}
180
181 Infographics try to contextualise charts and graphs to tell a story. Data vis builds on this to find new ways to design insight.
182
183 Most of the categories to follow have visualisation tools specific to their purpose.
Maxious 184
Alex Sadleir 185 You can find some data visualisation &#8220;essential&#8221\. tools below:
Alex Sadleir 186
187 [http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/](http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/)
Maxious 188
Alex Sadleir 189 Also check out [http://thejit.org](http://thejit.org/) &amp; [http://www.senchalabs.org/<wbr>philogl/</wbr>](http://www.senchalabs.org/philogl/) (contributed by Matt Adcock)
190
191 Have to use visual art concepts, good color schemes http://www.r-bloggers.com/the-paul-tol-21-color-salute/
192
193
194 - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
195 - http://drawingbynumbers.org/toolsandresources
196
197 examples - http://sunfoundation.tumblr.com/
198 tools - http://selection.datavisualization.ch/ data viz tools catalog
Maxious 199
Alex Sadleir 200
Maxious 201
Alex Sadleir 202 # Mobile
Alex Sadleir 203 html5 jquery mobile like directory.gov.au
204 - android datviz
Maxious 205 - http://code.google.com/p/afreechart/ http://code.google.com/p/snowdon/ http://code.google.com/p/chartdroid/ http://androidplot.com/ http://code.google.com/p/achartengine/
Maxious 206
Alex Sadleir 207
208
maxious 209 # Geographical Data Tools {#geographical-data-tools}
Alex Sadleir 210
maxious 211 Check out the[ GeoRabble Boundary Mapper&#8217;s Cookbook](http://georabble.org/2012/05/31/the-boundary-mappers-cookbook/) to see how you can tie all these things together!
Alex Sadleir 212
Alex Sadleir 213 ## Key datasets
Alex Sadleir 214 - base layers like agri http://agri.openstreetmap.org/, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
215 ASGS including suburbs/postcodes
maxious 216 - andrewharvey4.wordpress.com postgis/asgs tutorial
217 ## Wrangling
Maxious 218
Maxious 219 ### Converting
Maxious 220 There are many spatial data formats and often the one your tool requires is not the one the dataset is provided in
maxious 221 Online
Maxious 222 - http://converter.mygeodata.eu/vector kml exporter for shp
223 or locally using GDAL
maxious 224
225 ### geocoding
226 cloudmade, google (but you must display on a Google Map).
Maxious 227
228 Easiest way to do is with a Google Spreadsheet/Fusion Table http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.htm
Maxious 229
Maxious 230
231 ## Analysis
Maxious 232
Maxious 233
Maxious 234 ### PostGIS
235
236 [![](http://www.govhack.org/wp-content/uploads/postgisexample-300x130.jpg "postgisexample")](http://www.govhack.org/wp-content/uploads/postgisexample.jpg)PostGIS is an extension for the PostgreSQL database server that allows you to store and manipulate geospatial data on a large scale. For example finding which points are in an area or what points are closest . It is also very useful for storing geospatial data because it can convert between all major formats including ESRI Shape files and Google Earth/Maps KML.
237
Maxious 238 ### Quantum GIS
Maxious 239
Maxious 240 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88-300x160.jpg "QGIS Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88.jpg)QGIS is a graphical desktop application that allows viewing and editing of geospatial data. Some good base maps are available by adding the WMS layer/server [http://irs.gis-lab.info/](http://irs.gis-lab.info/)
241
242 ## Visualisation
243
244 ### Layar and other augmented reality tools
245
Alex Sadleir 246 ### Google Fusion Tables/ChartsBin/[OpenHeatMap](http://www.openheatmap.com/)
247
248 [![](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot-300x168.jpg "fusiontablesscreenshot")](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot.jpg)Input a numerical values and areas to a spreadsheet and maps are produced
249
250 ### [Cartographer.js](http://cartographer.visualmotive.com/)
251
Maxious 252 [![](http://www.govhack.org/wp-content/uploads/cartographerjs-300x187.png "cartographerjs screenshot")](http://www.govhack.org/wp-content/uploads/cartographerjs.png)Input data as JSON and maps are produced.
253 See also d3 maps.
254 - http://bost.ocks.org/mike/map/
255
maxious 256
Maxious 257 ### OpenLayers/Google Maps/[Leaflet](http://leaflet.cloudmade.com/)
maxious 258
259 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1-300x173.jpg "OpenLayers Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1.jpg)Display points and different layers. Leaflet is the easiest to use if you just want to show points with popups when clicked on.
260 There are wrappers for Google maps like http://hpneo.github.com/gmaps/examples.html and Mapstraction that can make it easier to use too.
Alex Sadleir 261
262 ### NASA World Wind/Google Earth
Maxious 263
264 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4-300x261.jpg "WorldWind screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4.jpg)Google Earth provides 3\. viewing of KML/GML files which represent points and shapes, both through a desktop application and a web plugin. These can be extended with interactive features that allow you to view by timeline or have animated tours between different points. You can also develop and customise your own viewer with the open source [NASA World Wind toolkit.](http://goworldwind.org/demos/)
265
266 ###
Maxious 267
268 # Tabular Data Tools {#tabular-data-tools}
269
270 ## Wrangling
271
272 Tabular data may have duplicate entries or incorrect formats (varying ways to enter dates/phonenumbers etc.). There are tools to quickly fix common problems
Alex Sadleir 273
Maxious 274 [DataWrangler](http://vis.stanford.edu/wrangler/)/[Google Refine](http://code.google.com/p/google-refine/)
275
Alex Sadleir 276 [![](http://www.govhack.org/wp-content/uploads/google_refine_interface.png "google_refine_interface")](http://www.govhack.org/wp-content/uploads/google_refine_interface.png)Clean up duplicate or inconsistent data entries.
Maxious 277
278 Can also use general purpose tools; grep/awk/sed
279 regex http://www.regexper.com/ http://www.debuggex.com/?re=&str=
Alex Sadleir 280
281 ## Analysis
282
283 ### Excel / Calc
Alex Sadleir 284
285 Great basic analysis and viewing. Older versions can be limited to 6500\. or so rows. Eg [http://www.tcij.org/training-material/car/data-mining/3474](http://www.tcij.org/training-material/car/data-mining/3474)
Maxious 286
287
Maxious 288 ### PostgreSQL/MySQL
289
290 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg "SQL screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg)Next step up, large datasets can be manipulated/extracted efficiently for example [http://www.postgresql.org/docs/8.4/static/tutorial-window.html](http://www.postgresql.org/docs/8.4/static/tutorial-window.html) , no built-in data visualisation though.
291
292 ### [Miso Dataset](http://misoproject.com/dataset/)
293
294 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38-293x300.png "miso screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38.png)Javascript data transformation library � especially good if you want to use the output for javascript interactive visualisations because the transformations can be done on-the-fly by users.
295
296 ### R Statistical Language
297
298 [![](http://www.govhack.org/wp-content/uploads/rstudio-windows-300x249.png "rstudio-windows")](http://www.govhack.org/wp-content/uploads/rstudio-windows.png)Advanced data analysis, can find and visualise trends in large datasets. Some reference resources to learn the language [http://cran.r-project.org/doc/manuals/R-intro.html ](http://cran.r-project.org/doc/manuals/R-intro.html)There are also some addons that provide graphical interfaces that make it easier to use such as Rattle [http://rattle.togaware.com/](http://rattle.togaware.com/) , RStudio [http://rstudio.org/](http://rstudio.org/) or Deducer [http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual](http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual)
299
300 - http://blog.yhathq.com/posts/10-R-packages-I-wish-I-knew-about-earlier.html
301 - excel -> R/rattle/ deducer? http://www.r-bloggers.com/updates-to-the-deducer-family-of-packages/
302 - http://www.twotorials.com/ for R
Maxious 303 - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
maxious 304 - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
Maxious 305 - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
Maxious 306 - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
Maxious 307
308
309 ## Visualisation
Alex Sadleir 310
Maxious 311 ### [Tableau Desktop](http://www.tableausoftware.com/)
Maxious 312
313 Create visualisations from various data formats by dragging and dropping. Free trial available on website. [![](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot-300x190.jpg "Tableau Screenshot")](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot.jpg)
Maxious 314
Maxious 315 ### [Flotr2](http://www.humblesoftware.com/flotr2/)/[Google Chart Tools](https://developers.google.com/chart/)
316
317 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce-300x199.jpg "flotr2 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce.jpg)Javascript based charts for webpages.
Alex Sadleir 318
319 ### D3.js (Data-Driven Documents)
Maxious 320
Alex Sadleir 321 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020-300x277.jpg "d3 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020.jpg)Javascript visualisations that are more interactive or intricate than charts. Can be hard to learn but there are examples and easier to use premade visualisations such as [word clouds](http://www.jasondavies.com/wordcloud/), [realtime filtering of barcharts](http://square.github.com/crossfilter/), or [bubble trees for comparing amount sizes](https://github.com/okfn/bubbletree).
Maxious 322 d3
Maxious 323 - http://datadrivenjournalism.net/resources/data_driven_documents_defined
324 - http://www.benmcmahen.com/blog/posts/50eb57d55a94d35262000001 d3 svg
325 - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
Alex Sadleir 326 - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
327 - how to make an xkcd chart http://bl.ocks.org/3914862
Maxious 328
329 ### Processing.js
330
331 # Unstructured (text documents, webpages, metadata, tweets etc) Data Tools
Maxious 332
Maxious 333 ## wranglying
334 Scraperwiki pytemplate scrapy
Maxious 335
336 Overviewer/ Jigsaw
337 http://www.cc.gatech.edu/gvu/ii/jigsaw/
338 - opennlp/nltk / https://github.com/clips/pattern
Maxious 339 - lucene/solr
Maxious 340 - http://www.r-bloggers.com/simple-text-mining-with-r/
341 - http://blog.josephwilk.net/ruby/latent-semantic-analysis-in-ruby.html similar terms usually found together
342
343 # Graph (relationships and networks) Data Tools {#graph-relationships-and-networks-data-tools}
344
345 - http://www.slideshare.net/OReillyStrata/visualizing-networks-beyond-the-hairball
346 - http://blog.sciencenet.cn/blog-554179-622011.html SNA tools catalog
347 - https://github.com/jacomyal/osdc2012-sigmajs-demo sigmajs filtering/searching
Maxious 348
349
350 ## Analysis
351
352 ### R
Alex Sadleir 353
354 - http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
Maxious 355
356
Maxious 357 ### Neo4j / OrientDB
358
Alex Sadleir 359 [![](http://www.govhack.org/wp-content/uploads/webadmin-data-300x127.png "Neo4\. web admin screenshot")](http://www.govhack.org/wp-content/uploads/webadmin-data.png)Help understand relationships � how is X connected to Y and via what other entities they both are connected to. Imports and exports
Maxious 360
361 - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
362
363 http://www.orientdb.org/
Alex Sadleir 364
Maxious 365 Both can be accessed using a preexisting tool like Gremlin or by writing a simple Java/Python/Ruby application. Queries can be tested in the built in data browser.
366
367
Alex Sadleir 368
maxious 369 ### [NetworkX](http://networkx.lanl.gov/index.html)
Maxious 370
Alex Sadleir 371 [![](http://www.govhack.org/wp-content/uploads/chess_masters-300x300.png "NetworkX")](http://www.govhack.org/wp-content/uploads/chess_masters.png)
372
373 NetworkX is a social network analysis library for python. Many advanced analyses built in like finding communities within a graph. Also good for converting data into graphs.
Maxious 374
Maxious 375
Alex Sadleir 376 ## Visualisation
377 ### Tree/Hierarchy visualisation
378 - don't use network viz if what you actually have is a tree/hierarchy with no interconnections http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/d3 for Trees and Hierarchies
Maxious 379 http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
Maxious 380
381 ### NodeXL for Microsoft Excel
Alex Sadleir 382 - http://nodexl.codeplex.com/ network graphs for excel
Maxious 383
Alex Sadleir 384 ### [Graphviz](http://www.graphviz.org/)
Maxious 385
maxious 386 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d-300x184.png "Graphviz Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d.png)Classic directed graph visualisation tool, can even [generate images online without installing](http://ashitani.jp/gv/) or use in webpages with [javascript port of software](http://code.google.com/p/canviz/). File format [�dot� very easy to learn](http://en.wikipedia.org/wiki/DOT_language)
Alex Sadleir 387
388 ### Gephi
Maxious 389
Alex Sadleir 390 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05-300x195.jpg "Gephi Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05.jpg)Desktop graph editor and renderer. Many good automatic layout algorithms even for very large graphs.
391
392 ### [sigma.js](http://sigmajs.org/)
393
Maxious 394 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3-300x130.jpg "Sigma.js Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3.jpg)Javascript graph viewer, can use GEXF files exported from tools like neo4j, gephi and NetworkX.
395