put sections into divs
[tools.git] / index.md
Alex Sadleir 1 #GovHack Toolkit
Maxious 2 Welcome to the GovHack toolkit. This page provides all the information you need to prepare hackfest entries.
Alex Sadleir 3 These tools can be used to make entries like: mobile apps, web apps, data visualisations/infographics.
4 This toolkit is open source, licenced cc-by and improvements are encouraged ...
5
Maxious 6 # How to register and submit your entry
Maxious 7 ## Registering your team
Alex Sadleir 8 Coming Soon: how to use the website "Hacker Space" to register and find teams.
9
Maxious 10 ## Preparing your submission
Alex Sadleir 11
Maxious 12 You should record a 3 minute speech and mix images/text to accompany.
Maxious 13 http://www.screenr.com/ and other screencasting tools allow you to demo apps.
Maxious 14 To mix together clips, you can use youtube video editor http://www.youtube.com/editor or local software like http://www.videolan.org/vlmc/ or http://www.lwks.com/
Maxious 15
Maxious 16 You also need to submit your "source material". For an application this may be source code, for another work it might be your notes or prototypes.
Maxious 17 The key thing here is that your source material demonstrates to the judges that some of the end result was your own work and that it is possible for another person to replicate that work.
Maxious 18
Maxious 19
20 # General References {#general-data-hacking-and-programming-references}
21
Maxious 22 ## Who can be a hack day participant
Maxious 23 There are many roles you can play; coder, designer UX/graphics
Maxious 24
25 ## Definitions
maxious 26 - definitions, open licence reuse permissive hacker hack data journalism data vis UX etc.
Maxious 27
Maxious 28 ## The basics of being a data scientist
29
Maxious 30 * Have a hypothesis - even if you're making a tool/api that helps people with their questions too, remember what the objective of that is.
Alex Sadleir 31 * Find the people and tools you need to prove/show/find. This rest of this page will help with the latter.
Maxious 32 * Analyse and present results - were they what you expected? Do they help explain to others what you have found out?
33 Can present as a interactive data visualisation or a web/mobile application or just a infographic/motion graphics video that tells a story.
maxious 34
Maxious 35 [![](img/How-to-participate-in-GovHack_html_m6a65720f-300x199.gif "Data Journalism Diagram")](img/How-to-participate-in-GovHack_html_m6a65720f.gif)</dt>
36 Illustration from Data Journalism Handbook, CC BY-SA 3.0</dd>
37
38 The best high level reference is the 'Understanding Data' and 'Delivering Data' chapters of the Data Journalism Handbook which is available online for free at
39 [datajournalismhandbook.org](http://datajournalismhandbook.org/)
40
41 You can learn the technical skills from scratch in Visualize This: The FlowingData Guide to Design, Visualization, and Statistics by Nathan Yau or for more advanced
42 practical advice check out Data Analysis with Open Source Tools by Philipp K. Janert
43 For further reading in this space
Alex Sadleir 44 [http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/](http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/)
45
46
Maxious 47 **Statistics**
48 [http://greenteapress.com/thinkstats/html/index.html](http://greenteapress.com/thinkstats/html/index.html)
49
50 **Programming**
Alex Sadleir 51
Maxious 52 Programming is valuable skill for manipulating and displaying data.
Alex Sadleir 53 Basic tutorials for a variety of languages are available for free online or you can learn
Maxious 54
55 interactively with websites like [http://www.codecademy.com/](http://www.codecademy.com/#!/exercises/0). for JavaScript or [http://www.learnpython.org/ ](http://www.learnpython.org/)or [http://tryruby.org](http://tryruby.org/)
56
Alex Sadleir 57 [https://developer.mozilla.org/en/JavaScript](https://developer.mozilla.org/en/JavaScript) - especially for web applications and visualisations, you'll need a basic understanding of JS. Common libraries like prototype or jQuery can help
Maxious 58
59 **Accessibility/User Experience**
60
Alex Sadleir 61 WCAG guidelines not only make a web app accessible but make it a better experience for all users! Even if not making an app, good to consider these things to do and not do: [http://www.w3.org/TR/WCAG/](http://www.w3.org/TR/WCAG/)
62
Maxious 63
maxious 64
Alex Sadleir 65 # Developer Tools For Your Computer {#developer-tools-for-your-computer}
Maxious 66 No matter what kind of application you have for the data, there are many tools you can use to better collaborate and manage your project.
Alex Sadleir 67
Maxious 68 ### Source Control
Maxious 69 Git / Subversion
70
Maxious 71 [![](img/Screenshot-at-2012-04-29-172132-300x235.png "Git Screenshot")](http://progit.org/book/)
72
Alex Sadleir 73 [http://progit.org/book/](http://progit.org/book/)
Maxious 74
75 [http://svnbook.red-bean.com/](http://svnbook.red-bean.com/)
76
77 [http://tortoisesvn.net/](http://tortoisesvn.net/)
78
Maxious 79 [http://code.google.com/p/tortoisegit/](http://code.google.com/p/tortoisegit/)
80
Alex Sadleir 81 ### Task Tracking -
Maxious 82
83 Issue/task trackers allow you to outline the tasks required for your project and assign them to people to do.
Alex Sadleir 84
85 [Trello](https://trello.com/) and [Workflowy](https://workflowy.com/) are free, lightweight project management tools suitable for a rapid project!
86
87 ## Hosted Developer Tools {#hosted-developer-tools}
88
89 Can get many tools (source control, issue tracking) combined into one service cloud hosted so no setup required.
90
91 ### Github
92 Git obviously but svn/hg interfaces are possible. Provide their own GUI for Windows/OSX or use the variety of Git capable tools
93
94 ### Sourceforge
95
96 Subversion, Git, Mercurial, Bazaar, CVS, issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
97
98 You can create your own Sourceforge project at [http://sourceforge.net/](http://sourceforge.net/)
Alex Sadleir 99
100 ### Google Code Project Hosting
101
Maxious 102 Git, Mercurial, and Subversion code. Issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
103
maxious 104 You can host your Google Code project and get access to developer tools, APIs and documentation at [http://code.google.com/](http://code.google.com/)
105
106 # Applications of data hacking
107
108 ## API Development {#api-development}
109
110
111 So an API isn't just an XML file ![;)](http://www.govhack.org/wp-includes/images/smilies/icon_wink.gif)
112
113 A good web based data API:
114
115 * Is logically organised
116 * Can filter returned data
117 * Can return results in different open formats (CSV/JSON etc.)
Maxious 118 * Is efficient and responsive by using caching and databases appropriately
119 * Handles errors gracefully
Maxious 120 * Monitors and controls access (to show benefit realised of API and prevent abuse)
Alex Sadleir 121 * Provides appropriate documentation with examples
Maxious 122
Alex Sadleir 123 Some people like sensis [http://](http://developers.sensis.com.au/)[developers.sensis.com.<wbr>au</wbr>](http://developers.sensis.com.au/)[/](http://developers.sensis.com.au/) use a provider like[http://](http://mashery.com/)[mashery.com](http://mashery.com/)[/](http://mashery.com/) or [https](https://apigee.com/)[://](https://apigee.com/)[apigee.com](https://apigee.com/) or [http://](http://apiaxle.com/)[apiaxle.com](http://apiaxle.com/)[/](http://apiaxle.com/) or [http://www.3scale.net/](http://www.3scale.net/) which handles making a good API for them.
maxious 124
Maxious 125 Atlassian have a great page on what makes a good API https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)
Alex Sadleir 126
Maxious 127 API
128 - howto.gov api resources about choosing SOAP vs. REST etc. http://www.howto.gov/mobile/apis-in-government
Alex Sadleir 129 - http://training.sunlightfoundation.com/module/data-visualizations-google-docs/
Alex Sadleir 130 - api documentation is important too.
131 - WSDL or http://swagger.wordnik.com/ or https://github.com/mashery/iodocs
132 - Many web app frameworks can generate the documentation for you. For example Symfony for PHPhttp://symfony.com/ https://github.com/FriendsOfSymfony/FOSRestBundle http://williamdurand.fr/2012/08/02/rest-apis-with-symfony2-the-right-way/ https://github.com/nelmio/NelmioApiDocBundle better apis https://github.com/liip/LiipHelloBundle
133 - or for Rails https://github.com/elc/rapi_doc https://github.com/Pajk/apipie-rails
134 -
maxious 135 http://amberonrails.com/building-stripes-api/
136 example WeatherTree weather API
Maxious 137
138
139 ## Infographics and Data Visualisation {#data-visualisation}
140
141 Infographics try to contextualise charts and graphs to tell a story. Data vis builds on this to find new ways to design insight.
142
Alex Sadleir 143 Most of the categories to follow have visualisation tools specific to their purpose.
Maxious 144
Maxious 145 You can find some data visualisation tools below:
Alex Sadleir 146
Maxious 147 [http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/](http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/)
Alex Sadleir 148
maxious 149 Also check out [http://thejit.org](http://thejit.org/) &amp; [http://www.senchalabs.org/<wbr>philogl/</wbr>](http://www.senchalabs.org/philogl/) (contributed by Matt Adcock)
150
Maxious 151 Have to use visual art concepts, good color schemes http://www.r-bloggers.com/the-paul-tol-21-color-salute/
152
maxious 153
Maxious 154 - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
Alex Sadleir 155 - http://drawingbynumbers.org/toolsandresources
156
157 examples - http://sunfoundation.tumblr.com/
158 ## The Open Budget
Alex Sadleir 159
Alex Sadleir 160 tools - http://selection.datavisualization.ch/ data viz tools catalog
161
162 ## Web Applications
163
164 With the rise of HTML5 technologies it is easier than ever to make a web application for engaging use of data.
165
166 - css framework like bootstrap or zurb foundation
167 - css gauges http://www.larentis.eu/donuts/
168 - bootstrap themes, web fonts, css sprites, icon fonts
Alex Sadleir 169 - http://designmodo.com/flat-free/ http://designmodo.github.com/Flat-UI/
Alex Sadleir 170
171 ### Examples
172
173
174 ## PlanningAlerts
175
176 [![Planning Alerts Screenshot](img/How-to-participate-in-GovHack_html_2f0199ff1-300x221.png "Planning Alerts Screenshot")](img/How-to-participate-in-GovHack_html_2f0199ff1.png)Description: Planning Alerts takes data from local government development applications and sends alerts to users based on what applications are lodged in their area.
177
178 Programming Language: Ruby
179
Maxious 180 Source Control: [Git](https://github.com/openaustralia/planningalerts-app)
Alex Sadleir 181
Alex Sadleir 182 Issue Tracking: [Atlassian JIRA](http://tickets.openaustraliafoundation.org.au/browse/PA/)
183
Maxious 184 ## LobbyLens
Alex Sadleir 185
186 [![](img/129-Screenshot-LobbyClue_-_Chromium-300x180.png "LobbyLens screenshot")](img/129-Screenshot-LobbyClue_-_Chromium.png)
187
188 Description: Displays connections between government contracts, business details, politician responsibilities, lobbyists, clients of lobbyists, political donors and the location of these entities.
189
190 Programing Language: PHP
191
192 Source Control: SVN (Subversion)
193
194 Issue Tracking: A whiteboard
Maxious 195
Alex Sadleir 196 ## bus.lambdacomplex.org
Maxious 197
Alex Sadleir 198 [![](img/How-to-participate-in-GovHack_html_3789acae-300x253.jpg "Bus.lambda screenshot")](img/How-to-participate-in-GovHack_html_3789acae.jpg)
Alex Sadleir 199
200 Description: Online Canberra Bus Timetables and Trip Planner.
Maxious 201
Maxious 202 Programing Language: PHP/Ruby
Alex Sadleir 203
204 Source Control: Git
maxious 205
Alex Sadleir 206 Issue Tracking: Github
maxious 207
Alex Sadleir 208 ## Mobile
Alex Sadleir 209
210 FRameworks, http://www.sencha.com/products/touch http://phonegap.com/ http://cordova.apache.org/
211
maxious 212 bom water,
213 nz gov budget
Maxious 214 html5 jquery mobile like directory.gov.au
Maxious 215
Maxious 216 - android datviz
maxious 217 - http://code.google.com/p/afreechart/ http://code.google.com/p/snowdon/ http://code.google.com/p/chartdroid/ http://androidplot.com/ http://code.google.com/p/achartengine/
218
219
220
Maxious 221 # Geographical Data Tools {#geographical-data-tools}
222
Maxious 223 Check out the[ GeoRabble Boundary Mapper's Cookbook](http://georabble.org/2012/05/31/the-boundary-mappers-cookbook/) to see how you can tie all these things together!
Maxious 224
225 ## Key datasets
Maxious 226 - base layers like agri http://agri.openstreetmap.org/, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
Maxious 227 ASGS including suburbs/postcodes
Maxious 228 - andrewharvey4.wordpress.com postgis/asgs tutorial
Maxious 229 ## Wrangling
Maxious 230
Maxious 231 ### Converting
232 There are many spatial data formats and often the one your tool requires is not the one the dataset is provided in
233 Online
234 - http://converter.mygeodata.eu/vector kml exporter for shp
235 or locally using GDAL
236
Alex Sadleir 237 ### geocoding
238 cloudmade, google (but you must display on a Google Map).
239
240 Easiest way to do is with a Google Spreadsheet/Fusion Table http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.htm http://support.google.com/fusiontables/answer/1012281?hl=en&ref_topic=2592806
241
242
243 ## Analysis
244
maxious 245
Maxious 246 ### PostGIS
maxious 247
248 [![](img/postgisexample-300x130.jpg "postgisexample")](img/postgisexample.jpg)PostGIS is an extension for the PostgreSQL database server that allows you to store and manipulate geospatial data on a large scale. For example finding which points are in an area or what points are closest . It is also very useful for storing geospatial data because it can convert between all major formats including ESRI Shape files and Google Earth/Maps KML.
249
Alex Sadleir 250 ### Quantum GIS
251
Maxious 252 [![](img/How-to-participate-in-GovHack_html_m50afbe88-300x160.jpg "QGIS Screenshot")](img/How-to-participate-in-GovHack_html_m50afbe88.jpg)QGIS is a graphical desktop application that allows viewing and editing of geospatial data. Some good base maps are available by adding the WMS layer/server [http://irs.gis-lab.info/](http://irs.gis-lab.info/)
253
254 ## Visualisation
255
Maxious 256 ### Layar and other augmented reality tools
257
258 ### Google Fusion Tables/ChartsBin/[OpenHeatMap](http://www.openheatmap.com/)
259
260 [![](img/fusiontablesscreenshot-300x168.jpg "fusiontablesscreenshot")](img/fusiontablesscreenshot.jpg)Input numerical values and areas to a spreadsheet and maps are produced where the areas are colored on a scale of the values
261
Alex Sadleir 262 http://www.peteraldhous.com/CAR/Making_maps_with_Google_Fusion_Tables.pdf tutorial or http://support.google.com/fusiontables/topic/2592754?hl=en&ref_topic=27020 for google help files
Maxious 263
264 ### [Cartographer.js](http://cartographer.visualmotive.com/)
Alex Sadleir 265
Maxious 266 [![](img/cartographerjs-300x187.png "cartographerjs screenshot")](img/cartographerjs.png)Input data as JSON and maps are produced.
267 See also d3 maps.
268 - http://bost.ocks.org/mike/map/
Alex Sadleir 269
270
271 ### OpenLayers/Google Maps/[Leaflet](http://leaflet.cloudmade.com/)
272
Alex Sadleir 273 [![](img/How-to-participate-in-GovHack_html_512fcbe1-300x173.jpg "OpenLayers Screenshot")](img/How-to-participate-in-GovHack_html_512fcbe1.jpg)Display points and different layers. Leaflet is the easiest to use if you just want to show points with popups when clicked on.
274 There are wrappers for Google maps like http://hpneo.github.com/gmaps/examples.html and Mapstraction that can make it easier to use too.
Maxious 275
276 ### NASA World Wind/Google Earth
Maxious 277
maxious 278 [![](img/How-to-participate-in-GovHack_html_4dda24a4-300x261.jpg "WorldWind screenshot")](img/How-to-participate-in-GovHack_html_4dda24a4.jpg)Google Earth provides 3\. viewing of KML/GML files which represent points and shapes, both through a desktop application and a web plugin. These can be extended with interactive features that allow you to view by timeline or have animated tours between different points. You can also develop and customise your own viewer with the open source [NASA World Wind toolkit.](http://goworldwind.org/demos/)
Maxious 279
280 ###
281
282 # Tabular Data Tools {#tabular-data-tools}
Alex Sadleir 283
Maxious 284 ## Wrangling
Maxious 285
Maxious 286 Converting formats json/xml/csv etc.
287 - http://shancarter.com/data_converter/
288
Alex Sadleir 289
290 Tabular data may have duplicate entries or incorrect formats (varying ways to enter dates/phonenumbers etc.). There are tools to quickly fix common problems
Maxious 291
Alex Sadleir 292 [DataWrangler](http://vis.stanford.edu/wrangler/)/[Google Refine](http://code.google.com/p/google-refine/)
293
294 [![](img/google_refine_interface.png "google_refine_interface")](img/google_refine_interface.png)Clean up duplicate or inconsistent data entries.
Alex Sadleir 295
296 Can also use general purpose tools; grep/awk/sed
297 regex http://www.regexper.com/ http://www.debuggex.com/?re=&str=
298
Maxious 299 ## Analysis
300
301 ### Excel / Calc
Maxious 302
303 Great basic analysis and viewing. Older versions can be limited to 6500\. or so rows. Eg [http://www.tcij.org/training-material/car/data-mining/3474](http://www.tcij.org/training-material/car/data-mining/3474)
304
305 ### PostgreSQL/MySQL
306
307 [![](img/How-to-participate-in-GovHack_html_209ee972.jpg "SQL screenshot")](img/How-to-participate-in-GovHack_html_209ee972.jpg)Next step up, large datasets can be manipulated/extracted efficiently for example [http://www.postgresql.org/docs/8.4/static/tutorial-window.html](http://www.postgresql.org/docs/8.4/static/tutorial-window.html) , no built-in data visualisation though.
308
309 ### [Miso Dataset](http://misoproject.com/dataset/)
310
311 [![](img/How-to-participate-in-GovHack_html_m53b7ee38-293x300.png "miso screenshot")](img/How-to-participate-in-GovHack_html_m53b7ee38.png)Javascript data transformation library - especially good if you want to use the output for javascript interactive visualisations because the transformations can be done on-the-fly by users.
312
313 ### R Statistical Language
314
Maxious 315 [![](img/rstudio-windows-300x249.png "rstudio-windows")](img/rstudio-windows.png)Advanced data analysis, can find and visualise trends in large datasets. Some reference resources to learn the language [http://cran.r-project.org/doc/manuals/R-intro.html ](http://cran.r-project.org/doc/manuals/R-intro.html)There are also some addons that provide graphical interfaces that make it easier to use such as Rattle [http://rattle.togaware.com/](http://rattle.togaware.com/) , RStudio [http://rstudio.org/](http://rstudio.org/) or Deducer [http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual](http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual)
316
317 - http://blog.yhathq.com/posts/10-R-packages-I-wish-I-knew-about-earlier.html
318 - excel -> R/rattle/ deducer? http://www.r-bloggers.com/updates-to-the-deducer-family-of-packages/
319 - http://www.twotorials.com/ for R
Alex Sadleir 320 - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
321 - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
Maxious 322 - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
323 - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
Alex Sadleir 324
Maxious 325
326 ## Visualisation
327
328 ### [Tableau Desktop](http://www.tableausoftware.com/)
Alex Sadleir 329
Maxious 330 Create visualisations from various data formats by dragging and dropping. Free trial available on website. [![](img/Tableau-Screenshot-300x190.jpg "Tableau Screenshot")](img/Tableau-Screenshot.jpg)
331
332 ### [Flotr2](http://www.humblesoftware.com/flotr2/)/[Google Chart Tools](https://developers.google.com/chart/)
333
334 [![](img/How-to-participate-in-GovHack_html_m11006fce-300x199.jpg "flotr2 screenshot")](img/How-to-participate-in-GovHack_html_m11006fce.jpg)Javascript based charts for webpages.
Alex Sadleir 335
maxious 336 ### D3.js (Data-Driven Documents)
Alex Sadleir 337
338 [![](img/How-to-participate-in-GovHack_html_m90d8020-300x277.jpg "d3 screenshot")](img/How-to-participate-in-GovHack_html_m90d8020.jpg)Javascript visualisations that are more interactive or intricate than charts. Can be hard to learn but there are examples and easier to use premade visualisations such as [word clouds](http://www.jasondavies.com/wordcloud/), [realtime filtering of barcharts](http://square.github.com/crossfilter/), or [bubble trees for comparing amount sizes](https://github.com/okfn/bubbletree).
339 d3
Maxious 340 - http://datadrivenjournalism.net/resources/data_driven_documents_defined
Maxious 341 - http://www.benmcmahen.com/blog/posts/50eb57d55a94d35262000001 d3 svg
Alex Sadleir 342 - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
343 - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
344 - how to make an xkcd chart http://bl.ocks.org/3914862
Maxious 345
346 ### Processing.js
Alex Sadleir 347
Maxious 348 # Unstructured (Text) Data Tools
Alex Sadleir 349 MOPst of thw world's dat isn't structured because it is contained in documents (webpages, tweets etc.). Sometimes it is possible to structure it, sometimes there are tools that are better suited it unstructured data.
Maxious 350 ## wrangling
maxious 351 Scraperwiki pytemplate scrapy
Alex Sadleir 352 regex
353
Maxious 354 ## analysing
Alex Sadleir 355 - opennlp/nltk / https://github.com/clips/pattern
356 - lucene/solr
357 - http://www.r-bloggers.com/simple-text-mining-with-r/
358 - http://blog.josephwilk.net/ruby/latent-semantic-analysis-in-ruby.html similar terms usually found together
Maxious 359
360 ## visualising
361
Alex Sadleir 362 Overviewer/ Jigsaw
Maxious 363 http://www.cc.gatech.edu/gvu/ii/jigsaw/
Maxious 364
365 http://www.jasondavies.com/wordtree/
366
Maxious 367 # Graph (relationships and networks) Data Tools {#graph-relationships-and-networks-data-tools}
Maxious 368
Maxious 369 - http://www.slideshare.net/OReillyStrata/visualizing-networks-beyond-the-hairball
370 - http://blog.sciencenet.cn/blog-554179-622011.html SNA tools catalog
371 - https://github.com/jacomyal/osdc2012-sigmajs-demo sigmajs filtering/searching
Alex Sadleir 372
373
Maxious 374 ## Analysis
375
Maxious 376 ### R
Maxious 377
378 - http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
Maxious 379
380
381 ### Neo4j / OrientDB
382
383 [![](img/webadmin-data-300x127.png "Neo4\. web admin screenshot")](img/webadmin-data.png)Help understand relationships - how is X connected to Y and via what other entities they both are connected to. Imports and exports
Alex Sadleir 384
385 - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
386 http://blog.neo4j.org/2013/03/importing-data-into-neo4j-spreadsheet.html
387
Maxious 388 http://www.orientdb.org/
Alex Sadleir 389
390 Both can be accessed using a preexisting tool like Gremlin or by writing a simple Java/Python/Ruby application. Queries can be tested in the built in data browser.
391
Maxious 392
393
394 ### [NetworkX](http://networkx.lanl.gov/index.html)
Maxious 395
Maxious 396 [![](img/chess_masters-300x300.png "NetworkX")](img/chess_masters.png)
397
398 NetworkX is a social network analysis library for python. Many advanced analyses built in like finding communities within a graph. Also good for converting data into graphs.
399
400
Maxious 401 ## Visualisation
Maxious 402 ### Tree/Hierarchy visualisation
403 Sometimes what you actually have is a tree/hierarchy with no interconnections.
Maxious 404 http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/d3 for Trees and Hierarchies
405 http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
406
Alex Sadleir 407 ### NodeXL for Microsoft Excel
408 - http://nodexl.codeplex.com/ network graphs for excel
409
410 ### [Graphviz](http://www.graphviz.org/)
411
412 [![](img/How-to-participate-in-GovHack_html_7579906d-300x184.png "Graphviz Screenshot")](img/How-to-participate-in-GovHack_html_7579906d.png)Classic directed graph visualisation tool, can even [generate images online without installing](http://ashitani.jp/gv/) or use in webpages with [javascript port of software](http://code.google.com/p/canviz/). File format ["dot" very easy to learn](http://en.wikipedia.org/wiki/DOT_language)
413
414 ### Gephi
Maxious 415
Alex Sadleir 416 [![](img/How-to-participate-in-GovHack_html_74d01d05-300x195.jpg "Gephi Screenshot")](img/How-to-participate-in-GovHack_html_74d01d05.jpg)Desktop graph editor and renderer. Many good automatic layout algorithms even for very large graphs.
417
418 ### [sigma.js](http://sigmajs.org/)
419
420 [![](img/How-to-participate-in-GovHack_html_m6006eaf3-300x130.jpg "Sigma.js Screenshot")](img/How-to-participate-in-GovHack_html_m6006eaf3.jpg)Javascript graph viewer, can use GEXF files exported from tools like neo4j, gephi and NetworkX.
421