edits
[tools.git] / index.md
Maxious 1 - tools.disclo.gs - how to use data
2 - developer tools inc. linked data
3 - gephi -> neo4j
Maxious 4 - neo4j lets you build on, do massive queries of who is friends with who
Maxious 5 -
6 - postgis/quantum gis
Maxious 7 - (google earth is alright but many limitations) NASA World Wind?
Maxious 8 - ABS statistical areas
9
10 - scraperwiki with new pytemplate libraries
11 - makes an API for your data to get in sqlite/json/csv
12
13 - govhack library
14 - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
15 - http://drawingbynumbers.org/toolsandresources
16 - http://wmbriggs.com/blog/?p=6465
Maxious 17 - http://ofps.oreilly.com/titles/9781449339739/k_00000002.html list of d3 alternatives
18 - http://craigkerstiens.com/2012/10/01/understanding-postgres-performance/
19 - https://github.com/clips/pattern for easy NLP/network analysis/data mining
Maxious 20 - https://github.com/theodi/open-data-tech-review/wiki othr cleanup/linked data toola
21 - http://selection.datavisualization.ch/ data viz tools catalog
22 - manipulating data - grep/find replace/sed/regex
23
24 - data viz
25 - http://k2company.com/blog/2012/09/06/toolbox-for-learning-machine-learning-and-data-science/
26 - http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.html google fusion tutorial
Maxious 27
28 - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
maxious 29
Maxious 30
Maxious 31 - http://dydra.com/
32 - http://selection.datavisualization.ch/ data viz tools list
Maxious 33 - http://nodexl.codeplex.com/ network graphs for excel
34 - http://sunfoundation.tumblr.com/
35 - analysing - linked data tools
36 - http://govcampau.wikispaces.com/useful+tools
37 - http://linkeddata.org/home
38
maxious 39
Maxious 40 Welcome to the GovHack toolkit. This page provides all the information you need to prepare hackfest entries.
41 These tools can be used to make entries like: mobile apps, web apps, data visualisations/infographics
42
43
44 # General Data Hacking and Programming References {#general-data-hacking-and-programming-references}
45 ## The basics of being a data scientist
46
47 * Have a hypothesis � even if you’re making a tool/api that helps people with their questions too, remember what the objective of that is.
48 * Find the people and tools you need to prove/show/find. This rest of this page will help with the latter.
49 * Analyse and present results � were they what you expected? Do they help explain to others what you have found out? Can present as a interactive data visualisation or a web/mobile application or just a infographic/motion graphics video that tells a story.
50 Please note, there are a combination of Analysis and Visualisation tools in each of the major categories below.
51
52
53 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f-300x199.gif "Data Journalism Diagram")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6a65720f.gif)</dt>
54 Illustration from Data Journalism Handbook, CC BY-SA 3.0</dd>
55
56
57 The best high level reference is the �Understanding Data� and �Delivering Data� chapters of the Data Journalism Handbook which is available online for free at
58
59 [datajournalismhandbook.org](http://datajournalismhandbook.org/)
60
maxious 61 You can learn the technical skills from scratch in Visualize This: The FlowingData Guide to Design, Visualization, and Statistics by Nathan Yau or for more advanced
Maxious 62
maxious 63 practical advice check out Data Analysis with Open Source Tools by Philipp K. Janert
Maxious 64
65 For further reading in this space
66
67 [http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/](http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/)
68
69
70
71 **Statistics**
72
73 [http://greenteapress.com/thinkstats/html/index.html](http://greenteapress.com/thinkstats/html/index.html)
74
75 **Programming**
76
77 Programming is valuable skill for manipulating and displaying data.
78
79 Basic tutorials for a variety of languages are available for free online or you can learn
80
81 interactively with websites like [http://www.codecademy.com/](http://www.codecademy.com/#!/exercises/0\. for JavaScript or [http://www.learnpython.org/ ](http://www.learnpython.org/)or [http://tryruby.org](http://tryruby.org/)
82
83 [https://developer.mozilla.org/en/JavaScript](https://developer.mozilla.org/en/JavaScript) &#8211\. especially for web applications and visualisations, you&#8217;ll need a basic understanding of JS. Common libraries like prototype or jQuery can help
84
85 **Accessibility/User Experience**
86
87 WCAG guidelines not only make a web app accessible but make it a better experience for all users! Even if not making an app, good to consider these things to do and not do: [http://www.w3.org/TR/WCAG/](http://www.w3.org/TR/WCAG/)
88
89 ## Who can be a hack day participant
90 - roles; coder, designer UX/graphics
91
92 ## Definitions
93 - definitions, open licence reuse permissive hacker hack data journalism data bis UCX etc.
94
95
96 ## key datasets
97 - key datasets, directory.gov.au gazetter/AEC electorates/suburbs/postcodes/LGAs
98
99 ## examples
100
101 ## The Open Budget
102
103 ## WeatherTree weather API
104
105 ## PlanningAlerts
106
107 [![Planning Alerts Screenshot](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1-300x221.png "Planning Alerts Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_2f0199ff1.png)Description: Planning Alerts takes data from local government development applications and sends alerts to users based on what applications are lodged in their area.
108
109 Programming Language: Ruby
110
111 Source Control: [Git](https://github.com/openaustralia/planningalerts-app)
112
113 Issue Tracking: [Atlassian JIRA](http://tickets.openaustraliafoundation.org.au/browse/PA/)
114
115 ## LobbyLens
116
Maxious 117 [![](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium-300x180.png "LobbyLens screenshot")](http://www.govhack.org/wp-content/uploads/129-Screenshot-LobbyClue_-_Chromium.png)
118
119 Description: Displays connections between government contracts, business details, politician responsibilities, lobbyists, clients of lobbyists, political donors and the location of these entities.
120
Maxious 121 Programing Language: PHP
122
123 Source Control: SVN (Subversion)
maxious 124
125 Issue Tracking: A whiteboard
Maxious 126
127 ## Bus.lambdacomplex.org
128
129 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae-300x253.jpg "Bus.lambda screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_3789acae.jpg)
130
131 Description: Online Canberra Bus Timetables and Trip Planner.
132
133 Programing Language: PHP/Ruby
134
135 Source Control: Git
136
137 Issue Tracking: Github
138
139
140 ## Developer Tools For Your Computer {#developer-tools-for-your-computer}
141
142 server admin / technical tools
Maxious 143 many projects will require some kind of internet presence, webpage etc.
144 - css framework like bootstrap or zurb foundation
145 video tools, youtube video editor/slideshow, FOSS video editing tools
146 - http://ubuntu-tutorials.com/2008/11/11/relaying-postfix-smtp-via-smtpgmailcom/
147 - amon
148
149 ### Source Control &#8211\. Git / Subversion
150
151 [![](http://www.govhack.org/wp-content/uploads/Screenshot-at-2012-04-29-172132-300x235.png "Git Screenshot")](http://progit.org/book/)
152
153 [http://progit.org/book/](http://progit.org/book/)
154
155 [http://svnbook.red-bean.com/](http://svnbook.red-bean.com/)
156
157 [http://tortoisesvn.net/](http://tortoisesvn.net/)
158
159 [http://code.google.com/p/tortoisegit/](http://code.google.com/p/tortoisegit/)
160
161 ### Task Tracking -
162
163 Issue/task trackers allow you to outline the tasks required for your project and assign them to people to do.
Alex Sadleir 164
Maxious 165 [Trello](https://trello.com/) and [Workflowy](https://workflowy.com/) are free, lightweight project management tools suitable for a rapid project!
166
maxious 167 ## Hosted Developer Tools {#hosted-developer-tools}
168
169 Can get many tools (source control, issue tracking) combined into one service cloud hosted so no setup required.
170
171 ### Github
172 Git obviously but svn/hg interfaces are possible. Provide their own GUI for Windows/OSX or use the variety of Git capable tools
173
174 ### Sourceforge
175
176 Subversion, Git, Mercurial, Bazaar, CVS, issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
177
178 You can create your own Sourceforge project at [http://sourceforge.net/](http://sourceforge.net/)
179
180 ### Google Code Project Hosting
Maxious 181
182 Git, Mercurial, and Subversion code. Issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
Maxious 183
184 You can host your Google Code project and get access to developer tools, APIs and documentation at [http://code.google.com/](http://code.google.com/)
185
186
187
188 # API Development {#api-development}
189
190
191 So an API isn&#8217;t just an XML file ![;)](http://www.govhack.org/wp-includes/images/smilies/icon_wink.gif)
Maxious 192
Maxious 193 A good web based data API:
194
Alex Sadleir 195 * Is logically organised
196 * Can filter returned data
197 * Can return results in different open formats (CSV/JSON etc.)
198 * Is efficient and responsive by using caching and databases appropriately
199 * Handles errors gracefully
200 * Monitors and controls access (to show benefit realised of API and prevent abuse)
maxious 201 * Provides appropriate documentation with examples
202
203 Some people like sensis [http://](http://developers.sensis.com.au/)[developers.sensis.com.<wbr>au</wbr>](http://developers.sensis.com.au/)[/](http://developers.sensis.com.au/) use a provider like[http://](http://mashery.com/)[mashery.com](http://mashery.com/)[/](http://mashery.com/) or [https](https://apigee.com/)[://](https://apigee.com/)[apigee.com](https://apigee.com/) or [http://](http://apiaxle.com/)[apiaxle.com](http://apiaxle.com/)[/](http://apiaxle.com/) or [http://www.3scale.net/](http://www.3scale.net/) which handles making a good API for them.
204
205 Atlassian have a great page on what makes a good API [https](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[://](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[developer.atlassian.<wbr>com</wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[/display/REST/](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[Atlassian](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[+<wbr>REST+API+Design+Guidelines+<wbr>version+1</wbr></wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)
206
Maxious 207 API
208 - howto.gov api tutorial
Maxious 209 - http://shancarter.com/data_converter/
210 - http://training.sunlightfoundation.com/module/data-visualizations-google-docs/
211 - api documentation
212 - WSDL or http://swagger.wordnik.com/ or https://github.com/mashery/iodocs
213 - http://symfony.com/ https://github.com/FriendsOfSymfony/FOSRestBundle http://williamdurand.fr/2012/08/02/rest-apis-with-symfony2-the-right-way/ https://github.com/nelmio/NelmioApiDocBundle better apis https://github.com/liip/LiipHelloBundle
214 - https://github.com/elc/rapi_doc https://github.com/Pajk/apipie-rails
215 -
216 http://amberonrails.com/building-stripes-api/
217
Maxious 218
maxious 219 # Infographics and Data Visualisation {#data-visualisation}
Maxious 220
221 Infographics try to contextualise charts and graphs to tell a story. Data vis builds on this to find new ways to design insight.
222
223 Most of the categories to follow have visualisation tools specific to their purpose.
Maxious 224
Alex Sadleir 225 You can find some data visualisation &#8220;essential&#8221\. tools below:
226
227 [http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/](http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/)
maxious 228
229 Also check out [http://thejit.org](http://thejit.org/) &amp; [http://www.senchalabs.org/<wbr>philogl/</wbr>](http://www.senchalabs.org/philogl/) (contributed by Matt Adcock)
Maxious 230
231 Have to use visual art concepts, good color schemes http://www.r-bloggers.com/the-paul-tol-21-color-salute/
232
233 # Mobile
Maxious 234 html5 jquery mobile like directory.gov.au
235 - android datviz
Maxious 236 - http://code.google.com/p/afreechart/ http://code.google.com/p/snowdon/ http://code.google.com/p/chartdroid/ http://androidplot.com/ http://code.google.com/p/achartengine/
Maxious 237
238
239
240 # Geographical Data Tools {#geographical-data-tools}
241
Maxious 242 Check out the[ GeoRabble Boundary Mapper&#8217;s Cookbook](http://georabble.org/2012/05/31/the-boundary-mappers-cookbook/) to see how you can tie all these things together!
Maxious 243
244 ## Key datasets
Maxious 245 - base layers like agri http://agri.openstreetmap.org/, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
246 ASGS including suburbs/postcodes
Maxious 247 - andrewharvey4.wordpress.com postgis/asgs tutorial
248 ## Wrangling
249
250 ### Converting
251 There are many spatial data formats and often the one your tool requires is not the one the dataset is provided in
252 Online
253 - http://converter.mygeodata.eu/vector kml exporter for shp
254 or locally using GDAL
255
256 ### geocoding
257 cloudmade, google (but you must display on a Google Map).
258
259
260 ## Analysis
maxious 261
262
263 ### PostGIS
264
Maxious 265 [![](http://www.govhack.org/wp-content/uploads/postgisexample-300x130.jpg "postgisexample")](http://www.govhack.org/wp-content/uploads/postgisexample.jpg)PostGIS is an extension for the PostgreSQL database server that allows you to store and manipulate geospatial data on a large scale. For example finding which points are in an area or what points are closest . It is also very useful for storing geospatial data because it can convert between all major formats including ESRI Shape files and Google Earth/Maps KML.
266
267 ### Quantum GIS
268
269 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88-300x160.jpg "QGIS Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88.jpg)QGIS is a graphical desktop application that allows viewing and editing of geospatial data. Some good base maps are available by adding the WMS layer/server [http://irs.gis-lab.info/](http://irs.gis-lab.info/)
Maxious 270
271 ## Visualisation
272
273 ### Layar and other augmented reality tools
274
275 ### Google Fusion Tables/ChartsBin/[OpenHeatMap](http://www.openheatmap.com/)
276
277 [![](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot-300x168.jpg "fusiontablesscreenshot")](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot.jpg)Input a numerical values and areas to a spreadsheet and maps are produced
278
279 ### [Cartographer.js](http://cartographer.visualmotive.com/)
280
281 [![](http://www.govhack.org/wp-content/uploads/cartographerjs-300x187.png "cartographerjs screenshot")](http://www.govhack.org/wp-content/uploads/cartographerjs.png)Input data as JSON and maps are produced.
282 See also d3 maps.
283 - http://bost.ocks.org/mike/map/
284
Alex Sadleir 285
286 ### OpenLayers/Google Maps/[Leaflet](http://leaflet.cloudmade.com/)
Maxious 287
288 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1-300x173.jpg "OpenLayers Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1.jpg)Display points and different layers. Leaflet is the easiest to use if you just want to show points with popups when clicked on.
289 There are wrappers for Google maps like http://hpneo.github.com/gmaps/examples.html and Mapstraction that can make it easier to use too.
290
291 ### NASA World Wind/Google Earth
292
293 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4-300x261.jpg "WorldWind screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4.jpg)Google Earth provides 3\. viewing of KML/GML files which represent points and shapes, both through a desktop application and a web plugin. These can be extended with interactive features that allow you to view by timeline or have animated tours between different points. You can also develop and customise your own viewer with the open source [NASA World Wind toolkit.](http://goworldwind.org/demos/)
294
Maxious 295 ###
296
297 # Tabular Data Tools {#tabular-data-tools}
298
299 ## Wrangling
300
301 Tabular data may have duplicate entries or incorrect formats (varying ways to enter dates/phonenumbers etc.). There are tools to quickly fix common problems
302
303 [DataWrangler](http://vis.stanford.edu/wrangler/)/[Google Refine](http://code.google.com/p/google-refine/)
304
305 [![](http://www.govhack.org/wp-content/uploads/google_refine_interface.png "google_refine_interface")](http://www.govhack.org/wp-content/uploads/google_refine_interface.png)Clean up duplicate or inconsistent data entries.
306
307 ## Analysis
Maxious 308
309 ### Excel / Calc
maxious 310
311 Great basic analysis and viewing. Older versions can be limited to 6500\. or so rows. Eg [http://www.tcij.org/training-material/car/data-mining/3474](http://www.tcij.org/training-material/car/data-mining/3474)
312
313
314 ### PostgreSQL/MySQL
315
Maxious 316 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg "SQL screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_209ee972.jpg)Next step up, large datasets can be manipulated/extracted efficiently for example [http://www.postgresql.org/docs/8.4/static/tutorial-window.html](http://www.postgresql.org/docs/8.4/static/tutorial-window.html) , no built-in data visualisation though.
317
Maxious 318 ### [Miso Dataset](http://misoproject.com/dataset/)
319
320 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38-293x300.png "miso screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m53b7ee38.png)Javascript data transformation library � especially good if you want to use the output for javascript interactive visualisations because the transformations can be done on-the-fly by users.
321
322 ### R Statistical Language
Maxious 323
324 [![](http://www.govhack.org/wp-content/uploads/rstudio-windows-300x249.png "rstudio-windows")](http://www.govhack.org/wp-content/uploads/rstudio-windows.png)Advanced data analysis, can find and visualise trends in large datasets. Some reference resources to learn the language [http://cran.r-project.org/doc/manuals/R-intro.html ](http://cran.r-project.org/doc/manuals/R-intro.html)There are also some addons that provide graphical interfaces that make it easier to use such as Rattle [http://rattle.togaware.com/](http://rattle.togaware.com/) , RStudio [http://rstudio.org/](http://rstudio.org/) or Deducer [http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual](http://www.deducer.org/pmwiki/pmwiki.php?n=Main.DeducerManual)
325
326 - http://blog.yhathq.com/posts/10-R-packages-I-wish-I-knew-about-earlier.html
327 - excel -> R/rattle/ deducer? http://www.r-bloggers.com/updates-to-the-deducer-family-of-packages/
328 - http://www.twotorials.com/ for R
329 - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
330 - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
331 - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
332 - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
333
334
335 ## Visualisation
336
337 ### [Tableau Desktop](http://www.tableausoftware.com/)
Maxious 338
339 Create visualisations from various data formats by dragging and dropping. Free trial available on website. [![](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot-300x190.jpg "Tableau Screenshot")](http://www.govhack.org/wp-content/uploads/Tableau-Screenshot.jpg)
340
Maxious 341 ### [Flotr2](http://www.humblesoftware.com/flotr2/)/[Google Chart Tools](https://developers.google.com/chart/)
342
343 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce-300x199.jpg "flotr2 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m11006fce.jpg)Javascript based charts for webpages.
344
345 ### D3.js (Data-Driven Documents)
346
maxious 347 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020-300x277.jpg "d3 screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m90d8020.jpg)Javascript visualisations that are more interactive or intricate than charts. Can be hard to learn but there are examples and easier to use premade visualisations such as [word clouds](http://www.jasondavies.com/wordcloud/), [realtime filtering of barcharts](http://square.github.com/crossfilter/), or [bubble trees for comparing amount sizes](https://github.com/okfn/bubbletree).
348 d3
Maxious 349 - http://datadrivenjournalism.net/resources/data_driven_documents_defined
Maxious 350 - http://www.benmcmahen.com/blog/posts/50eb57d55a94d35262000001 d3 svg
Maxious 351 - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
Maxious 352 - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
Maxious 353 - how to make an xkcd chart http://bl.ocks.org/3914862
Maxious 354
355 ### Processing.js
356
Maxious 357 # Unstructured (text documents, webpages, metadata, tweets etc) Data Tools
maxious 358
Maxious 359 Scraperwiki
360 Overviewer/ Jigsaw
361 http://www.cc.gatech.edu/gvu/ii/jigsaw/
362 - opennlp/nltk, lucene/solr
363 - http://www.r-bloggers.com/simple-text-mining-with-r/
364
365 R
Alex Sadleir 366 - http://blog.josephwilk.net/ruby/latent-semantic-analysis-in-ruby.html similar terms usually found together
367
Maxious 368 # Graph (relationships and networks) Data Tools {#graph-relationships-and-networks-data-tools}
369
370 - http://www.slideshare.net/OReillyStrata/visualizing-networks-beyond-the-hairball
371 - http://blog.sciencenet.cn/blog-554179-622011.html SNA tools catalog
372 - https://github.com/jacomyal/osdc2012-sigmajs-demo sigmajs filtering/searching
373
374
Maxious 375 ## Analysis
376
377 ### R
378
379 - http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
Maxious 380
381
maxious 382 ### Neo4j
383
Maxious 384 [![](http://www.govhack.org/wp-content/uploads/webadmin-data-300x127.png "Neo4\. web admin screenshot")](http://www.govhack.org/wp-content/uploads/webadmin-data.png)Help understand relationships � how is X connected to Y and via what other entities they both are connected to. Imports and exports
Maxious 385
Maxious 386 can be done using a preexisting tool like Gremlin or by writing a simple Java/Python/Ruby application. Queries can be tested in the built in data browser.
387
388 ### [NetworkX](http://networkx.lanl.gov/index.html)
389
390 [![](http://www.govhack.org/wp-content/uploads/chess_masters-300x300.png "NetworkX")](http://www.govhack.org/wp-content/uploads/chess_masters.png)
391
392 NetworkX is a social network analysis library for python. Many advanced analyses built in like finding communities within a graph. Also good for converting data into graphs.
393
394
395 ## Visualisation
396 ###
397 - don't use network viz if what you actually have is a tree/hierarchy with no interconnections http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/d3 for Trees and Hierarchies
398 http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
399
400 ### [Graphviz](http://www.graphviz.org/)
401
Maxious 402 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d-300x184.png "Graphviz Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_7579906d.png)Classic directed graph visualisation tool, can even [generate images online without installing](http://ashitani.jp/gv/) or use in webpages with [javascript port of software](http://code.google.com/p/canviz/). File format [�dot� very easy to learn](http://en.wikipedia.org/wiki/DOT_language)
403
Maxious 404 ### Gephi
405
Maxious 406 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05-300x195.jpg "Gephi Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_74d01d05.jpg)Desktop graph editor and renderer. Many good automatic layout algorithms even for very large graphs.
407
408 ### [sigma.js](http://sigmajs.org/)
409
410 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3-300x130.jpg "Sigma.js Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m6006eaf3.jpg)Javascript graph viewer, can use GEXF files exported from tools like neo4j, gephi and NetworkX.
maxious 411