edits
[tools.git] / index.md
Alex Sadleir 1 Below is a whole bunch of information to help you prepare hackfest entries. These tools can be used to make entries like: mobile apps, web apps, data visualisations/inforgraphics
2
3 govhack library
4
5 - http://hpneo.github.com/gmaps/examples.html
6 - android datviz
7 - http://code.google.com/p/afreechart/ http://code.google.com/p/snowdon/ http://code.google.com/p/chartdroid/ http://androidplot.com/ http://code.google.com/p/achartengine/
8 - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
9 - https://mixpanel.com/education/understanding-the-first-five-minutes
10 - http://drawingbynumbers.org/toolsandresources
11 - http://wmbriggs.com/blog/?p=6465
12 - http://ofps.oreilly.com/titles/9781449339739/k_00000002.html list of d3 alternatives
13 - http://craigkerstiens.com/2012/10/01/understanding-postgres-performance/
14 - https://github.com/clips/pattern for easy NLP/network analysis/data mining
15 - https://github.com/theodi/open-data-tech-review/wiki othr cleanup/linked data toola
16 - http://www.opentripplanner.org/apidoc/rest.plan.html
17 - http://selection.datavisualization.ch/ data viz tools catalog
18 - http://www.slideshare.net/OReillyStrata/visualizing-networks-beyond-the-hairball
19 - http://blog.sciencenet.cn/blog-554179-622011.html SNA tools catalog
20 - https://github.com/jacomyal/osdc2012-sigmajs-demo sigmajs filtering/searching
21 - manipulating data - grep/find replace/sed/regex
22 - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
23 - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
24 - how to make an xkcd chart http://bl.ocks.org/3914862
25 - http://blog.josephwilk.net/ruby/latent-semantic-analysis-in-ruby.html similar terms usually found together
26 - data viz
27 - http://k2company.com/blog/2012/09/06/toolbox-for-learning-machine-learning-and-data-science/
28 - http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.html google fusion tutorial
29 - andrewharvey4.wordpress.com postgis/asgs tutorial
30 - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
31 - http://www.twotorials.com/ for R
32 - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
33 - http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
34 - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
35 - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
36 - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
37 - http://dydra.com/
38 - http://selection.datavisualization.ch/ data viz tools list
39 - http://nodexl.codeplex.com/ network graphs for excel
40 - http://sunfoundation.tumblr.com/
41 - css framework like bootstrap or zurb foundation
42 - analysing - linked data tools
43 - http://govcampau.wikispaces.com/useful+tools
44 - http://linkeddata.org/home
45 - analysing - unstructured/nlp incl overviewer, opennlp/nltk, lucene/solr
46 - http://www.r-bloggers.com/simple-text-mining-with-r/
47
48 # Hosted Developer Tools {#hosted-developer-tools}
49
50 ### Sourceforge
51
52 Subversion, Git, Mercurial, Bazaar, CVS, issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
53
54 You can create your own Sourceforge project at [http://sourceforge.net/](http://sourceforge.net/)
55
56 ### Google Code Project Hosting
57
58 Git, Mercurial, and Subversion code. Issue tracker, wiki, release file downloads. Unlimited free use for open source projects.
59
60 You can host your Google Code project and get access to developer tools, APIs and documentation at [http://code.google.com/](http://code.google.com/)
61
62
63
Maxious 64 # The basics of being a data scientist
65
66
67 * Find the people and tools you need to prove/show/find. This rest of this page will help with the latter.
68
69 Please note, there are a combination of Analysis and Visualisation tools in each of the major categories below.
70
Alex Sadleir 71 # API Development {#api-development}
Maxious 72
73
74 So an API isn’t just an XML file ![;)](http://www.govhack.org/wp-includes/images/smilies/icon_wink.gif)
75
76 A good web based data API:
77
78 * Is logically organised
79 * Can filter returned data
80 * Can return results in different open formats (CSV/JSON etc.)
81 * Is efficient and responsive by using caching and databases appropriately
82 * Handles errors gracefully
83 * Monitors and controls access (to show benefit realised of API and prevent abuse)
84 * Provides appropriate documentation with examples
85
86 Some people like sensis [http://](http://developers.sensis.com.au/)[developers.sensis.com.<wbr>au</wbr>](http://developers.sensis.com.au/)[/](http://developers.sensis.com.au/) use a provider like[http://](http://mashery.com/)[mashery.com](http://mashery.com/)[/](http://mashery.com/) or [https](https://apigee.com/)[://](https://apigee.com/)[apigee.com](https://apigee.com/) or [http://](http://apiaxle.com/)[apiaxle.com](http://apiaxle.com/)[/](http://apiaxle.com/) or [http://www.3scale.net/](http://www.3scale.net/) which handles making a good API for them.
87
88 Atlassian have a great page on what makes a good API [https](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[://](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[developer.atlassian.<wbr>com</wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[/display/REST/](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[Atlassian](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)[+<wbr>REST+API+Design+Guidelines+<wbr>version+1</wbr></wbr>](https://developer.atlassian.com/display/REST/Atlassian+REST+API+Design+Guidelines+version+1)
89
90
91
92
93
Alex Sadleir 94 # Data Visualisation {#data-visualisation}
95
96 Most of the categories to follow have visualisation tools specific to their purpose.
97
98 You can find some data visualisation &#8220;essential&#8221\. tools below:
99
100 [http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/](http://www.visualisingdata.com/index.php/2011/07/part-6-the-essential-collection-of-visualisation-resources/)
101
102 Also check out [http://thejit.org](http://thejit.org/) &amp; [http://www.senchalabs.org/<wbr>philogl/</wbr>](http://www.senchalabs.org/philogl/) (contributed by Matt Adcock)
103
104
Maxious 105
Alex Sadleir 106 # Augmented Reality Tools {#augmented-reality-tools}
107
108 ### buildAR
109
110 buildAR was the world&#8217;s first AR Content Management System with the first early version launched back in 200\. as a bit of a test to see if people were interested in being able to create their own augmented experiences. MOB Labs officially launched the new improved buildAR at the Augmented Reality event in Silicon Valley in May 2011.
111
112 [http://buildAR.com](http://buildar.com/) (normally a 1\. day free trial but GovHack attendees on the day will get a fully activated account for a month. If you are a GovHack attendee want full access now to play, just sign up for a trial and then forward your GovHack Eventbrite registration email to govhack [at] buildar.com and they&#8217;ll set you up for the free month fully activated account within a couple of days.
113
114 ### Other AR tools and references
115
116 theAWEsomeWEB &#8211\. Future of the Augmented Web [http://theAWEsomeWEB.com](http://theawesomeweb.com/)
117
118 Layar &#8211\. AR Browser - [http://layar.com](http://layar.com/)
119
120 Junaio &#8211\. AR Browser - [http://junaio.com](http://junaio.com/)
121
122 Aurasma &#8211\. AR Browser - [http://aurasma.com/](http://aurasma.com/)
123
124 Vuforia &#8211\. NFT based AR SDK - [http://qualcomm.com/solutions/<wbr>augmented-reality</wbr>](http://qualcomm.com/solutions/augmented-reality)
125
126 String &#8211\. Marker based AR SDK - [http://poweredbystring.com/](http://poweredbystring.com/)
127
128 [pointcloud.io](http://pointcloud.io/) - SLAM based AR SDK - [http://pointcloud.io/](http://pointcloud.io/)
129
130 ARToolkit &#8211\. Marker based AR SDK - [http://en.wikipedia.org/wiki/<wbr>ARToolKit</wbr>](http://en.wikipedia.org/wiki/ARToolKit)
131
132 FLARToolkit &#8211\. Marker based AR SDK - [http://saqoo.sh/a/en/<wbr>flartoolkit/start-up-guide</wbr>](http://saqoo.sh/a/en/flartoolkit/start-up-guide)
133
134 Kooaba &#8211\. Visual search platform - [http://kooaba.com](http://kooaba.com/)
135
136 Catchoom &#8211\. Visual search platform - [http://catchoom.com/](http://catchoom.com/)
137
138 Google Googles &#8211\. Visual search app - [http://www.google.com/mobile/<wbr>goggles/#text</wbr>](http://www.google.com/mobile/goggles/#text)
139
140 Vuzix 920AR &#8211\. Wearable display - [http://www.vuzix.com/consumer/<wbr>products_wrap920ar.html</wbr>](http://www.vuzix.com/consumer/products_wrap920ar.html)
141
142 Project Glass &#8211\. Googles wearable display project - [http://www.youtube.com/watch?<wbr>v=9c6W4CCU9M4</wbr>](http://www.youtube.com/watch?v=9c6W4CCU9M4)
143
144 Mixed Reality &#8211\. Nokia&#8217;s vision for wearable displays [http://www.youtube.com/watch?<wbr>v=CGwvZWyLiBU</wbr>](http://www.youtube.com/watch?v=CGwvZWyLiBU)
145
146 City Lens &#8211\. Nokia&#8217;s latest AR app - [http://www.youtube.com/watch?<wbr>v=63lNPkl-EPE&amp;feature=youtu.be</wbr>](http://www.youtube.com/watch?v=63lNPkl-EPE&amp;feature=youtu.be)
147
148 AR &#8211\. Wikipedia page - [http://en.wikipedia.org/wiki/<wbr>Augmented_reality</wbr>](http://en.wikipedia.org/wiki/Augmented_reality)
149
150 Steve Mann &#8211\. Wearable Computing Pioneer - [http://en.wikipedia.org/wiki/<wbr>Steve_Mann</wbr>](http://en.wikipedia.org/wiki/Steve_Mann)
151
152 Thad Starner &#8211\. Wearable Computing Pioneer [http://en.wikipedia.org/wiki/<wbr>Thad_Starner</wbr>](http://en.wikipedia.org/wiki/Thad_Starner)
153
154 Mark Weiser &#8211\. Father of Pervasive Computing [http://en.wikipedia.org/wiki/<wbr>Mark_Weiser</wbr>](http://en.wikipedia.org/wiki/Mark_Weiser)
155
156
157 # Geographical Data Tools {#geographical-data-tools}
158
159 Check out the[ GeoRabble Boundary Mapper&#8217;s Cookbook](http://georabble.org/2012/05/31/the-boundary-mappers-cookbook/) to see how you can tie all these things together!
160
161 ## Analysis
162
163 ### PostGIS
164
165 [![](http://www.govhack.org/wp-content/uploads/postgisexample-300x130.jpg "postgisexample")](http://www.govhack.org/wp-content/uploads/postgisexample.jpg)PostGIS is an extension for the PostgreSQL database server that allows you to store and manipulate geospatial data on a large scale. For example finding which points are in an area or what points are closest . It is also very useful for storing geospatial data because it can convert between all major formats including ESRI Shape files and Google Earth/Maps KML.
166
167 ### Quantum GIS
168
169 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88-300x160.jpg "QGIS Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_m50afbe88.jpg)QGIS is a graphical desktop application that allows viewing and editing of geospatial data. Some good base maps are available by adding the WMS layer/server [http://irs.gis-lab.info/](http://irs.gis-lab.info/)
170
171 ## Visualisation
172
173 ### Google Fusion Tables/ChartsBin/[OpenHeatMap](http://www.openheatmap.com/)
174
175 [![](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot-300x168.jpg "fusiontablesscreenshot")](http://www.govhack.org/wp-content/uploads/fusiontablesscreenshot.jpg)Input a numerical values and areas to a spreadsheet and maps are produced
176
177 ### [Cartographer.js](http://cartographer.visualmotive.com/)
178
179 [![](http://www.govhack.org/wp-content/uploads/cartographerjs-300x187.png "cartographerjs screenshot")](http://www.govhack.org/wp-content/uploads/cartographerjs.png)Input data as JSON and maps are produced.
180
181
182
183 ### OpenLayers/Google Maps/[Leaflet](http://leaflet.cloudmade.com/)
184
185 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1-300x173.jpg "OpenLayers Screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_512fcbe1.jpg)Display points and different layers. Leaflet is the easiest to use if you just want to show points with popups when clicked on.
186
187 ### NASA World Wind/Google Earth
188
189 [![](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4-300x261.jpg "WorldWind screenshot")](http://www.govhack.org/wp-content/uploads/How-to-participate-in-GovHack_html_4dda24a4.jpg)Google Earth provides 3\. viewing of KML/GML files which represent points and shapes, both through a desktop application and a web plugin. These can be extended with interactive features that allow you to view by timeline or have animated tours between different points. You can also develop and customise your own viewer with the open source [NASA World Wind toolkit.](http://goworldwind.org/demos/)
190
191 ###
192
193 # Tabular Data Tools {#tabular-data-tools}
194
195 ## Analysis
196
197 ### Excel / Calc
198