edits
--- a/index.md
+++ b/index.md
@@ -1,59 +1,3 @@
-geo
-
-R
-
-- tools.disclo.gs - how to use data
- - developer tools inc. linked data
- - gephi -> neo4j
- - neo4j lets you build on, do massive queries of who is friends with who
- - don't use network viz if what you actually have is a tree/hierarchy with no interconnections http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/
- - http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
- - postgis/quantum gis
- - (google earth is alright but many limitations) NASA World Wind?
- - ABS statistical areas
- - base layers like agri, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
- - can do nearest/isin/union queries - personal geocoder
- - cloudmade geocoder, google maps my maps
-
- - scraperwiki with new pytemplate libraries
- - makes an API for your data to get in sqlite/json/csv
-
- - govhack library
- - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
- - http://drawingbynumbers.org/toolsandresources
- - http://wmbriggs.com/blog/?p=6465
- - http://ofps.oreilly.com/titles/9781449339739/k_00000002.html list of d3 alternatives
- - http://craigkerstiens.com/2012/10/01/understanding-postgres-performance/
- - https://github.com/clips/pattern for easy NLP/network analysis/data mining
- - https://github.com/theodi/open-data-tech-review/wiki othr cleanup/linked data toola
- - http://selection.datavisualization.ch/ data viz tools catalog
- - manipulating data - grep/find replace/sed/regex
- - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
- - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
- - how to make an xkcd chart http://bl.ocks.org/3914862
-
- - data viz
- - http://k2company.com/blog/2012/09/06/toolbox-for-learning-machine-learning-and-data-science/
- - http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.html google fusion tutorial
- - andrewharvey4.wordpress.com postgis/asgs tutorial
- - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
-
- - http://www.twotorials.com/ for R
- - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
- - http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
- - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
- - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
- - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
-
- - http://dydra.com/
- - http://selection.datavisualization.ch/ data viz tools list
- - http://nodexl.codeplex.com/ network graphs for excel
- - http://sunfoundation.tumblr.com/
- - analysing - linked data tools
- - http://govcampau.wikispaces.com/useful+tools
- - http://linkeddata.org/home
-
-
Welcome to the GovHack toolkit. This page provides all the information you need to prepare hackfest entries.
These tools can be used to make entries like: mobile apps, web apps, data visualisations/infographics
@@ -82,7 +26,6 @@
For further reading in this space
[http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/](http://flowingdata.com/2012/04/27/data-and-visualization-blogs-worth-following/)
-
**Statistics**
@@ -181,7 +124,12 @@
[Trello](https://trello.com/) and [Workflowy](https://workflowy.com/) are free, lightweight project management tools suitable for a rapid project!
-# Hosted Developer Tools {#hosted-developer-tools}
+## Hosted Developer Tools {#hosted-developer-tools}
+
+Can get many tools (source control, issue tracking) combined into one service cloud hosted so no setup required.
+
+### Github
+Git obviously but svn/hg interfaces are possible. Provide their own GUI for Windows/OSX or use the variety of Git capable tools
### Sourceforge
@@ -242,6 +190,15 @@
Have to use visual art concepts, good color schemes http://www.r-bloggers.com/the-paul-tol-21-color-salute/
+
+ - https://graphics.stanford.edu/wikis/cs448b-12-fall/ data viz theory
+ - http://drawingbynumbers.org/toolsandresources
+
+examples - http://sunfoundation.tumblr.com/
+tools - http://selection.datavisualization.ch/ data viz tools catalog
+
+
+
# Mobile
html5 jquery mobile like directory.gov.au
- android datviz
@@ -253,16 +210,22 @@
Check out the[ GeoRabble Boundary Mapper’s Cookbook](http://georabble.org/2012/05/31/the-boundary-mappers-cookbook/) to see how you can tie all these things together!
+## Key datasets
+ - base layers like agri http://agri.openstreetmap.org/, http://irs.gis-lab.info/ wms or http://www.gdal.org/frmt_wms_openstreetmap_tms.xml
+ ASGS including suburbs/postcodes
+ - andrewharvey4.wordpress.com postgis/asgs tutorial
## Wrangling
-## Converting
+### Converting
There are many spatial data formats and often the one your tool requires is not the one the dataset is provided in
Online
- http://converter.mygeodata.eu/vector kml exporter for shp
or locally using GDAL
-## geocoding
+### geocoding
cloudmade, google (but you must display on a Google Map).
+
+Easiest way to do is with a Google Spreadsheet/Fusion Table http://williamparry.blogspot.com.au/2011/04/putting-data-into-google-fusion-tables.htm
## Analysis
@@ -312,6 +275,9 @@
[](http://www.govhack.org/wp-content/uploads/google_refine_interface.png)Clean up duplicate or inconsistent data entries.
+Can also use general purpose tools; grep/awk/sed
+regex http://www.regexper.com/ http://www.debuggex.com/?re=&str=
+
## Analysis
### Excel / Calc
@@ -333,6 +299,11 @@
- http://blog.yhathq.com/posts/10-R-packages-I-wish-I-knew-about-earlier.html
- excel -> R/rattle/ deducer? http://www.r-bloggers.com/updates-to-the-deducer-family-of-packages/
+ - http://www.twotorials.com/ for R
+ - http://www.r-bloggers.com/gradient-word-clouds/ http://www.rstudio.com/shiny/ http://blog.ouseful.info/2012/11/28/quick-shiny-demo-exploring-nhs-winter-sit-rep-data/ https://github.com/timelyportfolio/shiny-d3-plot https://github.com/trestletech/shiny-sandbox/tree/master/grn
+ - http://www.r-bloggers.com/video-simpler-tricks-and-tools-help-debugging-git-latex-and-workflow-with-r-by-prof-rob-hyndman/
+ - http://yihui.name/knitr/ makes reports including google widgets/charts/maps via http://www.r-bloggers.com/googlevis-0-3-2-is-released-better-integration-with-knitr/
+ - http://chartsnthings.tumblr.com/post/36978271916/r-tutorial-simple-charts http://flowingdata.com/2012/12/17/getting-started-with-charts-in-r/
## Visualisation
@@ -351,18 +322,22 @@
d3
- http://datadrivenjournalism.net/resources/data_driven_documents_defined
- http://www.benmcmahen.com/blog/posts/50eb57d55a94d35262000001 d3 svg
+ - d3 tools and tutorial http://enjalot.com/ http://news.ycombinator.com/item?id=4608440
+ - Why d3 is the way it is and how to make charts http://bost.ocks.org/mike/chart/
+ - how to make an xkcd chart http://bl.ocks.org/3914862
### Processing.js
# Unstructured (text documents, webpages, metadata, tweets etc) Data Tools
-Scraperwiki
+## wranglying
+Scraperwiki pytemplate scrapy
+
Overviewer/ Jigsaw
http://www.cc.gatech.edu/gvu/ii/jigsaw/
- - opennlp/nltk, lucene/solr
- - http://www.r-bloggers.com/simple-text-mining-with-r/
-
-R
+ - opennlp/nltk / https://github.com/clips/pattern
+ - lucene/solr
+ - http://www.r-bloggers.com/simple-text-mining-with-r/
- http://blog.josephwilk.net/ruby/latent-semantic-analysis-in-ruby.html similar terms usually found together
# Graph (relationships and networks) Data Tools {#graph-relationships-and-networks-data-tools}
@@ -374,11 +349,22 @@
## Analysis
-### Neo4j
+### R
+
+- http://is-r.tumblr.com/post/38240018815/making-prettier-network-graphs-with-sna-and-igraph
+
+
+### Neo4j / OrientDB
[](http://www.govhack.org/wp-content/uploads/webadmin-data.png)Help understand relationships � how is X connected to Y and via what other entities they both are connected to. Imports and exports
-can be done using a preexisting tool like Gremlin or by writing a simple Java/Python/Ruby application. Queries can be tested in the built in data browser.
+ - http://www.slideshare.net/maxdemarzi/etl-into-neo4j
+
+http://www.orientdb.org/
+
+Both can be accessed using a preexisting tool like Gremlin or by writing a simple Java/Python/Ruby application. Queries can be tested in the built in data browser.
+
+
### [NetworkX](http://networkx.lanl.gov/index.html)
@@ -386,13 +372,14 @@
NetworkX is a social network analysis library for python. Many advanced analyses built in like finding communities within a graph. Also good for converting data into graphs.
-### Palantir
-
-Palantir make a good computer forensics tool, which they will showcase and give GovHack attendees access to for GovHack data analysis purposes. For more information check out:
-
-[http://palantir.com.au/](http://palantir.com.au/)
## Visualisation
+### Tree/Hierarchy visualisation
+ - don't use network viz if what you actually have is a tree/hierarchy with no interconnections http://www.randelshofer.ch/treeviz/ http://thejit.org/demos/ http://mbostock.github.com/protovis/ex/treemap.html http://blog.pixelingene.com/2011/07/building-a-tree-diagram-in-d3-js/d3 for Trees and Hierarchies
+ http://mbostock.github.com/d3/ex/pack.html http://mbostock.github.com/d3/ex/tree.html
+
+### NodeXL for Microsoft Excel
+ - http://nodexl.codeplex.com/ network graphs for excel
### [Graphviz](http://www.graphviz.org/)