adding directory with some of the WANE explorations for gov info coll…

…ection
web-archive-group · Mar 5, 2016 · 6cad511 · 6cad511
1 parent 8ce2d00
commit 6cad511
Show file tree

Hide file tree

Showing 12 changed files with 3,469,152 additions and 0 deletions.
diff --git a/gov-info/.ipynb_checkpoints/day3-adding-polish-checkpoint.ipynb b/gov-info/.ipynb_checkpoints/day3-adding-polish-checkpoint.ipynb
diff --git a/gov-info/.ipynb_checkpoints/gephi-export-trial-checkpoint.ipynb b/gov-info/.ipynb_checkpoints/gephi-export-trial-checkpoint.ipynb
diff --git a/gov-info/.ipynb_checkpoints/wane-bipartite-graphs-checkpoint.ipynb b/gov-info/.ipynb_checkpoints/wane-bipartite-graphs-checkpoint.ipynb
diff --git a/gov-info/README.md b/gov-info/README.md
@@ -0,0 +1,9 @@
+# Working with the Gov-Info files
+
+This directory contains iPython notebooks, WANE, and GML files which were used to work with a partial set of the Interent Archive for the parl.gc.ca domain.
+
+The WANE files are a derived dataset containing extracted named entities and URLs.
+
+The Python notebooks were developed to extract the named entities and URLs from the JSON in the WANEs and transform those items into a graph using the networkx Python module.
+
+After transforming the files into a graph the graphs were saved using the GML file type for import into Gephi in order to visualize the graphs and perform eploratory data analysis.