Wednesday, March 05, 2014

rpmout: Go (golang) tools for listing installed RPMs in HTML,. LaTeX, json

rpmout is a utility for creating user facing rpm information written in Go.

It extracts the rpm tag info (using the rpm command) and produces an HTML list fragment (default), JSON, simple text, and LaTeX. It can be restricted to the rpms that are implicated in a particular set of directories.

My use is to produce a list of bioinformatics applications installed as RPMS on a Rocks cluster http://en.wikipedia.org/wiki/Rocks_Cluster_Distribution

For example: users want to know what is installed in the bioinformatics install dir /opt/bioinformatics, and 'rpmout' generates (by default) an HTML fragment made up of a list of rpms and their useful attributes. This fragment is meant to be embedded into a static HTML page that wraps it with the appropriate local style, titles it, etc.

Here is an example HTML output file: https://github.com/AAFC-MBB/rpmout/blob/master/sample.html.gz?raw=true (~1.4MB compressed)

rpmout is my first real Go program, and I learned a lot about using channels and goroutines.

Comments welcome!  :-)

Monday, November 05, 2012

Energy flow visualizations for USA, UK, China and World, 2007

Continuing my series on the visualization of energy flows, the 2007 energy flows for (click on links for interactive diagrams):




Source: C.A. Smith, R.D. Belles, and A.J. Simon. March 2011. Estimated International Energy Flows 2007 (3.9MB PDF). Lawrence Livermore National Laboratory.  

Related links:  

Friday, October 26, 2012

Visualizing Alberta energy flow, emissions and water use by sector

Related to my earlier post Visualizing Canadian Energy Flows with d3.js Sankey diagrams, here I am presenting Sankey diagrams with data from the publication:

2011. Development of Energy, Emission and Water Flow Sankey Diagrams for the Province of Alberta Through Modeling Final Report. April 11, 2011. Amit Kumar, Veena Subramanyam, Md Ruhul Kabir. Department of Mechanical Engineering, University of Alberta.
Sankey diagrams (click on links for interactive diagrams):
 The last is particularly illuminating, showing a huge amount of both surface water and ground water used by the petroleum industry from the Athabasca River basin. See http://en.wikipedia.org/wiki/Athabasca_oil_sands#Water:

Thanks again to Mike Bostock and his d3.js plugin for making Sankey diagrams



Thursday, October 25, 2012

Visualizing Canadian Energy Flows with d3.js Sankey diagrams

I have been working with processing.js but wanted to learn a little about d3js for visualizations, so took a look at Mike Bostock's d3.js plugin for making Sankey diagrams.

So I pulled down two documents that had energy flow diagrams for Canada:

I extracted the data from these diagrams and built these interactive Sankey energy flows:
Note that these two documents are looking at slightly different views of energy flows (and 2007 does not include Uranium), so can't be compared directly.

If you have any (preferably Canadian) datasets that could be presented in this fashion, let me know and we can collaborate in getting them into this form.

Addendum: 2012 10 26 22:28: Wow! The Economist's blog Graphic detail: Charts, maps and infographics has an article about this post: Charting Canada's energy: Go with the flow 

Related article on energy flows using Sankey diagrams: Visualizing Alberta energy flow, emissions and water use by sector

Wednesday, November 23, 2011

My Google Scholar Citations page

I just took advantage of the opening-up of Google Scholar Citations and got my own page up. It is pretty cool to see your citations, etc. all pulled together.

Sunday, March 27, 2011

Canada not involved in Aid transparency

  1. The Aid Revolution begins with XML / The Aid Revolution Begins Here
  2. Publish What You Fund: The Global Campaign for Aid Transparency
  3. International Aid Transparency Initiative (IATI)

Very oddly, Canada (correction: Canadian government: see below) is NOT involved in this initiative, but the following countries and organizations are:
  •    World Bank
  •    Asian Development Bank
  •    The European Commission (EC)
  •    United Nations Development Programme (UNDP)
  •    Global Alliance for Vaccines and Immunisation (GAVI)
  •    Hewlett Foundation
  •    Australia - AusAID
  •    Denmark - Ministry of Foreign Affairs
  •    Finland - Ministry for Foreign Affairs
  •    Germany - Federal Ministry for Economic Cooperation and Development (BMZ)
  •   Ireland - Irish Aid
  •   Netherlands – Dutch Ministry of Foreign Affairs – Development Cooperation
  •   New Zealand – NZAID
  •   Norway - Norad
  •   Spain – Spain Ministry of Foreign Affairs and Cooperation
  •   Sweden - SIDA
  •   Switzerland - Swiss Agency for Development and Cooperation (SDC)
  •   UK - DFID
There is also no Canadian government involvement on the IATI steering committee.

    Someone should pass this on to the CBC, pointing out Canada's non-participation.
    Someone should ask all the parties in the Canadian election what their policy on this is.

    Correction: 2011.03.27 11:54:  As suggested by letters to donors ("IATI steering committee members commend donors for agreement of Standard") there is some Canadian, non-government, involvement of