1.USA.gov Data

If you are using the 1.USA.gov data and have feedback or want to tell us about your product, please e-mail us.


The Data 

1.USA.gov URLs are created whenever anyone shortens a .gov or .mil URL using bitly.

We provide a raw pub/sub feed of data created any time anyone clicks on a 1.USA.gov URL. The pub/sub endpoint responds to http requests for any 1.USA.gov URL and returns a stream of JSON entries, one per line, that represent real-time clicks.

You can access the feed at http://developer.usa.gov/1usagov

We store hourly archives of the raw data. You can also explore the raw data on Data.gov.

The JSON data dictionary is as follows:

    
    {
        "a": USER_AGENT, 
        "c": COUNTRY_CODE, # 2-character iso code
        "nk": KNOWN_USER,  # 1 or 0. 0=this is the first time we've seen this browser
        "g": GLOBAL_BITLY_HASH, 
        "h": ENCODING_USER_BITLY_HASH,
        "l": ENCODING_USER_LOGIN,
        "hh": SHORT_URL_CNAME,
        "r": REFERRING_URL,
        "u": LONG_URL,
        "t": TIMESTAMP,
        "gr": GEO_REGION,
        "ll": [LATITUDE, LONGITUDE],
        "cy": GEO_CITY_NAME,
        "tz": TIMEZONE # in http://en.wikipedia.org/wiki/Zoneinfo format
        "hc": TIMESTAMP OF TIME HASH WAS CREATED, 
        "al": ACCEPT_LANGUAGE http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html#sec14.4 
    }

Back to Top

Code from the 1.USA.gov Hack Day 

We held a nationwide 1.USA.gov Hack Day on July 29, 2011 to encourage people to explore the 1.USA.gov data. The following code was created by participants and shared publicly for others to use:

Back to Top

Projects from the 1.USA.gov Hack Day 

A number of items were created in anticipation of and at the Hack Day. Most tools centered around finding popular links, showing links by location, and using click data to enhance security:

  • Popular now - Barg Upender and Adam created a site called PopGov.us that shows which government links are popular in real time.
  • Popularity by day - Measured Voice created GovClicks to show the most popular links per day. GovClicks is built using Gogogon which consumes the 1.USA.Gov click feed and generates daily rankings of URLs.
  • NASA links - Adam Laiacano analyzed 1.USA.gov data and found that 42% of all clicks on 1.USA.gov links go to NASA websites. He created a map that shows that people in Europe are more likely to only click on NASA links, while people in the United States click on links from a wider variety of government links.
  • Across the world - Helmut Hissen made an animation that shows clicks across the globe on 1.USA.gov links from June 2 through July 14. Red flashes represent clicks from non-mobile devices, and green flashes represent clicks from mobile devices. Note that the final NASA Shuttle launch occurred on July 8. There’s a dramatic increase in activity at the 1:24 mark.
  • Map of clicks - Chris Metcalf built a tool that ingests the 1.USA.gov data and feeds it into Data.gov. It also feeds the data into a Google Map to show clicks based on location.
  • Popularity by location - Robert built a tool that searches for the most popular links near your city or within your country.
  • NASA shuttle launch - Bitly created a visualization that shows clicks around the globe that relate to the NASA shuttle launch on July 8.
  • Sharing by domain - Shreyas Karnik looked at which government domains are commonly shortened at a particular point of time and from what location. The resulted in a map showing the location of where the top 10 domains are shared.
  • DNSSEC status - Earl Crane, Scott Rose, and Richard Bullington-McGuire worked on a tool to look at the popularity of 1.USA.gov links against the DNSSEC status of .gov domains. Their project is still in progress, but the code is available to the public (gogogon fork and DNSSEC List Walk).
  • DNSSEC status visualization - Duane Wessels graphed the DNSSEC status of domains by popularity of short URLs from that domain. The size of nodes in the graph represent the number of URLs at or below that name that were shortened. A number of agencies have DNSSEC deployed on their own domains, but employ third party CDN services, such as Akamai, which do not utilize DNSSEC at this point. Scripts and additional results are also available.
  • Twitter mentions - Dmitry Kachaev compared the list of .gov domain names from Data.gov against 1.USA.gov data. He found that only 296 registered domains, out of 1,731, were mentioned on Twitter in the past 60 days. He also created Python code to get archived click data.
  • Creation and clicks - Harlan Harris looked at the time difference between when a link was created and when it was clicked. He created density plots to show the results. Results are available on his blog.
  • Word cloud - Hani Anani used 1.USA.gov data to identify popular government links, and then analyzed the contents with Open Calais to create a word cloud that summarizes popular government topics in near real time.
  • Sonifications - Niki Yoshiuchi from the New York event created a sonification, or audio representation of the data. Joachim Gossmann is also started working on a variety of sonifications.

Terms of Use 

By using the 1.USA.gov data, you agree to the Terms of Service.

Back to Top