Sunlight Labs

Influence Explorer and TransparencyData are the Sunlight Foundation’s two main sources for data on money and influence in politics. Both sites are warehouses for a variety of datasets, including campaign finance, lobbying, earmarks, federal spending and various other corporate accountability datasets. The underlying data is the same for both sites, but the presentation is very different. Influence Explorer takes the most important or prominent entities in the data--such as state and federal politicians, well-known individuals, and large companies and organizations--and gives each its own page with easy to understand charts and graphs. TransparencyData, on the other hand, gives searchable access to the raw records that make up each Influence Explorer page. Influence Explorer can answer questions like, “who was the top donor to Obama’s presidential campaign?” TransparencyData lets you dig down into the details of every single donation to that campaign.

Every chart and figure in Influence Explorer is derived from the detailed records in TransparencyData. But correctly computing totals from the raw records isn’t always straightforward. This article will explain how the figures on Influence Explorer are computed from TransparencyData records, and along the way show some of the intricacies of campaign finance rules and limitations of the data.

Sunlight reporter Ryan Sibley published a short post today on various efforts of Koch Industries to influence environmental policy. That piece is a perfect example of the value of bringing disparate datasets together under one site. Ryan pulls in data on Koch Industries’ lobbying activities, EPA enforcement actions against the company and a Koch executive that sat on an EPA advisory committee–all from Influence Explorer and TransparencyData.

The story is based on some of the new data sets that we’ve added to Influence Explorer: EPA enforcement actions, public comments on federal rulemakings and corporate employees on federal advisory committees. I’ll give a brief overview of each.

For the past year we’ve been busy adding data and features to Influence Explorer, our central source for data on money and influence in politics. From our original three data sources (federal campaign finance, state campaign finance and federal lobbying) we’ve now expanded the site to include earmarks, federal spending, contractor misconduct and EPA enforcement data. We’ve also released tools such as Checking Influence and Inbox Influence that put political influence data in a context that’s relevant to users.

After tackling these larger projects we decided to step back and revisit a few things that we didn’t get perfect the first time around. In a number of places we’ve tweaked our methodology, cleaned up our data and added more context. The result should be more accurate and useful information across the board.

Last month I wrote about Inbox Influence, a plugin for Gmail that highlights the political influence of people, companies and politicians mentioned in your emails. Gmail is just one example of a context where it makes sense to attach political influence data to text. (Another is news stories--see Poligraft.) But what about Yahoo Mail and Hotmail? What about Outlook and Thunderbird? What about RSS readers, PDF viewers and word processors? What about integrating political influence data into server-side systems such as blog engines and content management systems? Sunlight Labs can't do it all, which is why creating tools and APIs for developers is one of our primary missions. Indeed, nearly all of our products--including Inbox Influence--are powered by public APIs.

Today we're officially launching Inbox Influence, the latest addition to our suite of political influence tools. Inbox Influence is a browser extension that adds political influence data to your Gmail messages. With Inbox Influence installed, you'll see information on the sender of each email, the company from which it's sent, and any politician, company, union or political action committee mentioned in the body of the email. The information is added unobtrusively and nearly instantaneously, and includes campaign contributions, fundraisers and lobbying activity. You can use it to add context to news alerts, political mailers and corporate emails, or just to see who your friends donated to in the last election. We hope that the tool will be of interest to journalists, activists and anyone interested in seeing the political activity of the people and organizations they communicate with.

One of the primary goals of our site Influence Explorer is to show users a wide variety of influence data on one page. Today we're expanding the scope of influence data by integrating with three important Sunlight projects: Party Time, Lobbying Registration Tracker and OpenCongress. Along with integration with these sites we're also including new data from our partner organization, Center for Responsive Politics, that gives a far more accurate picture of the campaign donations of registered lobbyists.

Followers of this blog are probably already aware of two of the main sites developed by our Data Commons team: TransparencyData.com and InfluenceExplorer.com. Both sites present a variety of influence related data sets, such as campaign finance, federal lobbying, earmarks and federal spending. Influence Explorer provides easy to use overview information about politicians, companies, industries and prominent individuals, while Transparency Data allows users to search and download detailed records from various influence data sets.

In this blog post I want to show how easy it can be to use the public APIs for both sites to integrate influence data into your own projects. I'll walk through a couple examples and show how to use both the RESTful API and the new Python wrapper.

I wanted to let everyone know about some great new features that have just gone live on Influence Explorer. If you haven't already checked it out, Influence Explorer is our one-stop source for a variety of influence-related data on politicians, political organizations, private companies and powerful individuals.

Last week I was fortunate enough to attend OSCON in Portland, OR. This year OSCON hosted hundreds of talks on a dizzying array of subjects. The hot topics this year were definitely cloud computing and languages, established and emerging.

Most interesting to me though was the emphasis on government, social issues, and information freedom. Tim O'Reilly's opening keynote set the tone for many of the later talks by calling for the open source community to use its expertise in cooperative problem solving to address pressing issues in government and society. There were also keynotes from Portland's Mayor Sam Adams and DC's Chief Technology Officer Bryan Sivak on the importance of open source in local government.

This weekend I had the opportunity to attend Scott Chacon's Advanced Git class at Jumpstart Lab. Scott works for Github and maintains the Git project's website. He's also written a book, ProGit, and the handy reference site Git Reference.

Scott spent a good bit of time going over the fundamentals of Git--the different types of objects stored in its database and how they point to one another. I had seen all this before when I first started using Git, but I wasn't ready to really understand it then. If you've ever felt that Git was a bit mysterious or scary I'd highly recommend going over the basics again. Try this article and these two sections of Scott's book.

Here are some other useful tips I picked up: