Dataset of the Day: The New Digital (TV) Divide
June 12th, 2009by Bill Greer
Time to Switch over to Digital TV from the old analog system. This has been coming for a long time and its finally here. From the official DTV goverment website, “The switch from analog to digital broadcast television is referred to as the digital TV (DTV) transition. In 1996, the U.S. Congress authorized the distribution of an additional broadcast channel to each broadcast TV station so that they could start a digital broadcast channel while simultaneously continuing their analog broadcast channel. Later, Congress set June 12, 2009 as the final date that full power television stations can broadcast analog signals. As of June 13, 2009, full power television stations will only broadcast digital, over-the-air signals. Your local broadcasters may make the transition before then, and some already have.”
So who is ready for the switch and who isn’t? We made a few maps based on the Neilson report showing who was ready and who will be left behind in analog. Check the maps out below.
Click on the Eye Icon to turn layers on and off.
To download the data or view the meta data visit Finder here!
Popularity: 12% [?]
Dataset of the Day: Stimulus Projects and Unemployment
February 9th, 2009by Emily Sciarillo
Everyone is keeping their eye on what will happen with Obama’s stimulus package. When it does pass, Obama pledges full “transparency,” so that “citizens can see how and where their tax dollars are being spent.” So as citizens, how can we best evaluate the appropriateness and effectiveness of projects that will be candidates for stimulus funding?
To help us, stimuluswatch.org has set up a site dedicated to helping “the new administration keep its pledge to invest stimulus money smartly, and to hold public officials to account for the taxpayer money they spend.” They provide a database of “proposed ‘shovel-ready’ projects” throughout the country which will be candidates for federal grant money as part of the stimulus package. The site offers the capability for citizens to view the proposals and decide if they think they are critical or not.
In order to help viewers better assess the appropriateness of these projects, we uploaded the data to Finder! and then used Maker! to compare where these projects will be and where jobs are most needed.
In the map below, we show the projects by the number of jobs that will be created. The larger circles are where more jobs will be created. We also show the change in unemployment by county between November of 2007 and November of 2008. The blue counties are where there was a decrease in unemployment, the white where there was a fairly small increase, and the yellow and orange areas show larger increases.
Taking a look at the country as a whole, it does seem that many of the projects are proposed in areas that have suffered job losses. This is particularly true for areas of Southern California, Florida and the Rust Belt. Areas in the center of the country, where there have been the some decreases in unemployment have less proposals for job creating projects.
Lets look more closely into an area to examine how the proposed projects are matching up to job losses. Georgia is one area that seems to have experienced a heavy loss in jobs over the past year.
You can see in the map above that there are many clusters of counties whose unemployment rate has increased by more than five percent in Georgia. None of these counties have a project planned in the direct vicinity. The county of Hancock Georgia has had the highest increase in unemployment and the third highest unemployment rate for this November of all the counties in the US. In November of 2007, its unemployment rate was 9.2 and in November of 2008 the rate reached 20.1, a 10.9 percent increase overall. The nearest proposed projects to Hancock are either an hour and a half away in Macon or an hour and forty minutes away in Conyers.
While the governor of Georgia may have good reasons for creating jobs in the proposed areas, it leaves one to wonder what will become of the towns, such as Hancock, who have suffered the greatest in this economic crisis.
Take a look at this map yourself in Maker!. You can zoom in to areas you are interested and decide for yourself the validity of these projects.
On the other hand, it is interesting that Illinois is fairly well represented here. Of the 891 projects in the country, 119 or 13.8% of them are in Illinois. While Illinois does have some yellow and orange counties, it is by no means the hardest hit state in the country in terms of unemployment. Does the state expect some favoritism from the new president?
At a closer look, the 119 projects in Illinois will create significantly fewer jobs then projects in other states. California, which faced the fourth highest unemployment rate in November, is proposing 93 projects which will produce 238,329 jobs.
The chart below provides 16 states with the highest unemployment rates in November along with the number of projects proposed in each state and the total number of jobs and the number of jobs per 1,000 people those projects will create.
States like Michigan and South Carolina, who need jobs the most are proposing projects that will create comparatively few jobs per capita. You can download a CSV of this dataset from Finder! and do your own analysis of the proposed projects.
We can also look at the projects compared to state unemployment rates, as is seen in the map below. The yellow and orange states are the ones shown in the graph above. To see this map click here.
Of course nobody is saying that the unemployment rates should be the only criteria as to where stimulus money should go. But if the package it going to truly address unemployment, projects that will add significant jobs to areas with high unemployment rates should be considered strong candidates for federal funding.
Popularity: 32% [?]
What Could the Obama Administration Mean for the GeoWeb?
November 24th, 2008by Sean Gorman
With the elections over I’ve had a little time to think about what the new administration could mean for the GeoWeb. For those who follow the GeoWanking list serv there has been a raging debate on neogeography versus paleogeography. Some of the rhetoric reminds me of the just finished election and how we strive to create a binary world - blue state/red state or neo/paleo. In the spirit of moving beyond stereotypes and on to solving problems; I thought a closer look at what the potential impact of Obama’s technology platform on the GeoWeb could be. Might be a good diversion from our own self reflection - despite the fact I’ve added plenty of fuel to that fire
You can read Obama’s technology platform overview here. The plank that really grabbed my attention was the promise to “Open Up Government to its Citizens”. The idea that data about government (Congressional voting records) and created by the government (census data) should be easily available to the public. Specifically:
“Making government data available online in universally accessible formats to allow citizens to make use of that data to comment, derive value, and take action in their own communities. Greater access to environmental data, for example, will help citizens learn about pollution in their communities, provide information about local conditions back to government and empower people to protect themselves.”
The beauty is that we (the collective GeoWeb) have so many of these tools already built. The ability to deliver the data once it is made easily available has great promise. For instance here is EPA data on power plant emissions from GeoCommons:
From the map above you can see which power plants are producing the most poisonous CO2 emissions (click the down carrot on the layers box for the filter) or zoom into your specific neighborhood to see the plant and the type of environment around it. (Still refining the embed capability, but an example of how data can be virally spread).
The report goes on to recommend that the federal government should:
“Establishing pilot programs to open up government decision-making and involve the public in the work of agencies, not simply by soliciting opinions, but by tapping into the vast and distributed expertise of the American citizenry to help government make more informed decisions.“
This strikes again at the heart of the GeoWeb - enabling collaboration of experts and citizens across the country. Several projects and companies have pioneered dynamic collaboration around maps. Below is a Google MyMap with feedback around the GeoCommons power plant data in Florida”
The blue push pins are the user generated feedback linking to expert opinion and photos from the field. This is just the tip of the iceberg of what is possible with collaboration around maps. These approaches can also be leveraged inside of government agencies, which is another plank in the Obama technology platform:
“Employing technologies, including blogs, wikis and social networking tools, to modernize internal, cross-agency, and public communication and information sharing to improve government decision making.”
We’ve seen a lot of this type of work going on in the intelligence community with Intelink, Intellipedia, and A-Space. There is also data fusion and sharing concepts, like the EPA’s Central Data Exchange. I’d love to hear other projects that fit in with the three planks, and more importantly existing or planned GeoWeb technologies that could help enable the new vision. I’ve really only highlighted two and I know there are tons more out there.
Popularity: 24% [?]
Andrew’s Talk at Web 2.0 Expo: Trends and Technology in Where 2.0
September 18th, 2008by Bill Greer
Our own Andrew Turner and Mikel Maron presented at Web 2.0 Expo today on trends and technology in Where 2.0.
Cutting Edge Where 2.0 Trends
To kick things off Brady Forrest of O’Reilly and Andrew just published a report on the GeoWeb space, it’s available now.
For those not familiar with the Geo-geek world they started off defining the Geoweb as an interlinked set of people and places around the world that is finally web aligned. These people and places are linked together through open standards that can be searched and indexed online. This gives us a huge trove of information and data from numerous sources.
A new driver of geodata is the trend towards mass adoption of location aware mobile devices. Users are bringing mobile devices into social environments, business, and even global settings. Socialight provides users collaboration capabilities leveraging online and mobile technologies to provide reviews and information on top restaurants and other locations. Large established companies such as TeleAtlas and NAVTEQ are actively expanding into mobile as well. Users can also gather data on their own, with massive success of OpenStreetMap being one prominent example.
The majority web 2.0 services are starting to add geography. Wikipedia, Flickr, even YouTube. This information can now be mined. Check out geocodr which create geotags based on Flickr photos.
One issue that’s coming up with all this open data is metadata and providing source authentication. Can the data be trusted? The ability to crowdsource information for a specific crowd or business is exciting, but having authoritatively knowing the source of where the information is coming from is even more important. Privacy is another pressing issue with open data. Flickr is offering geo-privacy to their photo uploads - this introduces the idea of “casual privacy”. Trusted locations also have a strong impact on how data is perceived by users.
Omnifocus has an iPhone tool that adds geolocation to your “to-do” list. It automatically geo-locates you, so you can discover the closest option to complete the next task on your list. So, if you’re out at CVS and need to go pick up something at a grocery store, Omnifocus can tell you where the closest store is to check that task off your list.
Mapvertising is another interesting concept. Coupons and other location based advertising have to be able to understand what users are searching for in context. For example, searching for a “romantic restaurant” should NOT result in an advertisement for Hooters.
FAIL:
Andrew also discussed advances in traditional GIS. ESRI is one big GIS solution provider that is opening their data via KML, javascript and flash.
Many new users are looking to do more complex analysis than just mapping push pins and would like to map more sophisticated open source and private data. For example, with Maker! you can take a look at how average rent in Manhattan can be thematically mapped to discover price trends.
Burning Man 2008 GeoHacks Technology (The future)
At this point Andrew passed the presentation over the Mikel to provide more of a geo-hacking perspective perspective on the GeoWeb. He got things into gear by discussing what he learned in the Black rock Desert of Nevada. Burning Man is a blank canvas on which to dream and create anything. It’s a single week long social experiment and a petri dish of urban development. It’s almost a laboratory that we can use to begin to examine all the geodata and tools we have. We can look at urban development, how social groups form in cities, etc.
Burning Man Earth had a lot of “geogeekery”. Over 100 GB of data were collected over the week.
Why is this important for Web 2.0 Expo? This is a prime example of Web 2.0 and Where 2.0 and what these technologies can enable. Open platforms, open standards, open data, and collaboration that is easy and cheap.
Amateur Remote Sensing
We took remote sensing data every day. You don’t need expensive gear or a satellite. Small planes are used to get imagery with under $500. A plane is used with continuous shots and a camera hanging out the window with a clamp. The pilot has to manage the camera out the window, but there were no problems finding volunteers. “There are 3 F’s that no pilot will refuse….Food, Fuel, and something else…” Not only did we get aerial pics from planes, but also from kites.
Some great shots were taken as burning man convened. You can see how people created their spaces based on where the ones before them placed their tents.
We then processed the photo using ERMapper, ESRI, Photoshop, and some blood, sweat and tears.
The GeoDjango platform was used to collect even more visual data. If you have geographic items in your models, it can map to nicer views. A camp layout was placed in CAD for even more visualization, which we received in a PDF. To georectify, we used ESRI. We also had to use WMS and tiling (TileCache). These OpenLayers provided vectors from the PDF.
We then wanted to extend this to a social networking platform and get media artifacts from the information. We used “pinax” for networking. This data can be used for future city layout and camp planning tools.
Flickr took these tiles so people could geotag their photos from Burning Man based on the location of their maps.
Some of the other technologies that were used during burning man was Garmin radio for friend location, GPS tracking of vehicles, digipeater (which rebroadcasts to the Internet down the line for free).
Parting words:
“The Internet brings us together, but what if the single link holding us in place breaks?
What if what we learn in the harsh environment of the playa could be reapplied to those in crisis, instead of artistic indulgence?”
Popularity: 23% [?]









