Thursday, December 8, 2011

Launching CalTopo.com

A little bit of history . . .

I decided to build CalTopo.com while standing in the Skeggs Point parking lot above Woodside, CA at 4AM in the summer of 2009.  I'd just been headed to bed when the SAR pager went off for a missing hiker, so I sent a quick email to work letting them know I wouldn't be in the next morning, threw my gear together, and started driving.

We'd run into it before, but this search was particularly bad: our topo software didn't have any of the park trails on it, and the park brochure didn't have any contour lines.  It was almost impossible to translate positions between the two; you could get a GPS reading and place yourself on the topo map, but still have no idea where the nearest fire road was.  Standing in the command post looking at maps under a work light, I thought: there has to be a better way.

It took me a while to figure out exactly what that would be.  Through a lot of trial and error, I wound up creating the map viewer that is at the heart of CalTopo today: a web map viewer with UTM grids, datums, multiple layers blended together, and so on.  However, I still couldn't get anyone interested in using it, because I didn't have any decent maps.

If you had an internet connection you could use Terraserver's USGS scans and MyTopo's map layer, but they both left you felling a little wanting: Terraserver's scan quality was low, and while MyTopo's maps looked great on the screen, they didn't print well.  I don't know whether it was an intentional degredation of their free service or a byproduct of the way they composite base USGS maps with relief shading and updated road/trail data, but their prints came out blurry.

All of that aside, a lot of searches take place in areas with weak or nonexistent internet connections.  Our comms van has a satellite uplink, but stick it in the bottom of a canyon with heavy tree cover and it's useless.  Clearly, if this project were to go anywhere, I needed my own map layers.

Fortunately, California has high-quality topo scans, aerial imagery and elevation data available online at http://atlas.ca.gov/.  I didn't really know what I was doing at first, but with enough perseverence, I managed to learn how to use GDAL to stitch together individual maps into a single layer and then render the results out to 256x256 pixel web-map compatible tiles.  After letting my laptop work overtime for a couple months, I had 12 million tiles covering USGS maps, USFS maps, relief shading and aerial imagery for the entire state.

I then had another problem: volunteers don't work in SAR command posts that often.  It's hard enough to get them trained on off-the-shelf products that you can use at home, like Terrain Navigator Pro; good luck developing a userbase for a SAR-specific product from scratch.  I needed something that people would want to use in their daily lives to get them acquainted with the product.  So I added the ability to draw lines and markers on the map, removed the SAR-specific features like command posts and search assignments, uploaded all my map tiles to Amazon S3 and created CalTopo.com.

So that's the backstory.  The site exists, and I feel like I need to do some marketing for it.  The actual map viewer isn't a very good candidate for the Google SEO game, and I'd like to avoid the keyword-linkfarm approach of loading a bunch of place names into a database and creating dynamic-but-static-looking placeholder pages that eventually just link you to a particular lat/long in the map viewer - go search Google for an obscure place name like "bravel slough merced" for an example.  So - why not a blog?

In addition to communicating new features and updated map coverage for CalTopo, I'll use the blog to write about some of the things I've learned from creating the site and other GIS and mapping related topics.

No comments:

Post a Comment