What I am looking for is a pump that will mount to the side of my water bottle cage. Anyone have recommendations on a good pump that mounts this way? None of the online retailers show how the pump is mounted.

Go to Performance bike and take a look at this:

Hurricane Air Scepter Mini Pump

It is a low cost pump that comes with a mount that bolts underneath your bottle carrier and puts it along side the bottle.

It is deceptively flimsy and cheap looking but it works well and develops high pressure because of its longer pump stroke. They routinely sell it at $12.97 on sale.

Not fully recommended for fat touring tires though. That's a lot of pumping you'll need to do for those.

Those are minipumps. When folks use the term "frame pump" they are usually referring to a longer pump that wedges either along the full length of your top tube (usually) or sometimes seat tube. Zefal HpX has a frame pump that has a very devoted following and has for nearly two decades.

For mini pumps, I like the Barbieri. Not sure if that's spelled correctly. If you do a search on Google you'll probably find it easily. It's very light & small & works extremely well for a pump of this type.

http://us.f2.yahoofs.com/bc/401c1d53_4d88/bc/My+Documents/pump.jpg?bf49P5FBt7uglB6S

here's a pic of my topeak micro rocket masterblaster. I love it.