Here is a website that sells single speed conversion kits. Basically there is a spring tensioner chain guide that goes on to your hanger to help keep the chain in line. Then you can take off the chainrings up front to make it look legit without having to buy another crank.
http://www.universalcycles.com/shopping/index.php?category=2621