I agree- a little dirt never killed anyone. That said, you don't want the place to look gross... soap and water is probably fine, but I really like method's products (www.methodhome.com - I think) for everywhere in the house. Check the labels, but any I've used have been non-toxic, and they have cleaning sprays, wipes, wood cleaner, flushable bathroom wipes... and it smells good, too! No, I don't work for them...
I get them at Shoppers Drug Mart (in Canada), but I think if you're in the US you can find their stuff at Target... or so I've heard.
PS- Baby wipes may be the handiest things ever invented. :D