As suggested in this exchange at StartupNation, there are plenty of cheap options out there for startups providing services at little or no cost.

Examples include:
• Vistaprint.com, a source of free business cards
• Craigslist.org and Backpage.com for free online classified
• 37Signals for free business apps
• Daily Dashboard offering business services like accounting etc. for $10 per month
• SCORE for free advising and mentoring (I've consulted with these guys and your success can be a mixed bag depending upon who you get hooked up with)
• FreeConference.com offering free conference call services (Never even heard of this one but I've gotta try it out!)
• Google Website Optimizer with free tools for website testing
• Open Office suite as a free alternative to Microsoft Office

But as Nikole Gipps of NHG consulting also suggests:

The real thing about bootstrapping is knowing what things you should spend on and which you can save on...Save by taking public transportation, eating ramen and working out of your home ... but when you need to brand yourself, have some nice cards and wear a classy outfit.