When it comes to spending in business less is more. It forces you to become more efficient than your competitors. And business efficiencies are really where the money is made. Think of some of the great examples of people who took an idea a lot of other people had at the time but made it big because they were able to execute that idea some much more efficiently than their competitors. Think Henry Ford with Ford, Ray Kroc with McDonalds, and Sam Walton with Wal-Mart.
Don't fall into the trap of thinking you're going to spend your way to success. Running out and buying things you think you need to start a business is just a coping mechanism for avoiding the real work of finding customers. Winning customers is the hardest thing to do in business and so from my experience people will avoid it at all costs.
These days the most efficient way to win customers is through the web. Creating a web page and having a great process for catching leads and then prospecting those leads is a good place to start getting customers. You can build a free website at WebStarts.com.