There are basically two options. You can spend your time contacting all the various offices at the different levels of government, from the IRS all the way down to the city hall in your jurisdiction. You will then have to research which actual permits are applicable to your business. Many find this to be a daunting and extremely time consuming task.
Your other option is to have all this leg work done for you by applying for a Business License Research Compilation. You will receive the business licenses and permits tailored to your specific business. All applications, instructions, and other pertinent information will be sent to you in electronic format via email. You just fill out your documents, sign them and submit them for official processing, saving you time that you can dedicate to other aspects of your business.