Domains & Hosting
My preferred host is GoDaddy. Their prices are competitive and they have excellent customer service by phone (some hosts only provide email support).
Others that I have used are BlueHost and HostGator.
Bluehost affiliate link: www.bluehost.com/track/karenbrand
Email Service Providers
Mailchimp is great for new business owners. They offer a free option for up to 2000 subscribers on your list(s).
Constant Contact has more features, but also is more costly.
Aweber has yet more features, and its price reflects that.