This is the easiest part of podcasting, so don’t fret. There are multiple free and for-pay services to maintain your RSS feed and store your audio files.
You need two things to start distributing your podcast:
1) a maintained and updated RSS feed.
2) web space.
You might use a podcasting service like Libsyn or Podbean, a blogging service like Wordpress, or an audio distributor like Soundcloud. Whatever you use, they will have step-by-step guides for you. NB: the free versions of services like Wordpress and Soundcloud require you to provide the web space to store your audio files.