I don't think it was bad. I've listened to a lot of podcasts over the years that have been much harder to understand. On a scale of Asymco to 99% Invisible, I'd put the audio quality somewhere around "like listening to a phone call" which, for many people, is just fine.
There's no doubt in my mind that you could fix it up in less than an hour and put out something of much greater audio fidelity and quality. However, looking at how things on micro.blog are generally done, the effort would likely go unnoticed by many …You forgot to say how bad it really was.