Again: I was deliberately trying to work with your original one-liner. Yeah spaces in are not so fun.
On topic: I don’t have any spaces in file names, which to me seems like the simplest solution
Off topic: when doing more involved tasks, I quickly switch to python (from bash), I find it much more robust and elegant. For a purpose similar to yours I wrote a python script “a2wav”, which is an elaborate wrapper around sox.