@jasonw22 nothing at all wrong with your initial concept, but i do think you’d “…sorely miss the ability to generate signal in the modular…”.
as other posters have commented or alluded to, the fun is often in the immediacy : let’s take that audio rate clock signal and just jam it into that filter cv over there and see what happens… and then let’s send that oscillator output back into itself, as well as into the filter resonance cv, and then use that to mess with the clock dividider, and then mult that, and then take that signal and put it in the … and on and on and on. the immediate, physical act of patching was (and still is) revelatory for me, and is for many others. computers quickly lose their appeal.
sure you can take your cv and midify it for your computer to generate sound with, but you’d be missing out on more than half the fun.
but, the beautiful thing about modular is you can build whatever the krap you want, and explore any ideas you have. start small, play around, trade this for that, change you mind, change it back again … we’ve all been there and are still doing that.
regardless though, once you’ve bought one module you’ll be hooked. it’s unstoppable.