This feels like something that could be done by running OT midi out to CV to a matrix mixer / other CV tools and back into the OT. I know that sounds a little intensive, but if you’re that invested in the idea of this functionality, it is almost certainly doable, and imo anything that would be game-changing for your process is worth the additional time and effort to bring together, provided it excites you to do it.
Most modular-inclusive workflows I’ve seen that feel ‘successful’ in terms of rendering something resembling the kind of music that moves through the wider world involve this kind of hybridization (either sampling the modular, controlling it externally, or using it for control signals impacting sounds sourced elsewhere). Of course, I am still resistant to that leap, myself.
A good way to test this idea for cheap would be to run midi out from OT to your computer and back in to OT, using some CV-esque tools and plugins (Ableton and VCV, which is free, can both do this).