Having started modular with a synthvoice coming from a semi modular standalone box setup myself, I think the synthvoice alone provides a ton of options for that kind of Lorre mill / ciat Lonbarde hands on approach to patching and performing. There’s a lot there to get to grips with as a system.
Down the line as I expanded - I actually got rid of my ddsr after I realised it was frustrating me to have something so difficult to repeat perform as a main control interface. It’s also a pricey component to the system. If you still have a double knot you can use it with the bugs in a very similar way.
My vote would go towards a couple of dividers and logic, a LPG for the third oscillator and then see how you go with more things coming out in the future (blue pt delay, s+h, other fx etc). Dividers provide nice rhythmic playability especially when paired with logic and utilising the reset inputs, division B clock source switches etc. Also great for harmonic layering into the wavefolder side of the dual amplifier. LPG is a completely different texture to the dual filter and amplifier modules, more gritty.
I also didn’t get on with a red/blue combo system. The pt delay is actually great in there because it’s so playable and sounds ace, but the drm2 was too complex and demanding to be tweaked itself that I found it impossible to focus on a blue modular patch and interesting drm2 activity at the same time. I also didn’t like that the reds took up so much real estate in my modular frame.
Just my two cents obviously. I like keeping blues with blues and reds elsewhere. Also everyone else loves the ddsr so I’m a bit weird there!