Using modulars for about 20 years now, on and off. Definitely better to start with a few modules, you canāt really go wrong with a classic VCO, VCF, VCA, ENV and LFO approach.
Also, if you like reading about modular synthesis, by far the best resources for years now have been Allen Strangeās text, āElectronic Musicā, and the SoundOnSound Synth Secrets series. They both make things much clearer and come with many practical examples.
You can grab the Strange text here with a free Scribd account:
And the SOS series starts here:
https://www.soundonsound.com/techniques/synth-secrets-all-63-parts-sound-on-sound
The Strange text will blow your mind, especially if you like generative stuff, check out his āDream Machineā patch. I used to patch it up with a Wiard NoiseRing through a pitch quantizer and the results were very impressive!
I started with a single module, built up to 22u of Frac ten years later, then ended up getting rid of all of it.
These days Iām perfectly happy with the modular capabilities of my Moog Grandmother.
Just keep at it, itās a subset of analogue computing, itās like learning a new language, but once you get a little proficient and start āthinking in modularā lots of possibilities will open up.