I’ve built two desktop computers myself, had absolutely 0 problem. Most of the “clicky” latency issues have 90% to do with system configuration more than they have anything to do with hardware.
Typically, GPUs can cause this, CPU auto throttling can cause this, Ethernet Cards can do this, etc. there’s a whole lot of things that can do this, but you’ll rarely have clicky / latency problems because you took a RAM that’s less speedy, or one SSD instead of another, or because your motherboard doesn’t have the correct i/o section, etc.
I find this to be the most comprehensive source of information about how to avoid audio dropouts on Windows :
https://www.cantabilesoftware.com/glitchfree/
Edit: One hardware thing that might matter a lot : in realtime audio it’s my understanding that better speed per core in a CPU is usually more critical than having a lot of less powerful cores, which is quite specific to the audio realm. There was a time where getting the best i5 possible was a better option than getting a slightly slower per core i7. You can find quite a lot of informations about that online too, possibly also in the link above, can’t remember if that part is adressed.