I had the same noise with mine when I used it standalone. (similar to you, I didn’t notice it initially)
as soon, as I put it in my Eurorack, the noise disappeared - so definitely its the PSU.
have you tried using a USB battery pack and something like a Ripcord or the Koma Strom Mobile?
If I remove my KFK from the Eurorack, this is probably what I’ll do, not only should it get rid of the noise - but also will make it a nice portable solution.