What you are referring to is FPN, Fixed Pattern Noise.
Neat Video takes care of some of it.
Darkframe Averaging also removes some of it.
But in the end you are digging in the noise floor, i have in-house noise profiles that clean up the noise floor perfectly, except for the FPN, because the FPN is “detected” as part of the scene. I believe the FPN could be removed/interpolated in to the image again, with the right algorythm, because in most cases the FPN is a row of pixels being slightly under or overcharged compared to the neighbouring rows. But I am not capable of creating anything like that. I keep hoping Neat Video will add some kind of FPN remover, we will see.
So VFX it is, using Mocha if you really need to get rid of it.
And of course always add noise (Grain) back in to the image to dither the details and in some cases hide the FPN.