Yep, the pci/e and the controller of it, are the things to keep an eye on.
Don't touch them, or keep them happy, and u'll be fine.
Most pci clocks allow u to set them without movement these days, don't they ?
Ofc, fudging ur memory will effect everything