Should I have holes cut slightly larger than needed to ensure fitment?

Usually, when you order the part, you can download the specs on which cutout in panel are specified.
Follow this and it will be ok
(I did sometime took additionnal tolerance but it was sligthly loose. It is better to sand a bit to remove material than the opposite)