It would be very simple for the Rov , when personally invited, to simply say, “Mazal Tov and much nachas, I don’t know if I will be able to attend, so please forgive me if you see I didn’t make it. Mazal tov and much nachas again.”
Simple menschlichkeit.