So after more digging, I found the issue, the links we had created on a Centertab, where still pointed to prod, once I updated those, the links worked.