hi there Amanda, wow, that's a messed up situation.....
for azure specifically, if u still have any access at all (even just developer level), u can try to reclaim admin rights. go to azure active directory roles and administrators in the portal. look for 'global administrator' role assignments. if u see that contractor there, u might be able to remove them if u have privilege management rights.
since he took the keys, u need to rotate ALL of them immediately. check azure key vault first, regenerate every single key, secret and certificate. yes, it's a pain, but better safe than sorry.
pls check if multi factor authentication was bypassed. turn it on for all admin accounts if it's off. this might help in other tools too.
would u like an general advice? if u use any other cloud services, do the same thing there. rotate keys, check admin lists, enable mfa everywhere. worth looking into setting up privileged identity management for the future so this doesn't happen again.
aha, and about azure support, since u have developer level, u can open a ticket in the portal. they might help escalate this. use the word 'security breach' in the ticket, it sometimes gets faster attention ;D
good luck! hope u kick that contractor out soon :))
Best regards,
Alex
and "yes" if you would follow me at Q&A - personaly thx.
P.S. If my answer help to you, please Accept my answer
PPS That is my Answer and not a Comment