There is no way to deactivate an Admin API key without deleting it. Do you trigger the Install/Replace or do they?
My recommendation would be to simply retrigger from OttoFMS instead of adding and deleting an admin api key every time. The key is only used to kick off the deployment, so you could do the following without having to worry about access:
create an admin api key and add it to their ottodeploy
kick off the deployment to your dev server
delete the admin api key
the next time you need to run the deployment, just rerun it from the ottofms console.
Repeat step 4 ad infinitum
If you ever need to change the deployment settings, you could repeat steps 1-3 again.
Thanks Kyle, that’s actually a great idea. I’ve just gotten so used to running the deployments from OttoDeploy, but doing it from /otto/app/deployments is of course even easier.