The installation process gave indeed the necessary permissions to the account.
My SysAdmin just asked me out of curiosity why the account needed such a high-level permission and I couldn't find an ESRI documentation which explains it.
I'm guessing the account needs to be able to delete files regardless of file permissions, but I'm not sure.