The principle of least privilege: what is it and why is it needed?

What’s the principle of least privilege, why’s it needed, and how does it help secure corporate information assets?