Which cryptocurrency wallet to choose

What is a cryptocurrency wallet, and how do you choose which one suits you best?