What does character set and collation mean exactly?

I can read the MySQL documentation and it’s pretty clear. But, how does one decide which character set to use? On what data does collation have an effect?

I’m asking for an explanation of the two and how to choose them.