What exactly are DLL files, and how do they work?

How exactly do DLL files work? There seems to be an awful lot of them, but I don’t know what they are or how they work.

So, what’s the deal with them?