Why use finally in C#?

Whatever is inside finally blocks is executed (almost) always, so what’s the difference between enclosing code into it or leaving it unclosed?