Login with OpenID, similar to Stack Exchange sites?

Basically, I would like to add something like this into my WordPress site
(which obviously will also give the user an option to sign up for an account using WordPress’ default sign up system):

Is there any plugin or tutorial that may be helpful to accomplish this?

Try Make Your Site Social plugin which does most of the job for you