How to stop a PowerShell script on the first error?

I want my PowerShell script to stop when any of the commands I run fail (like set -e in bash). I’m using both Powershell commands (New-Object System.Net.WebClient) and programs (.\setup.exe).