What’s the fastest way to do a bulk insert into Postgres?

I need to programmatically insert tens of millions of records into a Postgres database. Presently I am executing thousands of insert statements in a single query.

Is there a better way to do this, some bulk insert statement I do not know about?