Why can’t I make a vector of references?

When I do this:

std::vector<int> hello;

Everything works great. However, when I make it a vector of references instead:

std::vector<int &> hello;

I get horrible errors like

error C2528: ‘pointer’ : pointer to reference is illegal

I want to put a bunch of references to structs into a vector, so that I don’t have to meddle with pointers. Why is vector throwing a tantrum about this? Is my only option to use a vector of pointers instead?