Changing publish date does not update post order

I have a ton of posts which display in descending order by date on my home page. I wanted to re-order them so I edited the publish date on some of them. However, my order of posts on the home page appears to be the same. Shouldn’t it update the order since I changed the post dates?

Yes it should, are you using a cache plugin like wp-super cache (or another?)