The talks regarding the Google Caffeine update placed importance on page load speeds along with relevance. Well, relevance is a main factor in ranking, here is a video to set the record straight: