Site speed is now a Google ranking factor (and has been for a while), and a fast site is one that visitors will spend more time on. So it's well worth taking a bit of time to ensure that your site performs well.
In my experience, there's a small number of "gotchas" that cause 95% of slow site issues. Here are the main ones and how you can fix them.
