Consider refinancing when interest rates are significantly lower than your current rate, you want to switch from an ARM to a fixed-rate, you want to shorten your loan term, or you need to access home equity through a cash-out refinance.