Carrying a credit card balance can lead to high interest charges and costly late fees.