How Do Interest Rates Work?

How do interest rates work and why is it so important for everyone to have a basic understanding of this cost for borrowing money?