The main downside?
Higher monthly payments.
Because you're paying off the loan as well as the interest, your monthly payments will be higher than an equivalent interest-only mortgage.
For most people, this trade-off is worth it for the security and simplicity that repayment mortgages provide.