Yes, but you can also optionally add a credit card. Though, looking closer, they say:
Credit cards are a backup payment method only and cannot be used to buy bitcoin directly
An additional fee of 3.1% + $0.18 will be applied to any charges made to your cards.
An additional "cash advance"/ATM fee may be applied by your bank, depending on your agreement with them.