They don't need the very obsolete technology, obsolete business processes and obsolete management mentality of most existing banks. Much better to start with a greenfield site and acquire customers from there.
Many people would drop their existing bank in a heartbeat if there were a viable modern alternative. Apple is in a perfect position to capitalize on this widespread dissatisfaction.