To remove a bank account or credit card, access the "Payments" tab of the "Settings" screen and select the "Remove" option. Once you remove a payment account, you will be able to add a new one.
You can have one credit card and one bank account connect at any time. It is not possible to have 2 or more credit cards attached and or to have 2 or more bank accounts attached.