For me, I went with Saasu, but I'd also looked at Xero and MYOB.
The benefits of the online ones like Saasu is that they can link to your bank and paypal accounts, and then automatically pull transactions across. Once they're in the system, you assign them to an action (invoice payment, phone bill, etc.)
They have invoice templates, reports, and all that other fun stuff built in. I paid an accountant $100 to talk me through setting it up properly for my business, and since then I've managed everything myself with ease.
Saasu cost me around $200/year.
Virtual Box + Microsoft's Windows Images for IE testing.
If you have Coda you don't necessarily need another FTP program since Transmit is built in. Transmit also happens to be my FTP program of choice.
Also find an accounting/billing/project management app. I use Saasu right now for billing/accounting stuff.