'I joke that I went from selling paper money to toilet paper,' says former banker