Though there may be a small fee if you exchange less than a certain amount, your bank or credit union will almost always be the cheapest place to exchange currency. You may be able to order currency at a branch location, by phone, or online to have it delivered to you or to pick up at a branch.