Stateside imports from Vietnam will be subject to a 20% tariff under the agreement, the president announced Wednesday.