Many of the specialty foods Americans enjoy are almost entirely imported from abroad. The few growers who cultivate these items domestically say it’s a tough business.