I could also do "previous" or "prior" ... yesterday just seemed more specific but I can see how it might be ambiguous in another way.