When I worked in the White House in the 1970s and '80s, I was often stopped within the White House by agents checking my credentials. They were very observant and would stop anyone they didn't recognize.