Who's the Dumb One Here?

I said to my neighbor, "You'd better let your shutters down, because yesterday I saw you making love with your wife." "Haha, you idiot," he replied. "I wasn't even home yesterday."