We weren't poor growing up on Long Island, but it wasn't lavish - just a regular middle-class house.