Paul Ryan has been part of the Never-Trump group.