Whitstable Castle has some lovely gardens that are certainly worth a look.