Lovely place Hartlip. If you want to say the church you will find numerous paths leading to it. The actual Anchorhold is to be found on the left hand side of the building facing you as you approach from the orchards or if you heading from the road interest you will find it at the rear of the building on the right hand side. It is easily recognisable as it has small windows and a little chimney.
If you were looking for some refreshment then why not try the Rose and Crown they do really nice food and an occasionally interesting ale.
If you wished to go for a stroll then there are loads of great walks from the village you might like to take a stroll through Queendown Warren which is not too far away.
If this video has piqued your interest in all things hermit like then here is a reading list.
Solitude and Sociability The World of the Medieval Anchorite by Mari Hughes-Edwards
The Hermits and Anchorites of England by Rotha Mary Clay
Anchorites in Faversham Churchyard by the Kent Archaeology Society from 1877
The Case for an Anchorite by Jeremy Lander
The Life of the Anchoress a rather interesting article by the British library