new england b& b or small hotel suggestions please

for my first anniv.  i want a weekend in new england.  we have so many family committments surrounding our anniv that all we have is a weekend and we decided to go in driving dist.  we live in westchester county about 30 min north of ny city.  we were thinking about driving some where with in 4 hours (max) or less of our home and trying to find a romantic b and b or small hotel.  I have to admit ai am a bit spoiled because I do like to stay in nice hotels when i travel.  searching the internet is fine but I much perfer the personal recomendation.  thanks.   ps we both play golf too so a golf course near is nice but by all means not mandatory as this is a romantic weekend!