Home to statesman and local officials for more than a century, with grounds designed by Olmstead’s firm. Oh and yes, it was built in 1820.