For nearly 100 years, many members of the New York City Social Set lived in a special oceanfront conclave in Southampton behind high hedgerows, a world apart from the so called riff-raff who lived in the rest of the East End communities. In real estate, these other folks were kept away from their lives…