However this was not considered an extreme position in the 1800s because, unforutnately, it was the majority position.
The problem you are having is you are defining extreme with reference to what you and the people around you believe to be extreme and fanatical rather than defining it based on what the majority consider extreme and fanatical, and the best evidence we have for the majority view in America is a very recent poll.