I think you underestimate what some of the Founding Fathers were into.
A lot of them were real estate speculators, or worse. They were voting their own interests in a lot of cases.
Ed Asner wrote a pretty good book on it. "The Curmudgeonly Historian".