Your argument doesn't work because moral absolutism does not logically entail freedom of speech. At any rate, I'm not a moral absolutist.

On the main point: you don't think luck of education is at least partly explanatory for diverge of opinions, especially on matters of fact?