There is a difference between teaching what someone said and teaching that someone was correct in what they said. Newt Gingrich doesn't seem to know this difference (or he might just not care). Watch the video, then read my further comments.
The first example Newt gives is that the Declaration of Independence says, "We hold these truths to be self-evident, that all men are created equal, that they are endowed by their Creator with certain unalienable Rights..." He then asks if children should learn what the founding fathers meant. And my answer to that is "Of course!" But does that mean teaching them that the founding fathers were correct in that statement? No! And, actually, the founding fathers were wrong with that statement. Rights are not unalienable; this should be quite clear with the fact that the U.S. Constitution has a Bill of Rights. Why would you need a bill of rights if rights are unalienable?
The second example Newt gives is perhaps even more absurd then the first. Again, it's a case of failing to distinguish teaching that person X had religious beliefs, which is acceptable to teach, versus person X was correct in their religious beliefs, which is not acceptable to teach.
And then the clown show came to town. The questioner originally pointed out that Newt had said he was against the State impossing religion. But what does Newt do? He demonstrates that he wants State impossing religion. Well, he wants children to be able to "approach God in any way [they] want to." For those who are unfamiliar with this, this is how many politicians attempt to weasel out of claims that they are impossing a religion, because they are not specifying which one. Even though when they say "god" they really mean "God" (as in the Christian diety), they can then say that they were actually using that former blanket term. Though, implying that children should even be "approaching" any god should be enough. What if you don't believe in their imaginary friend?
Continuing the clown show, Newt states that there is "an enormous difference between a culture which believes it is purly secular and a culture that believes it is somehow empowered by our creator." He has a point. There is an enormous difference between the likes of Norway or Japan (cultures that are nearly "purly" secular) and Pakistahn, Iran, Saudia Arabia (cultures that they are empowered by their creator)! Oh, was I not supposed to point that out???
Otherwise, Cenk says just about everything else needed to be said on this.