I'd like to share part of a letter written by a famous Hellenic Pagan orator, Libanius, to the Christian Emperor Theodosius. It was written in the late 4th century AD, and describes--from the Pagan perspective--what happened to the temples of the ancient Gods. A teaser:

"But they say, 'We have only punished those who sacrifice, and thereby transgress the law, which forbids sacrifices.' O Emperor, when they say this they lie. For no one is so audacious, and so ignorant of the proceedings of the courts, as to think himself more powerful than the law. When I say the law, I mean the law against sacrificers.

Can it be thought, that they who are not able to bear the sight of a collector's cloak, should despise the power of your government? This is what they say for themselves. And they have been often alleged to Flavian himself, and never have been confuted, no not yet.

For I appeal to the guardians of this law: Who has known any of those whom you have plundered to have sacrificed upon the altars, so as the law does not permit? What young or old person, what man, what woman? Who of those inhabiting the same country, and not agreeing with the sacrificers in the worship of the gods? Who of their neighbours? For envy and jealousy are common in neighbourhoods.

Whence some would gladly come as an evidence if any such thing had been done: and yet no one has appeared, neither from the one nor from the other: [that is, neither from the country, nor from the neighbourhood.] Nor will there ever appear, for fear of perjury, not to say the punishment of it. Where then is the truth of this charge, when they accuse those men of sacrificing contrary to law?"  
Read the rest of the translation here: Libanius, Oration 30: For the temples (Pro templis) (1830) pp.72-96. I promise, it will be a valuable glimpse into the past.