Revealing mistake: In the scene where Warden Norton is loading his pistol, as he dumps out the bullets and loads them the primers are dimpled. Unfired bullets would not have the dimples from the gun's hammer (even if they were home made reloads, the primer would have been replaced).
Revealing mistake: When Tommy crumples up the test paper he had written for Andy and throws it into a waste basket the metal container shakes as if he had thrown something heavy. (Telling from the noise it makes the item must have been heavy.) (01:23:30)
Revealing mistake: When Brooks is carving his name, "dust" seemingly like plaster dust vs wood dust is shown falling on the table top, his shoes etc. When they cut to the view of Brooks looking at his work and closing his knife, there is no "dust" on his hand or knife. That much carving with that much dust falling on the table would have left his knife covered with dust. It was clean.
Chosen answer: In a nutshell, tax evasion. He's running the prison like a company doing building work with, as its described by the builder in the movie, a pool of slave labour to allow him undercut other contractors. He is skimming profit for his own pockets, along with taking bribes, etc. that Andy's creative book keeping is hiding from the IRS.