Continuity mistake: At the end of the episode in church when the group of parishioners moves forward to forgive Ned there is a woman amongst the group who has light green hair. However, when there is a wide angle shot of the group again she is nowhere to be seen.
Homer's Barbershop Quartet - S5-E1
Audio problem: When Homer is playing on the piano, he says the word "fault". When he says this you can hear a key being pressed but Homer doesn't touch any keys.
Homer's Barbershop Quartet - S5-E1
Continuity mistake: At the end of the episode, while the B-sharps are singing on top of Moe's Cavern, the guy climbing the building asks the people to look at him. As he moves his hands, his gloves change color from red to white and back to red.
The Boy Who Knew Too Much - S5-E20
Continuity mistake: When Homer and Bart see each other skipping work/school, Homer is eating a donut then drops it on the pavement when he sees Bart. In the next shot of both of them the donut has disappeared.
Continuity mistake: After Bart's career is dead, he is at his house, and Marge brings out a box of Bart related items. She pulls out a doll and hands it to Bart, as she is handing it to him, the doll's arms disappear, and then reappear when Bart touches it.
Continuity mistake: When Chief Wiggum and Homer think that the convertible Ruth and Marge are in is a ghost car, they want to hold each other. In this shot, you can see 1 small star out of the backseat of the police car. But in the next shot, from the perspective of the backseat, there is a canyon top where the star would be.
Homer's Barbershop Quartet - S5-E1
Audio problem: When grandpa is listening to the radio, he says something like 'oh.', but his lips are not moving.
$pringfield (or How I Learned to Stop Worrying and Love Legalized Gambling) - S5-E10
Continuity mistake: When Homer makes the food with the mix of Tom Collins mix, cloves and a pie crust you can see the labels on the Tom Collins mix and the cloves change between mixing the ingredients and after tasting them. Also the top on the Cloves bottle keeps changing through the scene. When Homer takes the bottle out of the fridge you can see a red top on it. When he sits down the top has disappeared and starts pouring the cloves. When the shot changes the red top is back and it disappears after that. (00:15:20)
Continuity mistake: Near the start when Marge is putting jam on bread, she spreads it on the last piece but as she puts it on the plate it changes to a blob in the middle.
Secrets of a Successful Marriage - S5-E22
Continuity mistake: When Homer comes into the kitchen he is holding a pipe in his left hand. But in the next shot you see him holding up the ruined jacket with his left hand, then in the next shot his hand is back in his pocket.
Continuity mistake: When Homer is in space, when he is about to free the ants, the crisps that he opened earlier have disappeared from the background. This type of mistake happens again when both the crisps and the ants disappear and reappear between shots.
Secrets of a Successful Marriage - S5-E22
Continuity mistake: When Homer wipes the tobacco on his forehead in his new class, the tobacco just disappears on his hand/sleeve.
Continuity mistake: The colour of the alien poster in the nerds' room changes from pink to blue.
Other mistake: When Ned and Homer's raft is going fast, Ned decides to go on the left side of the gorge, so he paddles on the left side, which causes a raft to turn to the right, which 1, means the raft moved to the left, which is impossible, and 2, he wanted to go to the left, but paddled like he wanted the raft to turn right.
Continuity mistake: After Bart and Milhouse drink the all-syrup squishee, the syrup disappears from Bart's face between shots.
Burns' Heir - S5-E18
Continuity mistake: When Smithers finds Burns drowning in the bathtub, he throws the rag. When the rag hits the floor, it magically disappears.
Cape Feare - S5-E2
Continuity mistake: At the beginning of the episode when we see MacBain on TV he goes through a curtain, the curtain stays open for a second even though he isn't touching it.
Homer's Barbershop Quartet - S5-E1
Other mistake: When the Be Sharps are singing at the Statue of Liberty, in some shots the stars in the sky are black.
Homer's Barbershop Quartet - S5-E1
Audio problem: After Jasper has sung on the stage to Homer, Apu and Skinner, they simultaneously say "Next". But if you listen carefully you can't hear Homer's voice.
Burns' Heir - S5-E18
Continuity mistake: When Mr. Burns is sitting in front of the fireplace, he has his normal blue outfit when seen from behind, and a purple night gown when seen from The Front. (00:02:50)
Answer: I'm not sure if this is the one you're thinking of, but an episode of "Ray Bradbury Theatre," called "A Sound of Thunder," dealt with a similar matter: a group of hunters travel back in time to hunt dinosaurs, only to find things have changed when they get back because someone stepped on a butterfly.
Xofer