Continuity mistake: The location of the comet in the sky changes direction at several points. Whilst it's apparent size and altitude will of course change, the direction it is coming from cannot. As an example, it is seen looming over the power plant towers, but when Ned is on the hill, it's no longer there.
Continuity mistake: When Mr. Burns pushes the child on the swings, he somehow manages to defy the laws of physics. When he pushes the child forward for the last time, he swings forward, then back, hitting Mr. Burns in the head. He then swings forward again, hitting Mr. Burns from behind. Mr Burns starts saying "You've won this round..." and the child then hits Mr. Burns from behind again. In order for this to happen, he would have to go completely around between the second and third hits and you clearly see he doesn't.
Lisa on Ice - S6-E8
Factual error: The clock in a hockey game does not run during a penalty shot.
Springfield Connection - S6-E23
Continuity mistake: When Marge is in the supermarket, she only has about 4 items in the trolley. But just before the trolley crashes into the cheese model, it is full.
Continuity mistake: When everybody is chanting 'Film Festival', you can see that Mayor Quimby has his arm up. But in the next shot, which changes so that you can see Marge, he his holding up his other arm.
Lisa's Rival - S6-E2
Continuity mistake: When Nelson does his "Grapes of Wrath" demonstration, it splatters all over Skinner's jacket. When he walks over to the rest of the dioramas his jacket is clean again.
Homer Badman - S6-E9
Continuity mistake: When Homer mixes the Pop Rox with the soda he leaves the Pop Rox packaging over the can. After he throws the can and we see it in the air the Pop Rox packaging has disappeared.
Lisa on Ice - S6-E8
Other mistake: As Homer is signing Bart's academic alert form just before Marge starts talking to Lisa you can read the writing below the "Academic Alert" title, but the writing is completely incoherent including sentences such as "IMAEGTSIAD TSNHOJI NAMREB". Update; some of the "words" or parts of them are people's names, such as David, Stuart and Allison, but backwards. (00:03:50)
Continuity mistake: When Milhouse is spying with his binoculars with an camouflage outfit on, the colours of some patches change in some other shots. E.g The bottom left corner (from behind) changes from dark green to light green.
Revealing mistake: When Lisa and Hugh go by Taxi to the Simpsons house, you can see that they pass the same buildings all the time, especially "Coffee shop".
Springfield Connection - S6-E23
Continuity mistake: Before Marge sees Homer parking violation, if you look at where he is parked over the first handicapped spot there is a car parked in the first non-handicapped spot. A bit before Marge arrests him there is now a non-handicapped spot between the car and Homer's car. (00:14:35 - 00:15:05)
Homer Badman - S6-E9
Continuity mistake: After Marge's left pocket rips in the candy convention, she goes to start picking up the candy when we see that the right pocket has ripped all of a sudden. When Homer and Marge start running away the pockets are no longer ripped and full of candy again.
Springfield Connection - S6-E23
Continuity mistake: When Marge is shopping, there is a blue baby seat in her trolley. In a following shot of her running with the trolley and it going into the cheese display, the seat has gone.
Continuity mistake: When Bart is talking to Jessica after she stole the collection plate money, she is far away from Bart. But when Bart says "but you're not very nice", she is right next to him.
Two Dozen and One Greyhounds - S6-E20
Continuity mistake: When they are in Mr Burns' laundry room, it is shown that Bart wasn't wearing his socks. However, part way through this scene, Bart is wearing his shoes and socks again without having time to put them on.
Homer vs. Patty and Selma - S6-E17
Continuity mistake: At the beginning of the episode, there is a drunk wearing glasses. He disappears in the next shot onwards.
Tree House of Horror V - S6-E6
Other mistake: At the end, just before the Simpsons are turned inside-out, Bart is not only wearing his red shirt in bed, but sitting in a position that's not even possible in any position he was sleeping in. (00:20:35)
Who Shot Mr. Burns? (1) - S6-E25
Continuity mistake: When Smithers and Mr Burns are eating the chocolate and see the photo, you can see that Marge's necklace changes from red to white and then back to red.
Lisa on Ice - S6-E8
Continuity mistake: The turtle that Homer hands to Bart disappears as soon as it goes into Barts' hand, and it is never seen again.
Continuity mistake: When the plane takes off without them, you see that the Simpsons are only carrying 2 bags and 2 suitcases. But when it cuts to them un-packing in the house, there are 5 suitcases.
Answer: I'm not sure if this is the one you're thinking of, but an episode of "Ray Bradbury Theatre," called "A Sound of Thunder," dealt with a similar matter: a group of hunters travel back in time to hunt dinosaurs, only to find things have changed when they get back because someone stepped on a butterfly.
Xofer