Revealing mistake: Near the end of the episode, all the castaways are passed out cold when Lord Beasley finally catches his butterfly. Right after saying the line "That's the trouble with you Americans - you simply don't know how to hold your tea" as he's exiting off camera, Mrs. Howell starts to open her eyes slightly, but then quickly shuts them again. Perhaps she thought the cameras stopped rolling.
Other mistake: On the beginning, the butterfly Beasley calls the Pussycat Swallowtail is yellow. Later it's orange. Also, when Beasley holds the cage with the painted butterfly, you can see the wires making the puppet move.
Answer: Bob Denver answered this when he was on a talk show hosted by Pat Sajak. He said they were going to write into an episode where the castaways found all these clothes, but it got too complicated, so he said, they decided, "who cares, it's only a TV show," and forgot about it. So the writers and actors even asked this, they just never bothered to address it.