The Relaxation Integration - S11-E3
Character mistake: When Sheldon is telling Leonard, Amy and Penny about how his voice is like a white James Earl Jones, he quotes the famous Darth Vader line "Luke, I am your father." This is an example of the Mandela Effect, that apparently even Sheldon Cooper is susceptible to. Darth Vader actually says "No. I am your father."
Answer: Because Raj's selective mutism seems to be caused by women that Raj sees (on some sort of conscious or subconscious level) as a potential sexual partner. An attribute that wouldn't apply to either his sister or mother.