The Arrest of the Fun Girls - S5-E28
Other mistake: When Andy, Helen, and Thelma Lou are parked in front of the courthouse the lights turn on, and in the closeups from outside both sides of the car, note that both triangular vent windows are missing - the two doors are actually open for these closeups. This happens again later, when Andy and Barney are each apologizing individually to Helen and Thelma Lou.
Answer: Those "boxes" are valences that used to be very common, before air conditioning. They allow for windows to be open during rain storms. They permit air circulation, without letting the rain in.