Corrected entry: When Merry and Pippin run in on the Secret Council, you can see Elrond watch them come past him. However, for a few frames you can see that he keeps looking at where they came from even when they have gone past him. This is probably because they were superimposed on to the film.
Correction: There is no mistake. He is looking there since he thinks that someone else can also show up.