The problem is that it is a rape trial.  Some are concerned that details of rape are not appropriate for woman and children to hear.  The trial does get fairly graphic, at least as far as the South in the 30s is concerned.  Judge Taylor suggests that everyone knew full well that details of rape are of course going to be discussed at a rape trial.  If there are children at the trial, their parents certainly know that they are there and know what they will hear.  The rape is the talk of the two anyway, so it is being discussed in much less dignified terms everywhere, from the streets to the playgrounds.  He does not order the women and children out of court.