I agree they would withhold comment but we do not know that this is in situations that they would otherwise be willing to speak.
If the people who prefer not to know treated others as they wished to be treated, we can say with confidence that they will sometimes not speak their mind, however, we do not know that they actually would have spoken up if they were not following the golden rule.