Trusting scientists, questioning facts, and design

Trust me. I'm a scientist. Ars Technica recently reported on a survey carried out jointly by Scientific American and Nature abou...

Mad Scientist
Trust me. I'm a scientist.
Ars Technica recently reported on a survey carried out jointly by Scientific American and Nature about the level of public trust in scientists and their opinions.  The results indicate clearly that people trust scientists.  Unfortunately, I'm not sure we can trust these results.

Don't get me wrong.  I am definitely a member of the species Homo Scientificus1 - I know that science works, and that there are no known alternatives that can outperform science as a means of understanding reality.  But there's a problem with this survey that undermines the argument it makes.

Participants in the survey would have found out about it through one of the two publications that ran it.  It is fair to assume that most readers of Scientific American and Nature have an interest in science, and they are most likely to understand enough of it to see its virtue as a source of knowledge about reality.

This means that the sample used in the survey was biased.  Think of it this way: if the same survey were carried out via, say, the Online Christian Magazine, or the Christian Coalition, then I think the results would have been quite different.

It does not appear that this bias was seen as significant by its developers, who admit that the strong support for scientists shown by the results were not unexpected.  But that means you can't just generalize the results to some sound-bite like "people trust scientists."  That's not how Scientific American reported it, but that's how secondary sources, like Ars Technica, seemed to slant things.

Here's the argument a Luddite might use:
  • the survey says people trust scientists;
  • but the survey would have obviously sampled only those who read scientific publications;
  • this indicates those who took the survey are predisposed to support science and scientists generally;
  • since the sample is biased, the results cannot be trusted;
  • therefore the survey actually proves the opposite of what it claims; and
  • therefore the scientists who ran it cannot be trusted.
The Luddite is also probably sufficiently ignorant to not check the original source, and so would feel entirely justified in this ridiculous conclusion.

What does this have to do with design?  One of the fundamental principles of any good designing practise is to understand one's users.  In this case, while the direct users of the survey would be the community of those who already think well of scientists; there is also another, much larger, indirect user community - those who would hear about the survey through some intermediary source.  To those of us able to think in a designerly way, it would likely not have been a challenge to predict this unfortunate side-effect of the survey.  This means asking lots of (possibly uncomfortable) questions.

What's the point of conducting the survey?  Who's going to read about the results?  How can the results be misinterpreted?  How can misinterpretation be avoided?  How does one mitigate the undesirable effects of misinterpretation?  These are just a few of the possible questions that could be asked from a designerly point of view.

With that foreknowledge, perhaps the survey could have been run differently, or its results be written up more carefully.

This same kind of thing happened to me years ago.  One of my academic mentors showed me some pin buttons he'd had made to promote research activities among potential industry funders.  The buttons read: "Research makes cents."  He grinned, thinking he'd come up with something quite clever.  I said: "Right. Research makes only cents.  Not dollars; just cents."  He tossed the buttons.

I liked the buttons, but I was also able to put myself in the shoes of someone else, someone who doesn't "get it."  My mentor couldn't do that.  A good designer should have that talent.  (I should note, though, that having that talent doesn't necessarily make one a good designer.)

On a related matter, I note a correlation between the SciAm/Nature survey and another recent post of mine, in which I try to clarify the difference between science, the sciences, and scientists.  In this case, I would emphasize that whether we trust a given scientist does not bear on whether we trust scientists in general, nor does it bear on whether we trust science or the sciences.  Scientists will occasionally make mistakes, but in the long term, science still works.


1. Note to the gullible: there's no such thing as Homo Scientificus, wish though I might that there were.

COMMENTS

Name

academia activism adaptation admin aesthetics affect ageing AI analogy android anthropology anticipation app architecture art arts Asia assistive technology automobile balance biology biomimetics book branding building business CAD Canada care case cfp change revision children codesign cognition collaboration colonization commercialization commonplacing communication design competition complexity computation computer science computing concept map conference constructivism conversational analysis craft creative arts creativity CSCW culture cybernetics degrowth dementia design design thinking digital digital media digital reproduction digital scholarship disability dissertation drawing economics education effectiveness efficiency emotion engineering environment ergonomics ethics ethnography Evernote evolution exhibition exoskeleton experience experimental studies fail fashion featured film food function modeling futurism gender studies Germany globalization grantsmanship graphic design Greece HCI health heritage history housing human factors humanism identity image inclusivity industrial design informatics information innovation interaction interdisciplinarity interior design internet of things intervention iphone journal journalism language law library life life cycle lifehack literature review logistics luxury making management manufacturing material culture materials mechanics media method migration mobile motion design movie new product development Nexus 6 olfaction online organization packaging paper participatory design PBL pengate performance PhD philosophy planning policy politics practice predatory preservation prison proceedings productivity project management public space publishing reading Remember The Milk reproduction research resource-limited design reuse review Samsung scholarship science science fiction semiotics senses service design simplicity society sociology software space strategic design student sustainability systems tactile tangibility technology textile theatre theory Toodledo Toronto tourism traffic transhumanism transnationalism transportation tv uncertainty universal design urban usa usability user experience visualization wearable well-being women workshop writing
false
ltr
item
The Trouble with Normal...: Trusting scientists, questioning facts, and design
Trusting scientists, questioning facts, and design
http://filsalustri.files.wordpress.com/2010/10/madscientist.jpeg?w=150
The Trouble with Normal...
http://filsalustri.blogspot.com/2010/10/trusting-scientists-questioning-facts.html
http://filsalustri.blogspot.com/
http://filsalustri.blogspot.com/
http://filsalustri.blogspot.com/2010/10/trusting-scientists-questioning-facts.html
true
389378225362699292
UTF-8
Not found any posts VIEW ALL Readmore Reply Cancel reply Delete By Home PAGES POSTS View All RECOMMENDED FOR YOU LABEL ARCHIVE SEARCH ALL POSTS Not found any post match with your request Back Home Sunday Monday Tuesday Wednesday Thursday Friday Saturday Sun Mon Tue Wed Thu Fri Sat January February March April May June July August September October November December Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec just now 1 minute ago $$1$$ minutes ago 1 hour ago $$1$$ hours ago Yesterday $$1$$ days ago $$1$$ weeks ago more than 5 weeks ago Followers Follow THIS CONTENT IS PREMIUM Please share to unlock Copy All Code Select All Code All codes were copied to your clipboard Can not copy the codes / texts, please press [CTRL]+[C] (or CMD+C with Mac) to copy