Social Priming, Failed Replications, and Egos

The Chronicle of Higher Education has a good article on social priming—the effects on our behavior from subtle cues in our social environment. It reviews some of the key studies such as the famous elderly prime makes people walk more slowly finding. There is an appropriately strong focus on John Bargh, whose studies made the effect well known, as well as some of the individuals who have had trouble replicating his results. As it remains today, there is serious doubt about whether the effect is very robust. Instead, there might be some moderators that enhance or weaken the effect that are unknown. If there is anything good coming out of this, it may be that we start begin respecting the publication of failed replications. That will be good for the entire discipline.

Link to the article at the Chronicle.

Image courtesy Flickr user sunnydelishgirl. Licensed under Creative Commons

David Brooks on using psychological research for public policy

Today’s NY Times has an op-ed by David Brooks that points out that much of public policy is derived from “common sense” or “folk psychology” that has no scientific basis. Instead, he argues for public policy created by using research findings to enact behavioral changes in the population. I agree. There are some interesting comments to the article as well, but many of them amount to “David Brooks is on his agenda” and do not offer much of a criticism that is useful to the discussion.

Link to the article at the NY Times.

SPSP comments on the final Levelt report on the Deiderik Stapel debacle

The Society for Personality and Social Psychology just released a statement on the Levelt report. It is not (yet) on their web site, so I will reproduce it here. It arrived on the SPSP listserv. I am glad we are undertaking an assessment of where we have gone wrong and how our research practices can be improved to help avoid something like this in the future.

Society for Personality and Social Psychology Statement on the Levelt Report

The recent Levelt report from the Netherlands details the breadth of Deiderik Stapel’s fraudulent activities and offers reflections on the scientific culture that enabled this magnitude of deception to go (nearly) undiscovered for many years. It is a sobering read. Both the European Association of Social Psychology and the Society of Experimental Social Psychology have issued statements on the report. These statements expressed appreciation to the Levelt committee for its thorough investigation of the Stapel case and indicated reservations about the report’s indictment of the field at large for what the Levelt report considered “sloppy science” practices. In large measure, we support these previous statements, and our statement is meant to complement rather than reiterate the points made by our allied societies.

In the aftermath of the Stapel case and other recently discovered cases of fraud, it would behoove us to reflect on the steps we can take as we move forward to protect our science against incidents of fraud in the future and to repair the image of our science. The core foundation of any field of scientific endeavor is trust and integrity.

The Society for Personality and Social Psychology has consistently maintained the stance that we must work together as a professional organization and as individual scientists to promote a context in which good scientific practices are celebrated and are embedded into the training we provide to young scientists joining the field. Indeed, this was the theme of a recent letter I wrote to the Society regarding the Stapel case. It is a theme that merits repeating. These recent events provide an opportunity not only for constructive reflection but also specific action. Upholding sound scientific practices will insure that our science has integrity. We should not assume, however, that because we all believe in the principles of ethical conduct that this is sufficient. In this regard, we can all profitably discuss ways to accomplish these goals. These goals should include, but not be limited to:

  • Identifying effective ways to build discussion of ethics and good scientific practices into our course work and everyday discussions in our laboratories;
  • Developing safe venues for trainees and others to report concerns about breaches of ethics within universities and within the journal review process;
  • Establishing clear standards for what personality and social psychology papers should present in methods and results sections of articles;
  • Providing formal training in how to review articles;
  • Clarifying within our formal training acceptable practices for addressing, for example, missing data, eliminating cases from analysis, and providing clear detail on methods and measures;
  • Increasing opportunities and incentives for conducting and reporting direct replications of important findings; and
  • Evaluating the pressures that can lead to a careerist focus as opposed to a focus on true discovery among scientists.

These are but a few of the issues we, and all sciences, need to consider. Recent months have borne witness to a number of activities designed to address these issues. For example: replication issues have been the subject of a recent special issue of Perspectives on Psychological Science (http://pps.sagepub.com/content/7/6.toc), a forthcoming special target article in the European Journal of Personality, and recent issues of our own Dialogue (see http://tinyurl.com/auzkr73). Brian Nosek and Daniel Lakens are co‐editing a special issue on replication of important findings in social psychological research in Social Psychology (see http://tinyurl.com/asujp7s). Finally, SPSP commissioned a Task Force for Responsible Conduct, which outlined a variety of ways we could take positive steps to ensure the integrity of our science (https://www.spsp.org/?ResponsibleConduct) and the Task Force continues to work on these issues.

Our upcoming meeting in New Orleans provides a number of immediate opportunities to explore and discuss these issues with our community. Two formal symposia address issues related to good scientific practices.

The first is titled “Openness in Scientific Reporting: Potential and Reaction” and is scheduled for Friday, January 18 from 11:15 am to 12:30 pm (Rooms R03‐R05).

The second symposium is titled “False Positive Findings: Effect Sizes Too Large, Too Small, or Just Right” and is scheduled for Friday, January 18 from 3:30 pm to 4:45 pm (Rooms R03‐R05).

Finally, I suggested to you in a recent letter that the leadership of SPSP was likely to hold a Special session for the membership to come together to discuss these issues or any issues of interest to the membership. We have scheduled this session for Saturday, January 19 from 3:30 pm to 4:45 pm Room 203‐205. In attendance will be David Funder who is the 2013 President of the Society, Jenny Crocker who chaired the SPSP Task Force on Responsible Conduct, Jack Dovidio the current Executive Officer for the Society, Jamie Pennebaker the new President‐Elect of the Society, and me. We invite you to come to this session with questions and we will do our best to address these and other issues relevant to the Society and engage the membership in a productive discussion.

Yours Sincerely,

Patricia G. Devine for the SPSP Executive Committee

Past-­‐President, Society for Personality and Social Psychology

The NY Times on the Stapel debacle

The New York Times has a short piece on the Deiderik Stapel academic fraud incident I wrote about earlier. There are now “several dozen” papers involved. The investigating committee, for reasons unfathomable to me, has not released a list of  the papers. To me “several” implies more than 4, and less than 12. So there are somewhere around 50-100 papers possibly involved. That is huge, and for now I think we will simply have to avoid citing any of his work.

Link to the NY Times article.

Milgram replication on Discovery Sunday night

This week in class, we discussed Stanley Milgram’s obedience to authority experiments and saw the original film, Obedience, that he produced. Sunday night at 9pm EST on Discovery, there will be a show on people’s capacity for evil, which will have a Milgram experiment replication. The Advances in the History of Psychology blog mentioned it and gives details here.

Evidence-based tips for studying

Just in time for our third exam, the Wall Street Journal summarizes some research on studying for best test performance. here are some of the tips:

  • testing yourself repeatedly before an exam teaches the brain to retrieve and apply knowledge from memory
  • Review the toughest material right before going to bed the night before the test
  • A common study habit—the all-nighter—is a bad idea
  • High-carb, high-fiber, slow-digesting foods like oatmeal are best for breakfast the day of the test
  • Information reviewed amid distractions is less likely to be recalled later

Regarding anxiety about the exam:

  • One calming tactic that has been shown to improve scores is to teach yourself in advance to think differently about the test—using visualization techniques
  • reducing “novelty and stress on the day of the exam” can prevent choking under pressure
  • If you are still feeling anxious, set aside 10 minutes beforehand to write down your worries

See the full article here.

Memory and eyewitness testimony

In class Thursday, we discussed memory and social judgment, which led to a discussion of eyewitness testimony in court trials. The blog LiveScience covers some issues around reliability of memory, particularly in the context of eyewitness testimony. Have a look at it here.

Last night’s execution of convicted murderer Troy Davis reportedly sent those convinced of Davis’ innocence into hysterics. One of their concerns — that eyewitness testimony in the case had been recanted — also concerns cognitive scientists.

“This is not the first time a person is pretty much convicted based on eyewitness testimony and circumstantial evidence,” said Jason Chan, assistant professor of psychology at Iowa State University, adding that the number of eyewitnesses who later recanted their testimony was “relatively unusual.”

Familiarity: Liking or contempt?

PsyBlog covers a good exchange between two research teams about whether familiarity with others induces us to like them more or to dislike them. The literature generally supports the liking side of the debate, and when teaching it, that’s what professors generally emphasize. But this exchange points out how science works: we challenge the status quo and sometimes find surprising results (and suffer the slings and arrows of the establishment). If the results can be replicated and extended, then we learn a whole lot more about behavior.

The Psychologist on Milgram

The ever-excellent blog Mind Hacks pointed me toward a special open-access edition of the British Psychological Society’s magazine The Psychologist which covers Stanley Milgram, including articles by psychologists, a historian, and even Milgram’s widow.

Very much worth checking out.

There’s 5 articles in total:

The shock of the old—Stephen D. Reicher and S. Alexander Haslam introduce a special feature which reconnects with Milgram’s vision for social psychology

The man, his passions and motivations—Stanley Milgram’s widow, Alexandra Milgram, with her personal take on his life

Alive and well after all these years—Jerry M. Burger updates the enduring legacy of the Milgram Obedience Studies

The window in the laboratory—Film scholar Kathryn Millard looks at Stanley Milgram as filmmaker

Milgram and the historians—Richard Overy, Professor of History at the University of Exeter, in conversation with Stephen Reicher and Alex Haslam