The Black Goat

Don't Say Integrity

What is the connection between methodology and ethics? In the early days of the twenty-teens, some people referred to the changes afoot in psychology as a "scientific integrity movement," but that term quickly faded. In this episode, we explore the connections between scientific rigor and scientific ethics. What are the ethical dimensions of good methods? When do we have an ethical obligation to make sure that our studies can answer our questions? Are there ethical obligations that go beyond considerations around protecting human subjects? Why do we sometimes shy away from connecting science reform with ethical behavior? Plus: We answer a letter about data parasites.

Links:

• Science and ethics in conducting, analyzing, and reporting psychological research, by Robert Rosenthal
• nothing beats something, by Simine Vazire
• Making data sharing count: a publication-based solution, by Krzysztof J. Gorgolewski, Daniel S. Margulies, and Michael P. Milham
• Practical tips for ethical data sharing, by Michelle Meyer

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes or Stitcher.

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 56. It was recorded on April 12, 2019.

Oh, Behave!

Psychology calls itself a behavioral science, but how often do we measure actual behavior? In this episode we discuss what is involved in measuring realistic, meaningful behavior in psychology research - not just self-reports and response times. What counts as "behavior" anyway? Why does it seem like psychologists measure less behavior than they used to? What are the scientific, professional, or logistical reasons why researchers decide not to measure behavior? Our discussion is anchored around an article by Roy Baumeister, Kathleen Vohs, and David Funder with the delightful title "Psychology as the Science of Self-Reports and Finger Movements: Whatever Happened to Actual Behavior?" (linked below). Plus: We answer a letter about whether or how to try to get a retention offer as you are advancing in your career.

Links:

• Psychology as the Science of Self-Reports and Finger Movements: Whatever Happened to Actual Behavior? by Roy Baumeister, Kathleen Vohs, and David Funder (full text)
• Measuring Happiness Is Harder (But Maybe Also Easier) Than You Think, by Rich Lucas
• Social Psychology and Science: Some Lessons From Solomon Asch by Paul Rozin (full text)
• Hedge drift and advanced motte-and-bailey, by Stefan Schubert

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes or Stitcher.

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 55. It was recorded on March 18, 2019.

13/10 Would Criticize Again

If you are a scientist, criticizing science is a part of the job. We write peer reviews of papers and grants; after talks we ask questions, make comments, and ask questions that are more of a comment; and sometimes we even run replications or new studies to test each other's conclusions. But the scientific ecosystem does not have people who hold the dedicated job of science critic, in the way that fields like art, theater, and music have critics. In this episode we consider an argument made by philosopher Don Ihde that the scientific ecosystem needs such people too - people whose job it is to criticize science from outside the day-to-day practice of it. What is the case for dedicated critics? Are there important kinds of criticism that scientists are not currently making? What would that job look like, and how would it differ from the peer criticism that scientists currently do? Plus: We respond to a letter about how to start getting asked to review papers.

Links:

• Why Not Science Critics? by Don Ihde (full text)

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes or Stitcher.

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 54. It was recorded on February 18, 2019.

Our Best Episode Ever

Self-promotion: the idea makes some people cringe and others salivate. In this episode, we talk about self-promotion in academic science. What amount - and maybe more importantly, what kind - is right? Why do some people shy away from it while others dive in? What even counts as self-promotion? Is it a luxury to be able to do without active self-promotion? How do cultural and other differences play into self-promotion? Plus: We answer a letter about bringing open science practices into clinical psychology.

Links:

• Leveraging the open science framework in clinical psychological assessment research, by Jennifer Tackett, Cassandra Brandes, and Kathleen Reardon
• Using implementation science to close the gap between the optimal and typical practice of quantitative methods in clinical science, by Kevin King, Michael D. Pullmann, Aaron R. Lyon, Shannon Dorsey, and Cara C. Lewis
• Practical tips for ethical data sharing, by Michelle N. Meyer
• Recommendations for increasing the transparency of analysis of pre-existing datasets, by Sara Weston, Stuart Ritchie, Julia Rohrer, and Andrew Przybylski
• Dorothy Bishop's blog, BishopBlog
• Teaching replication, by Michael C. Frank and Rebecca Saxe
• The Collaborative Replications and Education Project
• A few people to follow on Twitter for open and transparent clinical psychological science: Grace Binion, Cassie Brandes, Kevin King, Kathleen Reardon, Jennifer Tackett

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes or Stitcher.

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 53. It was recorded on February 15, 2019.

Conference Talk

Love them or hate them, conferences are a big part of academic life. In this episode we talk about getting the most out of a conference experience. How do you meet people (the dreaded "networking") and make the transition from feeling awkward to comfortable when you're new to a conference? How do you decide what to go to and what to skip? What are the etiquette and norms you should know about? How does the experience of going to a conference change over the course of your career? We share our tips, experiences, and stories from over the years. Plus: A letter about getting familiar with the literature for your first research project.

Links:

• Nobody Goes There Anymore, It's Too Crowded, our previous episode on whether conferences should even exist (but if you came down on "no," consider the latest episode harm reduction)

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes. 

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 52. It was recorded on January 25, 2019.

Back From The Future

Whether you call it a crisis, a renaissance, a revolution, or something else, there is no doubt that psychology is in the middle of a period of great change. How will future historians, scientists, and others look back on this moment in our field's history? We speculate on what changes we think will stuck, whether some things will look silly or naive in hindsight, what new problems or issues will rise in importance, and more. Plus: We respond to a letter about whether, when, and how to disclose a disability during the job search (and we invite feedback from people with more experience or expertise than us).

Links:

• A Short (Personal) Future History of Revolution 2.0 by Bobbie Spellman
• The Psychological Science Accelerator: Advancing Psychology through a Distributed Collaborative Network by Hannah Moshontz et al.

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes. 

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 51. It was recorded on January 7, 2019.

 

Self-Help Helps Those Who Self-Help Themselves

Go to the "Psychology" section in a bookstore and chances are it will be full of self-help books. In this episode we talk about self-help and its relationship to academic psychology. What is the difference between a scientist and a self-help guru? How do we feel about the ways that self-help books talk about empirical research, and do we think they should do more of that or less of it? What self-help books have we read, and what did we think of them? Plus: We answer a letter from a n00b assistant professor who wants grad students to respect their authoritah.

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes. 

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 50. It was recorded on January 4, 2019.

 

The Year 2018 In Review

Continuing an annual tradition, for our last episode of 2018 we talk about noteworthy events and reflections from our lives in the past year. Alexa finds that she's growing more sentimental with age. Alexa and Sanjay commune over rediscovering reading books for pleasure. Sanjay muses about the legitimate benefits of taking a sabbatical. Simine reflects on the joys of meeting new people and reinventing yourself on the road. Plus: We answer a letter about how you now when a place of work is "the one"? 

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes. 

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 49. It was recorded in two parts on December 18, 2018.

 

Body Talk

Many psychologists study the brain or the body in relation to the mind. Alexa once thought psychophysiology and neuroscience would become a central part of her research; Sanjay flirted with the idea; Simine never seriously considered it. In this episode, we talk about how we see neuroscience and psychophysiology in relation to our own work. How well would those areas integrate into the research each of us does? What sorts of psychological questions are they not particularly well suited for? What do we think they are good for? What kinds of things do we learn from our colleagues who've made studying the brain and body a central part of what they do? Plus: A letter about avoiding taking money from funders who go against your values.

Links:

• This is your Brain on Psychology – This is your Psychology on Brain by Rob Chavez
• Can Cognitive Processes by Inferred from Neuroimaging Data? by Russ Poldrack
• The Iron Psychologist with Jamil Zaki (episode 13)

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes. 

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 48. It was recorded in two parts on December 3, 2018.

 

This Time Could Be Different (with Fiona Fidler)

The open science movement is not the first time psychology has tried to reform itself. Why do some scientific reform movements succeed and others fizzle out? In this episode we talk with Fiona Fidler, a philosopher and historian of science at the University of Melbourne. Fiona's doctoral thesis was an investigation of a decades-spanning attempt to reform statistical practice in psychology based on critiques of null hypothesis significance testing. Her research included interviews with reform proponents like Patricia Cohen, Paul Meehl, and Robert Rosenthal; reviews of the correspondence and output of the APA Task Force on Statistical Inference; and close study of how several psychology journals attempted to implement reform. The statistical reform movement came to what many saw as an unsatisfying end. We talk with Fiona about what we can learn from it - and crucially, why this time could be different. Plus: We answer a letter from a graduate student whose advisor's temperament has changed.

Links:

• Autumn (Episode 129 of Reply All)
• From Statistical Significance to Effect Estimation: Statistical Reform in Psychology, Medicine and Ecology by Fiona Fidler
• Fiona Fidler's website

The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at letters@theblackgoatpodcast.com. You can subscribe to us on iTunes.

Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.

This is episode 47. It was recorded in two parts on November 15 and November 25, 2018.