A blog about problems in the field of psychology and attempts to fix them.

Thursday, October 30, 2014

Why Inferential Statistics - Part 1

I am preparing a handout for undergrad research methods students (in several departments), who are about to get 1-class-session tutorials in SPSS. I have 3 pages to give them enough information to understand what we are doing. Here is page 1:

Why Inferential Statistics?

Imagine we had a question: “Do men and women differ on X?”
No matter what “X” is—height, empathy, knowledge of 13th century Spanish history, or anything else—we know that any given man will be different than any given woman, but what we don’t know is how men “on average” differ from women “on average.” That is, when we asked our initial question, we probably wanted to know how the mean for men compared with the mean for women. But we will never know the actual mean for men or the actual mean for women, because that would involve measuring more than 7 billion people! So, we need to, somehow, get a sample of men and a sample of women, compare them, and draw a conclusion from that.

Why academic writing sucks - Part II

Before I start my academic writing challenge, I wanted to finish up a few things, including one more reaction from Pinker's paper on "Why Academic Writing Stinks". I keep coming back to one accusation Pinker makes about academic writing, one that struck particularly close to home: The idea that academic writing is flawed by virtue of being self-reflexive and by making its assumptions and their justifications clear. For example, apparently he would hate the fact that the book I am preparing on evolution and psychology considers whether we can sensibly talk about the evolution of psychological processes. My knee jerk reaction is "Of course I need to talk about that, the answer isn't obvious at all!" But then Pinker shows how undermining that type of writing can be, with a convincing (borrowed) example of a self-reflexive cookbook:

Wednesday, October 22, 2014

Academic NaNoWriMo Challenge!

I am issuing a challenge to all my colleagues! For those who do not know, November is National Novel Writing Month (pronounced: NaNoWriMo). This is a great event that challenges participants to write at least 50,000 words in a month. (Over 400,000 people participated last year, including 90,000 K-12 students doing the youth challenge.) I do kind of want to write a novel... but I do feel the need to get my academic productivity kicked up a notch, and this is a good excuse. Trying this worked well for me last year, and I want to challenge others to join me this year. Keep reading for details.

Friday, October 3, 2014

Why Academic Writing Sucks

I'm not a huge fan of Stephen Pinker's psychology, but he is a solid writer, and I respect his perspective on many subjects. So when he wrote a Chronicle article on "Why Academics Stink at Writing" I took notice. The article starts by considering, and rejecting several suggestions for why academic writing is so bad:
  • Bad writing is there deliberately, to stop normal people from realizing scholars are talking about nothing.
  • Bad writing cannot be avoided, because the topics of discussion are so complex.
  • Bad writing is virtually required by reviewers and editors, who will not accept papers written in more straightforward manners.
These things happen, but apply to a very small percentage of published work, Pinker claims. Instead, Pinker suggests that academic writing is bad because it tries to mix writing styles, and authors become muddled about the audience and its desires. As he puts it:
Most academic writing, in contrast, is a blend of two styles. The first is practical style, in which the writer’s goal is to satisfy a reader’s need for a particular kind of information, and the form of the communication falls into a fixed template, such as the five-paragraph student essay or the standardized structure of a scientific article. The second is a style that Thomas and Turner call self-conscious, relativistic, ironic, or postmodern, in which "the writer’s chief, if unstated, concern is to escape being convicted of philosophical naïveté about his own enterprise."
With this perspective in mind, Pinker argues that much bad writing in academia is the result of "agonizing self-consciousness". This leads to too much meta-discussion, and leads academics to lose the balance between their role as communicators of knowledge vs. their role as members of a profession with its own internal norms and mores. There are many good criticisms of common phrases used by academics, which weaken their writing, and bad habits, such as the misuse of scare quotes. He goes on to talk about how certain cognitive processes (chunking, functional fixity, and the curse of knowledge) make it hard for authors to realize what will make sense to their readers. And he ends with a discussion about how few obvious incentives there are for academics to write well. For the most part I nodded in agreement, and thought about making some minor tweaks to a few papers that are in the pipeline. However, there were two points that made me uneasy.

First, Pinker criticizes "apologizing", such as when authors say that the topics they are about to write on are "extremely complex." I can see how this can be inappropriate in some circumstances, but I think the audience needs to be considered. Many of the things I write about are not subjects that others think about much, and when others do think about those subjects, they tend to think things are very simple. In that context, when I use the language Pinker is criticizing, it is because I am informing the reader that their initial views might be mistaken. For example, the types of psychological questions you can ask using a rat, in a box with a level and a few lights, are quite complex. Many psychology students and even many psychology professors (nevertheless members of the general public) do not believe that assertion, until they have learned quite a bit about the amazing studies that people have done.

Second, Pinker criticizes authors who "hedge" their statements, rather than relying on the reader to be charitable. This criticism baffled me. Certainly it is possible to over-hedge, but Pinker lives in a world full of non-charitable readers. I cannot understand his position except as a weird statement of elitism: He is too influential to be taken down by minor nit-picking, so he assumes all academics have the luxury of ignoring it as well. In my world, there is a big difference between making a claim such as "Perception is accurate" and saying "For the most part, perception is accurate." Depending on the context, a paper could easily get rejected for the hedged sentence, or get rejected for the non-hedged sentence. --- In fairness, Pinker acknowledges that some hedging may be necessary, but argues that skilled writers use it cautiously, rather than as a "tick." Alas, I'm not sure that hedge is sufficient to convey the reality; most academic authors face extremely ungenerous gatekeepers.
It is also interesting to note how often Pinker cannot resist the urge to be clever, inserting semi-jokes, at the expense of clarity. I do that too, but I am not sure I would do it so much in a piece specifically about clear writing. It makes his article half-way between something amazingly clear, like Elements of Style, and joking self-aware rule lists, with entries such as "Preposition are not things to end a sentence with."

Overall, however, very good, and recommended reading.