Saturday, July 6, 2013

Cowbell


What follows is an attempt to clarify what I took to be an obvious point made in a previous post (here).

There is a seriously under appreciated research rule of thumb (one that I have elevated to Norbert’s first principle): those things not worth doing are not worth doing well. What makes something worth doing? Well, in syntax (and other scientific domains as I understand them), what’s worth doing is anything that will advance understanding.  That means trying to explain why things are the way they are. Now a way station towards this quest is figuring out how things are, but this is (or in my view should be) a way station. The big rewards lie with ‘why’ questions.  Why are humans such terrific linguistic machines? Why does syntactic binding require c-command? Why do grammars code locality conditions? Why does French eschew null subjects but Italian doesn’t?  I take this to be very anodyne.  However, it has a pretty big consequence, I believe.  If ‘why’ questions are what drive inquiry, if they are the cowbell that makes the tune go, then a very important (supremely important) dimension of research is the boring/interesting axis. I take this to be obvious, but as the obvious is at times inaccessible (I always have trouble locating the young woman here?), let me spell this out a bit more.

‘Why’ questions are interest relative (here). They live in a context of presuppositions and other interests.  Some ‘why’ questions are BORING and ANNOYING!! If you don’t believe me find a three year old with whyitis and see how long you last.  So, some ‘why’ questions are interesting, some not. Good research aims to find the first and minimize time spent (wasted?) on the second.[1]  A good rule of thumb is to find an interesting ‘why’ question and study it. Why? Because the answer that one gets to an interesting question is quite often interesting. And what makes it interesting? If true it explains why what you are asking is the way it is.  In short, the interest of the ‘why’ question carries over to the interest of the answer. It’s what gives the research cowbell.

If this is correct, then one dimension along which theories (answers to ‘why’ questions) can be evaluated is wrt their boredom index (BI). And the rule is: choose topics with low BIs and eschew those with high BIs.  Two observations.

First, the BI index of a theory can change over time. As we explore its properties more fully and understand how it works the explanatory oomph (this is a technical term EO) goes down.  The more we understand the inner workings of an account the less why-mileage we get. This follows from the fact that why questions are interest relative and so are susceptible to change as the knowledge context shifts. What were once exciting insights based on exciting low BI projects loose EO and recede into the presupposed background (they become fixed truths!). There is a thermodynamic rule in fact, BI rises over time, EO dissipates as we make scientific progress. To keep BI low requires finding hypotheses with high potential EO and convert these to actual EO. But as we go from potential to actual EO, BI tends to rise. Of course, really great programs have very high potential EO and hence very low actual BI and it may take a very long time for BI to rise to dangerous levels. But, after a while, even the best stories (indeed those that we take to be obviously true) loose EO and increase BI. Or to say this pedantically: as the question of interest becomes settled it becomes less interesting.[2] Interest relativity is a bitch, aint’ it?

Second, it often takes a lot of time and effort to develop a story that answers an interesting ‘why’ question.  In other words, a central characteristic of many (most? all?) very low BI questions is that they are hard to come by.  However, if they have high EO (there is a systematic inverse relation between BI and EO, as one goes down the other goes up, i.e. BI µ 1/EO) then they are very much worth pursuing. However, as high EO low BI theories are often non-obvious and often appear on surface inspection to be incorrect, they need a lot of nurturing, e.g. protection from falsificationist sadists.

Third, not all apparent ‘why’ questions are either real questions or worth pursuing when posed.  As in most things, some why questions that look interesting are pseudo-questions and even some non pseudo ‘why’ questions are currently unanswerable.  In other words, not all frogs are princes and there is a tide in the affair of ‘why’ questions. Consequently, one thing one does (or should do) in pursuing a ‘why’ question with high potential EO is see what it buys you were it true, i.e. look for confirming evidence.  As I said (here), this may involve a falsificationist strategy towards a verificationist end.  Unexpected explanations have high EO, so it pays to look for them in evaluating a theory’s potential.  Similarly, apparent falsification is entirely expected and is reasonable to ignore.

How long is it reasonable to ignore it?  There is, sadly, no, good answer to this. But we do have cases in which 35-40 years was required to get what we now know to be the “truth” established (here). This means that, sadly, judgment is required in deciding what to do. And different reasonable people (oh yes there are also unreasonable ones, and they should be ignored. Sadly, they are hard to identify: were that they all looked froggish when being unreasonable, sigh!) judge differently and pursue different directions. Often when one hears methodological dicta about falsification etc. it just signals a fight over whether a theory that some consider to have high EO/low BI others consider to have mainly high BS and so should be discarded.  These fights, however, when conducted well are very useful. Contrary to popular opinion: de gustibus very much disputandum est. In fact, I suspect that it is the main thing worth disputing scientifically for it is what drives research through its relation to ‘why’ questions. Good taste in ‘why’ questions is worth its weight in Nobel gold.

Last point: what’s all this have to do with science being the pursuit of truth?  Everything. By its nature, this pursuit must be indirect. Rorty, I think, once said (and I agree) that ‘true’ functions in science like QED at the end of a proof. It signals that all the hard work has already been done. We mere mortals must pursue truth indirectly. How? In large part, by looking for explanations. But explanations being answers to ‘why’ questions are interest relative (this does not make them irreducibly subjective however, recall we can and should dispute taste) and so the BI/EO dimension is critical. Being that it is also subtle and tricky and hard to measure, we need to be careful to look for it and value it when it arises.  The real problem with falsificationism (the subtle non naïve varieties are generally ignored in real debate) is that it is so easily deployed to cudgel the interesting and promote the boring. And, as I consider BI/EO to be very effective routes to the “truth,” falsificationism can have (and has had) very baleful effects. That was the point I intended to make before.


[1] A particularly vivid example of the second is Everett’s observations about Piraha. His observations are entirely uninteresting as they have zero relevance to the question he purports to be addressing. However, he gets lots of airtime. Wasted time in my opinion. I mention this because a whole evening was dedicated to his claims this past week at the LSA summer institute here at U Michigan (which aside from this has been really quite enlightening).
[2] Just look at how excited physicists sound when they think that the Standard Theory is showing cracks. Whole new physics, whole new questions. The theory is false, whoopy!

4 comments:

  1. This comment has been removed by the author.

    ReplyDelete
  2. Finally we learn how science is to be done according to Norbert: cowbells are needed! Milka advertisement with happy purple cows providing happy milk comes to mind...
    [sorry youtube only had this version: https://www.youtube.com/watch?v=ZpHOEL3sauo ]

    Joking aside, footnote 1 reveals why Norbert thinks certain questions are interesting and others not. In the Hornsteinian science anything that confirms the theories Norbert believes to be true is interesting, anything that threatens them is boring. But instead of simply stating this fact he piles up trivialities from phil-o-science [presumably to hide it?].

    Yes, new theories may need nurturing, yes in some cases it might be justified to temporarily ignore seeming counter evidence etc. etc. BUT it does not follow that this can go on for ever. And it does not even address the circularity problem that has befallen Chomskyan linguistics long time ago. Why is that not even mentioned? Which generative linguist, struggling with a particularly difficult problem in syntax, cares what physicists think? [But if physicists need to be dragged into every discussion one should be at least aware that they never had a "Standard Theory" - presumably the Standard Model was meant?]

    Now for people who believe scientists are not a herd of Milka cows, it may be worthwhile knowing that Dan Everett gets as much attention as he does because his work IS interesting, it has produced unexpected results, and apparently inspired quite a few students to get into linguistics. Here is a review http://ling.auf.net/lingbuzz/001696 discussing the many reasons for why this is interesting work, BESIDES the claims about recursion Norbert finds so infuriating. Readers of this blog who have a scientific [as opposed to bovine] spirit just are well advised to learn a bit more about work Norbert finds uninteresting. And, who knows, trying to challenge some of Everett's proposals might prove more fun than waiting for the next 'language evolution miracle'

    ReplyDelete

    ReplyDelete
  3. "That means trying to explain why things are the way they are. Now a way station towards this quest is figuring out how things are, but this is (or in my view should be) a way station. The big rewards lie with ‘why’ questions."

    In the grand scheme of things, I agree with you completely, and in the grand scheme of things, what you say is surely a truism. The goal of the field is to keep asking "why" until we discover the ultimate "because". But we linguists are humans, and we don't, can't, and (I think) shouldn't live in the "grand scheme of things" all the time. For many of us who spend hours and days living in more humble schemes of things, there are very human rewards in answering "how" questions as well. Putting future string-theoreticians aside, this is the same kind of joy I see in undergraduate advisees at MIT in just being part of a lab and "discovering stuff".

    Furthermore, I think this is good for the field -- in fact, essential! Without semi-organized piles of semi-analyzed, often accidental discoveries in our heads, and without the ability to publish puzzles in advance of their solutions (and still be considered cool), where would the field find the unanswered questions that ultimately lead to the "high explanatory oomph" non-boring theories that yield the "big rewards" in the grand scheme of things?

    I find it hard to believe you disagree (though feel free), but I thought it might be useful to put forward a slightly more nuanced set of value judgments about linguistic oomphitude before things get too out of hand.

    ReplyDelete
    Replies
    1. Actually, re-reading my own comments, I realize I accepted a dichotomy from your post between "figuring out how" and "figuring out why" that I really shouldn't have. I'm not sure there is any principled difference at all -- just "why" questions higher and lower in the explanatory chain. Doesn't change my urge to nuance your oomph discussion in more or less the same way, but I might have phrased my comments somewhat differently. Enough for now, however.

      Delete