Archive

Archive for the ‘Essays and Columns’ Category

Topic For Discussion: The NDCA Baker Award

February 2nd, 2010 Bill Batterman 20 comments

Established in 2006, The David P. Baker Award for Season Long Excellence is presented at the National Debate Coaches’ Association Championship to the high school policy debate team with the highest point total using the tournament’s qualification system.

Modeled to some extent after college debate’s Copeland Award, the Baker is calculated based on a mathematical formula rather than on a poll of coaches or voters. This basic statistical approach to evaluating a debate team’s performance over the course of a season has been criticized by some participants and coaches who have advanced several critiques of the formula.

This article is an attempt to first explain the way that the Baker Award is calculated and then to highlight the major complaints that have been levied against it.

Read more…

Categories: Essays and Columns Tags:

The Case For Judges Providing Written Comments On Their Ballots

January 21st, 2010 Bill Batterman 15 comments

Contention One: Inherency

In the status quo, the vast majority of high school policy debate judges (at least those at “national circuit” tournaments) do not provide written comments on their ballots. A very small subset of judges—approximately ten percent based on an unscientific assessment of the publicly-posted ballots from the St. Mark’s and Blake tournaments—provide any written content at all. Of that subset, an even smaller group of judges provides “substantial” written commentary (defined as more than a short, one or two sentence reason for decision). Some tournaments have responded to this norm by eliminating ballots entirely—The Glenbrooks, for example, only provides small judge cards that are not copied or scanned for the competitors.

Thus The Plan:

High school policy debate judges should provide written comments on their ballots. This commentary should supplement—not replace—post-round oral disclosure and discussion of the debate.

Contention Two: The Advantage

The plan is superior to the status quo for all three relevant constituencies: debaters, coaches, and judges.

Read more…

Categories: Essays and Columns, Judging Tags:

Logical Decision-Making: In Defense of Harrigan’s “Judge Choice” Theory

November 6th, 2009 Bill Batterman 28 comments

[T]o say that representations matter—insofar as [they] determine/influence policy outcomes—says little or nothing about which justifications should be used for policymaking. The representations presented by the 1AC that are justifications for action, instead of outcomes of the plan are neither mandatory nor inevitable outcomes of voting Aff.

Thus, the judge, at the end of the debate, should be able to choose (for themselves) why to vote Aff or Neg. Logically, one can choose the best arguments from the set of available reasons presented in the debate. Not every 1AC justification needs to be part of the final “package” of voting Aff. If one or more representations for voting for the plan is undesirable, they should not be used. If, at the end of the debate, positive/beneficial justifications for acting remain, the plan is desirable and the Aff should win.

With that, University of Georgia Debate Coach Casey Harrigan has levied a fundamental challenge to the theoretical viability of representational critique as currently conceptualized in academic policy debate. This article will defend Harrigan’s “judge choice” theory against the attacks of its critics and thereby contribute to the developing theoretical literature about representational critique.

Read more…

Categories: Essays and Columns, Kritiks, Theory Tags:

Judging Methodologies: How Do Judges Reach Their Decisions?

November 3rd, 2009 Bill Batterman 1 comment

Paul Strait of the University of Southern California recently authored an interesting post on the CEDA forum about the time it takes judges to make their decisions. As discussed in a previous column, this is a hot topic in the college community because the average length of decisions at that level is forcing tournaments to consider reductions in the number of preliminary rounds offered in order to prevent marathon tournament schedules. Paul’s contention is that we need to foreground consideration of judging methodologies in order to determine what contributes to lengthy decisions and what effect this has on the quality of decisions.

Read more…

Categories: Essays and Columns, Judging Tags:

Shortening Tournament Days: Simple Steps For Debaters And Judges

November 3rd, 2009 Bill Batterman 1 comment

There is an ongoing discussion occurring in the college debate community about the length of tournaments and the need to balance competitive opportunities with a humane schedule. Many of the major college tournaments have moved to seven or even six rounds of preliminary competition in order to accommodate the substantially longer length of current debate rounds without forcing students and coaches/judges to endure a marathon schedule.

While this issue is not nearly as salient at the high school level, both debaters and judges could do substantially more to make the average day at a debate tournament more livable.

Read more…

Categories: Essays and Columns Tags:

Thoughts on the 100 speaker point system after St. Mark’s

October 27th, 2009 Roy Levkovitz No comments

First I want to say that Tim Mahoney, Jason Peterson and everyone at St. Mark’s did an incredible job running this tournament.   The tournament did not run late, everyone had ample time for pre round prep and the tournament ran incredibly smooth.  If you have not been to St. Mark’s before you should consider adding it to your schedule of tournaments.

Having spent a little bit of time reviewing the packet and ballots (both available on Joyoftournaments.com for everyone to see) I think that overall the implementation of the 100 point system was a success.

St. Mark’s provided a scale to be used for assigning points.   The scale translated into the following.  Take the points you would have given a debater on the 30 point scale, subtract that number by 20 and multiply that result by 10.  So if I had wanted to give someone a 27,  27-20 = 7.  7 x 10 = 70.  Now obviously because the scale is larger you get to play around and say assign a 71 72, 73 etc.  The ballot also requested that you not give two debaters in the room the same exact speaker points; the goal of this was that in every single debate you should be able to differentiate in order who debated the best.

Looking at the ballots and the packet I got a good sense that this system is clearly superior to the current system of .5 increments.  The concern of widespread variance was solved for by the scale provided by the tournament.   You were more able to get a grasp of who debated better in any given debate (by forcing each debater to get separate points)  and you were able to better see the differences amongst a medium 27.5 debater and high 28.5 debater in a debate.

My biggest criticism of the system might be something that is more cosmetic then anything but speaks to relative point inflation.  The top 7 debaters at St. Marks averaged above a 90 (or over 29 in the 30 point system) in their 6 debates( looking at total points not even the high /low).  While I think that all of those top 7 speakers deserved their speaker awards (heck one of them was one of my kids) I’ve become concerned that there might be a psychological barrier associated with the 90 point mark.  I’m not sure if people feel comfortable having a high 28.5 be less than a 90 total points.  This in turn could cause points to creep back up into the 85-100 scale and lead us back to the same broken point system we currently use.  Because this is obviously the first high school tournament this is not a reason to dismiss this system and on balance just some food for thought about the system.

The way I see it we have 3 options

1.)    Stay with the current .5 increment 30 point system- to me this is the worst of the 3 options, this system is broken and has been for a while.  I suspect it will take tournaments a while to adjust I’m glad St. Mark’s started this move in HS.

2.)    Keep this point scale (the -20 x 7) at most major hs tournaments and hope it adjusts itself to normal ( I suspect it might)

3.)    Go to a decimal point system where you have 28.1, 28.2, 28.3.   While it doesn’t have the shock factor of seeing a 93 and 73 given out in the same debate it is functionally the same and might prevent 29.2 from being the average points of the top speaker at a tournament

If someone has an in depth position either way on the system and how it worked at St. Marks e-mail me and we’ll consider making it a feature post.  If you all liked / disliked it send me an email with a reason why and I’ll compile those into a long post to not totally clutter the comment section on the right.

Categories: Essays and Columns Tags:

Chaudoin Method Applied to Carroll Evidence

October 22nd, 2009 Roy Levkovitz 3 comments

Another post from Stephen about the card at hand

Let’s apply the Chaudoin method to the Carroll evidence that has been heralded as the bringer of death for Consult:

Before doing that, let’s observe that this “piece of evidence” fails the old debate test of “claim + warrant = argument.”  I feel like a novice saying this, but, there’s no warrant in that card.  Also note that this is really unfair to Jamie because we’re talking about a footnote, not his actual argument.  I blame the author of the post for this silliness in the first place.

1)      Do the predictions logically flow from the assumptions:

No.

This footnote seems to conflate “allowing a veto” with “subservience of foreign policy to the whims of other countries.”  It also seems to ignore the potential for the US to decide when to consult and when not to consult.

2)      Are real world data consistent with these predictions?

No.

This footnote doesn’t mention any, so this is really a nonstarter anyways, but we could easily think of some pretty prominent examples where allowing other countries to veto foreign policy would have saved us some serious mockery.  Had the US actually consulted the UN on Iraq II, Jon Stewart would be out of a job.

3)      What are some more rigorous academic arguments related to the subject? (Khalilzad and a Friedman rant/op ed don’t count).

-          We might check out articles by Chapman and Reiter, or Chapman alone that are about the rally round the flag effect and international effects of consultation.  We might develop a better notion of “cooperation” by reading Carrubba’s “Courts and Compliance in International Institutions” etc.  Ikenberry’s “After Victory” is about hegemons “smoothing” their power trends by binding themselves to particular institutions.

Here’s another quick way to apply the Chaudoin method.  Ask: “Does the piece of ‘evidence’ I’m reading have all the depth of a Fox News transcript or does it actually make an argument?”

Debate “Evidence” and Evaluating Theories

October 22nd, 2009 Roy Levkovitz No comments

This is a post written by my former college debate partner Stephen Chaudoin (Emory alum 2006) Phd Candidate in the Department of Politics at Princeton University.

—-

In academia, the term “evidence” means “observations about the world that may or may not be consistent with the hypothesis they’re designed to test.”  In debate, the term “evidence” means “some shit somebody got published.”

Observe the difference…

Professor: “I think that X causes Y and as evidence I have measured X and found it to be correlated with this measurement of Y.”

Debater: “I think that X causes Y and as evidence I present to you this article from Foreign Affairs that says ‘X causes Y.”

It isn’t hard to tell which one I think is actual evidence and which one is paraphrasing someone else’s publication that may or may not contain evidence.

It isn’t accidental that debaters use the second interpretation as opposed to the first one:

Reason 1 (not debate’s fault):  Debate is about prediction.  “I think if you do policy X then Y will result in the future.”  It is not about empirically testing hypotheses.  “In the past, did policy X tend to result in Y or Z?”  It is hard to predict the future and doing so with empirics necessitates certain assumptions that may or may not be “true.”  This is a fundamental problem that is not debate’s fault because assumptions aren’t testable.

Reason 2 (sorta debate’s fault, but not really):  The core principles of debate do not lend themselves well to in depth evaluation of evidence or to in depth research sources.  In 8 minutes, I can probably summarize the theory and evidence in a Foreign Affairs article.  (Actually, I could probably explain the entire volume with “none and none” but I digress).  I would be hard pressed to do the same with American Economic Review article.  Google scholar some and see if I’m wrong.  I could give you the tagline like “Risk aversion explains behavior in a first price auction laboratory settings better than prospect theory” but I would not be able to cover the theories involved or the evidence, at least not so that you could reach the same point on the research frontier as the article.

I won’t say speed or emphasis on taglines are bad.  They most certainly are not.  Conciseness and organization are just as important as depth.  (I vaguely remember some cards about speed and memory, irony much?)  But realize that the setup of debate ensures a ceiling on the quality of evidence debate.

Reason 3 (probably debate’s fault):  I’m going to assume the 3NR is at the frontier of debate thought both because I know (two of) the authors and because it seems pretty darn astute.  Bill, I’m sure you rock; we just haven’t met.  But even the frontier minds emphasize only one half of theory testing: logical consistency.

A theory can be evaluated in (at least) two ways:

1) Logical consistency:  I start with these assumptions.  I derive this prediction.  Logical consistency asks “does this prediction logically follow from these assumptions?”

This is the one that debate focuses on almost entirely, probably because we all possess good logic skills and that’s part of why we selected ourselves into the activity.

2) Empirical consistency: Are real world data consistent or inconsistent with the hypotheses derived from the theory?

There are two words to look at, “data” and “consistency.”  Bill and Paul’s responses to Roy’s Toulmin revision get at this nicely.  “Data” refers to observations from the world used to measure a certain concept.  “Consistency” refers to the way in which you think about sets of observations to determine whether or not they are consistent with a theory.  Some potential objections are “the researcher didn’t measure something correctly,” “the researcher did not account for this other thing,” etc.

Two easy solutions:

  1. Focus on implementing the Chaudoin method (I don’t know who Toulmin was, but he has the word “tool” built in and he’s probably old and won’t care if I steal his method’s spotlight.)  After reading evidence as a debater or judge, ask “does the claim follow logically from the assumptions used to generate it?”  Next, ask “how convincing are the empirics used to test this theory?”  I would be willing to bet that 50% of debate “evidence” fails the first test and 95% fails the second.
  2. Cut longer cards.  You don’t gotta read it in the round, but the judge probably will afterwards.
  3. Read journals that are more academic:  Google something like “political science journal rankings” for a list of the top political science ones (APSR, AJPS, IO, etc) or do the same for economics (AER, QJE, JPE, etc) or for any other relevant disciplines from sociology to biology.

Implementing the Chaudoin method will win you 50-60 more rounds next year.

Full disclosure: I debated competitively for a long time before moving on to a PhD program in Political Science.  I study empirical methods and game theory which for sure affects my opinions on this subject as well.

Also, I’m trying to get Roy to put me on as a guest writer on the 3NR, so maybe commenters should back me up.

The 100 speaker point system

October 12th, 2009 Roy Levkovitz 9 comments

I was looking at the St. Marks invitation on JOT and noticed that in honor of Ross Smith (RIP Ross) that the St. Marks tournament would be moving to the 100 speaker point system for its tournament in 2 weeks.    In a podcast and probably in some other diatribes I’ve been known to go on I’ve discussed some of my concerns with the 100 speaker point system.

Let me make this clear I am strongly in support of a more expansive speaker point scale. I think there are differences between 28s, and 28.5s and the current system does not allow a judge to differentiate between the quality of those speeches. My fear with this scale is that in a 6 round tournament (which is the norm in hs) this system has the potential to “mess up” who clears and speaker awards in general.    I feel like the community does need to do a couple of things to make this work (not just for this tournament but to transition away from the 30 point scale in general).

Read more…

K overviews- Do’s and Dont’s

October 7th, 2009 Scott Phillips 2 comments

A good K overview should be like a good movie trailer- it should give me as the judge some idea of what is coming but still leave enough to keep me interested. Bad movie trailers either tell too much (and reveal all the funny lines in the movie) or give you no idea what is going on in the movie- and K overviews usually do one of those 2 things as well. Formulating a good overview is like having a good haircut- it frames the rest of the things you are going to do and establishes expectations. Its a place where you don’t need to be bound by having evidence or even rational thought- you are free to express yourself artistically and tell your own story. Sounds easy right?

Read more…