6

As someone who never had the opportunity to formally study Political Theory or Political Science, I was always interested in how these fields are being used to solve real problems. Comparing their methods to those of 'hard' sciences seemed like a good way to start.

I'd be very appreciative is someone could describe to me any formally recognised methods and processes for verifying empirical claims that pertain to the political realm, and the theoretical justifications behind them.

  • Just a guess, but peer review is probably the core of it since thats whats used in all other academic fields – David Grinberg Mar 17 '17 at 11:22
  • 1
    I was under the impression that peer review is more about assuring academic quality and consistency than preventing invalid research from being published. – Boblicon Mar 17 '17 at 13:27
  • 1
    That validity is an important part of quality! It's true that peer review is largely a quality control function, but one of the important qualities is whether the research is any good. That's why reviewers are usually (hopefully) experts in field related to the article being reviewed. – indigochild Mar 17 '17 at 14:51
  • Citation to sources. – ohwilleke Mar 18 '17 at 13:32
6

We Don't

Political scientists do not validate empirical claims. It might seem counter-intuitive if your background is not in the sciences, but we generally focus on disproving statements rather than proving them.

Why? Because in practical terms it's nearly impossible to prove anything. Non-experimental sciences work through induction: we collect observations and then posit an explanation to generalize those observations. However, we can never be certain that this generalization is correct, because it's always possible there are conflicting observations that we didn't see (this is the problem of induction).

Go ahead and posit a hypothesis. A classical example is "all swans are white". To prove (or validate) that hypothesis we would need to observe all swans that exist in the past, present, and future. That's impossible and not really a fruitful way to conduct research. Instead, we would focus on disproving the statement by restating the hypothesis as "There exists at least one non-white swan." This could be proven by observing a non-white swan, although the only real value is that we proved that not all swans are white. This is to say that we falsified (or disproved) the original hypothesis.

If you want to know more about the general philosophy of science utilized in political science, you'd want to focus on the works of Karl Popper. He was really interested in what separates science from non-science and how we should approach proving or disproving things.

Research Methods

How do we actually falsify things? I'll cast this broadly, but the general idea is that we hypothesize the existence of some fact and then try to collect the dis-confirming evidence.

We have two fundamental approaches, both stemming from the philosophy of John Stuart Mills:

  • The Method of Similarity: Take a collection of things you expect to be the same and look for differences. For example, a famous hypothesis is that cultures that emphasize trust have more efficient governments (Further reading: Making Democracy Work). What we could do is take a bunch of regions with low trust and observe their efficiency. If we observe that some of those low-trust regions actually have very efficient governments, we would have disproved the hypothesis.
  • The Method of Differences: Take a collection of things you expect to be different and look for similarity. Using the same hypothesis, we could include some low-trust and high-trust regions in our study. If we find that both kinds of regions can have efficient governments, we have disproved the hypothesis.

If we can't collect any dis-confirming evidence, than the formal logical statement is that we have "failed to disprove the hypothesis". Since we can't prove anything for sure, failing to disprove it is the best we can do.

Hopefully later someone will come along and disprove our hypothesis - that's how science progresses!

  • "If we can't collect any dis-confirming evidence, than the formal logical statement is that we have "failed to prove the hypothesis". " - You mean failed to disprove it, right? – Boblicon Mar 17 '17 at 13:44
  • @Boblicon - Yes! Thanks for the catch. I've corrected that. – indigochild Mar 17 '17 at 13:47
4

According to Poper and Lakatos, scientific statements cannot be actually proven, but instead they must be falsifiable. Thus, putting a theory to test in social science involves attempting to falsify a theory, and the theory is considered good if, well, it survives continued attempts of falsification.

Of course, there is more to Lakatos' philosophy of scientific discovery, and I'll not go into that; I'm not a philosopher after all.

However, the point I'm making is that one could not really prove a theory in political science, but only refute it. So, what political scientists are actually doing is making lots of empirical observations in an attempt to refute a theory, and those unrefuted are considered good theories. Of course, people use statistical approaches to determine what counts as refutation, but again I'll not go into it.

  • Good answer. Do you feel like Lakotos is applicable here? I had understood he was talking about how theories can't be proven or disproven, but I had thought empirical statements could be. – indigochild Mar 17 '17 at 13:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.