Showing posts with label epistemology. Show all posts
Showing posts with label epistemology. Show all posts

Thursday, June 22, 2017

Explanation and critical realism


To explain something is to provide a true account of the causes and circumstances that brought it about. There is of course more to say on the subject, but this is the essential part of the story. And this normative account of explanation should work as well for investigations created within the framework of critical realism as any other scientific framework.

Moreover, CR is well equipped with intellectual resources to produce explanations of social outcomes based on this understanding. In particular, CR emphasizes the reality of causal mechanisms in the social world. To explain a social outcome, then -- perhaps the rise of Trumpism -- we are instructed to identify the causal mechanisms and conditions that were in play such that a novice from reality television would gain the support of millions of voters and win the presidency. So far, so good.

But a good explanation of an outcome is not just a story about mechanisms that might have produced the outcome; instead, we need a true story: these mechanisms existed and occurred, they brought about the outcome, and the outcome would not have occurred in the absence of this combination of mechanisms. Therefore we need to have empirical methods to allow us to evaluate the truth of these hypotheses.

There is also the important and interesting point that Bhaskar makes to the effect that the social world involves open causal configurations, not closed causal configurations. This appears to me to be an important insight into the social world; but it makes the problem of validating causal explanations even more challenging.

This brings us to a point of contact with the theme of much current work in critical realism: a firm opposition to positivism and an allegiance to post-positivism. Because a central thrust of positivism was the demand for substantive empirical confirmation or verification of substantive claims; and that is precisely where we have arrived in this rapid analysis of explanation as well. In fact, it is quite obvious that CR theories and explanations require empirical validation no less than positivistic theories. We cannot dispense with empirical validation and continue to believe we are involved in science.

Put the point another way: there is no possible avenue of validation of substantive explanatory hypotheses that proceeds through purely intuitive or theoretical avenues. At some point a good explanation requires empirical assessment.

For example, it is appealing in the case of Trumpism to attribute Trump's rise to the latent xenophobia of the disaffected lower working class. But is this true? And if true, is it critical as a causal factor in his rise? How would we confirm or disconfirm this hypothetical mechanism? Once again, this brings us into proximity to a few core commitments of empiricism and positivism -- confirmation theory and falsifiability. And yet, a rational adherence to the importance of empirical validation takes us in this direction ineluctably.

It is worth pointing out that the social and historical sciences have indeed developed empirical methods that are both rigorous and distinctive to the domain of the social: process tracing, single-case and small-N studies, comparative analysis, paired comparisons, and the like. So the demand for empirical methods does not imply standard (and simplistic) models of confirmation like the H-D model. What it does imply is that it is imperative to use careful reasoning, detailed observation, and discovery of obscure historical facts to validate one's hypotheses and claims.

Bhaskar addresses these issues in his appendix on the philosophy of science in RTS. He clearly presupposes two things: that rigorous evidence must be used in assessment of explanatory hypotheses in social science; and flat-footed positivism fails in providing an appropriate account of what that empirical reasoning ought to look like. And, as indicated above, the open character of social causation presents the greatest barrier to the positivist approach. Positivism assets that the task of confirmation and refutation concerns only the empirical correspondence between hypothesis and observation.

Elsewhere I have argued for the piecemeal validation of social theories and hypotheses (link). This is possible because we are not forced to adopt the assumption of holism that generally guides philosophy in the consideration of physical theory. Instead, hypotheses about mechanisms and processes can be evaluated and confirmed through numerous independent lines of investigation. Duhem may have been right about physics, but he is not right about our knowledge of the social world.

Saturday, April 14, 2012

Race, perception, and reality

Several recent themes come together in Ron Jacobs' very interesting 2000 book, Race, Media, and the Crisis of Civil Society: From Watts to Rodney King (Cambridge Cultural Social Studies). There is the recurring theme of racial separation in American society, this time with respect to divergent perceptions of important historical events. There is the role of representation and framing as a component of identity and agency. And there is the question of realism: given the fact of divergence, what sense can we make of the question, what really happened?

Jacobs is a cultural sociologist, within a group of theorists who believe that social imagination, representation, and framing are interesting and appropriate objects of sociological inquiry. Like theorists in the broad field of social mobilization, he believes that an understanding of these "subjective" features are key to understanding mobilization and action. But he also takes very seriously the idea that an individual's (or group's) mental framework is constructed by concrete social processes, including the media. And, finally, he offers a sophisticated framework in terms of which to analyze and dissect the media itself. This is an approach that blends the methods of the social sciences and the humanities in a very constructive way.

His specific goal in this book is to try to identify crucial differences of framework between African-American and white publics in the United States at several important junctures. He studies the African-American and mainstream press in their reporting of the Watts uprising (1965) and the disturbances that followed the Rodney King beating and court findings. The African-American press serves an important "fragmented public", and Jacobs wants to identify in detail the differences in perspective that exist between it and the mainstream press.

The theoretical frame for Jacobs is Habermas's thinking about communication, discourse, and the public sphere. He largely buys into Habermas's notion that a populace constitutes itself as a collective identity through discourse in public spaces. And the media represent some of those spaces. But he diverges from Habermas's views in emphasizing that there are multiple publics and multiple discourses. And this point is particularly important when it comes to race in the United States. The OJ Simpson trial illustrated this point very sharply, with widely divergent opinions about the trial among African-Americans and white Americans.

Jacobs' primary method is narrative analysis. He analyzes several thousand news stories with respect to plot, characters, and genres. And he finds there are substantial and consistent differences between mainstream and African-American press accounts of Watts, Rodney King, and the innocent verdicts for the police assailants of Rodney King.

What Jacobs doesn't assert, and what probably isn't true, is that the perspective found in, say, the Chicago Defender, is a faithful, exact expression of the collective perspective and framing of the black public of Chicago at a point in time. Rather, the Defender is a media publication with an editorial perspective and a small group of writers and editors. They have their own perspectives. As Jacobs points out, the Defender helps to influence black perspective in Chicago, but it isn't identical to the mentality of the black Chicago public or publics. (One might speculate that much of Chicago's black youth took a more radical and less patient view of police harassment than the Defender.) In order to probe these mentalities on the ground, a different kind of research would be needed -- ethnographic rather than documentary.

So this invokes one of the themes of realism we've surfaced in recent posts: what can we say about the truth of the matter when it comes to assertions about social perceptions and representations? And here I'm not thinking of the veridicality of the black teenager's perceptions of the police, but rather the veridicality of the sociologist's representations of that group's perceptual scheme about race and the police. How does critical realism come into the picture when we are discussing intangible, subjective features of imagination and representation by a social group? Can we be realists about mentalities?

I believe that the answer is "yes". There are research methods that permit a degree of confidence in assessing the forms of thinking associated with a given group at a given time. These range from participant-observer methods, to ethnography more broadly, to the kind of historical ethnography practiced by Robert Darnton, to survey methods attempting to measure attitudes and values. These methods generally require interpretive skills and judgments on the part of the investigator -- in this respect the sociologist is also a humanist--but it is reasonable to think that evidence-based inquiry can lead to reasonably confident conclusions about facts of subjectivity.

And this leads to another connection to realism: subjective schemes of interpretation are linked to actions as well. Mentality and action are linked. So the fact that Chicago teenagers in 1968 perhaps shared a narrative of police brutality very plausibly played a causal role in their behaviors in Chicago's uprising. So realism about the causes of contentious politics requires a degree of realism about mentalities as well.

(All of the action in Jacobs' book involves Los Angeles, a city with a very specific racial history. Readers will find the Easy Rawlins novels of Walter Mosley a vivid representation of African-American life in LA in the 1950s -- e.g. A Red Death (Easy Rawlins Mysteries). But even here a question of realism arises: can we gain realistic understanding of a historical moment through a novel? Does Mosley offer a true depiction of race in LA?)

Saturday, August 7, 2010

Links between literature and the social sciences


Some novelists take as part of their task the description and evocation of certain social realities. James Baldwin captured one slice of African-American life in the 1950s and 60s. Tim O'Brien captured aspects of infantry life in Vietnam in The Things They Carried. And Tolstoy caught much about social attitudes and relations in elite Russia at a certain time and place. We could interpret these sorts of novels "realistically" and ask a range of questions about them: how accurate are they? Do they leave out important aspects of the picture? And what was the epistemic location of the author, such that he/she could claim to observe and portray accurately?

If we take this function of literature seriously, then it is natural to ask how this creative act relates to various areas of the social sciences. Does the knowledge offered by Baldwin complement the work of sociologists and historians of race in America? And, for that matter, can the realistically-minded novelist find valuable synergy in the research of historians and sociologists?

These questions are taken especially seriously by critics who are developing the framework of "critical realism", including especially Satya Mohanty. Particularly valuable is Identity Politics Reconsidered (Future of Minority Studies), edited by Linda Alcoff, Satya Mohanty and Michael Hames-Garcia. The topic is a core concern for the Future of Minority Studies project (link).

So, what about it? Can a work of fiction have realistic, referential content? Is a novel sometimes an empirical statement? Can a fictional character truthfully represent aspect of what it is like to be black in America, South Asian in Manchester, or gay in a suburban Illinois high school? For that matter, can a novel be faulted for "getting it wrong" -- for example, for representing an American Muslim as being completely oblivious to issues of racism?  Or is "right" and "wrong" out of place when it comes to evaluating the relationship between a novel and the world?

Here is one possible answer: fiction is always fiction, and normally does not have empirical validity. If we want to make empirical statements about social relations, class attitudes, or typical social values of specific groups, we need to do so based on valid methods of social research: surveys, focus groups, interviews, and observations of behavior. And we need to analyze the data we collect according to valid methods of aggregation and inference. That is what is required in order to arrive at knowledge about the social world.

Another very different response goes along these lines. Novelists are sometimes skilled social observers, and some of these are also skilled "painters" or evokers of what they have seen. A great novelist can pull together his/her many insights and observations into a powerful description of a fictional world or experience that captures an important sociological truth about the society depicted.  So these novelists do in fact gain knowledge of social life through observation, and they represent that knowledge through the fiction they produce. Both parts of this epistemic process are subject to criticism; but both are valid knowledge practices.

According to the second view, readers have the possibility of gaining real knowledge about the social world through the novel.  Seen in this way, a novelist is somewhat akin to an ethnographer, trying to make sense of a complex system of behaviors and meanings and expressing his/her findings in a way that is truthful to the social reality observed.

It seems that one would have to be a pretty narrow-minded epistemologist to hold that there is only one kind of knowledge, and that literature necessarily falls outside its bounds.  This might have been credible when the program of logical empiricism still seemed possible -- that there are observations that can be unambiguously arrived at, and that theories are evaluated through a specific logic of confirmation marshaling a domain of observations in support of hypothetical statements.  But this epistemology doesn't work well even in the sciences.  And within the framework of an anti-foundationalist epistemology, it seems reasonable enough to believe that literature has the potential of revealing important aspects of the social world.

This brings us back to the question of linkage between literature and the social sciences.  If we think that Platoon or The Things They Carried express some important truth about the nature of the experience of that war for American soldiers, this suggests the possibility of framing other sorts of social-science investigations to probe the extent and variation of these characteristics on the ground.  In other words, there is a simple kind of synergy that can exist between novelists, sociologists, and historians, when it comes to framing interpretations and explanations of a complex social reality, and designing further empirical studies to evaluate and qualify these findings.

Thursday, May 13, 2010

Social theory and the empirical social world


How can general, high-level social theory help us to better understand particular historically situated social realities? Is it helpful or insightful to "bring Weber's theory of religion to bear on Islam in Java" or to "apply Marx's theory of capitalism to the U.S. factory system in the 1950s"? Is there any real knowledge to be gained by applying theory to a set of empirical circumstances?

In the natural sciences this intellectual method is certainly a valid and insightful one. We gain knowledge when we apply the theory of fluid dynamics to the situation of air flowing across a wing, or when we apply the principles of evolutionary theory to the problem of understanding butterfly coloration. But do we have the same possibility in the case of the social world?

My general inclination is to think that "applying" general social theories to specific social circumstances is not a valid way of creating new knowledge or understanding. This is because I believe that social ensembles reflect an enormous degree of plasticity and contingency; so general theories only "fit" them in the most impressionistic and non-explanatory way. We may have a pure structural theory of feudalism; but it is only the beginning of a genuinely knowledge-producing analysis of fourteenth-century French politics and economy or the Japanese samurai polity. At best the theory highlights certain issues as being salient -- the conditions of bonded labor, the nature of military dependency between lord and vassal. But the theory of feudalism does not permit us to "derive" particular features or institutions of French or Japanese society. "Feudalism" is an ideal type, a heuristic beginning for social analysis, rather than a general deductive and comprehensive theory of all feudal societies.  And we certainly shouldn't expect that a general social theory will provide the template for understanding all of the empirical characteristics of a given instance of that theorized object.

Why is there this strong distinction between physical theory and social theory? Fundamentally, because natural phenomena really are governed by laws of nature, and natural systems are often simple enough that we can aggregate the effects of the relevant component processes into a composite description of the whole. (There are, of course, complex physical systems with non-linear composite processes that cannot be deductively represented.)  So theories can be applied to complicated natural systems with real intellectual gain.  The theory helps us to predict and explain the behavior of the natural system.

The social world lacks both properties. Component social mechanisms and processes are only loosely similar to each other in different instances; for example, "fealty" works somewhat differently in France, England, and Japan. And there is a very extensive degree of contingency in the ways that processes, mechanisms, agents, and current circumstances interact to produce social outcomes. So there is a great degree of path dependency and variation in social outcomes, even in cases where there are significant similarities in the starting points. So feudalism, capitalism, financial institutions, religions, ethnic conflicts, and revolutions can only be loosely theorized.

That is my starting point. But some social theorists take a radically different approach. A good example of a bad intellectual practice here is the work of Hindess and Hirst in Pre-Capitalist Modes Of Production, in which they attempt to deduce the characteristics of the concrete historical given from its place within the system of concepts involved in the theory of the mode of production.

Is this a legitimate and knowledge-enhancing effort? I don't think that it is. We really don't gain any real insight into this manor, or the Burgundian manor, or European feudalism, by mechanically subsuming it under a powerful and general theory -- whether Marx's, Weber's or Pareto's.

It should be said here that it isn't the categories or hypotheses themselves that are at fault. In fact, I think Marx's analysis and categories are genuinely helpful as we attempt to arrive at a sociology of the factory, and Durkheim's concept of anomie is helpful when we consider various features of modern communities. It is the effort at derivation and subsumption that I find misguided. The reality is larger and more varied than the theory, with greater contingency and surprise.

It is worthwhile looking closely at gifted social scientists who proceed differently. One of these is Michael Burawoy, a prolific and influential sociologist of the American labor process. His book, Manufacturing Consent: Changes in the Labor Process Under Monopoly Capitalism, is a detailed study of the American factory through the lens of his micro-study of a single small machine shop in the 1940s and 1970s, the Allied/Geer factory. Burawoy proceeds very self-consciously and deliberately within the framework of Marx's theory of the capitalist labor process. He lays out the fundamental assumptions of Marx's theory of the labor process -- wage labor, surplus labor, capitalist power relations within the factory -- and he then uses these categories to analyze, investigate, and explain the Allied/Geer phenomena. But he simultaneously examines the actual institutions, practices, and behaviors of this machine shop in great participant-observer detail. He is led to pose specific questions by the Marxist theory of the labor process that he brings with him -- most importantly, what accounts for the "consent" that he observes in the Allied workers? -- but he doesn't bring a prefabricated answer to the question.  His interest in control of surplus labor and coercion and consent within the workforce is stimulated by his antecedent Marxist theory; but he is fully prepared to find novelty and surprise as he investigates these issues.  His sociological imagination is not a blank slate -- he brings a schematic understanding of some of the main parameters that he expects to arise in the context of the capitalist labor process.  But his research assumptions are open to new discovery and surprising inconsistencies between antecedent theory and observed behavior.

And in fact, the parts of Burawoy's book that I find most convincing are the many places where he allows his sociological imagination and his eye for empirical detail to break through the mechanism of the theory. His case study is an interesting and insightful one. And it is strengthened by the fact that Burawoy does not attempt to simply subsume or recast the findings within the theoretical structure of Marx's economics.

(Burawoy addresses some of these issues directly in an important article, "Two Methods in Search of Science" (link). He advocates for treating Marxist ideas as a research program for the social sciences in the sense articulated by Imre Lakatos. )

So my advice goes along these lines: allow Marxism, or Weber or Durkheim or Tilly, to function as a suggestive program of research for empirical investigation. Let it be a source of hypotheses, hunches, and avenues of inquiry. But be prepared as well for the discovery of surprising outcomes, and don't look at the theory as a prescription for the unfolding of the social reality. Most importantly, don't look to theory as a deductive basis for explaining and predicting social phenomena. (Here is an article on the role of Marxism as a method of research rather than a comprehensive theory; link.)

Thursday, February 11, 2010

"Theory" in sociology


What is a sociological theory? And how does it relate to the challenge of providing explanations of social facts?

In the natural sciences the answer to this question is fairly clear. A theory is a hypothesis about one or more entities or processes and a specification of their operations and interactions. A theory is articulated in terms that permit rigorous and unambiguous derivation of implications for the behavior of a body of phenomena -- perhaps through specification of a set of equations or through a set of statements with deductive consequences. A theory may specify deterministic properties of a set of entities -- thus permitting point predictions about future states of the relevant system; or it may specify probabilistic relations among entities, giving rise to statements about the distribution of possible future states of the system. And a theory is provided with a set of "bridge" statements that permit the theorist to connect the consequences of the theory with predictions about observable states of affairs.

So in the natural sciences, theories are expected to have precise specification, deductive consequences, and specific bridge relationships to observable phenomena.

Is there anything like this construct in the social sciences?

The question of the role of theory in social thinking is a complex one, and the concept of theory seems to be an ambiguous one (as Gabriel Abend points out in an article mentioned below). At one end of the spectrum (is it really a spectrum?) is the idea that a theory is a hypothesis about a causal mechanism. It may refer to unobservable processes (and is therefore itself "unobservable"), but it is solidly grounded in the empirical world. It postulates a regular relationship between or among a set of observable social factors; for example, "middle class ideology makes young people more vulnerable to mobilization in XYZ movements."

At a much more abstract level, we might consider whether a theory is a broad family of ideas, assumptions, concepts, and hypotheses about how the world works. So Marxism or feminism might represent a theory of the forces that are most important in explaining certain kinds of phenomena. We might refer to this broad collection of ideas as a "theory".  Or we might instead regard this type of intellectual formation as something more than a theory -- a paradigm or mental framework -- or something less than a theory -- a conceptual scheme.

Consider this taxonomy of the field of social knowledge-creation:
  • concepts -- a vocabulary for organizing and representing the social world
  • theory -- one or more hypotheses about causal mechanisms and processes
  • mental framework / paradigm -- a set of presuppositions, ontological assumptions, guiding ideas, in terms of which one approaches a range of phenomena
  • epistemology -- a set of ideas about what constitutes valid knowledge of a domain
And we might say that there is a generally rising order among these constructs. We need concepts to formulate hypotheses and theories; we need theories to give form to our mental frameworks; and we need epistemologies to justify or criticize theories and paradigms.  In another sense, there is a descending order from epistemology to framework to concepts and theories: the framework and epistemology guide the researcher in designing a conceptual system and a set of theoretical hypotheses.

Where do constructs like feminism, critical race theory, or Marxism fall within this scheme?  We might say that each of these bodies of thought involves commitments in each of these areas: specialized concepts, specific causal hypotheses, an organizing framework of analysis, and an epistemology that puts forward some specific ideas about the status of knowledge and representation.

The theory of "resource mobilization" and social movements is somewhat less comprehensive (McAdam and Snow, Readings on Social Movements: Origins, Dynamics, and Outcomes; McAdam, McCarthy, and Zald, Comparative Perspectives on Social Movements: Political Opportunities, Mobilizing Structures, and Cultural Framings ; link, link, link).  It functions as a linked body of hypotheses about how social movements arise.  So RMT is a good example of the limited conception of theory.  Zald, McCarthy, Tilly, McAdam, and others purport to identify the controlling causal variables that explain the success or failure of mobilization around grievance. Their theories reflect a mental framework -- one that emphasizes purposive rationality (rational choice theory) and material factors (resources).  And they offer specific hypotheses about mobilization, organization, and social networks.

Gabriel Abend's article "The Meaning of Theory" (link) in Sociological Theory (2008) is a valuable contribution on this subject. Abend offers explications for seven varieties of theories and shows how these variants represent a wide range of things we might have in mind by saying that "theory is important."  Here are his formulations:
  1. Theory1. If you use the word ‘theory’ in the sense of theory1, what you mean by it is a general proposition, or logically-connected system of general propositions, which establishes a relationship between two or more variables.
  2. Theory2. A theory2 is an explanation of a particular social phenomenon.
  3. Theory3. Like theory1 and theory2, the main goal of a theory3 is to say something about empirical phenomena in the social world. However, the main questions that theory3 sets out to answer are not of the type ‘what x causes y?’ Rather, given a certain phenomenon P (or a certain fact, relation, process, trend), it asks: ‘what does it mean that P?,’ ‘is it significant that P?,’ ‘is it really the case that P?,’ ‘what is P all about?,’ or ‘how can we make sense of or shed light on P?’
  4. Theory4. The word ‘theory’ and some of its derivatives are sometimes used to refer to the study of and the students of the writings of authors such as Marx, Weber, Durkheim, Simmel, Parsons, Habermas, or Bourdieu.
  5. Theory5. A theory5 is a Weltanschauung, that is, an overall perspective from which one sees and interprets the world. Unlike theories1, theories2, and theories3, theories5 are not about the social world itself, but about how to look at, grasp, and represent it.
  6. Theory6. Lexicographers trace the etymology of the word ‘theory’ to the late Latin noun ‘theoria,’ and the Greek noun ‘the¯oria’ and verb ‘the¯orein’ (usually translated as “to look at,” “to observe,” “to see,” or “to contemplate”). The connotations of these words include detachment, spectatorship, contemplation, and vision. This etymology notwithstanding, some people use the word ‘theory’ to refer to accounts that have a fundamental normative component.
  7. Theory7. Many sociologists have written about issues such as the ‘micro-macro problem,’ the ‘problem of structure and agency,’ or ‘the problem of social order.’ This type of work is usually thought to fall within the domain of sociological theory. One may also use the word ‘theory’ to refer to discussions about the ways in which ‘reality’ is ‘socially constructed’; the scientific status of sociology (value freedom, the idea of a social law, the relations between explanation and prediction, explanation and understanding, reasons and causes, and the like); or the ‘relativity’ of morality. In these examples the word ‘theory’ assumes a distinct meaning, which I distinguish as theory7. (177-181)
Abend comes to a very good conclusion about the ways we should think about theory -- and refrain from legislating the forms that theory can take.  He argues for a principle of "ontological and epistemological pluralism":
I believe that a satisfactory solution to SP [semantic predicament] should make as few ontological and epistemological demands as possible. The set of conditions under which the word ‘theory’ can be correctly used should not have too much built-in ontological and epistemological baggage. I call this the ‘principle of ontological and epistemological pluralism.’ The reason why I advocate this principle is, very roughly put, the following. Suppose sociologists made a certain picture of the world or idea about what can be known a prerequisite for something being a sociological theory at all. Consider some examples. We may demand that theories be underlain by the assumption that “the social world consists of fixed entities with variables attributes” (Abbott 1988:169). We may require that causality be taken to be the cement of the universe, the most important relation that can hold between two entities. Or, we could build into the definition of ‘theory’ the idea that social processes are regulated by laws of nature. Alternatively, we may demand the belief that the distinction between text and reality is misleading, or even the belief that there are no such things as ‘reality’ and ‘objectivity.’ Or else, we may demand the assumption that nothing exists but what can be actually observed or otherwise grasped by our senses, thereby denying existence to such ‘mysterious’ things as causality and similar ‘underlying theoretical mechanisms’ (Steinmetz 2005). In any of these scenarios, only to the extent that you shared the required ontology or epistemology, could you be said to have a theory of the social world. You could have other things about the social world—opinions, views, beliefs, ideas—but not a theory. By definition, that particular ontology or epistemology would be obligatory for one to be allowed to enter a theoretical discussion, make a theoretical contribution, or theorize at all. (195)

Saturday, January 16, 2010

High modernism and expert knowledge



James Scott is one of the really exceptional social scientists of his generation.  His contributions to peasant studies have been transformative -- his ideas of the "moral economy of the peasant" and "weapons of the weak" are now part of the tool set that we all use in trying to make sense of agrarian societies (The Moral Economy of the Peasant: Rebellion and Subsistence in Southeast Asia, Weapons of the Weak: Everyday Forms of Peasant ResistanceDomination and the Arts of Resistance: Hidden Transcripts).  And his historical and ethnographic accounts of peasant life and struggle have given us a strong basis for understanding these movements that were so important during the anti-colonial struggles of the mid-twentieth century.  (I've treated several of these contributions in earlier posts here, here, here, and here.)

What is particularly striking about Scott's work is the range of his sociological imagination.  He is a genuinely creative thinker when it comes to making sense of some of some very complex human phenomena -- peasant mobilization, agricultural modernization, and large-scale efforts to transform the world.  Each of his books introduces something new (for example, his treatment of Gramsci and hegemony in Weapons of the Weak, or his use of "hidden transcripts" in Domination and the Arts of Resistance).  He is a master at coming up with a concept, theory, or metaphor that can help to explain complex forms of social behavior, from the points of view of the actors.  And he does a great job of overcoming the dichotomy between "material circumstances" and "culture"; the peasant communities and movements that he treats are both materially situated and culturally specific.

A more recent book that makes a number of important new contributions is Seeing Like a State: How Certain Schemes to Improve the Human Condition Have Failed (1998).  Here Scott shifts focus in two ways.  His analysis here differs from his earlier books in that it is both more macro -- he examines the ways that states think; and more micro -- he also examines the nature of individually situated expert local knowledge.  Both parts of the analysis are interesting and novel.

The book explores what Scott calls "high modernism" -- essentially, the effort to use science and theory to order and regularize the social world, and to use theories of the future to remake the present.  Scott defines high modernism in these terms:
It is best conceived as a strong, one might even say muscle-bound, version of the beliefs in scientific and technical progress that were associated with industrialization in Western Europe and in North America from roughly 1830 until World War I. At its core was a supreme self-confidence about continued linear progress, the development of scientific and technical knowledge, the expansion of production, the rational design of social order, the growing satisfaction of human needs, and, not least, an increasing control over nature. (89)
Initially he puts the point in terms of the modern state's agenda of "sedentarianization" -- reducing the mobility and anonymity of nomadic peoples and organizing them into "legible" formations.
The more I examined these efforts at sedentarization, the more I came to see them as a state's attempt to make a society legible, to arrange the population in ways that simplified the classic state functions of taxation, conscription, and prevention of rebellion. (2)

Much of early modern European statecraft seemed similarly devoted to rationalizing and standardizing what was a social hieroglyph into a legible and administratively more convenient format.  The social simplifications thus introduced not only permitted a more finely tuned system of taxation and conscription but also greatly enhanced state capacity. (Introduction)
The core thesis of the book is the damage that states have done when they have attempted to implement antecedent theories of social change:
I believe that many of the most tragic episodes of state development in the late nineteenth and twentieth centuries originate in a particularly pernicious combination of three elements.  The first is the aspiration to the administrative ordering of nature and society, an aspiration that we have already seen at work in scientific forestry, but one raised to a far more comprehensive and ambitious level....  The second element is the unrestrained use of the power of the modern state as an instrument for achieving these designs.  The third element is a weakened or prostrate civil society that lacks the capacity to resist these plans. (88-89)
High modernism was evident in agriculture; but it was also visible in urban planning.
Le Corbusier had no patience for the physical environment that centuries of urban living had created. He heaped scorn on the tangle, darkness, and disorder, the crowded and pestilential conditions, of Paris and other European cities at the turn of the century ... He was visually offended by disarray and confusion. (106)
The French-inspired urban design of colonial-era Saigon is pictured above.

Scott's view is that the central development disasters of the twentieth century derived from this toxic combination of epistemic arrogance and authoritarian power, including especially an excessive confidence in the ability of principles of "scientific management" to order and organize human activity.  He provides case studies of the creation of Brasilia as a completely planned city; Soviet collectivization of agriculture in 1929-30; villagization in Tanzania; and the effort to regularize and systematize modern agriculture (266).  And we could add China's Great Leap Forward famine to the list.  In each case, the high-modernist ideology led to a catastrophic failure of social development.
In sum, the legibility of a society provides the capacity for largescale social engineering, high-modernist ideology provides the desire, the authoritarian state provides the determination to act on that desire, and an incapacitated civil society provides the leveled social terrain on which to build. (5)
A constant contrast in the book is between the objectifying knowledge of modernist science -- social and natural -- and the particular knowledge systems of practitioners and locals about the nature of their local environment -- what he calls "metis".  "Throughout this book I make the case for the indispensable role of practical knowledge, informal processes, and improvisation in the face of unpredictability" (6).  A particularly clear instance of these two perspectives comes in through Scott's discussion of scientific forestry and the local knowledge of forest ecology possessed by villagers.  Beekeeping, traditional farming, and the cultivation of the mango tree (333) are other good examples.  Two forests are pictured below; the first is an old-growth forest, and the second is the result of scientific forestry. And Scott documents the ecological destruction that resulted when these principles of scientific forestry were exported from Germany to Southeast Asia.





Scott's perspective here is not anti-scientific or anti-modern.  Instead, it is fundamentally anti-authoritarian: the high-modernist impulse coupled with the power of the modern state has led to massive human disasters.  And confidence in comprehensive, abstract theories -- whether of forests, bees, or cities -- has been an important element of these destructive endeavors.  So the conclusion is a moderate one: pay attention to local knowledge, be suspicious of totalizing experiments in transforming society or nature, and trust the people who are affected by policies to contribute to their design.

Scott's arguments in Seeing Like a State provide some resonance with two other insightful writers discussed in earlier postings: Michael Polanyi (on the importance of tacit knowledge) and Karl Popper (on the hazards associated with comprehensive social engineering).

(Scott's most recent book is The Art of Not Being Governed: An Anarchist History of Upland Southeast Asia.  Here is a very interesting working paper by Grant Evans reviewing Scott's contributions; From moral economy to remembered village: The sociology of James C. Scott (Working paper / Centre of Southeast Asian Studies, Monash University).)


Sunday, January 3, 2010

The disciplines of economics



Economics is sometimes presented as the most "scientific" of the social science disciplines.  It is mathematical, it involves sophisticated models, it makes use of enormous data sets, and it is invoked in the formulation of social and economic policies in much the way that the science of mechanics is invoked in the building of bridges.  So one might imagine that the foundations, objectivity, and empirical credibility of modern economics are now beyond question.

Each of these assumptions is debatable, however.  Daniel Hausman, a sympathetic critic and the leading authority in the philosophy of economics, casts doubt on the claims for precision and comprehensiveness of economic theory in The Inexact and Separate Science of Economics.  Essays in my volume, On the Reliability of Economic Models: Essays in the Philosophy of Economics, cast doubt on the validity and reliability of some of the computational models that are used in current economics, including especially the computable general equilibrium models (CGE).  And economists like Bruce Pietrykowski have pointed out that there are multiple traditions bundled into the history of contemporary economics, some of which have been overlooked to the detriment of the science of economics (The Political Economy of Consumer Behaviour: Contesting Consumption).  (See an earlier post on Pietrykowski's work).

We need to have a better history and sociology of the formation of the disciplines of economics in order to have a better understanding of the scope and limits of current theory.  There is, of course, a major literature on the history of economic thought, including such beacons as Joseph Schumpeter's History of Economic Analysis, Mark Blaug's Economic Theory in Retrospect, and I. I. Rubin's History of Economic Thought.  (Rubin saw the muzzle-end of economic history, by being executed by Stalin in 1937 for crimes against the state.)  But traditional approaches to the history of economic thought almost always look for synthesis and logical progression; so the account that we often get represents the development of economics as a fairly linear evolution from the physiocrats to the classical political economists to the marginalist revolution to Keynes and general equilibrium theory.  The differences, contingencies, and choices that occurred along the way tend to disappear.

What the sociology of science can add to the history of science is a detailed, empirical examination of the institutions, processes, networks, and knowledge systems of a discipline.  Sociologists like Robert Merton (link) and Andrew Abbott (Chaos of Disciplines) attempt to provide a micro-level account of the development and workings of a scientific discipline, using the empirical and theoretical tools of sociology.  And this approach sheds a great deal of light on the way the particular field of science works, as well as providing greater granularity to the status of scientific claims within various disciplines.  (It should be said that the current generation of historians of science also sometimes take this kind of micro-level view -- for example, Peter Galison's treatment of Einstein and Poincaré in Einstein's Clocks, Poincare's Maps: Empires of Time.  But to date this hasn't been true of historians of the social sciences.)

Marion Fourcade's profoundly innovative book, Economists and Societies: Discipline and Profession in the United States, Britain, and France, 1890s to 1990s, takes a sociologist's toolkit to work on the disciplines of economics.  Here is a good statement of her fundamental thesis:
Economics arose everywhere.  But everywhere it was distinctive.  If we look back just a few decades, we see that the institutionalization of economics expertise in science, policy, or business took different routes across nations.  Scientific and practical knowledge about the economy was conceptualized and institutionalized in different ways in different places, and for identifiable reasons. (3)
What is some of the evidence for thinking that "economics" is different in different national settings?  Here is a good example of an empirical approach a sociologist can take to this question.  Fourcade cites opinion surveys that have been conducted of "professional economists" in seven European and North American countries, on topics relevant to economic theory and policy.  For most of these questions there are significant differences between U.S., French, U.K., and Canada economists -- documenting the idea that there are meaningful differences in the theoretical presuppositions of economists in those national cultures.  Here are a couple of questions from table 0-2 (p. 6):
Tariffs and quotas reduce welfare
Agree          U.S. 95%  France 70%   U.K. 84%
Disagree      U.S.   3%  France 27%   U.K. 15%

Reducing the influence of regulatory authorities (e.g., in air traffic) would improve the efficiency of the economy
Agree          U.S. 75%  France 37%   Canada 56%
Disagree      U.S. 21%  France 56%   Canada 43%
On these two questions (only a subset of eight in the table), economists in the U.S. and France demonstrate very significant differences of judgment on very basic economic policy issues, with U.K. and Canada falling between them.  The regulatory question is particularly revealing.  So survey research -- a very basic tool of sociological research -- turns out to have useful and surprising results when directed at the profession of economics.

Another tool that Fourcade uses to good advantage is something that Merton emphasized as well: examination of scientific biographies and interviews with current practitioners.  How did specific influential individuals develop into professional economists?  And what can the sociologist learn about the profession from these detailed intellectual itineraries?

Fourcade is careful and reflective in formulating the methodology she pursues in the book.  She makes use of the comparative framework employed by comparative historical sociologists in other fields as well; she singles out the U.S., U.K., and France as specific national cases within which she attempts to reconstruct the specific values, attitudes, and institutions that defined "economics" as a profession.  (This is methodologically similar to Frank Dobbin's study of "policy cultures" in these same three countries; Forging Industrial Policy: The United States, Britain, and France in the Railway Age.)  She calls her approach "critical organized comparison" (13).

This approach defines the bulk of the book; Fourcade provides chapters on the economic cultures of professional economics in the U.S., U.K., and France, in which she examines in detail the academic institutions, policy environments, and epistemic assumptions that went into the creation of economics as a discipline of knowledge and expertise in each country.  She argues that each national setting represents a "constellation of practices" that distinguishes it from the others; so that the profession of economics is defined differently in the three settings.  Here are the components of the French constellation as she sorts it out: limited private jurisdiction, segmentation of economics training, legitimacy of technocratic generalist discourse, state jurisdiction dominant, and late and piecemeal institutionalization (16).

A key insight in the book is Fourcade's insistence that economic knowledge, economic policies, economic expertise, and the profession of economics are jointly specified within a specific national culture.  They are socially constructed in ways that she makes perfectly understandable.  These social products are interrelated, and they are differently understood in the separate cultures studied.  "In short, we want to examine the historical conditions that helped crystallize the very idea of what economics is, and attend closely to changing local classifications and representations of this idea over time" (13).

She also pays close attention to the institutions through which economists are trained and validated -- another key sociological insight:
The structure of the academic system and the place of economics education and research within it are particularly relevant to understanding the nature of economic knowledge production in each country.  As an academically organized form of knowledge, and a training ground for a vast array of business and administrative professions, economics is shaped by broader research and higher education ecologies. (22-23)
Here is a nice statement of how she sees her work hanging together:
This book has been particularly concerned with one specific type of affinity, that which ties knowledge to its social setting.  Instead of focusing--in Foucault's manner-- on what makes particular sorts of knowledge possible at a given historical moement, I have thus tried to analyze interactions between forms of political organization and forms of knowledge making within specific social contexts. (239)
Economists and Societies is a very appealing piece of sociology, and it is a highly insightful contribution to a very fundamental question: what is the status of economic knowledge?

(Related work on the significant differences that can be discerned across national traditions of a social science discipline is being done for the discipline of sociology as well; see this post on national differences in the discipline of sociology, highlighting work by Gabriel Abend.)

Tuesday, December 1, 2009

Styles of epistemology in world sociology



One of the basic organizing premises of the sociology of science is that there are meaningful differences in the conduct of a given area of science across separate communities, all the way down.  There is no pure language and method of science into which diverse research traditions ought to be translated.  Rather, there are complex webs of assumptions about ontology, evidence, observation, theory, method, and reasoning; and there are highly significant differences in the institutions through which scientific activities are undertaken and young scientists are trained.  Sociologists and philosophers such as Thomas Kuhn, David Bloor, Paul Feyerabend, Bruno Latour, and Wiebe Bijker have attempted to lay out the reasons for thinking these forms of difference are likely to be ubiquitous, and several of them have done detailed work in specific areas of scientific knowledge to demonstrate some of these differences.  (Here is a post on Kuhn's approach to the history of science.)

In this vein is a genuinely fascinating and important article by Gabriel Abend with the evocative title, "Styles of Sociological Thought: Sociologies, Epistemologies, and the Mexican and U.S. Quests for Truth" (Sociological Theory 24:1, 2006).  Abend attempts to take the measure of a particularly profound form of difference that might be postulated within the domain of world sociology: the idea that different national traditions of sociology may embody different epistemological frameworks that make their results genuinely incommensurable.  Abend offers an empirical analysis of the possibility that the academic disciplines of Mexican and U.S. sociology embody significantly different assumptions when it comes to articulating the role and relationships between "evidence" and "theory."  Here is how he summarizes his findings:
[The] main argument is that the discourses of Mexican and U.S. sociologies are consistently underlain by significantly different epistemological assumptions. In fact, these two Denkgemeinschaften are notably dissimilar in at least four clusters of variables ... : their thematic, theoretical, and methodological preferences; their historical development and intellectual influences; the society, culture, and institutions in which they are embedded; and the language they normally use.(2)
The core of Abend's analysis is an empirical study involving content analysis of four leading sociology journals in Mexico and the U.S. and sixty articles, randomly chosen through a constrained process.  He analyzes the articles with respect to the practices that each represents when it comes to the use of empirical evidence and sociological theory.  And he finds that the differences between the Mexican articles and the U.S. articles are highly striking.  Consider this tabulation of results on the question of the role of evidence and theory taken by the two sets of articles:



His central findings include these:
  • U.S. and Mexican sociologists have very different understandings of "theory" and the ways in which theories relate to data.  U.S. sociologists conform to Merton's idea of "theories of the middle range" in which a theory relates fairly directly to empirical observations through its deductive consequences.  Mexican sociologists tend to use theories and theoretical concepts as ways of interpreting or thematizing large social phenomena.
  • U.S. sociologists see the burden of their work to fall in the category of testing or confirming sociological hypotheses.  Mexican sociologists see the burden of their work in detailing and analyzing complex social phenomena at a fairly factual level.  "93 percent of M-ART are principally driven by the comprehension of an empirical problem" (10).
  • U.S. sociologists are strongly wedded to the hypothetico-deductive model of confirmation and explanation.  This model plays very little role in the arguments presented in the sample of articles from Mexican sociologists.
  • U.S. and Mexican sociologists have very different assumptions about "scientific objectivity".  U.S. authors aspire to impersonal neutrality, whereas Mexican authors embrace the fact that their analysis proceeds from a particular perspective.
  • U.S. authors attempt to exclude value judgments; Mexican author incorporate value judgments into their empirical analysis.  "Among U.S. sociologists, the standard reference is Weber’s purportedly sharp distinctions between value and fact, Wertfreiheit (value freedom or ethical neutrality) and Wertbezogenheit (value relevance or value relatedness), and context of discovery and context of justification" (22).   Concepts such as "oppression," "exploitation," and "domination" are used as descriptive terms in many of the Mexican research articles.
Here is a striking tabulation of epistemic differences between the two samples:



Abend believes that these basic epistemological differences between U.S. and Mexican sociology imply a fundamental incommensurability of results:
To consider the epistemological thesis, let us pose the following thought experiment. Suppose a Mexican sociologist claims p and a U.S. sociologist claims not-p.  Carnap’s or Popper’s epistemology would have the empirical world arbitrate between these two theoretical claims. But, as we have seen, sociologists in Mexico and the United States hold different stances regarding what a theory should be, what an explanation should look like, what rules of inference and standards of proof should be stipulated, what role evidence should play, and so on. The empirical world could only adjudicate the dispute if an agreement on these epistemological presuppositions could be reached (and there are good reasons to expect that in such a situation neither side would be willing to give up its epistemology). Furthermore, it seems to me that my thought experiment to some degree misses the point. For it imagines a situation in which a Mexican sociologist claims p and a U.S. sociologist claims not-p, failing to realize that that would only be possible if the problem were articulated in similar terms. However, we have seen that Mexican and U.S. sociologies also differ in how problems are articulated—rather than p and not-p, one should probably speak of p and q.  I believe that Mexican and U.S. sociologies are perceptually and semantically incommensurable as well. (27)
Though Abend's analysis is comparative, I find his analysis of the epistemological assumptions underlying the U.S. cases to be highly insightful all by itself.  In just a few pages he captures what seem to me to be the core epistemological assumptions of the conduct of sociological research in the U.S.  These include:
  • the assumption of "general regular reality" (the assumption that social phenomena are "really" governed by underlying regularities)
  • deductivism 
  • epistemic objectivity
  • a preference for quantification and abstract vocabulary
  • separation of fact and value; value neutrality
Abend is deliberately agnostic about the epistemic value of the two approaches; he is explicit in saying that he is interested in discovering the differences, not assessing the relative truthfulness of the two approaches.  But we cannot really escape the most basic question: where does truth fall in this analysis?  What is the status of truth claims in the two traditions?  Are there rational grounds for preferring one body of statements over the other, or for favoring one of these epistemologies over its alternative north or south?

This is important and original work.  Abend's research on this topic is an effort well worth emulating; it adds a great deal of depth and nuance to the effort to provide a philosophy of sociology.  I hope there will be further analysis along these lines by Abend and others.

(There is a lot of social observation and theory in the image above -- and no pretense of academic objectivity.  Class opposition, global property systems, and a general impression of deep social conflict pervade the image.)

Saturday, May 30, 2009

Pragmatic inquiry


Intellectuals are sometimes accused of being out of touch with the real world. But there is a strong thread of intellectual life that proceeds on the basis of a commitment to linking thought to action, theory to practical outcomes. Karl Marx and John Dewey had at least this in common: they both urged intellectuals to commit themselves to joining the intellectual realm with the solution of humanity's challenges. This isn't a universal view; pure physicists and mathematicians, many philosophers, and many theorists of the arts would adamantly defend the pure search for truth and creativity, no matter what connection these may have to the improvement of humanity. But at least some thinkers and researchers see the purpose of their work as bringing the leverage of science and the mind into engagement with practical human problems. We might refer to this as a "pragmatic" perspective on inquiry.

What is involved in pursuing a life of inquiry within a pragmatic perspective? Most basically, it is the idea that inquiry can make a practical difference in the world. According to a pragmatic perspective, science is not a free-standing system for its own sake; rather, science serves humanity. There should be consequences that flow from research and inquiry that somehow or other lead to resolution of problems that we care about. This suggests a loose priority for "problem-directed research" over "curiosity-driven research." And a pragmatic orientation implies that the researcher should design his/her research activities in an intelligent portfolio around a significant set of pressing human problems.

A second implication of "pragmatism" in research comes down to expectations about methodology and epistemology. A pragmatic conception of research defines the epistemic values of research results "practically." A theory or set of measurements should be "good enough" for the needs of the problem, rather than aspiring to an abstract notion of perfect precision. The standards of precision and veridicality are set by the needs of the problem to be solved, rather than existing as free-standing requirements of ever-greater precision. (Sometimes, of course, greater precision is of great practical importance.)

But there is a little bit of a paradox underlying these comments. We don't generally know what kind of theoretical advance will be needed or constructive in application to a particular problem. Solving problems requires valid understandings of the mechanisms that give rise to these problems; but discovery of underlying mechanisms may proceed best from apparently unrelated theoretical research. So this seems to imply that the research community as a whole will be most pragmatically successful, if there is some division of labor within the community between "curiosity-driven researchers" and "problem-solver researchers." (This seems to correspond roughly to the distinction between pure research and applied research.)

There is of course an important current of American philosophy that is labeled "American pragmatism." (See Christopher Hookway's excellent essay in the Stanford Encyclopedia of Philosophy, and Israel Scheffler, Four Pragmatists: A Critical Introduction to Pierce, James, Mead and Dewey.) How do the central ideas and exponents of this school -- Peirce, James, Dewey, perhaps eventually Goodman, Quine, and Rorty -- relate to the discussion to this point? William James puts the point of pragmatism in terms of a theory of semantics (link): we can explore the meaning of concepts in terms of the practical difference one interpretation or the other makes in the realm of ordinary experience. John Dewey emphasizes the practical connections that exist between knowing and living (Experience and Nature). Neither of these ideas exactly captures the sense of "pragmatic" that is at work here, though; the idea that there is a human point to inquiry, and that the investigator needs to pay attention to both ends of the "theory/world" dichotomy.

It is also interesting to realize that there is a parallel theme in Marx's thought. Marx's insistence on the unity of theory and practice falls in this general area, as does his eleventh thesis on Feuerbach: "The philosophers have sought only to understand the world; the point, however, is to change it" (link). Marx didn't diminish the importance or value of theoretical research; but he insisted on the importance of keeping in mind the relationship between theory and practice, between knowledge and social improvement.

The Chicago school of sociology provides a good illustration of a pragmatic approach to social research. (See Martin Bulmer, The Chicago School of Sociology.) The Chicago sociologists regularly went back and forth between assessment of the current material and social problems that the city of Chicago was experiencing, and formulation of theories and analytical constructs that might assist in better understanding and addressing these problems. (It is interesting that John Dewey was an important early influence on the formation of the Chicago school.)

So there is a coherent position to take concerning the relationship between intellectual inquiry and practical outcomes. We might say that one of the responsibilities of intellectuals is to assure that their work ultimately has value, and an important manifestation of value is "contribution to the solution of practical human problems." However, it is also true that there are other ways in which intellectual work can have value; so the pragmatic approach cannot be considered to be an exclusive one. Moreover, the point made above, that pure imaginative and theoretical investigation can often have great practical value assures that there is a continuing point to pure research as well. Proof of the Gödel incompleteness theorem didn't have direct practical consequences for computing, so far as I know; and yet it is unmistakeably a valuable result of human reasoning, and one that sheds strikingly new light on the nature of mathematical truth.

Friday, May 22, 2009

China's agricultural history


Consider the discipline of the agricultural history of China. The following represent a sampling of research problems concerning the social and economic history of rural China in recent research:
  • What were the patterns of population growth, growth of cultivated land, and growth of net output, in traditional China? (Perkins 1973)
  • What was the distribution of land tenure arrangements in north China? (Arrigo 1986)
  • What was the structure of rural marketing hierarchies? (Skinner 1964, 1965)
  • What was the urbanization rate in 1893? (Skinner 1977)
These are all factual questions about features of economy and social institutions. The findings on these topics are, of course, fallible and revisable.

A core study in Chinese economic history is Dwight Perkins' Agricultural development in China, 1368-1968 (1973). This study plays the role in China studies that Deane and Cole (British Economic Growth 1688-1959) plays in English studies. Perkins attempts to provide estimates of population growth, cultivated land, and grain output for a period from the late fourteenth century through the mid-twentieth century. Perkins' central thesis is that China's population increased five- or six-fold between the late fourteenth and early nineteenth centuries, and that the agricultural system was able to keep pace with this increase in equal measure by expanding cultivated acreage and by raising the yield per acre (1973:13).

So what kinds of historical and empirical data provide a basis for these sorts of estimates?

For the pre-twentieth century period, Perkins' findings are largely based on primary research: Ming-Ch'ing tax records on population and cultivated acreage, local gazetteers, agricultural handbooks published over past centuries, memorials by local officials to the Emperor, and so forth. He also refers to a large volume of Chinese and Japanese research on the agrarian history of China. The local gazettes provide a great deal of information about the timing and location of markets; commodity prices; land tenure arrangements; and the activities of local elites.

For the twentieth century there are a different set of sources available: rural studies by American or European investigators (Buck, Tawney, and Gamble); data collected by the China Maritime Customs bureau; provincial gazetteers compiled by the Ministry of Industries; and a series of village studies of North China undertaken by the Japanese South Manchurian Railway Company. The earliest twentieth-century studies of the Chinese rural economy in English include Tawney (1932), Buck (1930, 1937), and Gamble (1963). Tawney and Buck provide statistical data describing the state of the Chinese rural economy in the early twentieth century. An important source in current economic research on the early twentieth century is the Mantetsu surveys. These were Japanese field studies conducted by the Japanese South Manchurian Railway Company during 1935-42, and provide extensive detail concerning the structure and organization of the rural economy in selected parts of North China.

In addition to these source materials, there are a number of core studies that have appeared since 1950 that function in much the way that was seen in English economic history. They represent a synthesis of primary data available at the time of publication which later researchers are authorized to draw upon in support of other claims. In addition to Perkins, these include Gamble (1968), Myers (1970), Rawski (1972), Skinner (1964, 1965), and Huang (1984). There is also an extensive literature in Japanese on Chinese economic history.

Current economic history of China depends on previously underutilized sources--local archives, government records, Japanese studies, and the like. Thus Huang (1984) makes extensive use of the Mantetsu surveys, Board of Punishment reports (1984:47), and county archives (the Baxian archives; 1984:51). William Rowe's study of the economic and social history of the city of Hankow is even more closely dependent on primary sources: county gazettes, records of English companies (e.g., Jardine's), and local and provincial government records. This feature may reflect the differences between stages of development of the two disciplines; in the China case there are still extensive primary sources that have not been investigated, and there are correspondingly large and important questions about Ming and Ch'ing economic history which have not been addressed, let alone resolved, in the existing literature.

Perkins pays careful attention to the problem of validating the key estimates of economic activity upon which his analysis depends, and he refers to some of the ways in which he attempts to check the validity of these sources:
I have, in fact, frequently judged the validity of data for the decades and centuries prior to the 1950's on whether these earlier figures were consistent with those for 1957 and with historical developments in the intervening periods. (Perkins 1969:10)
Perkins gives a consistency test for his estimates of population and acreage:
If the pre-modern estimates of provincial population and acreage had been arrived at by arbitrary methods, one would expect yield data derived from such figures to rise in certain periods and fall in others with no apparent pattern. . . . But most of the estimates in Table II.3 for 1850 bear a close relation to the 1957 figures. (1969:20)
Perkins' research predates the current debate about "involution" in the field of Chinese economic history; but his estimates (and those of Bozhong Li) set the parameters for much of that debate. (See "The Involution Debate" for more on this recent controversy.)

References


Arrigo, Linda Gail. 1986. Landownership Concentration in China: The Buck Survey Revisited. Modern China 12 (3):259-360.
Buck, John Lossing. 1930. Chinese farm economy. Chicago, Ill.,: The University of Chicago press.
———. 1937. Land Utilization in China. Chicago: University of Chicago Press.
Fogel, Joshua. 1987. Liberals and Collaborators: The Research Department of the South Manchurian Railway Company. Association for Asian Studies.
Gamble, Sidney D. 1968. Ting Hsien; a north China rural community. Stanford, Calif.: Stanford University Press.
Huang, Philip C. C. 1985. The Peasant Economy and Social Change in North China. Stanford: Stanford University Press.
Huang, Philip C. 1990. The peasant family and rural development in the Yangzi Delta, 1350-1988. Stanford, Calif.: Stanford University Press.
Li, Bozhong. 1998. Agricultural Development in Jiangnan, 1620-1850. London: Palgrave Macmillan.
Myers, Ramon H. 1970. The Chinese Peasant Economy. Cambridge: Harvard University Press.
Rawski, Evelyn Sakakida. 1972. Agricultural Change and the Peasant Economy of South China. Cambridge: Harvard University Press.
Rowe, William T. 1984. Hankow: Commerce and Society in a Chinese City 1796-1889 Stanford, Calif.: Stanford University Press.
Skinner, G. William. 1964-65. Marketing and Social Structure in Rural China. Journal of Asian Studies 24 (1-3).
Skinner, G. William. 1977. Regional Urbanization in Nineteenth-Century China. In The City in Late Imperial China, edited by G. W. Skinner.
Tawney, R. H. 1966 [1932]. Land and Labor in China. Boston: Beacon.

Monday, December 29, 2008

Correspondence, abstraction, and realism

Science is generally concerned with two central semantic features of theories: truth of theoretical hypotheses and reliability of observational predictions. (Philosophers understand the concept of semantics as encompassing the relations between a sentence and the world: truth and reference. This understanding connects with the ordinary notion of semantics as meaning, in that the truth conditions of a sentence are thought to constitute the meaning of the sentence.) Truth involves a correspondence between hypothesis and the world; while predictions involve statements about the observable future behavior of a real system. Science is also concerned with epistemic values: warrant and justification. The warrant of a hypothesis is a measure of the degree to which available evidence permits us to conclude that the hypothesis is approximately true. A hypothesis may be true but unwarranted (that is, we may not have adequate evidence available to permit confidence in the truth of the hypothesis). Likewise, however, a hypothesis may be false but warranted (that is, available evidence may make the hypothesis highly credible, while it is in fact false). And every science possesses a set of standards of hypothesis evaluation on the basis of which practitioners assess the credibility of their theories--for example, testability, success in prediction, inter-theoretical support, simplicity, and the like.

The preceding suggests that there are several questions that arise in the assessment of scientific theories. First, we can ask whether a given hypothesis is a good approximation of the underlying social reality--that is, the approximate truth of the hypothesis. Likewise, we can ask whether the hypothesis gives rise to true predictions about the future behavior of the underlying social reality. Each of these questions falls on the side of the truth value of the hypothesis. Another set of questions concerns the warrant of the hypothesis: the strength of the evidence and theoretical grounds available to us on the basis of which we assign a degree of credibility to the hypothesis. Does available evidence give us reason to believe that the hypothesis is approximately true, and does available evidence give us reason to expect that the hypothesis's predictions are likely to be true? These questions are centrally epistemic; answers to them constitute the basis of our scientific confidence in the truth of the hypothesis and its predictions.

It is important to note that the question of the approximate truth of the hypothesis is separate from that of the approximate truth of its predictions. It is possible that the hypothesis is approximately true but its predictions are not. This might be the case because the ceteris paribus conditions are not satisfied, or because low precision of estimates for exogenous variables and parameters leads to indeterminate predictive consequences. Therefore it is possible that the warrant attaching to the approximate truth of the hypothesis and the reliability of its predictions may be different. It may be that we have good reason to believe that the hypothesis is a good approximation of the underlying economic reality, while at the same time we have little reason to rely on its predictions about the future behavior of the system. The warrant of the hypothesis is high on this account, while the warrant of its predictions is low.

Whatever position we arrive at concerning the possible truth or falsity of a given economic hypothesis, it is plain that this cannot be understood as literal descriptive truth. Economic hypotheses are not offered as full and detailed representations of the underlying economic reality. For a hypothesis unavoidably involves abstraction, in at least two ways. First, the hypothesis deliberately ignores some empirical characteristics and causal processes of the underlying economic reality. Just as a Newtonian hypothesis of the ballistics of projectiles ignores air resistance in order to focus on gravitational forces and the initial momentum of the projectile, so an economic hypothesis ignores differences in consumption behavior among members of functional defined income groups. Likewise, a hypothesis may abstract from regional or sectional differences in prices or wage rates within a national economy. Daniel Hausman provides an excellent discussion of the scope and limits of economic theories in The Inexact and Separate Science of Economics.

Another epistemically significant feature of social hypotheses is the difficulty of isolating causal factors in real social or economic systems. Hypotheses are generally subject to ceteris paribus conditions. Predictions and counterfactual assertions are advanced conditioned by the assumption that no other exogenous causal factors intervene; that is, the assertive content of the hypothesis is that the economic processes under analysis will unfold in the described manner absent intervening causal factors. But if there are intervening causal factors, then the overall behavior of the system may be indeterminate. In some cases it is possible to specify particularly salient interfering causal factors (e.g. political instability). But it is often necessary to incorporate open-ended ceteris paribus conditions as well.

Finally, social theories and hypotheses unavoidably make simplifying or idealizing assumptions about the populations, properties, and processes that they describe. Consumers are represented as possessing consistent and complete preference rankings; firms are represented as making optimizing choices of products and technologies; product markets are assumed to function perfectly; and so on.

Given, then, that hypotheses abstract from reality, in what sense does it make sense to ask whether a hypothesis is true? We must distinguish between truth and completeness, to start with. To say that a description of a system is true is not to say that it is a complete description. (A complete description provides a specification of the value of all state variables for the system--that is, all variables that have a causal role in the functioning of the system.) The fact that hypotheses are abstractive demonstrates only that they are incomplete, not that they are false. A description of a hockey puck's trajectory on the ice that assumes a frictionless surface is a true account of some of the causal factors at work: the Newtonian mechanics of the system. The assumption that the surface of the ice is frictionless is false; but in this particular system the overall behavior of the system (with friction) is sufficiently close to the abstract hypothesis (because frictional forces are small relative to other forces affecting the puck). In this case, then, we can say two things: first, the Newtonian hypothesis is exactly true as a description of the forces it directly represents, and second, it is approximately true as a description of the system as a whole (because the forces it ignores are small).

This account takes a strongly realist position on social theory, in that it characterizes truth in terms of correspondence to unobservable entities, processes, or properties. The presumption here is that social systems generally--and economic systems in particular--have objective unobservable characteristics which it is the task of social science theory to identify. The realist position is commonly challenged by some economists, however. Milton Friedman's famous argument for an instrumentalist interpretation of economic theory (Essays in Positive Economics) is highly unconvincing in this context. The instrumentalist position maintains that it is a mistake to understand theories as referring to real unobservable entities. Instead, theories are simply ways of systematizing observable characteristics of the phenomena under study; the only purpose of scientific theory is to serve as an instrument for prediction. Along these lines, Friedman argues that the realism of economic premises is irrelevant to the warrant of an economic theory; all that matters is the overall predictive success of the theory. The instrumentalist approach to the interpretation of economic theory, then, is highly unpersuasive as an interpretation of the epistemic standing of economic hypotheses. Instead, the realist position appears to be inescapable: we are forced to treat general equilibrium theory as a substantive empirical hypothesis about the real workings of competitive market systems, and our confidence in general equilibrium hypotheses is limited by our confidence in the approximate truth of the general equilibrium theory.