One of the consequential puzzles of the Second World War was the sudden, catastrophic collapse of the French army following German invasion in 1940. This is the subject of Marc Bloch's Strange Defeat, written in 1940, and it is an event of major historical importance and mystery. The mystery is this: France was a powerful military force, it had declared war against Germany following the Nazi invasion of Poland, it had ample warning that Germany would wage war against it soon following the invasion of Poland, and it had invested heavily in defensive materiel against an anticipated German attack. And yet when the attack came in May 1940, France was surprised, French armies were quickly defeated, and France capitulated after only six weeks of fighting.
Saturday, January 1, 2022
Strange defeat
One of the consequential puzzles of the Second World War was the sudden, catastrophic collapse of the French army following German invasion in 1940. This is the subject of Marc Bloch's Strange Defeat, written in 1940, and it is an event of major historical importance and mystery. The mystery is this: France was a powerful military force, it had declared war against Germany following the Nazi invasion of Poland, it had ample warning that Germany would wage war against it soon following the invasion of Poland, and it had invested heavily in defensive materiel against an anticipated German attack. And yet when the attack came in May 1940, France was surprised, French armies were quickly defeated, and France capitulated after only six weeks of fighting.
Tuesday, August 17, 2021
Social change and agency
Much of the drama of history is found in processes of large social and political change, both slow and rapid. The sudden collapse of the Soviet system in 1989 and 1990, the success of the Chinese Communist Revolution in 1949, the decades-long rise of the nationalist right in France and the United States, the rise of fascism in Germany, Austria, and Spain in the 1930s, the success of movements for female suffrage in most western democracies since the beginning of the twentieth century -- these are examples of social and political change that are of great importance for the future of humanity, for better and worse.
There is a school of thought that wants to think of social change as being largely the result of human agency: parties, leaders, social movements, organizations, and social classes bring about changes that they "want" that they plan for. And sometimes this is true enough: the Republican tax-cutting policies of the past forty years in the United States have brought about a lot of social change, and a lot of that has been deliberate. Ideology and class interests, conjoined with a determined and persistent political party, have led to a substantial shift of wealth and income to an ever-smaller percentage of the population.
But much social and historical change doesn't look like that story. The change associated with GOP tax activism is a large and important one; but it is a pretty simple one as well. It is more akin to a pirate band taking plunder from a defenseless coastal population than a long, complex process of engagement with social forces, groups, and structures aimed at creating change.
Unquestionably there is a vast amount of agency, both individual and group, in typical processes of large social change. But much of this agency is contentious and decentralized, with widely different objectives, plans, strategies, and coalitions associated with different configurations of actors. Groups set out with one set of objectives; internal conflicts lead to adjustment and re-prioritization of objectives; other groups hijack the activism and organization of competitors and redirect their efforts towards a different set of goals altogether. The result is a set of outcomes that often would create an enormous sense of surprise for the activists and actors who were involved in collective efforts at the beginning: is this what we were striving for?
This feature of the multiplicity of social actors is what makes the field of contentious politics so important and so interesting. Scholars like McAdam, Tarrow, and Tilly (Dynamics of Contention) have highlighted the complexity that underlies large social movements, and the social mechanisms through which multiple actors interact, compete, collaborate, and divide from each other. And it turns out that some of the same dynamics that are discovered in large processes of social movements are also found in more ordinary social environments as well; this is the special insight offered by Fligstein and McAdam in A Theory of Fields. Corporations, universities, and government agencies all embody some of the mechanisms of "contentious politics".
But social movements represent just one important source of social change. In broad perspective, there are a handful of different kinds of social factors that are involved in important examples of social and political change. And, significantly, all of these mechanisms play out in a social world which also possesses some dynamics of its own that are largely beyond the reach of purposeful intervention.
Change through social movements
When major segments of a population are mobilized around an issue, they can become important sources of social and political change. This raises questions from several perspectives. First, what factors lead to successful mobilization of a group? Second, what tactics and strategies are available to social groups through which they can bring about change through collective action? And third, what tactics and strategies are available to "incumbents" -- current power holders and the structures that they control -- through which they can defeat the efforts of groups involved in collective action? Concerning mobilization: a group needs to be sensitized to an issue that it can be brought to care about, and this rarely happens spontaneously. Rather, leaders and organizations are needed to convey messages, gather resources, plan for collective action, and the like. As McAdam and Kloos show in Deeply Divided: Racial Politics and Social Movements in Post-War America, the Tea Party served such an organizational role in conservative mobilization in the 2000s. Concerning tactics: groups can exercise their political will through mass actions -- demonstrations, sit-ins, occupations, boycotts, and electoral contests. They can engage in "everyday forms of resistance," in James Scott's words. And they can support "ideological" campaigns, promulgating and legitimizing the perspective of their group to other non-committed social actors. Finally, incumbents (governments and existing power-holders) can use ideological means to discredit the insurgent organizations. They can use the legitimate enforcement of the legal system to interfere with mass actions. And they can call upon organized force -- both official (police, military) and unofficial (militias, armed organizations) against the actions of insurgents. All of these dimensions have been visible in the collective actions and reactions that have occurred around the Black Lives Matter movement in the past year and a half.
Change through influential organizations
Social mobilization is rarely spontaneous. Rather, there is a need for organizations that have resources and capacities that permit them to rally supporters, conduct strikes and demonstrations, and coordinate efforts with other groups and potential allies. Coordinated collective action requires communication, confidence-building, and resources. Organizations like labor unions, political organizations, religious hierarchies, and kin groups are all able to fill these roles. Charles Tilly highlights the importance of the Catholic Church during the uprising in the Vendée (The Vendee); the Solidarity organization in Poland originating in Gdansk provided this impetus in 1980 (link); and SNCC was able to offer substantial organizational impetus to civil rights activism in the South in the 1960s. So organizations are a highly important ingredient of social mobilization; further, they can play an important role in determining the direction and strategy of a social movement. Labor unions in the United States in the 1960s played an important role in advancing the cause of civil rights, and much of this effort was prompted by the emergence of dissident union activism within unions like the United Auto Workers, including the Dodge Revolutionary Union Movement (DRUM) and Ford Revolutionary Union Movement (FRUM). Activism by African-American auto workers pushed the UAW into a more active position on the struggle for racial equality. (Here is a brief description of some of this history; link.)
Change through state power
The New Deal and the social agenda of the Roosevelt administration were examples of largescale social change initiated by a government. FDR and his political allies were able to enact programs and legislation that profoundly changed the relationship between ordinary people and the economy in which they lived. A generation later the enactment of the Civil Rights Act and the Voting Rights Act, supported by the advocacy and political efforts of the Johnson administration, led to a significant change in the political status of African-American citizens. As McAdam shows in Political Process and the Development of Black Insurgency, 1930-1970, these changes would not have been possible without wide and persistent activism and mass mobilization of the civil rights movement; but equally, they would not have occurred without the political efforts of the Johnson administration.
Change through education, media, entertainment
Public perception and worldview plainly play a crucial role in social mobilization and engagement in a struggle for social change. It is evident, then, that the content and pervasiveness of the institutions through which the opinions and perceptions of ordinary citizens are shaped are significant factors in the impulse towards social change. If children and young adults are exposed to values of human equality, freedom, and democracy throughout their education, it is more likely that they will be responsive to issues of racism and authoritarian state behavior later in their lives. On the other hand, if the content of the educational system downplays the importance of equality and democracy and minimizes the history of racial and sexual discrimination, then many in the population will be unmoved by calls for mobilization for greater equality. The influence of right-wing media on political attitudes has been well documented for the past several decades, and this is intentional: the owners of Fox News and similar sources have a message they want to convey, and their programs embody that message. And social media like Twitter, Facebook, Instagram, or right-wing sites like Parler and Rumble have proven to have an enormous capacity for generating hate-based activism. The institutions of education, media, and entertainment must be counted as causal factors in the occurrence of social and political change.
Change through generational and demographic shifts
These factors serve to identify some of the direct and purposeful sources of social and political change. But, as historians like Emmanuel Ladurie and Ferdinand Braudel demonstrated (link), there are long waves of change in history that are only remotely related to the intentions and purposes of the current generation. Long, slow processes can lead to substantial social change over time (link). For example, Paul Abramson and Ronald Inglehart argued that a large factor driving change in post-World War II democracies was "generational change and value replacement" (link). Here the idea is that value change in a nation is less about individuals and more about the shifting mix of cohorts of individuals over time. Here is their formulation of this hypothesis in the abstract to this paper:Generational replacement has had a major impact on the distribution of materialist/post-materialist values among Western publics. Between 1970 and 1984 the ratio of post-materialists to materialists increased substantially in West Germany, Britain, and The Netherlands, and increased somewhat in France. In Belgium and Italy materialist values increased as a result of short-term forces conducive to materialism. In Germany, Britain, and The Netherlands population replacement contributed to the rise of post-materialism. In France, it reversed short-term forces contributing to materialism, while in Belgium and Italy population replacement partially offset short-term forces that contributed to materialist values. Analysis of the impact of generational replacement sheds light on the development of value orientations in Western societies and on a process through which attitude change occurs among mass publics.
Inglehart extends this argument along with Pippa Norris in Cultural Backlash: Trump, Brexit, and Authoritarian Populism to offer a degree of reassurance about the likely future of extremist populism: the tide of progressive attitudes towards race and ethnicity is very powerful, and right-wing extremism should be expected to decline.
A similar argument can be made about demographic change in the ethnic composition of a region or country. No particular individual needs to change his or her culinary tastes, in order for the ratio of Swedish restaurants to Polish restaurants to shift as a result of largescale immigration of Swedish families into the region. And if Swedish people are, on average, more liberal than Polish people, then the region becomes more liberal -- even though no individual has become more liberal.
Wednesday, May 12, 2021
Corporations and the Nazi regime
It is apparent, 90 years after the beginnings of the Nazi period, that large corporations played an important and lamentable role in Nazi power and administration, and the implementation of the atrocities of slave labor and mass murder. This is true for domestic German industries, like I.G. Farben and Siemens; and it appears to be true for some multinational companies with subsidiaries in Germany, including the major automobile companies such as General Motors and Ford Motor Company. In his important book Industry and Ideology: I. G. Farben in the Nazi Era Peter Hayes summarizes the involvement of I.G. Farben in these terms: "By 1943, the concern's 334 plants and mines across Germany and occupied Europe were turning out more than 3 billion marks' worth of goods and earning net profits of more than 0.5 billion. Nearly 50% of IG's 330,000-person work force had come to consist of conscript or slave laborers, among whom were some of the perhaps 30,000 inmates of Auschwitz who eventually died in the company's new factory and mines near the camp" (xxi-xxii). And one of its subsidiaries was the industrial source of Zyklon B, the extermination gas used to kill more than a million concentration camp victims.
Sunday, May 10, 2020
Good government and the pandemic
Can the functions of government be delegated to voluntary individual action? The pandemic sheds light on this question too. The efforts that some states pursued in February and March to beg citizens to practice voluntary social distancing were fundamentally ineffective. Spring break in Florida, crowds in California, people saying "they have faith that God will take care of them" -- as a public we didn't do very well in self-designing or self-imposing sound public health behaviors. And as epidemiologists have demonstrated throughout this crisis, it doesn't take many non-compliant individuals to keep the exponential growth of infection going. Free-riding ("I can go to the grocery store without a mask if enough other people don't"), failure to understand non-linear processes ("there are just a few cases in Seattle, how bad can it get"), and perverse magical thinking ("it will all blow over in a while, and I'll probably be OK") seem to have motivated enough people to behave badly that voluntary measures were doomed to failure. One part of the problem is the complexity of a disease epidemic. Most citizens simply could not incorporate the mathematics of an epidemic into their practical thinking. They could not accept that on this nice sunny day, devastating disaster was already unfolding. So the power and regulatory authority of the state was needed. (Even mandatory measures don't seem to be enforceable in many places.)
We thus have concrete illustration of the fact that good government is both necessary and possible. So a fundamental demand of citizens upon their potential leaders must be one of commitment and competence: is this candidate committed to using government for the key functions of securing the health, safety, freedoms, and wellbeing of all citizens? And does he or she have the leadership competence and skill that will be needed to marshal the organizations and agencies of government in support of these fundamental goals?
Thursday, February 20, 2020
Slime mold intelligence
We often think of intelligent action in terms of a number of ideas: goal-directedness, belief acquisition, planning, prioritization of needs and wants, oversight and management of bodily behavior, and weighting of risks and benefits of alternative courses of action. These assumptions presuppose the existence of the rational subject who actively orchestrates goals, beliefs, and priorities into an intelligent plan of action. (Here is a series of posts on "rational life plans"; link, link, link.)
It is interesting to discover that some simple adaptive systems apparently embody an ability to modify behavior so as to achieve a specific goal without possessing a number of these cognitive and computational functions. These systems seem to embody some kind of cross-temporal intelligence. An example that is worth considering is the spatial and logistical capabilities of the slime mold. A slime mold is a multi-cellular "organism" consisting of large numbers of independent cells without a central control function or nervous system. It is perhaps more accurate to refer to the population as a colony rather than an organism. Nonetheless the slime mold has a remarkable ability to seek out and "optimize" access to food sources in the environment through the creation of a dynamic network of tubules established through space.
The slime mold lacks beliefs, it lacks a central cognitive function or executive function, it lacks "memory" -- and yet the organism (colony?) achieves a surprising level of efficiency in exploring and exploiting the food environment that surrounds it. Researchers have used slime molds to simulate the structure of logistical networks (rail and road networks, telephone and data networks), and the results are striking. A slime mold colony appear to be "intelligent" in performing the task of efficiently discovering and exploiting food sources in the environment in which it finds itself.
One of the earliest explorations of this parallel between biological networks and human-designed networks was Tero et al, "Rules for Biologically Inspired Adaptive Network Design" in Science in 2010 (link). Here is the abstract of their article:
Abstract Transport networks are ubiquitous in both social and biological systems. Robust network performance involves a complex trade-off involving cost, transport efficiency, and fault tolerance. Biological networks have been honed by many cycles of evolutionary selection pressure and are likely to yield reasonable solutions to such combinatorial optimization problems. Furthermore, they develop without centralized control and may represent a readily scalable solution for growing networks in general. We show that the slime mold Physarum polycephalum forms networks with comparable efficiency, fault tolerance, and cost to those of real-world infrastructure networks—in this case, the Tokyo rail system. The core mechanisms needed for adaptive network formation can be captured in a biologically inspired mathematical model that may be useful to guide network construction in other domains.Their conclusion is this:
Overall, we conclude that the Physarum networks showed characteristics similar to those of the [Japanese] rail network in terms of cost, transport efficiency, and fault tolerance. However, the Physarum networks self-organized without centralized control or explicit global information by a process of selective reinforcement of preferred routes and simultaneous removal of redundant connections. (441)They attempt to uncover the mechanism through which this selective reinforcement of routes takes place, using a simulation "based on feedback loops between the thickness of each tube and internal protoplasmic flow in which high rates of streaming stimulate an increase in tube diameter, whereas tubes tend to decline at low flow rates" (441). The simulation is successful in approximately reproducing the observable dynamics of evolution of the slime mold networks. Here is their summary of the simulation:
Our biologically inspired mathematical model can capture the basic dynamics of network adaptability through iteration of local rules and produces solutions with properties comparable or better than those real-world infrastructure networks. Furthermore, the model has a number of tunable parameters that allow adjustment of the benefit-cost ratio to increase specific features, such as fault tolerance or transport efficiency, while keeping costs low. Such a model may provide a useful starting point to improve routing protocols and topology control for self-organized networks such as remote sensor arrays, mobile ad hoc networks, or wireless mesh networks. (442)Here is a summary description of what we might describe as the "spatial problem-solving abilities" of the slime mold based on this research by Katherine Harman in a Scientific American blog post (link):
Like the humans behind a constructed network, the organism is interested in saving costs while maximizing utility. In fact, the researchers wrote that this slimy single-celled amoeboid can "find the shortest path through a maze or connect different arrays of food sources in an efficient manner with low total length yet short average minimum distances between pairs of food sources, with a high degree of fault tolerance to accidental disconnection"—and all without the benefit of "centralized control or explicit global information." In other words, it can build highly efficient connective networks without the help of a planning board.This research has several noteworthy features. First, it seems to provide a satisfactory account of the mechanism through which slime mold "network design intelligence" is achieved. Second, the explanation depends only on locally embodied responses at the local level, without needing to appeal to any sort of central coordination or calculation. The process is entirely myopic and locally embodied, and the "global intelligence" of the colony is entirely generated by the locally embodied action states of the individual mold cells. And finally, the simulation appears to offer resources for solving real problems of network design, without the trouble of sending out a swarm of slime mold colonies to work out the most efficient array of connectors.
We might summarize this level of slime-mold intelligence as being captured by:
- trial-and-error extension of lines of exploration
- localized feedback on results of a given line leading to increase/decrease of the volume of that line
I've been tempted to offer the example of slime mold intelligence as a description of several important social processes apparently involving collective intentionality: corporate behavior and discovery of pharmaceuticals (link) and the aggregate behavior of large government agencies (link).
On pharmaceutical companies:
So here's the question for consideration here: what if we attempted to model the system of population, disease, and the pharmaceutical industry by representing pharma and its multiple research and discovery units as the slime organism and the disease space as a set of disease populations with different profitability characteristics? Would we see a major concentration of pharma slime around a few high-frequency, high profit disease-drug pairs? Would we see substantial under-investment of pharma slime on low frequency low profit "orphan" disease populations? And would we see hyper-concentrations around diseases whose incidence is responsive to marketing and diagnostic standards? (link)On the "intelligence" of firms and agencies:
But it is perfectly plain that the behavior of functional units within agencies are only loosely controlled by the will of the executive. This does not mean that executives have no control over the activities and priorities of subordinate units. But it does reflect a simple and unavoidable fact about large organizations. An organization is more like a slime mold than it is like a control algorithm in a factory. (link)In each instance the analogy works best when we emphasize the relative weakness of central strategic control (executives) and the solution-seeking activities of local units. But of course there is a substantial degree of executive involvement in both private and public organizations -- not fully effective, not algorithmic, but present nonetheless. So the analogy is imperfect. It might be more accurate to say that the behavior of large complex organizations incorporates both imperfect central executive control and the activities of local units with myopic search capabilities coupled with feedback mechanisms. The resulting behavior of such a system will not look at all like the idealized business-school model of "fully implemented rational business plans", but it will also not look like a purely localized resource-maximizing network of activities.
******
Here is a very interesting set of course notes in which Prof. Donglei Du from the University of New Brunswick sets the terms for a computational and heuristic solution to a similar set of logistics problems. Du asks his students to consider the optimal locations of warehouses to supply retailers in multiple locations; link. Here is how Du formulates the problem:
* Assuming that plants and retailer locations are fixed, we concentrate on the following strategic decisions in terms of warehouses.
- Pick the optimal number, location, and size of warehouses
- Determine optimal sourcing strategy
- Which plant/vendor should produce which product
- Determine best distribution channels
- Which warehouses should service which retailers
- Production/ purchasing costs
- Inventory carrying costs, and facility costs (handling and fixed costs)
- Transportation costs
Even though this example looks rather similar to the rail system example above, it is difficult to see how it might be modeled using a slime mold colony. The challenge seems to be that the optimization problem here is the question of placement of nodes (warehouses) rather than placement of routes (tubules).
Saturday, December 28, 2019
High-reliability organizations
Charles Perrow takes a particularly negative view of the possibility of safe management of high-risk technologies in Normal Accidents: Living with High-Risk Technologies. His summary of the Three Mile Island accident is illustrative: “The system caused the accident, not the operators” (12). Perrow’s account of TMI is chiefly an account of complex and tightly-coupled system processes, and the difficulty these processes create for operators and managers when they go wrong. And he is doubtful that the industry can safely manage its nuclear plants.
It is interesting to note that systems engineer and safety expert Nancy Leveson addresses the same features of “system accidents” that Perrow addresses, but with a greater level of confidence about the possibility of creating engineering and organizational enhancements. A recent expression of her theory of technology safety is provided in Engineering a Safer World: Systems Thinking Applied to Safety (Engineering Systems) and Resilience Engineering: Concepts and Precepts.
In examining the safety of high-risk industries, our goal should be to identify some of the behavioral, organizational, and regulatory dysfunctions that increase the likelihood and severity of accidents, and to consider organizational and behavioral changes that would serve to reduce the risk and severity of accidents. This is the approach taken by a group of organizational theorists, engineers, and safety experts who explore the idea and practice of a “high reliability organization”. Scott Sagan describes the HRO approach in these terms in The Limits of Safety:
The common assumption of the high reliability theorists is not a naive belief in the ability of human beings to behave with perfect rationality, it is the much more plausible belief that organizations, properly designed and managed, can compensate for well-known human frailties and can therefore be significantly more rational and effective than can individuals. (Sagan, 16)Sagan lists several conclusions advanced by HRO theorists, based on a small number of studies of high-risk organizational environments. Researchers have identified a set of organizational features that appear to be common among HROs:
- Leadership safety objectives: priority on avoiding altogether serious operational failures
- Organizational leaders must place high priority on safety in order to communicate this objective clearly and consistently to the rest of the organization
- The need for redundancy. Multiple and independent channels of communication, decision-making, and implementation can produce a highly reliable overall system
- Decentralization -- authority must exist in order to permit rapid and appropriate responses to dangers by individuals closest to the problems
- culture – recruit individuals who help maintain a strong organizational culture emphasizing safety and reliability
- continuity – maintain continuous operations, vigilance, and training
- organizational learning – learn from prior accidents and near-misses.
- Improve the use of simulation and imagination of failure scenarios
The genuinely important question here is whether there are indeed organizational arrangements, design principles, and behavioral practices that are consistently effective in significantly reducing the incidence and harmfulness of accidents in high-risk enterprises, or whether on the other hand, the ideal of a "High Reliability Organization" is more chimera than reality.
A respected organizational theorist who has written on high-reliability organizations and practices extensively is Karl Weick. He and Kathleen Sutcliffe attempt to draw some useable maxims for high reliability in Managing the Unexpected: Sustained Performance in a Complex World. They use several examples of real-world business failures to illustrate their central recommendations, including an in-depth case study of the Washington Mutual financial collapse in 2008.
The chief recommendations of their book come down to five maxims for enhancing reliability:
- Pay attention to weak signals of unexpected events
- Avoid extreme simplification
- Pay close attention to operations
- Maintain a commitment to resilience
- Defer to expertise
Maxim 2 addresses the common cognitive mistake of subsuming unusual or unexpected outcomes under more common and harmless categories. Managers should be reluctant to accept simplifications. The Columbia space shuttle disaster seems to fall in this category, where senior NASA managers dismissed evidence of foam strike during lift-off by subsuming it under many earlier instances of debris strikes.
Maxim 3 addresses the organizational failure associated with distant management -- top executives who are highly "hands-off" in their knowledge and actions with regard to ongoing operations of the business. (The current Boeing story seems to illustrate this failure; even the decision to move the corporate headquarters to Chicago, very distant from the engineering and manufacturing facilities in Seattle, illustrates a hands-off attitude towards operations.) Executives who look at their work as "the big picture" rather than ensuring high-quality activity within the actual operations of the organization are likely to oversee disaster at some point.
Maxim 4 is both cognitive and organizational. "Resilience" refers to the "ability of an organization (system) to maintain or regain a dynamically stable state, which allows it to continue operations after a major mishap and/ or in the presence of a continuous stress". A resilient organization is one where process design has been carried out in order to avoid single-point failures, where resources and tools are available to address possible "off-design" failures, and where the interruption of one series of activities (electrical power) does not completely block another vital series of activities (flow of cooling water). A resilient team is one in which multiple capable individuals are ready to work together to solve problems, sometimes in novel ways, to ameliorate the consequences of unexpected failure.
Maxim 5 emphasizes the point that complex activities and processes need to be managed by teams incorporating experience, knowledge, and creativity in order to be able to confront and surmount unexpected failures. Weick and Sutcliffe give telling examples of instances where key expertise was lost at the frontline level through attrition or employee discouragement, and where senior executives substituted their judgment for the recommendations of more expert subordinates.
These maxims involve a substantial dose of cognitive practice, changing the way that employees, managers, and executives think: the importance of paying attention to signs of unexpected outcomes (pumps that repeatedly fail in a refinery), learning from near-misses, making full use of the expertise of members of the organization, .... It is also possible to see how various organizations could be evaluated in terms of their performance on these five maxims -- before a serious failure has occurred -- and could improve performance accordingly.
It is interesting to observe, however, that Weick and Sutcliffe do not highlight some factors that have been given strong priority in other treatments of high-reliability organizations: the importance of establishing a high priority for system safety in the highest management levels of the organization (which unavoidably competes with cost and profit pressures), the organizational feature of an empowered safety executive outside the scope of production and business executives in the organization, the possible benefits of a somewhat decentralized system of control, the possible benefits of redundancy, the importance of well-designed training aimed at enhancing system safety as well as personal safety, and the importance of creating a culture of honesty and compliance when it comes to safety. When mid-level managers are discouraged from bringing forward their concerns about the "signals" they perceive in their areas, this is a pre-catastrophe situation.
There is a place in the management literature for a handbook of research on high-reliability organizations; at present, such a resource does not exist.
(See also Sagan and Blanford's volume Learning from a Disaster: Improving Nuclear Safety and Security after Fukushima.)
Saturday, November 23, 2019
Organizations as open systems
Key to understanding the "ontology of government" is the empirical and theoretical challenge of understanding how organizations work. The activities of government encompass organizations across a wide range of scales, from the local office of the Department of Motor Vehicles (40 employees) to the Department of Defense (861,000 civilian employees). Having the best understanding possible of how organizations work and fail is crucial to understanding the workings of government.
I have given substantial attention to the theory of strategic action fields as a basis for understanding organizations in previous posts (link, link). The basic idea in that approach is that organizations are a bit like social movements, with active coalition-building, conflicting goals, and strategic jockeying making up much of the substantive behavior of the organization. It is significant that organizational theory as a field has moved in this direction in the past fifteen years or so as well. A good example is Scott and Davis, Organizations and Organizing: Rational, Natural and Open System Perspectives (2007). Their book is intended as a "state of the art" textbook in the field of organizational studies. And the title expresses some of the shifts that have taken place in the field since the work of March, Simon, and Perrow (link, link). The word "organizing" in the title signals the idea that organizations are no longer looked at as static structures within which actors carry out well defined roles; but are instead dynamic processes in which active efforts by leaders, managers, and employees define goals and strategies and work to carry them out. And the "open system" phrase highlights the point that organizations always exist and function within a broader environment -- political constraints, economic forces, public opinion, technological innovation, other organizations, and today climate change and environmental disaster.
Organizations themselves exist only as a complex set of social processes, some of which reproduce existing modes of behavior and others that serve to challenge, undermine, contradict, and transform current routines. Individual actors are constrained by, make use of, and modify existing structures. (20)
Most analysts have conceived of organizations as social structures created by individuals to support the collaborative pursuit of specified goals. Given this conception, all organizations confront a number of common problems: all must define (and redefine) their objectives; all must induce participants to contribute services; all must control and coordinate these contributions; resources must be garnered from the environment and products or services dispensed; participants must be selected, trained, and replaced; and some sort of working accommodation with the neighbors must be achieved. (23)Scott and Davis analyze the field of organizational studies in several dimensions: sector (for-profit, public, non-profit), levels of analysis (social psychological level, organizational level, ecological level), and theoretical perspective. They emphasize several key "ontological" elements that any theory of organizations needs to address: the environment in which an organization functions; the strategy and goals of the organization and its powerful actors; the features of work and technology chosen by the organization; the features of formal organization that have been codified (human resources, job design, organizational structure); the elements of "informal organization" that exist in the entity (culture, social networks); and the people of the organization.
They describe three theoretical frameworks through which organizational theories have attempted to approach the empirical analysis of organizations. First, the rational framework:
Organizations are collectivities oriented to the pursuit of relatively specific goals. They are "purposeful" in the sense that the activities and interactions of participants are coordinated to achieve specified goals..... Organizations are collectivities that exhibit a relatively high degree of formalization. The cooperation among participants is "conscious" and "deliberate"; the structure of relations is made explicit. (38)
From the rational system perspective, organizations are instruments designed to attain specified goals. How blunt or fine an instrument they are depends on many factors that are summarized by the concept of rationality of structure. The term rationality in this context is used in the narrow sense of technical or functional rationality (Mannheim, 1950 trans.: 53) and refers to the extent to which a series of actions is organized in such a way as to lead to predetermined goals with maximum efficiency. (45)
Organizations are collectivities whose participants are pursuing multiple interests, both disparate and common, but who recognize the value of perpetuating the organization as an important resource. The natural system view emphasizes the common attributes that organizations share with all social collectivities. (39)
Organizational goals and their relation to the behavior of participants are much more problematic for the natural than the rational system theorist. This is largely because natural system analysts pay more attention to behavior and hence worry more about the complex interconnections between the normative and the behavioral structures of organizations. Two general themes characterize their views of organizational goals. First, there is frequently a disparity between the stated and the “real” goals pursued by organizations—between the professed or official goals that are announced and the actual or operative goals that can be observed to govern the activities of participants. Second, natural system analysts emphasize that even when the stated goals are actually being pursued, they are never the only goals governing participants’ behavior. They point out that all organizations must pursue support or “maintenance” goals in addition to their output goals (Gross, 1968; Perrow, 1970:135). No organization can devote its full resources to producing products or services; each must expend energies maintaining itself. (67)And the "open-system" definition:
From the open system perspective, environments shape, support, and infiltrate organizations. Connections with "external" elements can be more critical than those among "internal" components; indeed, for many functions the distinction between organization and environment is revealed to be shifting, ambiguous, and arbitrary.... Organizations are congeries of interdependent flows and activities linking shifting coalitions of participants embedded in wider material-resource and institutional environments. (40)(Note that the natural-system and "open-system" definitions are very consistent with the strategic-action-field approach.)
Here is a useful table provided by Scott and Davis to illustrate the three approaches to organizational studies:
An important characteristic of recent organizational theory has to do with the way that theorists think about the actors within organizations. Instead of looking at individual behavior within an organization as being fundamentally rational and goal-directed, primarily responsive to incentives and punishments, organizational theorists have come to pay more attention to the non-rational components of organizational behavior -- values, cultural affinities, cognitive frameworks and expectations.
This emphasis on culture and mental frameworks leads to another important shift of emphasis in next-generation ideas about organizations, involving an emphasis on informal practices, norms, and behaviors that exist within organizations. Rather than looking at an organization as a rational structure implementing mission and strategy, contemporary organization theory confirms the idea that informal practices, norms, and cultural expectations are ineliminable parts of organizational behavior. Here is a good description of the concept of culture provided by Scott and Davis in the context of organizations:
Culture describes the pattern of values, beliefs, and expectations more or less shared by the organization’s members. Schein (1992) analyzes culture in terms of underlying assumptions about the organization’s relationship to its environment (that is, what business are we in, and why); the nature of reality and truth (how do we decide which interpretations of information and events are correct, and how do we make decisions); the nature of human nature (are people basically lazy or industrious, fixed or malleable); the nature of human activity (what are the “right” things to do, and what is the best way to influence human action); and the nature of human relationships (should people relate as competitors or cooperators, individualists or collaborators). These components hang together as a more-or-less coherent theory that guides the organization’s more formalized policies and strategies. Of course, the extent to which these elements are “shared” or even coherent within a culture is likely to be highly contentious (see Martin, 2002)—there can be subcultures and even countercultures within an organization. (33)Also of interest is Scott's earlier book Institutions and Organizations: Ideas, Interests, and Identities, which first appeared in 1995 and is now in its 4th edition (2014). Scott looks at organizations as a particular kind of institution, with differentiating characteristics but commonalities as well. The IBM Corporation is an organization; the practice of youth soccer in the United States is an institution; but both have features in common. In some contexts, however, he appears to distinguish between institutions and organizations, with institutions constituting the larger normative, regulative, and opportunity-creating environment within which organizations emerge.
Scott opens with a series of crucial questions about organizations -- questions for which we need answers if we want to know how organizations work, what confers stability upon them, and why and how they change. Out of a long list of questions, these seem particularly important for our purposes here: "How are we to regard behavior in organizational settings? Does it reflect the pursuit of rational interests and the exercise of conscious choice, or is it primarily shaped by conventions, routines, and habits?" "Why do individuals and organizations conform to institutions? Is it because they are rewarded for doing so, because they believe they are morally obligated to obey, or because they can conceive of no other way of behaving?" "Why is the behavior of organizational participants often observed to depart from the formal rules and stated goals of the organization?" "Do control systems function only when they are associated with incentives ... or are other processes sometimes at work?" "How do differences in cultural beliefs shape the nature and operation of organizations?" (Introduction).
Scott and Davis's work is of particular interest here because it supports analysis of a key question I've pursued over the past year: how does government work, and what ontological assumptions do we need to make in order to better understand the successes and failures of government action? What I have called organizational dysfunction in earlier posts (link, link) finds a very comfortable home in the theoretical spaces created by the intellectual frameworks of organizational studies described by Scott and Davis.
Saturday, May 25, 2019
The 737 MAX disaster as an organizational failure
The topic of the organizational causes of technology failure comes up frequently in Understanding Society. The tragic crashes of two Boeing 737 MAX aircraft in the past year present an important case to study. Is this an instance of pilot error (as has occasionally been suggested)? Is it a case of engineering and design failures? Or are there important corporate and regulatory failures that created the environment in which the accidents occurred, as the public record seems to suggest?
The formal accident investigations are not yet complete, and the FAA and other air safety agencies around the world have not yet approved the aircraft for flight following the suspension of certification following the second crash. There will certainly be a detailed and expert case study of this case at some point in the future, and I will be eager to read the resulting book. In the meantime, though, it is useful to bring the perspectives of Charles Perrow, Diane Vaughan, and Andrew Hopkins to bear on what we can learn about this case from the public media sources that are available. The preliminary sketch of a case study offered below is a first effort and is intended simply to help us learn more about the social and organizational processes that govern the complex technologies upon which we depend. Many of the dysfunctions identified in the safety literature appear to have had a role in this disaster.
I have made every effort to offer an accurate summary based on publicly available sources, but readers should bear in mind that it is a preliminary effort.
The key conclusions I've been led to include these:
The updated flight control system of the aircraft (MCAS) created the conditions for crashes in rare flight conditions and instrument failures.
- Faults in the AOA sensor and the MCAS flight control system persisted through the design process
- pilot training and information about changes in the flight control system were likely inadequate to permit pilots to override the control system when necessary
- Disempowered mid-level experts (engineers, designers, software experts)
- Inadequate organizational embodiment of safety oversight
- Business priorities placing cost savings, timeliness, profits over safety
- Executives with divided incentives
- Breakdown of internal management controls leading to faulty manufacturing processes
- Inadequate government regulation
- FAA lacked direct expertise and oversight sufficient to detect design failures.
- Too much influence by the company over regulators and legislators









