Monthly Archives: May 2016

tracking change in a group that discusses issues

Colleagues and I just ran a mini-experiment in which students at two very different universities held online discussions of the same controversial current issues. Before and after each discussion, we surveyed them to ascertain their social networks within their own class. We assumed that a group of people who discuss issues exhibit three layers of network ties that can change over time:

  1. Social networks: affective ties among the people, defined by friendship or respect.
  2. Networks of direct address: When person A asks person B a question or endorses B’s view, that creates a tie, and many ties create a network.
  3. Semantic (or epistemic) networks: Ideas connected by explanations. For instance, if A says that racism causes unequal health outcomes, then A has connected two ideas.

I am interested in tracking the relationships among these networks, because some patterns seem more desirable than others, and it would be useful to recognize the differences. For example, if people who are popular in social networks receive most of the direct addresses and determine the group’s epistemic network, then the discussion looks like a popularity contest. But if a new idea causes people to revise their opinions of whose views should be respected, that is evidence of learning.

Here is a small illustrative finding from the data so far. Below I show the trajectory of two particular students within the Tufts University discussion thread. Both started off as somewhat less central than average in the class’s social network. At the start of the experiment, Tufts 06 was mentioned by three fellow students as a friend or an influencer, and Tufts09 got one mention. (Below I show the percentage of all mentions, to control for differences in the amount of text at each phase.)

Screen Shot 2016-05-15 at 12.11.56 PM

In the second discussion, which concerned the social determinants of health, Tufts09 posted the very first comment. She wrote, “the presentation given by Dr. [F.] was one of the best presentations given on social determinants of health that I have seen. … As a woman of black decent, I have taken these discussions and this knowledge very seriously, and I now view life with a completely different perspective. … When talking about the Flint, Michigan water crisis, it was shocking to hear that companies … are often built where the majority of the community is minority and low income. This infuriated me.”

Her comment was explicitly referred to by five other students and set the agenda for the whole discussion thread. When next surveyed, four students counted her as someone who had influenced them, up from one at the pretest. The number of mentions fell, however, to two at the end of the experiment.

It appears, then, that by making a forceful comment to start an online discussion—drawing on her own identity—Tufts09 may have gained social capital for a week or so. On the other hand, she did not need social capital before the second discussion to be influential in it.

Tufts 06 was the first to post in the the third conversation, writing: “As someone who has suffered from anxiety and depression, the topic of mental health stigma is incredibly important to me. In my family, nearly everyone on my mother’s side is on medication for anxiety, depression, OCD, or some combination of the three. We have had three suicides in our family (all before I was born) just because the treatments and attitudes toward mental health were not sufficient at the time those family members were suffering through their diseases.”

She received six mentions in the discussion thread, and in the subsequent survey, six students named her as influential (up from 3 at pretest). Again, she seemed to raise her social capital by making an influential point in the online dialog.

These are just two little anecdotes, and much remains to be explored. For instance: How typical is this kind of trajectory? Even in these two cases, did participation in the online discussion really cause social capital to rise? (The effect could be random or driven by some other factor.) And if these students were influential, was it because of what they argued, how they drew on their personal backgrounds, or simply the fact that they each posted first on the discussion thread?

reinventing the high school government course

One of the most exciting current efforts in civic education–which also has applications far beyond civics–is a project on reinventing the high school civics course led by Walter Parker with Jane Lo and others.

Typically, a civics course involves presenting and explaining a whole lot of material to students, who then face a test to see what they have understood and remembered. Walter has noted that, all around the world, the final-year of high school tends to be dominated by courses that are fast-paced surveys of information, known for being difficult mainly because they cover so much ground. It doesn’t seem likely that students obtain advanced skills or remember much of the content from these classes.

Walter and his colleagues worked with teachers of the American Government AP course to redesign it so that projects become fundamental. The redesign process was a collaboration with the teachers and involved iteration: trying projects, evaluating, and changing the design. In the fully redesigned courses, activities–such as a mock trial, or a model Congress–come first, and students learn the content that is tested on the AP because they need to know it in order to succeed in the projects. As Parker and Lo write in a very valuable new overview article, “Projects carry the full subject matter load of the course. They are not culminating activities that come at the end of an instructional sequence nor lively interludes inserted periodically into traditional recitation.”

As reported in earlier articles, students in the redesigned AP course “did as well or better on the AP test than students in comparison groups, and … found the course and projects personally meaningful.” That means that there is no tradeoff between learning to be an active citizen by participating in simulations and mastering the content tested by the AP. If teachers use this redesigned curriculum, they can achieve both outcomes together.

three cores of contemporary social science

At the risk of annoyingly oversimplifying and omitting important exceptions,* I’d propose that three major efforts drive most of social science today:

1. Causal explanations of concrete human behaviors

People buy commodities at a given price, or vote for a given candidate, or even die at a given age. To explain why, social scientists often use either statistical models or controlled experiments. These two methods are conceptually related, because one interpretation of a regression model is that it mimics the results of an experiment.

Regression models are used across the social sciences, including such applied social sciences such as business and education. Economics is the discipline that historically has had the most influence on these methods, because economists tend to be good at math, the discipline is large and influential, and lots of concrete data on economic behavior is available. However, economists increasingly study all kinds of behavior that have nothing to do with money, and some sophisticated techniques for these purposes originate in other disciplines. For instance, education researchers developed Hierarchical Linear Modeling because they so often encounter individuals nested in classrooms, nested in schools, nested in communities. HLM is now used in other contexts as well.

2. Detection of unobserved psychological factors

Some important human characteristics are not concrete behaviors and are not directly observable. For instance, you can’t tell how much a teenager knows about US history by just looking at her. You can give her a 100-item test and compute a knowledge score from her answers, but much science and art goes into designing the test and interpreting the data. The same is true of emotional states, character traits, etc.

Once you have valid and reliable measures of such inner psychological states, you can put them into the kinds of causal models described in #1. But it is a major task just to determine who has which inner traits. By the way, if people know and can be trusted to disclose their own inner psychological states, then all this research is unnecessary. We’d just ask people whether they know US history, trust their teachers, or feel angry. An important premise is that we have unconscious or unarticulated inner lives that can be revealed better from outside. For instance, I’d find out how much US history I know by taking a test written by someone else.

Psychology–like economics, a large and influential discipline–has driven the development of these methods, but they are used across the social sciences.

3. Interpretation of purposive human activity in context

People’s behavior can (sometimes) be causally explained, but it also requires interpretation. Voting is a concrete act, but what does it mean for an American to vote in a church basement? (Note that this is not the same question as why some of our polling places are in churches. The causal explanation might have little bearing on the significance of this phenomenon.) Likewise, what are the meanings of a Balinese cockfight to the people who watch and participate–and, specifically, what does it mean when cockfighting is traditional yet illegal?

In ethnography, the emphasis is on interpretation, particularity, context, and translation rather than generalizable explanations or unconscious states. A characteristic method is to ask people what things mean to them in their most familiar settings.

Ethnography has–to me–an odd origin. Late-Victorian anthropologists wanted to turn traditionally philosophical questions about the nature of “Man” into empirical questions. They were Darwinians, so they presumed that our essential natures were evolved, clearly evident in prehistoric contexts, but obscured by subsequent cultural variation. So they visited so-called “prehistoric” communities to understand how they worked. Now most of that conceptual apparatus has been criticized. For instance, hunter-gatherer societies are in history, have often developed from other kinds of societies, and vary profoundly. But ethnographic techniques remain illuminating in all kinds of settings that no one would call “prehistoric,” including Silicon Valley office parks and even departments of anthropology. They are used across the social sciences, and they overlap with the humanities.

I haven’t mentioned a host of specific techniques or even whole disciplines, such as sociology and political science. But I’d propose that the three methodological programs described here are dominant. A field like political science takes its name from the phenomena it studies–government and politics–but it draws on, and contributes to, causal modeling, psychometrics, and ethnography. To the extent that all of these approaches make problematic assumptions (e.g., methodological individualism, or a simplistic fact/value distinction), then those assumptions are pervasive in the social sciences.

*e.g., Community Based Participatory Research, or historically-informed political theory, or research on social entities other than people.

podcast on civic education and engagement in Catholic communities

Here, starting at minute 39, is my recent conversation with Msgr. Kevin Sullivan, Executive Director of Catholic Charities, New York, on his SiriusXM Radio Show, “Just Love.” We talked about why Millennials volunteer so much (I named a combination of idealism and structured opportunities and expectations), why civic education seems to work well in Catholic schools, why the media is biased against Millennials, why Obama ’08 and Sanders ’12 drew youth support, the difference between service and social change, and the argument for expanding service opportunities.

“Explainer” on civic education

Over at The Conversation, I have a new article that’s meant to be a short overview of civic education today. It begins:

Any election demands knowledge, attention and wisdom from the whole electorate. When a campaign season does not seem to be going well, there’s often angst about whether the public has been sufficiently educated.

Anxious eyes turn to our public schools.

For instance, writing in The Atlantic recently, Jonathan Zimmerman, professor of education and history at New York University, decried the incivility of the 2016 campaign and named “a flaw with civic education.” He wrote: “Put simply, schools in the United States don’t teach the country’s future citizens how to engage respectfully across their political differences.”

I have studied and advocated civic education for almost two decades. I believe civic education must be improved in the United States. First, though, it’s important to understand the condition of America’s civic education.