JOHN WILCOX
  • Home
  • Curriculum Vitae
  • Teaching
    • Teaching Methods
    • Philosophy of Science
    • Ethics in a Human Life
    • Epistemology & Probability
    • Logic
    • Applied Research Methods
    • Teaching Evaluations
  • John's Blog

John's Blog

A project for Stanford affiliates: Education and impact

7/14/2020

1 Comment

 

The TL;DR key points

  • Presumably we'd all like to live lives that make a positive impact on the world 
  • Education is a uniquely powerful tool for making an impact: it can make changemakers
  • On some toy models, the impact of education drastically outperforms the impact of other approaches to making a positive impact
  • We do not know how realistic those models are, but it is worth exploring the potential of education
  • That is the purpose of this project, and everyone is welcome to participate how they see fit

​Making an impact: Why you should care about it

Imagine that you’re 80 years old, looking back on your life and all the things you have accomplished. What would you like to see? Perhaps you’d like to see that you had a happy life, a family and success in some line of work.

But I suspect you’d also like to see that you had made a positive impact in some way: that somehow others benefited from your existence. After all, when we step back to consider the question, what beauty is there in a life lived only in pursuit of one’s selfish ends? Presumably, then, this has implications for now: presumably we’d like to make a positive impact while we still can.

And given that the world faces a diversity of challenges, such an impact is desperately needed.  But where do we start?

We all know about two high-profile challenges: the coronavirus and racial injustice. So maybe we could start there.

Or how about healthcare? Shane Boyle, for example, died after he couldn’t raise just another $50 to fund his diabetes medication. He is not alone. One study estimated that as many as 44,789 Americans died because they could not afford medication in 2005. Meanwhile,  drug companies have been rising prices to maximize profit, the most notable example being an increase of one important medication from $13.50 to $750 a pill.

So healthcare is one challenge, but what about poverty in general? One study claimed that in 2000, approximately 133,000 deaths were attributable to poverty afflicting individuals in the United States.

Or what about mental health? Over 45 million Americans are experiencing mental illness, about 20% of the population. Over 10.3 million have suicidal thoughts, while over 48,000 people died by suicide in 2018.

Or what about the myriad other extremely important challenges facing the world? Climate change? The pervasive sexual harassment and mistreatment of women? International conflicts costing millions of people their lives? Environmental pollution? The extinction of species at accelerating rates? Corruption? Homophobia? The myriad specific diseases out there? 

Believe it or not: the point is not to depress or overwhelm you. Instead, the point is that if we consider all these problems, one thing is clear: you cannot directly address them all, but they are all extremely important—and their importance cannot be overstated.
​

Being a changemaker and making changemakers

But how does one go about making change in world of so many challenges?

One option is to be a changemaker: to focus on one or a handful of issues, hopefully making some progress on them. Of course, this is both necessary and extremely praiseworthy.

But another option is make changemakers: to empower growing numbers of people with the motivation and competence to make a positive impact.

The difference is between solving problems and creating problem solvers. It’s like giving a man a fish and teaching a man to fish—focusing on long-term solutions with potentially greater payoffs and impact.

We could visualize this more concretely with a illustrative model. Suppose there’s 5 people considering how they can make an impact over a 15-year period. They have two options: they can either be changemakers or they can make changemakers.

Let us make some assumptions about the impact which they can have with each option. Of course, these assumptions are over-simplifications, but they potentially illustrate an important truth which I'll touch on later. Here are the assumptions:
  • It takes 5 changemakers 5 years to solve one problem—such as environmental pollution in San Mateo
  • 5 people can create an educational program that:
    1. Effectively creates 100 changemakers after its first 5 years
    2. Expands its capacity by a factor of 10 every 5 years after that (so it makes 100 after 5 years, 1000 after 10 years, 10,000 after 15 years)

If we make these assumptions, then we can plot how much impact those 5 people would have when they are changemakers versus when they make changemakers. Here's a 15 year projection:
Picture
We can see how both approaches differ in their impacts.

The "make changemakers" approach doesn't see a big impact quickly. It takes 5 years to effectively educate 100 changemakers, and then it takes those changemakers another 5 years to solve one problem in groups.
However, it makes an attractive impact after 15 years. 20 problems are solved when making changemakers whereas only 3 problems are solved when being changemakers.

But really, the most pronounced difference is what happens after 25 years:
Picture
If the two approaches conform to the above assumptions, then the "making changemakers" approach has solved 2,720 problems after 25 years, while the "being changemakers" approach has solved 5.  

​
Of course, the natural reaction to this graph is to question how realistic the assumptions are, especially since they're undoubtedly over-simplifications. (Actually, you can play with the assumptions in this spreadsheet yourself if you like.)

The purpose of this graph, however, is not to have precisely accurate assumptions—something which I suspect is neither possible nor desirable at this stage. Instead, it's to make two points.

First, there may very well be some kind of relationship like this, where education generates vastly greater payoffs over the long-term. As my collaborators Will Roderick and Jake McKinnon point out, even making just one other effective changemaker increases your impact in a big way.

Second, we do not know what the realistic assumptions are. Perhaps it is harder to educate 100 changemakers in 5 years, since it might take time to develop materials. Or perhaps it is easier to educate 100 changemakers, since we could build on existing programs and work with them. Likewise, for each of the other assumptions, there are arguments in both directions about what the more realistic replacement is.

The point is that there is much that we do not know. But the potential payoffs of this line inquiry could be tremendous—incomparable even. 

While we don't want to jump to conclusions about what is possible, we also wouldn't want to jump to conclusions about what is impossible. Who could have anticipated the impact of the internet or of mobile phones for example? Could an effective education program likewise change the world in hard to fathom ways? Who knows. But it seems to me to be worth exploring--and with an open mind.
​

The project: Some questions for exploration

So the aim is to explore the potential of education, guided by the idea that it might play an incomparably important role in social transformation. What questions need to be asked in exploring this topic, then? Well, perhaps we could group them under several categories.

​There's questions about existing programs and possibilities:
  • What educational programs are already trying to make changemakers, and what are their strengths and weaknesses?
  • Can we contribute to their programs, or should we design other programs?
  • What societal constraints are there in pursuing such a program?

Then there's questions about the design of programs:
  • What does it take to motivate people to be changemakers?
  • Assuming that people are motivated to make a change, how can they competently do that?
  • What follow up protocols and institutions can accompany changemakers in their efforts?

Then there's also questions about how the project runs:
  • What qualities does one need to be an effective researcher?
  • What qualities does a team need in order to cooperate and work effectively?

And we also have more logistical and practical questions about the project's immediate operations:
  • Who is potentially interested in being involved?
  • Does our project require funding, and if so, how can we get it?

To some extent, the current collaborators have explored these questions already, some of us in papers we've written and others through our experience in organizations. But the purpose of the project is to further explore these questions to probe the potential of education.
​

What does participation look like?

Assuming one is interested in the project, what could participation involve? Here's my initial response: anything ranging from "not much" to "lots"—it depends on the interests and availability of the person.

At the "not much" side of the spectrum, even coming to a Zoom chat occasionally to listen to ideas and share opinions can be valuable. Often, everyone has something valuable to contribute, and we wouldn't want to preclude their participation, especially if they find the ideas interesting.

At the "lots" side of the spectrum, someone may wish to take this on as a full-time job, applying for grants and pursuing this research as it interests them.

Then, there are various mediums between these extremes. For example, someone might like to:
  • Write something for the project, like a blog post or a paper addressing one of the questions
  • Help make applications for funding, or find others who are interested
  • Collaborate on  bigger projects in the future, such as designing or refining curricula

Really, it depends on the individual, but the important point is that anything helps and is welcome—but without further expectations.
​

Who could participate in the project?

Of course, the project touches on many questions from various fields: education, management, psychology and philosophy—to name a few. But not everyone has a background in these things. So who could participate?

Here's my suggestion: everyone who is willing and able—but in a sense which I will soon describe.

The rationale for this is twofold.

First, a growing body of research suggests that background expertise, while useful, is not necessary to be proficient in particular domains. The most striking example of this comes from four decades of research into geopolitical forecasting. There, thousands of people make predictions about future events—like the outcomes of elections, wars, pandemic and economic events.

One of the most startling findings of the program was that typical indicators of competence actually didn't correlate with success: it made no difference whether one had a PhD, many years of experience or even a full-time profession giving their opinions to the media or important organizations (Tetlock, 2005). In fact, many "experts" on political matters turned out to not be that good.

However, others were remarkably good at predicting the future—in fact, they even outperformed intelligence analysts with classified information and indeed any other prediction mechanism that we know of (Tetlock & Gardner, 2015). These people—the "superforecasters", as they're called—often came to questions with no strong background knowledge: they might have to make predictions about the "UNHCR" without even knowing what that is at first. But the point is they even if they don't know a lot, they would learn a lot--and they're impressively good at what they do. 

Furthermore, the research shows various things can make people good (Chang et al., 2017; Haran et al., 2013; Mellers et al., 2014, 2015; Tetlock & Gardner, 2015). These things include:
  • Working in teams
  • Being accountable for the outcomes of one's judgments, as well as the processes by which they produce them
  • Strong motivation in doing well at what they do
  • Focusing their efforts  on topics which they can make progress on
  • Being an "actively open-minded" thinker"—that is, going out of one's way to get more information, to find evidence against one's opinions and to take into account the opinions of others
  • Acquiring subject-specific knowledge
  • Reflecting on their past efforts—especially the strengths, weaknesses and lessons to be learned

So when I say "willing and able", I mean everyone who is seriously willing to develop these qualities. The research suggests all these things make one a better forecaster. But upon reflection, it seems clear that they could make one better in many domains which they apply themselves to. 

My point is that what's most important is not so much the expertise which people have, but rather whether they have the qualities that could predict future success across many domains. 

My second reason for thinking that everyone can get involved is that others have successfully worked in areas that were not always their own. This is true in education: FUNDAEC has successfully implemented education programs across Latin America, for instance, despite being championed primarily by a physicist and a mathematician. But this is also true in areas outside of education as well: Jeff Bezos was just a smart Princeton graduate in electrical engineering and computer science, but he did remarkably well in turning a book company into the world's most profitable business.

What, then, could a group of Stanford graduates accomplish?

If you're interested in the project, don't hesitate to contact John at wilcoxje@stanford.edu.
​

References

  • Chang, W., Atanasov, P., Patil, S., Mellers, B. A., & Tetlock, P. E. (2017). Accountability and adaptive performance under uncertainty: A long-term view. In Judgment and Decision Making (Vol. 12, Issue 6).
  • Haran, U., Ritov, I., & Mellers, B. (2013). The Role of Actively Open-Minded Thinking in Information Acquisition, Accuracy, and Calibration. Judgment and Decision Making. https://repository.upenn.edu/marketing_papers/413
  • Mellers, B., Stone, E., Atanasov, P., Rohrbaugh, N., Metz, S. E., Ungar, L., Bishop, M. M., Horowitz, M., Merkle, E., & Tetlock, P. (2015). The psychology of intelligence analysis: Drivers of prediction accuracy in world politics. Journal of Experimental Psychology: Applied, 21(1), 1–14. https://doi.org/10.1037/xap0000040
  • Mellers, B., Ungar, L., Baron, J., Ramos, J., Gurcay, B., Fincher, K., Scott, S. E., Moore, D., Atanasov, P., Swift, S. A., Murray, T., Stone, E., & Tetlock, P. E. (2014). Psychological Strategies for Winning a Geopolitical Forecasting Tournament. Psychological Science, 25(5), 1106–1115. https://doi.org/10.1177/0956797614524255
  • Tetlock, P. (2005). Expert political judgment: how good is it? How can we know? Princeton University Press.
  • Tetlock, P., & Gardner, D. (2015). Superforecasting: the art and science of prediction. Broadway Books. https://doi.org/doi:10.1201/b15410-25
1 Comment
Patricia Wilcox
11/23/2022 01:27:36 pm

Love this.

Reply



Leave a Reply.

    Author

    John Wilcox

    Interdisciplinary researcher
    @ Stanford University
    @ fp21

    Archives

    January 2023
    November 2021
    May 2021
    July 2020

    Categories

    All
    Education
    Heuristics And Biases
    Philosophy Of Science
    Probability And Statistics
    Social Transformation

    RSS Feed

  • Home
  • Curriculum Vitae
  • Teaching
    • Teaching Methods
    • Philosophy of Science
    • Ethics in a Human Life
    • Epistemology & Probability
    • Logic
    • Applied Research Methods
    • Teaching Evaluations
  • John's Blog