Dispatches from Brookline: Home Schooling and Social Distancing III

In two previous posts (I, II), I described how my wife Nell, our two daughters and I were coping with social distancing and the closure of the public schools in Brookline, Massachusetts until at least April 3, 2020. Other than staying inside as much as possible, we converted our dining room into a functioning classroom complete with workbooks, flip charts and a very popular white board.

**********

On Friday, March 20, 2020, I came downstairs to find this in the “classroom.”

March 20

And this homage to the brilliant Netflix series Stranger Things by our 4th-grade daughter was on the always-popular white board; apparently she still retains the obsessive love of the show I instilled in her, and one I discussed last December.

Upside Down Nora

While that same daughter had something of a rough morning, our 6th-grade daughter had a terrific morning; the latter girl is genuinely enjoying her workbooks and other projects. Providing ample time for each daughter to exercise and/or FaceTime friends helps immensely as well. That said, it was our younger daughter who, in the evening, asked if we could have “school” again tomorrow (Saturday). I am certainly happy to oblige—I have a review “quiz game” I have been thinking about putting together—but Nell and I suspect her outlook will be different in the morning. Still, to the extent these “classes” are about imposing structure and routine in the era of social distancing, maybe we should do some form of group learning activity every day, including weekends.

As I noted in the first “dispatch,” I planned to teach basic politics/government for an hour and basic applied math for an hour every weekday afternoon—except Friday. To break up the monotony, I will teach a hopefully-more-entertaining form of history on Fridays.

It is no secret I am a massive film noir fan. In October 2018, I had the opportunity to teach a course titled “What Is Film Noir” through Brookline Adult and Community Education. I only had six students, and I had a series of technical glitches trying to show movie clips—using my own DVDs—using Nell’s ancient laptop, but I nonetheless immensely enjoyed those four Wednesday nights.

Our daughters have actually watched a handful of classic films noir: both girls have seen The Maltese Falcon; Murder, My Sweet; Laura; The Naked City; Strangers on a Train and Rear Window; as well as long chunks of Out of the Past. Our older daughter has also seen Double Indemnity. They each spent some time at the first-ever NOIR CITY Boston in June 2018, watching the aforementioned Murder, My Sweet and helping their father sell Film Noir Foundation merchandise; this was my “reward” for having help to set up the festival. And they have certainly heard their father talk at great length about the subject.

It thus made perfect sense when it was time for “Daddy Prepatory” yesterday afternoon for me to set up my desktop computer in the “classroom” and open the PowerPoint slides from my first class. While I basically jumped ahead to slide 22 (of 130), in which I begin to tell the history of film noir as an idea, we did linger briefly on two photographs I had used to help to establish my bona fides to teach this class in 2018.

What is Film Noir

The first one I took in July 2017. It shows part of the “film noir” section at the now-defunct Island Video Rentals on Martha’s Vineyard.

IMG_3137

The second photograph was of yours truly attending NOIR CITY 16 in San Francisco, California the following winter.

IMG_3603

The two-part class went extremely well, with both girls asking insightful questions for the most part; our younger daughter did try to invoke Stranger Things once or twice, along with other more recent bits of pop culture. In the first hour, we focused on how “film noir” was a label first imposed after the fact on a particular set of American crime films, starting with two French film critics in 1946. After a 30-minute break, I told them two different, albeit broadly overlapping, “origin stories” for film noir:

  1. Traditional story: it was an inevitable organic artistic movement
  2. What in my opinion is a more accurate modification: it emerged from economic and creative necessity with the rise of B-movies in the 1930s

To be fair, by the middle of the second origin story, the usual doodling-based fidgeting had become sitting on the floor playing with our golden retriever, so I wrapped up quickly.

And with that we ended—possibly—classes for week one of our necessary experiment in home schooling.

**********

In my previous post, I briefly discussed some thoughts I had about the efficacy of using a designated test to determine whether a person has a condition such as the novel coronavirus. Specifically, I introduced the concepts of sensitivity (the percentage of persons who have the condition who test positive for it) and specificity (the percentage of persons who do not have the condition who test negative for it). And, given how hard it is to have 100% sensitivity and 100% specificity, I asserted epidemiologists generally prefer to have higher specificity (i.e., fewer false positives), which is achieved by loosening the criteria used to identify the condition. This preference stems from the relative rarity of most conditions epidemiologist study, which results in having many more false positives than false negatives.

Being the sort of person who does these sorts of things, though, I decided to use Microsoft Excel to test this idea. I set up a series of 2×2 tables such as the following in which I varied four values: sensitivity, specificity, prevalence (a proxy for whether everyone is tested, or only those persons deemed likeliest to have the condition) and the total number of tests performed.

Truth

Positive Negative
Observed Positive 142,500 42,500 185,000
Negative 7,500 807,500 815,000
150,000 850,000 1,000,000
Sensitivity 95%
Specificity 95%
Prevalence 15%
# Tested 1,000,000
Ratio FN/FP 5.7

What I was primarily interested in, beyond the raw number of false positives (FP) and negatives (FN), was the ratio of the former to the latter. Table 1 summarizes the results; the number of tests administered did not alter these ratios given the same set of sensitivity, specificity and prevalence values, so I omitted it from the table.

Table 1: Ratio of False Positives to False Negatives Using Different Combinations of Sensitivity, Specificity and Prevalence, Based on 1,000,000 Tests

Prevalence Sensitivity Specificity FP/FN #FP #FN
15% 95% 95% 5.7 42,500 7,500
90% 95% 2.8 42,500 15,000
95% 90% 11.3 85,000 7,500
80% 95% 1.4 42,500 30,000
95% 80% 22.7 170,000 7,500
33% 95% 95% 2.0 33.350 16,650
90% 95% 1.0 33.350 33,300
95% 90% 4.0 66,700 16,650
80% 95% 1.5 33.350 66,600
95% 80% 8.0 133,400 16,650
50% 95% 95% 1.0 25,000 25,000
90% 95% 0.5 25,000 50,000
95% 90% 2.0 50,000 25,000
80% 95% 0.25 25,000 100,000
95% 80% 4.0 100.000 25,000
85% 95% 95% 0.18 7,500 42,500
90% 95% 0.09 15,000 42,500
95% 90% 0.35 7,500 85,000
80% 95% 0.04 30,000 42,500
95% 80% 0.71 7,500 170,000

A test with sensitivity<80% and/or specificity<80% should not be utilized. Also, for any prevalence, the ratio of FP to FN will be the same across cases where sensitivity=specificity, albeit with different raw values.

Here are the primary conclusions from Table 1:

  • The lower the prevalence—or, in the case of COVID-19, the less you restrict testing only to those deemed likeliest to have it—the higher the likelihood you will have many more false positives than false negatives, irrespective of sensitivity and specificity
  • Within a given prevalence level, FP/FN is
    • Lowest when specificity > sensitivity
    • Highest when sensitivity > specificity
    • In the “middle” when sensitivity = specificity
  • The total number of “false” values (FP + FN) is
    • Lowest when both sensitivity and specificity are equal and close to 100%
    • Highest when sensitivity >> specificity

I saw a report on Twitter that 33% of persons testing positive were false positives. Based on these 20 scenarios, that would seem to indicate a situation where a fairly wide swath of the population is being tested (prevalence=15%), both sensitivity and specificity are at least 90%, and sensitivity > specificity. That percentage, which is not THAT meaningful, to be pehonest, would decrease if specificity were equal to or higher than sensitivity.

If you want to explore other scenarios like this, here is a protected copy of the workbook.

Disease Testing Worksheet

Until next time…please be safe and sensible out there…

3 thoughts on “Dispatches from Brookline: Home Schooling and Social Distancing III

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s