Real time monitoring of COVID

Scientific Reports volume 13, Article number: 9371 (2023) Cite this article

1 Altmetric

Metrics details

Communities worldwide have used vaccines and facemasks to mitigate the COVID-19 pandemic. When an individual opts to vaccinate or wear a mask, they may lower their own risk of becoming infected as well as the risk that they pose to others while infected. The first benefit–reducing susceptibility–has been established across multiple studies, while the second–reducing infectivity–is less well understood. Using a new statistical method, we estimate the efficacy of vaccines and facemasks at reducing both types of risks from contact tracing data collected in an urban setting. We find that vaccination reduced the risk of onward transmission by 40.7% [95% CI 25.8–53.2%] during the Delta wave and 31.0% [95% CI 19.4–40.9%] during the Omicron wave and that mask wearing reduced the risk of infection by 64.2% [95% CI 5.8–77.3%] during the Omicron wave. By harnessing commonly-collected contact tracing data, the approach can broadly provide timely and actionable estimates of intervention efficacy against a rapidly evolving pathogen.

Vaccination and mask wearing continue to be two of the most important public health tools for preventing COVID-19 transmission and mortality1,2,3,4,5,6,7,8,9,10. However, estimates of their effectiveness vary widely across communities and stages of the pandemic11. Measuring the impacts of vaccination and mask wearing is particularly important for protecting vulnerable communities, which include nursing homes and congregate settings such as college campuses12. Understanding intervention effectiveness of strategies that have minimal impact on global economic activity can better inform policy responses that balance reduction in epidemic burden and economic cost.

Discrepancies in intervention effectiveness estimates may stem from variation between study populations, such as the prevalence of comorbidities, demographic structure, and contact patterns. During the Delta wave, estimates of two-dose mRNA-1273 (Moderna) effectiveness against symptomatic and asymptomatic infection were as high as 86.7%13,14,15 in a hospital setting and as low as 53.1% in nursing home residents16. Although both of these studies controlled for the common sources of heterogeneity (age and previous infection), there may have been a higher prevalence of comorbidities in the nursing home population. During the Omicron wave, effectiveness estimates for two doses of either Moderna or Pfizer mRNA vaccines ranged from 70% in a South African hospital setting17 to 36.6% across multiple testing facilities in Ontario, Canada18. Again, these studies controlled for many of the same confounding variables, including age and comorbidities, however, Buchan et al. were unable to control for previous levels of infection in the population, possibly leading to the discrepancy in findings18. These results highlight that SARS-CoV-2 intervention effectiveness varies through time and across communities and that statistical models for estimating effectiveness should consider local epidemiological, demographic and behavioral conditions.

Test-trace-isolate which includes "contact tracing" has been used widely to prevent COVID-19 transmission, particularly during the early months of the pandemic. While such efforts were often impeded by testing delays and resource limitations19, they frequently collected valuable data on the vaccination history, [mask use history], behavior, contact patterns, previous infection, and infection status of index patients and their contacts2,9,20. [Such data allow for estimation of the protective effect of mask wearing and vaccination simultaneously, as well as their effect on both infection and onward transmission]. We contrast this with traditional "test-negative" designs of vaccine effectiveness, where symptomatic individuals present to health care providers and their test and vaccine status are recorded. In traditional test-negative designs, confounders are assumed to be randomized conditional on receiving a test (with the exception of healthcare seeking behavior)21. However, test negative designs cannot jointly estimate the protective effect of interventions against onward transmission and often have difficulty controlling for previous infection. In the context of COVID-19 test negative designs, it is unclear whether presenting at a testing facility sufficiently controls for an individual's propensity to wear a mask or social distance. Finally, test negative designs can suffer from susceptible depletion bias22, which cannot occur in contact tracing based studies since the analysis is conducted conditional on a set of exposures of susceptible individuals.

We analyze data from a SARS-CoV-2 contact tracing program at a large university in the US to estimate the changing impact of vaccines and face masks on transmission, while highlighting community structures that are higher risk. [To our knowledge, this is the first study to estimate vaccine and face mask effectiveness in a university community and the first to simultaneously estimate the effectiveness of more than one intervention in any population, however, other studies have leveraged contact tracing data for vaccine effectiveness estimation ]2,23. Our framework is designed to provide real-time and venue-specific estimates–such as transmission risks associated with schools, workplaces, sporting events, and congregate living–while informing targeted interventions and risk communications.

We define intervention effectiveness (\(\mathbb {E}_A\)) as

where \(Y_{A=1}\) denotes the counterfactual test positivity rate if everyone had received the intervention and \(Y_{A=0}\) denotes the counterfactual test positivity rate if no one had received the intervention. Equivalently, we define the effectiveness of an intervention as one minus the causal risk ratio21,24,25. Ideally, we would measure true infections rather than those that test positive, but this is unobservable.

We estimate Eq. (1) from the observed data in the presence of confounding by marginalizing over covariates (W).

We do not bound the expected value of the effectiveness of the intervention between 0 and 1, but rather allow negative values, which would indicate that the intervention is associated with an increase in the probability of a positive test. To establish \(\mathbb {E_A}\) as a causal quantity, we must assume no unmeasured confounding after conditioning on observed covariates as well as counterfactual consistency. [We verify that each combination of covariates has at least one individual who tested positive and at least one who tested negative.]

As we are particularly interested in the effectiveness across time due to immune waning and emerging variants, we also define the conditional intervention effectiveness, conditional on a particular variant (V) dominating during a given time period.

We begin by formulating a parametric logistic regression model for the probability of a test positive interaction between an index case and a contact. We denote \(Y_{i,j}\) as an indicator of a positive contact of the j-th index case with the i-th contact.

In Eq. (4), duration is a binary indicator of the duration of the contact (greater or less than 60 minutes), indoor is a binary indicator of whether the interaction occurred indoors or outdoors, physical contact is an indicator of a direct physical contact, and relationship denotes a categorical variable of the relationship (roommate, classmate, or baseline, which included common relationship types such as friends, partners, co-workers, family). We include an interaction term of the effect of vaccination and mask wearing (for both cases and contacts) with an indicator of the variant circulating during three distinct waves, Alpha, Delta and Omicron. When index cases have multiple contacts, the risks associated with those events may be correlated. To account for this correlation, we include a random intercept (\(b_{0,j}\)) specific to index case j that captures additional transmission risk beyond the explicit covariates.

We tie this model to the [estimand] defined in Eq. (3) through a Bayesian parametric formulation of the g-computation formula. [The g-computation formula is an established method to marginalize over confounding variables when estimating a marginal treatment effect, in this case, one minus the marginal risk ratio]26,27. As an example, to recover vaccine effectiveness from Eq. (2) during the Omicron wave we target the following functional of the observed data.

Under a parametric logistic outcome regression model we can plug-in the expression for the expected probability in the numerator and denominator of Eq. (5) and marginalize out over the empirical distribution of confounders.

Equation (6) can be thought of as the expected value across the empirical distribution of the data if we were to "set" the contact vaccination status and "set" the circulating variant to Omicron. As each \(\beta _k\) is a random variable in a Bayesian context, we obtain uncertainty estimates of our target estimand in Eq. (6) through standard MCMC sampling of the posterior. See Appendix 1 for more details.

Data were generated by the University of Texas at Austin's (UT) COVID-19 testing and tracing program which functioned under the authority of Austin Public Health. [For the purposes of our analysis, we divided the data into three distinct variant waves; the period when the Alpha variant was dominant (02/15/2021–06/15/2021), when the Delta variant was dominant (06/15/2021–12/10/2021) and when the Omicron variant was dominant (12/10/2021–03/04-2022). We defined a period of dominance by variant as the time period in which greater than 95% of cases in the greater Austin area were attributed to a specific variant. UT Austin reported an average of less than 1% test positivity for both the period when the Alpha and Delta variants were dominant and up to an 8.7% test positivity for the period when Omicron was dominant. The university never implemented a vaccine mandate, but did strongly suggest vaccination. There was a mask mandate in place during the period when Alpha was dominant as well as a hybrid strategy for both in-person and remote classes. However, by the arrival of the Delta variant, the university had lifted the mask mandate and resumed in-person classes with limited remote options.] Student, Staff and Faculty cases were reported to UT Contact Tracing following a positive rapid antigen or nucleic acid amplification test conducted between 02/15/2021 and 03/04/2022 (Table 1). Case reports were received from campus testing programs and via self-report. In collaboration with Austin Public Health, UT Contact tracing identified additional UT Student, Staff, and Faculty cases who were interviewed by Austin Public Health. Contact tracers interviewed cases by phone about their symptoms, history of vaccination, and contacts exposed during their infectious period. In 2021, the infectious period was estimated to begin 2 days prior to, and end 10 days after, symptom onset (or, positive test result if asymptomatic) . Beginning on January 1st, 2022, and during the Omicron wave, the infectious period was assumed to end 5 days after symptom onset28. Detailed information about the nature of each exposure was collected from the case, including the duration of exposure, context (indoor vs. outdoor), nature of contact (physical vs. non-physical), relationship with the contact (e.g. roommate, classmate, or baseline, which included common relationship types such as friends, partners, co-workers, family) and whether masks were worn by both the case and contact. Contacts were notified of their exposure by phone, and interviewed about their symptoms, history of SARS-CoV-2 infection and vaccination. Contacts with no history of recent infection (within three months of the exposure) were encouraged to seek a COVID-19 test twice, between 3 and 5 days following the exposure to catch new infections early and between 5 and 7 days to align with national guidelines, regardless of vaccination status. Negative test results were acquired through campus testing programs and through self-report. Data was stored in UT's contact tracing database.

Cases were included in the analysis if they were: (1) successfully investigated at UT and were willing to share their contacts, (2) had at least one contact who tested at least once 3 to 14 days after the exposure and, (3) had a known vaccination status at the time of exposure. Contacts were included if they had received at least one phone call attempt from contact tracing and if the contact's vaccination status was known. Test results for each contact were appended to the index case. [As we were unable to observe every contact of each index case, and this missingness may be associated with both vaccination status and test positivity, there may be bias in the resulting estimates of vaccine effectiveness. Missingness was particularly pronounced during the period when Omicron was dominant due to an overwhelming case load for contact tracers (Fig. 1A). We explore this bias in detail "Contact tracing data" in section] [Most index cases had less than 5 contacts and the distributions of the number of contacts for each of the variant waves appeared roughly power law (Fig. 1B)]. Any contact that reported a positive test result 3 to 14 days after exposure was considered a test-positive contact. Contacts with only negative results during this period were considered test-negative contacts. Contacts with missing test results were included in an analysis of non-response. Some UT-affiliated contacts who were unable to be notified by contact tracers at UT still tested at a campus testing site and their results were entered into the contact tracing database. Case and contact vaccination status was assessed through two primary routes. First, interviews were conducted over the phone to assess vaccination status at the time of exposure for both cases and contacts. However, when contact tracers were unable to notify a contact and obtain a vaccination status, university vaccination records were used. Cases and contacts were considered fully vaccinated if the exposure occurred at least 14 days after the [second] dose of an FDA-approved mRNA vaccine. Johnson and Johnson and AstraZeneca vaccinated individuals were dropped from the analysis. Cases and contacts who were unvaccinated, partially vaccinated, or had an exposure occurring in the 14-day period following the final dose of an FDA-approved mRNA vaccine were considered unvaccinated. The sample size was not sufficient to estimate natural waning immunity or booster effectiveness within a period dominated by a particular variant. This study was determined to be not human subjects research by UT's Institutional Review Board.

(A): Proportion of contacts successfully investigated across time. There was a significant drop in the contact tracers ability to investigate contacts of index cases during the Omicron surge due to the magnitude of the case load. (B): Distribution of the number of contacts by index case [, conditional on an index case having at least one contact, ] across the time periods when Alpha (02/15/2021–06/15/2021), Delta (06/26/2021–12/10/2021), and Omicron (12/10/2021–03/04/2022) were dominant.

A test result was missing for 10.3% of contacts. Unlike traditional test-negative designs, missingness in contact tracing test-negative designs may be informative. If a contact engages in COVID-19 risk taking behavior, they may be more likely to become infected, more likely to be unvaccinated and more likely to be missing a test result. We do observe a lower rate of vaccination among those missing a test (Table 1). Given the integration of testing and tracing data at UT, we were still able to observe individuals who tested at UT regardless of whether the individual was successfully notified by a contact tracer. [However, we were unable to observe their test status if they tested off campus or did not test at all. We were also able to monitor the proportion of contacts who were successfully investigated by contact tracers (Fig. 1A]. The proportion fell drastically during the Omicron wave, when contact tracers became overwhelmed by the number of cases. If unvaccinated individuals who were likely to test positive due to risk taking behaviors were more likely to] not [respond to contact tracers then this can significantly bias the estimate of vaccine effectiveness downward. In particular, when vaccine effectiveness is low (13%), the bias can reach -100%, indicating that vaccination dramatically increases the odds of testing positive. By monitoring the proportion of contacts successfully notified, we can identify time periods where estimates may become unreliable, such as the Omicron surge. Further details, including specific simulation studies of the bias, are supplied in Appendix A2].

All data collection efforts were carried out in accordance with the University of Texas at Austin guidelines and approved by the University of Texas at Austin internal review board (STUDY00000438-MOD02). Informed consent was obtained from all subjects and/or their legal guardians.

There were 3782 case-contact pairs available for analysis. For the period when the Alpha variant was dominant, there were 300 cases and 593 contacts. For the period when the Delta variant was dominant, there were 703 cases and 2433 contacts. For the period when the Omicron variant was dominant, there were 456 cases and 756 contacts. The distribution of the number of contacts by case is show in Appendix A2. 57% of cases and 56% of contacts were female (Table 1). The median age for index cases and contacts were 21 years (range = 17–48 years) and 20 years (range = 14–40 years), respectively. Over half of all index cases and contacts were vaccinated (56.7% and 56.6%, respectively). The majority of cases and contacts were unmasked at the time of exposure (80.4% and 85.4%, respectively). Exposures typically lasted over 60 minutes (82.2%) and were indoors (96.7%). The average number of days since receiving two doses was 169 for contacts, with 95% having been vaccinated between 50 and 250 days prior to exposure. Overall, 76.8% contacts were successfully notified of their exposure to the index case and 82.5% of contacts tested following their exposure regardless of notification. In order to account for missing test results among contacts, four different scenarios were considered: (1) the contact was notified of the exposure (i.e., answered the contact tracer's call) and their test result was captured (61.0%); (2) the contact was notified of the exposure but did not get tested (15.7%); (3) the contact was not successfully notified but still tested (21.3%); and (4) the contact was not successfully notified and no test result was available (2%). Test positivity was 3.6% and 52.3% among contacts who were or were not reached, respectively.

We estimated vaccine effectiveness against infection in the UT community during three different periods of the pandemic (Fig. 2A). When the Alpha variant was dominant (02/15/2021–06/15/2021), vaccination of a contact reduced their risk of infection by 25.1% [95% CI − 16.0–62.0%] based on 493 index case contact pairs (Fig. 2A). When the Delta variant was dominant (06/15/2021–12/10/2021), the estimate was 36.8% [95% CI 20.8–51.3% ] based on 1,885 index case contact pairs. Finally, when the Omicron variant was dominant (12/10/2021–03/04/2022), we found no protective effect, with an estimated effectiveness of -107.0% [95% CI − 159.2 to − 64.8%] based on 294 index case contact pairs. Turning to the vaccination status of the index case, vaccine effectiveness against onward transmission was estimated to be 38.7% [95% CI 23.9–51.1%] during the alpha wave, 40.7% [95% CI 25.8–53.2%] during the delta wave, and 31.0% [95% CI 19.4–40.9%] during the period when Omicron was dominant (Fig. 2C).

Estimates of intervention effectiveness (in percent) against infection of the contact with 95% credible intervals (vertical black marks). (A): Posterior density of vaccine effectiveness against infection (contact vaccination status). The negative estimate for the time period when Omicron was dominant may stem from excess behavioral risks in the vaccinated group. (B): Posterior density of mask effectiveness against infection (contact masking status). (C): Posterior density of vaccine effectiveness against onward transmission (index vaccination status). (D): Posterior density of mask effectiveness against onward transmission (index masking status).

Mask wearing by both the contact and the index case was not significantly protective during the Alpha or Delta variant waves (Alpha: 22.7% [95% CI − 36.2–63.9%], Delta: 20.4% [95% CI − 61.8–71.4%] ) (Fig. 2B). However, during the time period when Omicron was dominant mask effectiveness was estimated to be 64.2% [95% CI 5.8–77.3%]. Mask wearing by the index case alone, while not significant, did have point estimates in the direction of a protective effect (Alpha: 26.7% [95% CI − 23.8–63.3%], Delta: 43.4% [95% CI − 8.4–76.9%], Omicron: − 8.0 % [95% CI − 74.2–47.8%]) (Fig. 2D).

We also estimated the odds ratio of transmission as a function of behavioral and environmental covariates while accounting for vaccination status and masking during the exposure. Classmates (OR = .15 [95% CI .06–.29]) and roommates (OR = .53 [95% CI .39–.70]) (Fig. 3A) were significantly less likely to transmit relative to the baseline, which included common relationship types (friends, partners, co-workers, family). We also find that longer interactions (> 60 minutes) (OR = 1.46 [95% CI 1.13–1.89]) and those involving direct physical contact (RR = 1.37 [95% CI 1.07–1.84]) increase the probability of a test-positive contact relative to shorter and less physical contacts, respectively. The estimated random intercepts by index case exhibit significant variation (Fig. 3B), with some index cases having more than twice the average transmission odds after controlling for covariates. Thus, there are likely other drivers of infection risks beyond vaccination, mask wearing, relationship type, the nature or duration of the exposure, and exposure location.

Risk factors for SARS-CoV-2 transmission on a university campus. (A): Posterior densities or potentially confounding variables across the study period (02/15/2021 through 03/04/2022), including the relationship between the index case and the contact (classmate, roommate, or baseline, which included common relationship types such as friends, partners, co-workers, family), the location of exposure (indoor vs outdoor), the duration of the interaction (longer or shorter than one hour), and whether there was direct physical contact. The odds ratio indicates the odds for those with the indicator relative to those without the indicator. (B): Histogram of the estimated random intercepts of the index cases, representing excess heterogeneity in transmission not explained by the vaccination status of the index case and contact, mask wearing behavior of the index case and contact, relationship between the index case and contact, exposure duration, exposure location, or direct physical contact. Values less than one (greater than one) correspond to index cases who were less (more) infectious than average.

Contact tracing data from a large urban university in the US revealed a precipitous decline in the effectiveness of vaccines against SARS-CoV-2 infection [as the pandemic progressed], consistent with other studies18,29,30. Declines likely stem from a combination of immune evasiveness of the variants, natural waning of immunity over the months following vaccination, and unobserved behavioral factors. [However, during the Omcron surge, contact tracers became overwhelmed by the volume of cases, and follow up of contacts significantly decreased. This may explain the statistically significant negative estimate of vaccine effectiveness during the Omicron surge and highlights a weakness of the contact-tracing based vaccine effectiveness design. However, by consistently monitoring the rate of successful contact investigations, public health officials can identify periods when estimates may become unreliable.]Lyngse et al. similarly found a negative point estimate for vaccine effectiveness against infection during the Omicron wave31. The high degree of uncertainty in our estimates of intervention effectiveness stems from small sample sizes, particularly for the periods when Alpha and Omicron were dominant.

We found that vaccines offered a high level of protection against onward transmission during the Alpha, Delta, and Omicron waves. While prior household-based studies have demonstrated this protective effect32,33, we believe this is the first indication that vaccines reduce infectivity in a larger community. These estimates provide evidence in support of clear and consistent messaging to promote vaccination, boosting, and vigilant use of masks during dangerous surges in college communities. Contact tracing data allow us to control for environmental and behavioral factors that influence transmission, when estimating the effectiveness of interventions. In our college-aged study population, the relationships between the index case and the contact strongly correlated with infection risk. Individuals who encountered each other through daily college activities (such as classmates and roommates) had a lower odds of testing positive than non-college structured relationships (friends, family, co-workers, etc). These results have counterintuitive implications for university administrators grappling with the costs and benefits of limiting campus activities during surges34,35. Limiting in-person classes may be less effective at preventing infection than limiting social gatherings among friends to small "bubbles" or strongly encouraging vaccination, masking and testing to mitigate risks during social encounters.

While large scale studies have confirmed the protective effect of surgical mask wearing36,37, in a cluster randomized trial, Abaluck et al. found that mask wearing significantly reduced symptomatic seropositivity by 9%38 but the effect decreased for cloth masks relative to surgical masks. This may suggest that our results are driven by the mix of cloth, surgical and other masks used in this college population or data quality issues related to self-reporting of mask use. Larger scale studies are needed to disentangle behavioral from virologic drivers of changes in face mask effectiveness. Our estimates of vaccine and face mask effectiveness in a large university community may be higher than that for a broader US population. College students are more likely to engage in risky behavior in comparison to older adults39, and this may be compounded by consistent messaging that COVID-19 is less severe in young adults39. College students also tend to have large numbers of close physical contacts per week, given communal living arrangements and classroom structures. They also tend to be young and healthy, with lower prevalence of comorbidities, which may reduce the risks of developing symptoms that would otherwise inhibit social activities while infectious. Even if this larger risk was mitigated by vaccination and face masks, we might still expect lower estimates of intervention effectiveness compared to other populations at lower risk.

While test negative designs often have the advantage of large data sets (high statistical power), consistent monitoring of vaccine effectiveness using contact tracing data can provide complementary real-time estimates that can inform rapid and effective policy responses, particularly when interventions stop working. Unlike test negative studies of vaccine effectiveness, which monitor only symptomatic individuals who present to health care providers, contact tracing data can also catch asymptomatic infections and identify super spreading individuals within a community, potentially helping identify emerging variant threats. However, use of contact tracing data to study intervention effectiveness is prone to three sources of bias that do not occur with the more commonly used test negative design. First, [as noted above, missigness can be highly informative and can significantly bias the estimate of vaccine effectiveness (Appendix A2)]. [Second,] confounding factors of the particular interaction between the case and contact must be captured retrospectively and controlled for statistically. For example, when studying vaccine effectiveness, one must control for mask wearing since the choice to vaccinate and the choice to wear a face mask may be correlated. Conversely, vaccine status must be considered when estimating masking effectiveness. [Finally], contact tracing may involve repeated measurements on a single index case with multiple contacts. These repeated measurements may be correlated due to unmeasured properties of the index case, such as a higher viral load or immunity from prior infections, and must be considered when estimating intervention effects to avoid biased estimates. Other contact tracing based studies40 have labeled missing test results as test-negative contacts, potentially biasing the results (Appendix A2). While there is no statistical remedy for missingness not at random, analyses of contact tracing data should include [monitoring of contact follow up rates to identify unreliable estimates]. We note that data collected by contact tracing programs across the US are highly heterogeneous, ranging from minimal case information41 to fully detailing each exposure42. Moreover, it is often difficult to link contact tracing data to vaccination records and other relevant health data42,43. Increased investment in infectious disease surveillance systems that enhance data capture and integrate healthcare and public health data would facilitate accurate and timely estimation of intervention effectiveness and behavioral risks.

Our study provides a general statistical framework for using commonly collected contact tracing data to track the utility of interventions as the virus continues to evolve and human behaviors shift. The proposed Bayesian g computation model can simultaneously assess multiple interventions, provide probabilistic estimates of their effectiveness at reducing both susceptibility and infectivity, and identify individual- and exposure-related factors that increase risks of transmission. While global contact tracing efforts are winding down, the approach can be applied in real-time as contact tracing is collected in specific populations to provide crucial situational awareness and inform effective mitigation and communication strategies.

The data that support the findings of this study are available from University of Texas at Austin but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of the University of Texas at Austin.

Sheikh, A., Robertson, C. & Taylor, B. BNT162b2 and ChAdOx1 nCoV-19 vaccine effectiveness against death from the delta variant. N. Engl. J. Med. 385(23), 2195–2197 (2021).

Article CAS PubMed Google Scholar

Braeye, T. et al. Vaccine effectiveness against infection and onwards transmission of COVID-19: Analysis of belgian contact tracing data, January-June 2021. Vaccine 39(39), 5456–5460 (2021).

Article CAS PubMed PubMed Central Google Scholar

Oon, T. N. et al. Impact of delta variant and vaccination on SARS-CoV-2 secondary attack rate among household close contacts. Lancet Reg. Health West Pac. 17, 100299 (2021).

Article Google Scholar

Yair, G. et al. Waning immunity after the BNT162b2 vaccine in israel. N. Engl. J. Med. 5, 789 (2021).

Google Scholar

Patrick, T. et al. BNT162b2 and mRNA-1273 COVID-19 vaccine effectiveness against the SARS-CoV-2 delta variant in qatar. Nat. Med. 5, 968 (2021).

Google Scholar

Francis, C. M. et al. Assessment of simulated surveillance testing and quarantine in a SARS-CoV-2-Vaccinated population of students on a university campus. Science 5, 2147 (2021).

Google Scholar

John, T. B. & Jay, C. B. Effectiveness of mask wearing to control community spread of SARS-CoV-2. JAMA 325(10), 998–999 (2021).

Article Google Scholar

Yu, W. et al. Reduction of secondary transmission of SARS-CoV-2 in households by face mask use, disinfection and social distancing: a cohort study in Beijing, China. Science 5, 214 (2020).

Google Scholar

Jacob, R., Jamie, M. H., Jennifer, A. M., Amelia, L. B. S. & Grant, D. B. Mask effectiveness for preventing secondary cases of COVID-19, Johnson county, Jowa, USA. Emerg. Infect. Dis. 28(1), 69–75 (2022).

Google Scholar

Hendrix, M. J., Charles, W., Kendra, F. & Robin, T. Absence of apparent transmission of SARS-CoV-2 from two stylists after exposure at a hair salon with a universal face covering policy-Springfield, Missouri. MMWR Morb. Mortal. Wkly. Rep. 69(28), 930–932 (2020).

Article CAS PubMed Google Scholar

Melissa, M. H. et al. A systematic review of COVID-19 vaccine efficacy and effectiveness against SARS-CoV-2. Infect. Dis. 2, 456 (2021).

Google Scholar

Hannah, L. et al. Are college campuses superspreaders? A data-driven modeling study. Comput. Methods Biomech. Biomed. Eng. 24(10), 1136–1145 (2021).

Article Google Scholar

Katia, J. B. et al. Effectiveness of mRNA-1273 against delta, mu, and other emerging variants of SARS-CoV-2: Test negative case-control study. BMJ 375, e068848 (2021).

Google Scholar

Jill, M. F. et al. Waning 2-dose and 3-dose effectiveness of mRNA vaccines against COVID-19-Associated emergency department and urgent care encounters and hospitalizations among adults during periods of delta and omicron variant predominance – VISION network. Science 2, 968 (2022).

Google Scholar

Mark, G. T. et al. Effectiveness of a third dose of mRNA vaccines against COVID-19-Associated emergency department and urgent care encounters and hospitalizations among adults during periods of delta and omicron variant predominance – VISION network. Sci. Rep. 3, 968 (2022).

Google Scholar

Srinivas, N. et al. Effectiveness of Pfizer-BioNTech and moderna vaccines in preventing SARS-CoV-2 infection among nursing home residents before and during widespread circulation of the SARS-CoV-2 b.1.617.2 (delta) variant-national healthcare safety network. MMWR Morb. Mortal. Wkly. Rep. 70(34), 1163–1166 (2021).

Article Google Scholar

Collie, S., Champion, J., Moultrie, H., Bekker, L.-G. & Gray, G. Effectiveness of BNT162b2 vaccine against omicron variant in South Africa. N. Engl. J. Med. 386(5), 494–496 (2022).

Article PubMed Google Scholar

Sarah, A. B. et al. Effectiveness of COVID-19 vaccines against omicron or delta symptomatic infection and severe outcomes. Sci. Rep. 21, 8633 (2022).

Google Scholar

Eva, C., Elizabeth, Y. C. & Amirian, E. S. Why contact tracing efforts have failed to curb coronavirus disease 2019 (COVID-19) transmission in much of the united states. Clin. Infect. Dis. 72(9), e415–e419 (2021).

Article Google Scholar

Ivo, M. F., Michael, H., Jill, M. F. & David, K. S. The case test-negative design for studies of the effectiveness of influenza vaccine. Vaccine 31(30), 3104–3109 (2013).

Article Google Scholar

Joseph, A. L., Christine, T., Benjamin, J. C. & Marc, L. Measurement of vaccine direct effects under the Test-Negative design. Am. J. Epidemiol. 187(12), 2686–2697 (2018).

Article Google Scholar

Rebecca, K., Stephanie, J. S., Jennifer, R. V. & Marc, L. Identifying and alleviating bias due to differential depletion of susceptible people in post-marketing evaluations of COVID-19 vaccines. Am. J. Epidemiol. 5, 2147 (2022).

Google Scholar

Shepherd, R. S. et al. Effectiveness of BNT162b2 mRNA COVID-19 vaccine against SARS-CoV-2 variant beta (b.1.351) among persons identified through contact tracing in israel: A prospective cohort study. EClinicalMedicine 42, 101190 (2021).

Article Google Scholar

Benjamin, J. C. & Sheena, G. S. A concern over terminology in vaccine effectiveness studies. Science 5, 641 (2018).

Google Scholar

Anders, H., Mats, J. S. & Etsuji, S. On the collapsibility of measures of effect in the counterfactual causal framework. Emerg. Themes Epidemiol. 16, 1 (2019).

Article Google Scholar

Jonathan, M. S., Sherri, R. & Kathleen, M. M. Implementation of g-computation on a simulated data set: Demonstration of a causal inference technique. Am. J. Epidemiol. 173(7), 731–738 (2011).

Article Google Scholar

Alexander, P. K., Eric, J. D., Stephanie, M. E., Jessie, P. B. & Jessie, K. E. A bayesian approach to the g-formula. Science 6, 7489 (2018).

Google Scholar

Muluneh, A. et al. Serial interval and incubation period of covid-19: A systematic review and meta-analysis. BMC Infect. Dis. 21(1), 1–9 (2021).

Google Scholar

Eli, S. R. et al. Covid-19 vaccine effectiveness in New York state. N. Engl. J. Med. 386(2), 116–127 (2022).

Article Google Scholar

Sara, Y. T. et al. Effectiveness of mRNA BNT162b2 COVID-19 vaccine up to 6 months in a large integrated health system in the USA: A retrospective cohort study. Science 42, 3896 (2021).

Google Scholar

Frederik, P. L. et al. Transmission of SARS-CoV-2 omicron VOC subvariants BA.1 and BA.2: Evidence from danish households. Sci. Rep. 21, 796 (2022).

Google Scholar

David, W. E. et al. Effect of covid-19 vaccination on transmission of alpha and delta variants. N. Engl. J. Med. 386(8), 744–756 (2022).

Article Google Scholar

de Brechje, G., de Brechje, G., Stijn, A., Jantien, A. B., Susan, J. M. H., van den Susan, H., de Hester, E. M., Mirjam, J. K., & RIVM COVID-19 surveillance and epidemiology team. Vaccine effectiveness against SARS-CoV-2 transmission to household contacts during dominance of delta variant (b.1.617.2), August–September 2021, The Netherlands.

Harry, P. & Robin, D. A Review of Learning Loss During COVID-19 (Springer, Berlin, 2021).

Google Scholar

Per, E., Arun, F. & Mark, D. V. Learning loss due to school closures during the COVID-19 pandemic. Sci. Rep. 5, 214 (2021).

Google Scholar

Daniel, C. P., Sarah, E. S.-J., Gosia, N., Uzo, C., Jesse, R. G., Robert, J. H., Jeffrey, A. J., Natalie, J. T., Jarad, S., Zachary, W., Bettina, B., Michael, D. B., Adam, M., Monita, R. P., Eric, D., Bruce, L. G., Rebekah, T., Rene, G., Shannon, R., Brett, W., Ashley, K., Peyton, S., Christopher, L., & James, G. CDC COVID-19 Surge Laboratory Group, and CDC COVID-19 Surge Laboratory Group. SARS-CoV-2 infections and serologic responses from a sample of U.S. navy service members—USS theodore roosevelt (2020).

Pawinee, D.-ngern, Rapeepong, S., Apinya, P., Chawisar, J., Duangrat, R., Nawaporn, D., Napatchakorn, E., Nichakul, P., Nuengruethai, S., Oiythip, Y., & Others (2012) Case-Control study of use of personal protective measures and risk for SARS coronavirus 2 infection, Thailand.

...Jason, A. et al. Impact of community masking on COVID-19: A cluster-randomized trial in Bangladesh. Science 375(6577), eabi9069 (2022).

Article Google Scholar

Alison, K. C., Lindsay, T. H., Chloe, R. N., Neshat, Y. & Miranda, P. D. Opportunities to reduce young adult college students’ COVID-19-Related risk behaviors: Insights from a national, longitudinal cohort. J. Adolesc. Health 69(3), 383–389 (2021).

Article Google Scholar

Frederik, P. L., Laust, H. M., Matthew, J. D., Lasse, E. C., Camilla, H. M., Robert, L. S., Katja, S., Anders, F., Maria, M. L., Morten, R., Marc, S., Claus, N., Raphael, N. S., Arieh, S. C., Frederik, T. M., Maria, O., Kåre, M., Tyra, G. K., & Carsten, T. K. SARS-CoV-2 omicron VOC transmission in danish households (2021).

Paige, K. et al. Implementation and process of a COVID-19 contact tracing initiative: Leveraging health professional students to extend the workforce during a pandemic. Am. J. Infect. Control 48(12), 1451–1456 (2020).

Article Google Scholar

Seung-Ji, K., Sooyeon, K., Kyung-Hwa, P., Sook, I. J., Min-Ho, S., Sun-Seog, K., Hyang, P., Seong-Woo, C., Eungyu, L., & So, Y. R. Successful control of COVID-19 outbreak through tracing, testing, and isolation: Lessons learned from the outbreak control efforts made in a metropolitan city of South Korea.

Anjum, K., Justin, F. R., Steven, B. A., & William, M. T. Establishing a Data-Sharing environment for a 21st-century academic health center (2020).

Download references

This research was supported a donation from Love, Tito's (the philanthropic arm of Tito's Homemade Vodka, Austin, TX, USA) to the University of Texas to support the modeling of COVID-19 mitigation strategies. Additional funding was provided by the Council of State and Territorial Epidemiologists under Grant Number NU38OT000297.

Los Alamos National Laboratory, Los Alamos, USA

Graham C. Gibson

Department of Integrative Biology, University of Texas at Austin, Austin, USA

Spencer Woody, Spencer J. Fox & Lauren Ancel Meyers

Department of Population Health, Dell Medical School, University of Texas at Austin, Austin, USA

Emily James & Darlene Bhavnani

Epidemiology and Disease Surveillance Unit, Austin Public Health, Austin, USA

Minda Weldon

You can also search for this author in PubMed Google Scholar

You can also search for this author in PubMed Google Scholar

You can also search for this author in PubMed Google Scholar

You can also search for this author in PubMed Google Scholar

You can also search for this author in PubMed Google Scholar

You can also search for this author in PubMed Google Scholar

You can also search for this author in PubMed Google Scholar

G.G., D.B., and L.M. conceived and designed the analysis. E.J., M.W., and D.B. collected the data. S.F. and S.W. contributed data or analysis tools. G.G. and D.B. performed the analysis.

Correspondence to Graham C. Gibson.

The authors declare no competing interests.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

Gibson, G.C., Woody, S., James, E. et al. Real time monitoring of COVID-19 intervention effectiveness through contact tracing data. Sci Rep 13, 9371 (2023). https://doi.org/10.1038/s41598-023-35892-0

Download citation

Received: 02 September 2022

Accepted: 25 May 2023

Published: 09 June 2023

DOI: https://doi.org/10.1038/s41598-023-35892-0

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.