Skip to main content

ORIGINAL ARTICLE

Int J Public Health, 27 July 2022

Testing for COVID-19 is Much More Effective When Performed Immediately Prior to Social Mixing

Chad R. WellsChad R. Wells1Senay Gokcebel,Senay Gokcebel2,3Abhishek PandeyAbhishek Pandey1Alison P. GalvaniAlison P. Galvani1Jeffrey P. Townsend,,
Jeffrey P. Townsend4,5,6*
  • 1Center for Infectious Disease Modeling and Analysis (CIDMA), Yale School of Public Health, New Haven, CT, United States
  • 2Yale School of Public Health, New Haven, CT, United States
  • 3Grinnell College, Grinnell, IA, United States
  • 4Department of Biostatistics, Yale School of Public Health, New Haven, CT, United States
  • 5Program in Computational Biology and Bioinformatics, Yale University, New Haven, CT, United States
  • 6Program in Microbiology, Yale University, New Haven, CT, United States

Objective: To quantify the utility of RT-PCR and rapid antigen tests in preventing post-arrival transmission based on timing of the pre-departure test.

Methods: We derived analytical expressions to compute post-arrival transmission when no test is performed, and when either an RT-PCR or any of 18 rapid antigen tests is performed at specified times before arrival. We determined the diagnostic sensitivity of the rapid antigen tests by propagating their RT-PCR percent positive agreement onto known RT-PCR diagnostic sensitivity.

Results: Depending on the rapid antigen test used, conducting a rapid antigen test immediately before departure reduces post-arrival transmission between 37.4% (95% CrI: 28.2%–40.7%) and 46.7% (95% CrI:40.0%–49.3%), compared to a 31.1% (95% CrI: 26.3%–33.5%) reduction using an RT-PCR 12 h before arrival. Performance of each rapid antigen test differed by diagnostic sensitivity over the course of disease. However, these differences were smaller than those engendered by testing too early.

Conclusion: Testing closer to arrival—ideally on the day of arrival—is more effective at reducing post-arrival transmission than testing earlier. Rapid antigen tests perform the best in this application due to their short turnaround time.

Introduction

Travel has been greatly reduced during the COVID-19 pandemic, with declines in airfare following border closures and cancellation of flights due to safety concerns [1, 2]. Restrictions on gathering size have halted many festivals and events that provide human social activity and stimulate the economy. A widely adopted approach to limit transmission is to solely require a test for COVID-19 prior to arrival at the travel destination or at large events [3, 4].

Many countries have adopted such testing strategies to resume travel in a safer manner. For example, many European Union countries require a negative RT-PCR test 72 h prior to entry. In many cases, pre-departure testing may be coupled with testing and quarantine to ensure minimal imminent infection in the country of arrival [5]. Similarly, event organizers have adopted testing rules to prevent super-spreading events. For many events, attendees need either a proof of COVID-19 vaccination, or testing prior to event entry. However, there is no broad consensus for the timing of the test conducted prior to arrival. While testing 48–72 h prior is a common requirement for attendance or travel, longer time windows for testing are still allowed in some organizations. For example, events hosted by the US Track and Field Association require participants to undergo testing within the past 7 days [6]. Similarly, the National Archives and Records Administration requires employees who have failed to present their weekly COVID-19 test results to provide new test results, with the collection date no longer than a week prior to entry [7]. To assess the effectiveness of testing in identifying cases, many studies have evaluated the sensitivity of RT-PCR and antigen tests, and even aspects of the optimal time window for testing [8, 9]. Kucirka et al [8] report that testing for COVID-19 early in the incubation period is more likely to yield inaccurate results than when the test is conducted later on when symptoms appear. In the context of travel, projects developed prior to the pandemic—such as Prevention and Management of High Threat Pathogen Incidents in Transport Hubs (PANDHUB)—have used modeling approaches to assess mitigation approaches (e.g., screening to detect cases) for high-threat diseases (e.g., Ebola virus disease, pandemic influenza, and pneumonic plague) [10]. These methods developed for other diseases can be applied to inform disease control efforts for SARS CoV-2. Some of the travel related studies for SARS CoV-2 have qualitatively argued that the application of testing close to departure is desirable to detect and isolate infected individuals [11, 12]. Kiang et al. [12] contended that conducting a test within 3 days of departure, combined with a post-quarantine test following arrival, was most ideal in reducing onward transmission. Johansson et al. [11] use a mathematical model to show that the risk of transmission diminishes as the time between testing and departure shortens. Using Monte Carlo simulations, Clifford et al. [13] show that testing a day before travel provides a greater reduction in post-arrival transmission than testing four or 7 days prior to travel. Quilty et al. [14] use mathematical modeling to quantify the effectiveness of thermal screening—which would have constant sensitivity in detecting a case in comparison to the temporal sensitivity of diagnostic molecular tests—upon departure and arrival of airline passengers. However, no study uses a mathematical model to compare the effectiveness of pre-arrival testing in reducing transmission across multiple types of tests or has evaluated how pre-arrival testing impacts the probability of onward transmission after arrival. To aid in the safe resumption of travel and attendance at large gatherings, we determine the optimal timing for use of RT-PCR testing and 18 antigen tests prior to arrival. We derive analytical expressions for the expected post-arrival transmission of SARS-CoV-2 and compute the probability of onward transmission when 1) testing is not required prior to arrival and 2) testing conducted 1 week prior to arrival up to the time of arrival. We focus our analysis on the RT-PCR test and five popular rapid antigen tests (BD Veritor, BinaxNOW, CareStart, LumiraDx and Sofia), while also examining an additional 10 brands of antigen tests that have received Emergency Use Approval from the US Food and Drug Administration.

Methods

Transmission Over Time

Transmission of a pathogen from an infected individual is typically time-dependent, based on pathogen shedding and behavioral changes, and can be represented over time by a function r(t), for which time t = 0 represents initial infection. To represent infectiousness of an individual, a function r(t) can be scaled such that

t = 0r(t)dt=R0,(1)

where R0 is the basic reproduction number: the expected number of infections consequent to a single infected individual under a scenario of no intervention. Specifying a discrete end to the infection at time te (i.e., 20 days after symptom onset [1517]) such that r(t)=0 for t>te,

t = 0ter(t)dt=R0.

Self-Isolation at Symptom Onset

A significant means of intervention to prevent infection is self-isolation of infected individuals upon symptom onset. We express the transmission over time for a symptomatic individual who isolates upon symptom onset as,

rS(t)={r(t)if0ttS,0ift>tS.

Specifying a proportion pa of infected individuals who can infect others but never manifest symptoms (i.e., that are asymptomatic carriers), then transmission may be partitioned into the contributions of symptomatic and asymptomatic cases as R0=R0,sps+R0,apa, in which the probability of a symptomatic case ps=(1pa). R0,s and R0,a can be equated to distinct infectiousness functions rs(t) and ra(t), in the absence of self-isolation. Concordant with previous research [18, 19], we set R0,s= R0,a and equivalent infectivity profiles in the absence of self-isolation (i.e., rs(t)=ra(t)=r(t)). If asymptomatic cases are less infectious than symptomatic cases, this assumption of equivalency entails that our estimate of the post-arrival transmission is an upper bound. Alternate overall transmission and alternate forms of infectivity over time for asymptomatic cases may easily be partitioned and tracked in the theory that follows should there be evidence to substantiate their difference.

The presence of asymptomatic carriers increases the degree of transmission consequent to a self-isolation intervention such that

R=pst = 0tsrS(t)dt+paR0 (2)

Pre-Departure Testing

In a rapidly spreading epidemic, individuals who might be traveling or attending events will tend to be early in disease time-course. In a rapidly declining epidemic, individuals who might be travelling or attending events will tend to be later in disease time-course. In a steady-state epidemic with case counts c(t), the change in case counts dcdt  0 over the period from the time of infection to ts, such that asymptomatic or presymptomatic individuals who might be about to travel or about to participate in an event are uniformly distributed across the disease time course. Provided all individuals experience symptoms at time ts and that those experiencing symptoms are excluded from arrival at time ts, then the expected post-travel transmission from an infected individual is

Rv(v)=t=vrS(t)dt,

where v is the time of arrival to an event or travel destination relative to the start of infection.

To evaluate the impact of a pre-arrival test on onward transmission from infected individuals based on when the test is administered, we can account separately for those individuals who are infected subsequent to the test and prior to travel, and those individuals who are infected prior to the test and prior to travel.

If testing occurs w days prior to travel, individuals who are infected subsequent to the test and prior to arrival who will exhibit symptoms and self-isolate at time ts—will contribute

t=wutsrS(t)dt,

where u is the duration between the test and time of infection. Integrating uniformly over potential times of infection of an individual subsequent to the test and prior to arrival, the expected contribution to post-arrival transmission for a symptomatic case is

RS,w(w)=1w u=0wt=wutsrS(t)dtdu.(3)

In contrast, individuals who are infected prior to the test (and prior to arrival)—and who will exhibit symptoms and self-isolate at time ts—will contribute

t=u+wts(1s(u)) rS(t)dt,

where u is the duration from time of infection to the time the test is conducted, and s(u) is the time-dependent diagnostic sensitivity of the test. Integrating uniformly over potential times of infection of an individual infected prior to the test, the expected contribution to post-arrival transmission for a symptomatic case is

RS,x(w)=1tsw u=0tswt=u+wts(1s(u)) rS(t)dtdu.(4)

Because Eqs 3, 4 quantify expected contributions to post-arrival transmission consequent to mutually exclusive and exhaustive events, the total post-arrival transmission from an infected traveler who will manifest symptoms as a function of when the pre-arrival test is administered is

RS,T(w)=wtsRS,w(w)+tswtsRS,x(w).(5)

Individuals who are infected subsequent to the test and prior to arrival—and who will not exhibit symptoms or self-isolate without a positive test result—will contribute

RA,w(w)=1w u=0wt=wuterA(t)dtdu,(6)

where te is the time from infection until cessation of infectivity. In contrast, individuals who are infected prior to the test (and prior to arrival at event or travel destination)—and who will not exhibit symptoms or self-isolate without a positive test—will contribute

RA,x(w)=1tew u=0tewt=u+wte(1s(u)) rA(t)dtdu,(7)

in which the time-dependent diagnostic sensitivity of the test, in time t since infection, is s(t).

Because Eqs 6, 7 quantify expected contributions to post-arrival transmission consequent to mutually exclusive and exhaustive events, the total post-arrival transmission from infected travelers who will not manifest symptoms as a function of when the pre-arrival test is administered is

RA,T(w)=wteRA,w(w)+tewteRA,x(w).(8)

Incorporating both symptomatic and asymptomatic infections, Eqs 5, 8 are exhaustive and exclusive at respective proportions of non-isolated infection pS and pA, the total post-arrival transmission from infected travelers as a function of when the pre-arrival test is administered w days before arrival is

RT(w)=pSRS,T(w)+pARA,T(w).(9)

Model Parameterization

Analytical expressions for the expected post-arrival transmission are informed by diagnostic performance data for RT-PCR and antigen testing, the timing of the test, the incubation period, the transmission over the disease time course [20], the basic reproduction number, and the proportion of asymptomatic infections [21].

Our computations use a RT-PCR diagnostic sensitivity curve that was constructed by piecewise mapping using the Cartesian pairing of the relative infectivity—obtained by dividing the infectivity profile by the magnitude of the peak infectivity—to diagnostic sensitivity from the pre- and post-peak infectivity (Supplementary Figure S1). Specifying an incubation period and corresponding distribution from Ashcroft et al [22], the baseline RT-PCR diagnostic sensitivity curve was obtained from a log-Normal distribution functional form [23] fit to the serial testing data of 27 healthcare workers from Hellewell et al [24] using a maximum likelihood approach [23, 24]—restricting the time of peak diagnostic sensitivity to the time of peak infectivity (Supplementary Figure S1). The functional form of this RT-PCR diagnostic sensitivity curve and distribution of the incubation period differs from that used in Hellewell et al [24]. From our RT-PCR diagnostic sensitivity curve, we constructed diagnostic sensitivity curves for each rapid antigen test using their temporal percent positivity agreement with RT-PCR—indicating that the diagnostic sensitivity of the rapid antigen can be no higher than that of RT-PCR. Specifically, the diagnostic sensitivity of the rapid antigen test at time t is determined by multiplying the diagnostic sensitivity of the RT-PCR test at time t by the percent positive agreement at time t. For each rapid antigen test, a linear logit model was fitted to the percent positive agreement data with a RT-PCR test from the time of symptom onset using a maximum likelihood approach [23]. To determine the percent positive agreement of the rapid antigen test during the incubation period, we used an interpolation function of the infectivity based on the Cartesian pairing of the infectivity and the percent positive agreement.

We specified an incubation period of 3.1 days [25] and basic reproduction number R0 = 6.93 [26,27] appropriate for the Omicron variant of concern (B.1.1.529), for our baseline analysis. To examine the impact of the incubation period on our results, we calculated the probability of post-arrival transmission for a RT-PCR diagnostic sensitivity curve that was informed by an incubation period of 4.4 days [28] and R0 = 5.08 [27]—appropriate for the Delta variant of concern (B.1.617.2)—as well as an incubation period of 5.72 days [22] and R0 = 2.79 [27]—appropriate for the original SARS-CoV-2 strain.

To account for over-dispersion of COVID-19 transmission [29], we specified the expected post-arrival secondary cases R to be negative-binomially distributed as

f(x|k,p)=Γ(k+x)Γ(k)Γ(x+1)pk(1p)x,

with the negative-binomial dispersion parameter k = 0.25 30,31 and the negative binomial parameter p = k/(k + R); the negative binomial distribution is commonly used to model the overdispersion of secondary infections that is typically seen in the transmission of infectious disease [32]. Accordingly, the probability of post-arrival transmission was calculated as 1f(0|k,p). To examine the impact of the dispersion parameter on our results, we conducted a one-way sensitivity analysis for a broad range of dispersion between 0.04 and 1 [29, 33].

To construct the credible intervals (2.5th and 97.5th percentiles), we first conducted a grid search, computing a broad and densely-populated likelihood surface for the parameterization of each diagnostic test. We then used likelihood-based importance sampling to obtain 1,000 importance-sampled parameter sets from values evaluated in the grid search. The proportion of infections that would remain asymptomatic across the time course of disease was obtained by drawing 1,000 samples from a Beta distribution—with a mean of 35.1%—calibrated to the 95% credible interval from 30.7% to 39.9% [21]. Computations were done in MATLAB, with source files available in an online repository [34].

Results

Specifying an incubation period of 3.1 days [25] and 35.1% of infections remaining asymptomatic over the entire course of disease [21], we computed the reduction in the expected post-arrival transmission when testing is performed using either a RT-PCR test or one of the 18 commercially available rapid antigen tests up to 7 days prior to arrival relative to the expected post-arrival transmission when there is no testing.

No Testing

For a baseline reference, we computed the expected post-arrival transmission in the absence of testing. In the absence of pre-arrival testing, the probability of post-arrival/onward transmission is 39.8% (95% CrI: 39.6%–40.1%) (Figure 1B).

FIGURE 1
www.frontiersin.org

FIGURE 1. The post-arrival transmission for pre-arrival testing. Specifying an incubation period of 3.1 days, an RT-PCR diagnostic sensitivity based on data from Hellewell et al [24], and 35.1% infections as asymptomatic throughout disease, we calculated (A) the reduction in the post-arrival transmission compared to no pre-departure testing and (B) the probability of post-arrival transmission for a basic reproduction number of 6.93 when there is no pre-departure testing (gray dotted line), or when there is pre-departure testing using an RT-PCR test (black solid line), the BD Veritor (purple dashed line), BinaxNOW (red dashed line), CareStart (blue dashed line), LumiraDx (yellow dashed line), and Sofia (green dashed line) rapid antigen test conducted at departure or any previous day, up to 7 days prior to departure (United States, 2021–2022).

Pre-Departure RT-PCR Testing

The reduction in expected post-arrival transmission became greater as the RT-PCR test was conducted closer to the day of arrival (Figure 1A). Accounting for a 24-h delay in obtaining results for RT-PCR tests, the expected post-arrival transmission for the RT-PCR test taken 24 h before departure declines by 19.2% (95% CrI: 16.0%–21.1%) (Figure 1A; Table 1). Reducing this turnaround time of 24 h to 12 h and testing 12 h before travel can decrease the expected transmission (Figure 1A), resulting in a decrease of the probability of post-arrival transmission from 37.0% (95% CrI: 36.5%–37.7%) to 34.9% (95% CrI: 34.3%–35.9%). If delays to obtain RT-PCR test results take as long as 72 h, then the probability of onward transmission can be as high as 39.2% (95% CrI: 38.9%–39.6%), with only a 4.5% (95% CrI: 3.6%–5.1%) reduction in the expected post-arrival transmission (Figure 1; Table 1). Testing a week prior to arrival at an event or travel destination produces a trivial 0.57% (95% CrI: 0.45%–0.65%) reduction in expected post-travel transmission (Figure 1A; Supplementary Figure S4).

TABLE 1
www.frontiersin.org

TABLE 1. Reduction in expected post-arrival transmission after pre-arrival testing relative to no testing a (United States, 2021–2022).

Pre-Departure Rapid Antigen Testing

We conducted analyses of 18 commercially available rapid antigen tests, focusing on the frequently used tests BD Veritor, BinaxNOW, CareStart, LumiraDx, and Sofia. Similar to RT-PCR, pre-arrival testing with rapid antigen tests led to a lower expected post-arrival transmission when testing was conducted closer to the time of arrival (Figure 1). Among the five most popular antigen tests, the reduction in the expected post-arrival transmission when testing at arrival ranged from 40.1% (95% CrI: 31.4%–42.5%) to 46.4% (95% CrI: 39.4%–49.2%), with LumiraDx exhibiting the best performance. When testing at arrival, the associated probability of post-arrival transmission for these five tests ranged from 31.5% (95% CrI: 30.7%–33.2%) to 33.0% (95% CrI: 32.5%–34.9%) (Figure 1B). Among all available antigen tests, the median reduction in the expected post-arrival transmission at departure was 45.2% (95% CrI: 38.7%–47.6%) with a range of 37.4% (95% CrI: 28.2%–40.7%) to 46.7% (95% CrI:40.0%–49.3%) (Supplementary Table S1); the median probability of post-arrival transmission was 31.8% (95% CrI: 31.1%–33.4%) (Supplementary Table S2). Of the 18 FDA-approved rapid antigen tests that could be conducted at time of arrival, none were found to result in greater transmission than RT-PCR conducted 24 h or 12 h before arrival (Supplementary Table S2).

Scenario Analysis

We examined the impact of the incubation period on the effectiveness of pre-arrival testing in the reduction of post-arrival transmission relative to no testing by lengthening the incubation from 3.1 days [25] to 4.4 days [28] and 5.72 days [22]. The expected post-arrival transmission in the context of longer incubation periods is greater than that for shorter incubation periods. For example, specifying no test prior to arrival, the post-arrival transmission is 20.0% (95% CrI: 19.7%–20.3%) larger for the 4.4-day incubation relative to the post-arrival transmission under the 3.1-day incubation period. Specifying the 5.72-day incubation period, post-arrival transmission with no test is 35.9% (95% CrI: 35.4%–36.3%) greater than that for the 3.1-day incubation period. We found that the effectiveness of testing at arrival decreased very modestly for the longer incubation periods (Supplementary Figures S2, S3; Supplementary Tables S1, S3, S5). For example, conducting the BD-Veritor test at arrival, the reduction in post-arrival transmission declined from 40.8% (95% CrI: 32.2%–44.8%) to 39.9% (95%CrI: 31.5%–43.7%) and 39.3% (95% CrI: 31.0%–43.2%), respectively for the 4.4-day and 5.72-day incubation period. In contrast, the effectiveness of testing prior to arrival increased moderately when the incubation period was lengthened (Supplementary Figures S2, S3; Supplementary Tables S1, S3, S5). For example, an RT-PCR test conducted 12 h prior to arrival reduced post-arrival transmission by 31.1% (95% CrI: 26.3%–33.5%), increasing to 34.0% (95% CrI: 28.8%–36.4%) and 35.7% (95% CrI: 30.4%–38.2%) respectively for the 4.4-day and 5.72-day incubation periods. Under these different scenarios, a rapid antigen test performed at arrival still outperformed an RT-PCR that was conducted 12 or more hours prior to arrival (Supplementary Figures S2, S3; Supplementary Tables S1, S3, S5).

To compare the effectiveness of testing on arrival across different variants, we computed the probability of post-arrival transmission for Omicron, Delta, and the original variant. Using variant-specific incubation periods and basic reproduction numbers, we found that the probability of post-arrival transmission was greatest for the Omicron variant, and lowest for the original variant (Supplementary Figures S2, S3; Supplementary Tables S2, S4, S6). For all three variants, conducting RT-PCR 12 h prior to arrival was outperformed by all 18 rapid antigen tests when conducted at arrival (Supplementary Tables S1–S6).

To examine the impact of the negative-binomial dispersion parameter on the probability of post-arrival transmission, we conducted a one-way sensitivity analysis across a wide range from 0.04 to 1 for no testing, RT-PCR testing 12-h prior to arrival, as well as BD Veritor, BinaxNOW, CareStart, LumiraDx, and Sofia conducted on arrival [29, 33]. The probability of post-quarantine transmission increases with the dispersion parameter, with the differences between tests becoming magnified (Supplementary Figure S5).

Discussion

Here we have quantified the effect of COVID-19 testing before large-scale events or travel on curtailing subsequent infections. We demonstrated that tests will provide markedly better suppression of disease spread when testing is conducted closer to arrival, consistent with previous studies [1113] and across a vast range of scenarios. Highly accurate pre-arrival testing, when conducted at an optimal time, is the least restrictive and perhaps the most promising of strategies in reducing post-arrival transmission. Our results from a broad range of scenarios and parameterization illustrate that rapid antigen tests could serve as a suitable and at times better alternative to RT-PCR, particularly if it takes 12 h or longer to receive test results.

It has been reported that rapid antigen tests alone are not sufficient in effectively identifying COVID-19 cases, because they have lower diagnostic sensitivities than RT-PCR [35]. In high-risk settings especially, RT-PCR continues to be the gold standard, and rapid antigen tests are suggested as adjunctive to other diagnostic tools [36]. However, the practical implications of when, where, and at what cost a test can be performed is a crucial component to their utility. Some countries require RT-PCR testing prior to travel and will not accept results from rapid antigen tests [5]. Pre-departure RT-PCR tests are sometimes coupled with another RT-PCR test upon entry, or additional quarantine regimens are applied, depending on the caseload in the country of origin. Specifying full adherence to self-isolation and testing protocols, we find that a rapid antigen test on the day of arrival would aid in the detection and isolation of cases, being more effective than RT-PCR testing—with turnaround time of 12 h or more—in reducing post-arrival transmission. This result is consistent with empirical evidence that rapid antigen testing 3 days prior to arrival can be effective [37], but reveals that testing closer to the day of arrival will significantly reduce transmission at events or after travel.

The trials to determine the sensitivity of most rapid antigen tests were conducted under optimal conditions, which are not necessarily representative of their practical real-world implementation. Test performance may differ substantially under practical conditions, and in the context of travel or events, may lead to post-arrival transmission values divergent from what we observed in this analysis. Independent academic investigations into the relative sensitivity for each rapid antigen test across the disease time course in a practical real-world implementation would enable increasingly accurate quantification of transmission. In a comparison of these real-world tests to those in a controlled clinical setting, a previous study demonstrated that there was similar effectiveness under these different conditions [23]. Therefore, we expect the effectiveness of each rapid antigen test presented here to be consistent in real-world implementation.

The quantification of the probability of post-arrival transmission provides a measure of effectiveness of a control strategy that accounts for the average number of secondary cases generated after arrival and individual variation in the secondary cases, but this measure is strongly dependent on the effective reproduction number. Using a basic reproductive number R0 of 6.93 26,27 (quantifying the expected number of cases generated by each case) and a negative-binomially distributed number of cases generated by each case with a dispersion parameter of 0.25 [30, 31], the probability of post-arrival transmission for testing at arrival across the rapid antigen tests considered ranged from 32% to 34% compared to 35% for an RT-PCR test conducted 12 h prior to arrival. The effective reproductive number varies depending on many factors, such as the proportion of the population susceptible, behavioral variation, and public health interventions in place. For example, the probability of post-arrival transmission will change with the evolution of the epidemic, increases in vaccination uptake, or adjustments in the enforcement/practice of disease control measures. New variants of SARS-CoV-2 have been substantially increasing the transmissibility of the virus and its effective reproduction number. Our quantification of transmission depending on the day of test is entirely dependent on the baseline level of transmission, which can differ from location to location because of differences in contact patterns, population demographics, and socio-economic status. However, because the expected post-arrival transmission scales linearly with baseline values for R, the relative utility of the tests across days remains unchanged with changes in the effective reproductive number, which changes with time over the course of the epidemic. Thus, the relative benefit of testing at times prior to travel or events will be consistent for any levels of vaccination coverage or immunity in the population, both of which scale R. In the context of the dispersion parameter, the differences between the probability of post-arrival transmission become magnified for larger dispersion parameter values, favoring the use of rapid antigen test over RT-PCR. At smaller and smaller values of the dispersion parameter, the probabilities of post-arrival transmission become increasingly similar across the different tests, diminishing the impact of the choice of test on outbreak suppression. Overall, our results comparing the probability of post-arrival transmission for rapid antigen test to RT-PCR testing to highlight the benefits of rapid turnaround and testing close to arrival are qualitatively robust.

The diagnostic sensitivity of RT-PCR and rapid antigen tests have been suggested to be lower for asymptomatic cases than symptomatic cases. However, empirical studies have found that the differences in transmission between symptomatic and asymptomatic cases are moderate, especially during the initial stages of infection [17, 3840]. This apparent reduced sensitivity among asymptomatic cases relative to symptomatic cases can be related to the time of testing over the disease time course. In the clinical trials for rapid antigen tests, samples of symptomatic individuals were concentrated around the periods of high viral loads at which symptoms appeared. In contrast, asymptomatic individuals were typically sampled across the entire disease course. As a result of this long sampling period and an unknown time of infection, the average percent positive agreement for asymptomatic cases was on average lower, appearing as a lower diagnostic sensitivity. Thus, the reduction in diagnostic sensitivity for asymptomatic cases relative to symptomatic cases might be attributable to evaluation of the tests at distinct distributions of times across the disease course [41].

A number of previous analyses have assumed a constant diagnostic sensitivity instead of a temporally varying diagnostic sensitivity for COVID-19 tests [4244]. However, this assumption implies an equal probability of detecting infection over the course of disease, even at times when the virus is not detectable. There is not yet a strong consensus on the initial sensitivity of RT-PCR tests and changes in sensitivity over the disease course. The temporal components of the average diagnostic sensitivity of a test arise due to the individual and temporal variation in viral dynamics relative to the clinical sensitivity of the test. Many studies have demonstrated a decline in viral load as the disease progresses [19, 38, 40, 45, 46], subsequently leading to a decline in RT-PCR diagnostic sensitivity [8, 24, 31, 47, 48]. While initial sensitivity for RT-PCR can be over 85%, several studies have reported significantly lower diagnostic performance [8, 49, 50]. Further, there is little agreement on the extent and exact timing of the decline in RT-PCR diagnostic sensitivity [8, 47, 48]. Confusion regarding the temporal sensitivity of RT-PCR testing can challenge achieving informative conclusions about its relative utility compared to antigen testing [51]. Rapid antigen tests detect active viral replication and produce fewer false-negatives when an individual is most infectious than in the extremely early stages or later stages of disease when detection of antigen is difficult. These temporal changes in the average diagnostic sensitivity during the early stages of disease carry greater influence on the extent of post-arrival transmission than those later in the disease time course. For example, we estimated that the diagnostic sensitivity of the Ellume rapid antigen test rapidly dropped after 12 days of exhibiting symptoms (Supplementary Figure S12). Yet, the Ellume rapid antigen had similar effectiveness in reducing post-arrival transmission as RT-PCR (Supplementary Tables S1–S6). Thus, the ability to detect a case prior to or at times of high infectivity is critical to mitigating post-arrival transmission.

Travel can rapidly disseminate disease and new variants across the globe, and large gatherings without sufficient vaccination, boosting, and testing can lead to surges in incidence [5254]. The identification of cases before entry to a new, populous locale or to social mixing can be a key to the prevention of rising incidence from introduced variants of concern and super-spreading, provided pre-arrival testing is conducted as close to arrival as possible.

Author Contributions

JT conceived and designed the study. JT and CW developed the theory and its exposition. CW developed and applied analytical approaches, wrote computational code, and designed figures with input from JT. SG and CW drafted the manuscript with AP and JT. All authors contributed to revision of the manuscript and approved the final version of the manuscript.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors acknowledge a degree of textual manuscript overlap with Wells et al. [23] and Wells et al. [55] arising from commonality of methodology regarding the collection and analysis of the percent positive agreement data for all the rapid antigen tests with RT-PCR.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.ssph-journal.org/articles/10.3389/ijph.2022.1604659/full#supplementary-material

References

1. Bielecki, M, Patel, D, Hinkelbein, J, Komorowski, M, Kester, J, Ebrahim, S, et al. Air Travel and COVID-19 Prevention in the Pandemic and Peri-Pandemic Period: A Narrative Review. Trav Med Infect Dis (2021) 39:101915. doi:10.1016/j.tmaid.2020.101915

CrossRef Full Text | Google Scholar

2. Nicola, M, Alsafi, Z, Sohrabi, C, Kerwan, A, Al-Jabir, A, Iosifidis, C, et al. The Socio-Economic Implications of the Coronavirus Pandemic (COVID-19): A Review. Int J Surg (2020) 78:185–93. doi:10.1016/j.ijsu.2020.04.018

PubMed Abstract | CrossRef Full Text | Google Scholar

3.Traveladvisories. COVID-19 Country Specific Information (2022). Available from: https://travel.state.gov/content/travel/en/traveladvisories/COVID-19-Country-Specific-Information.html (Accessed July 28, 2021).

Google Scholar

4. Kreps, D. Live Nation to Allow Touring Artists to Mandate Vaccinations, Negative Tests. Rolling Stone (2021). Available from: https://www.rollingstone.com/pro/news/live-nation-touring-artists-mandate-vaccinations-negative-tests-1208900/ (Accessed August 13, 2021).

Google Scholar

5. Ledsom, A. August EU Travel Restrictions, Covid-19 Test Requirements, Quarantine by Country. Forbes (2021). Available from: https://www.forbes.com/sites/alexledsom/2021/08/05/august-eu-travel-restrictions-covid-19-test-requirements-quarantine-by-country/ (Accessed September 17, 2021).

Google Scholar

6.USATF. USATF Masters Outdoor Championships (2021). Available from: https://usatf.org/events/2021/2021-usatf-masters-outdoor-championships (Accessed June 28, 2022).

Google Scholar

7.National Archives and Records Administration. Fact Sheet #12, Version 4: Vaccine Documentation and COVID-19 Testing Program. Report No.: 12 (2022). Available from: https://www.archives.gov/files/news/covid-19-fact-sheet-12.4-agency-testing-program-v0307 2022.pdf (Accessed April 12, 2022).

Google Scholar

8. Kucirka, LM, Lauer, SA, Laeyendecker, O, Boon, D, and Lessler, J. Variation in False-Negative Rate of Reverse Transcriptase Polymerase Chain Reaction–Based SARS-CoV-2 Tests by Time since Exposure. Ann Intern Med (2020) 173:262–7. doi:10.7326/m20-1495

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Pekosz, A, Cooper, CK, Parvu, V, Li, M, Andrews, JC, Manabe, YC, et al. Antigen-Based Testing but Not Real-Time Polymerase Chain Reaction Correlates with Severe Acute Respiratory Syndrome Coronavirus 2 Viral Culture. Clin Infect Dis (2021) 73:e2861–e2866. doi:10.1093/cid/ciaa1706

PubMed Abstract | CrossRef Full Text | Google Scholar

10.European Commission. Final Report Summary - PANDHUB (Prevention and Management of High Threat Pathogen Incidents in Transport Hubs) (2018). Available from: https://cordis.europa.eu/project/id/607433/reporting (Accessed May 17, 2022).

Google Scholar

11. Johansson, MA, Wolford, H, Paul, P, Diaz, PS, Chen, TH, Brown, CM, et al. Reducing Travel-Related SARS-CoV-2 Transmission with Layered Mitigation Measures: Symptom Monitoring, Quarantine, and Testing. BMC Med (2021) 19:94. doi:10.1186/s12916-021-01975-w

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Kiang, MV, Chin, ET, Huynh, BQ, Chapman, LAC, Rodríguez-Barraquer, I, Greenhouse, B, et al. Routine Asymptomatic Testing Strategies for Airline Travel during the COVID-19 Pandemic: a Simulation Study. Lancet Infect Dis (2021) 21:929–38. doi:10.1016/s1473-3099(21)00134-1

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Clifford, S, Quilty, BJ, Russell, TW, Liu, Y, Chan, YWD, Pearson, CAB, et al. Strategies to Reduce the Risk of SARS-CoV-2 Re-introduction from International Travellers. medRxiv (2020).

Google Scholar

14. Quilty, BJ, Clifford, S, Flasche, S, and Eggo, RM, CMMID nCoV working group. Effectiveness of Airport Screening at Detecting Travellers Infected with Novel Coronavirus (2019-nCoV). Euro Surveill (2020) 25(5):2000080. doi:10.2807/1560-7917.ES.2020.25.5.2000080

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Xiao, AT, Tong, YX, Gao, C, Zhu, L, Zhang, YJ, Zhang, S, et al. Dynamic Profile of RT-PCR Findings from 301 COVID-19 Patients in Wuhan, China: A Descriptive Study. SSRN J (2020) 2020. doi:10.2139/ssrn.3548769

PubMed Abstract | CrossRef Full Text | Google Scholar

16.CDC. Interim Guidance on Duration of Isolation and Precautions for Adults with COVID-19 (2021). Available from: https://www.cdc.gov/coronavirus/2019-ncov/hcp/duration-isolation.html (Accessed April 13, 2021).

Google Scholar

17. Cevik, M, Tate, M, Lloyd, O, Maraolo, AE, Schafers, J, Ho, A, et al. SARS-CoV-2, SARS-CoV, and MERS-CoV Viral Load Dynamics, Duration of Viral Shedding, and Infectiousness: a Systematic Review and Meta-Analysis. Lancet Microbe (2021) 2(1):e13–22. doi:10.1016/S2666-5247(20)30172-5

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Li, Y, Shi, J, Xia, J, Duan, J, Chen, L, Yu, X, et al. Frontiers in Microbiology, 11 (2020). p. 1570. doi:10.3389/fmicb.2020.01570Asymptomatic and Symptomatic Patients with Non-severe Coronavirus Disease (COVID-19) Have Similar Clinical Features and Virological CoursesA Retrospective Single Cent Study

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Lee, S, Kim, T, Lee, E, Lee, C, Kim, H, Rhee, H, et al. Clinical Course and Molecular Viral Shedding Among Asymptomatic and Symptomatic Patients with SARS-CoV-2 Infection in a Community Treatment Center in the Republic of Korea. JAMA Intern Med (2020) 180:1447–52. doi:10.1001/jamainternmed.2020.3862

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Ferretti, L, Ledda, A, Wymant, C, Zhao, L, Ledda, V, Abeler-Dörner, L, et al. The Timing of COVID-19 Transmission. medRxiv (2020).

Google Scholar

21. Sah, P, Fitzpatrick, MC, Zimmer, CF, Abdollahi, E, Juden-Kelly, L, Moghadas, SM, et al. Asymptomatic SARS-CoV-2 Infection: A Systematic Review and Meta-Analysis. Proc Natl Acad Sci (2021) 118:e2109229118. doi:10.1073/pnas.2109229118

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Ashcroft, P, Lehtinen, S, Angst, DC, Low, N, and Bonhoeffer, S. Quantifying the Impact of Quarantine Duration on COVID-19 Transmission. Elife (2021) 10:e63704. doi:10.7554/eLife.63704

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Wells, CR, Pandey, A, Moghadas, SM, Singer, BH, Krieger, G, Heron, RJL, et al. Comparative Analyses of FDA EUA-Approved Rapid Antigen Tests and RT-PCR for COVID-19 Quarantine and Surveillance-Based Isolation. medRxiv (2022).

Google Scholar

24. Hellewell, J, Russell, TW, Beale, R, Kelly, G, Houlihan, C, Nastouli, E, et al. The SAFER Investigators and Field Study Team, The Crick COVID-19 Consortium, CMMID COVID-19 working group Estimating the Effectiveness of Routine Asymptomatic PCR Testing at Different Frequencies for the Detection of SARS-CoV-2 Infections, 19 (2021). p. 106. doi:10.1186/s12916-021-01982-xBMC Med

PubMed Abstract | CrossRef Full Text

25. Águila-Mejía, JD, Wallmann, R, Calvo-Montes, J, Rodríguez-Lozano, J, Valle-Madrazo, T, and Aginagalde-Llorente, A. Secondary Attack Rates, Transmission, Incubation and Serial Interval Periods of First SARS-CoV-2 Omicron Variant Cases in a Northern Region of Spain (2022). Available from: https://europepmc.org/article/ppr/ppr445151?client=bot (Accessed March 28, 2022).

Google Scholar

26. Yang, W, and Shaman, J. COVID-19 Pandemic Dynamics in South Africa and Epidemiological Characteristics of Three Variants of Concern (Beta, Delta, and Omicron). medRxiv (2022).

Google Scholar

27. Liu, Y, and Rocklöv, J. The Reproductive Number of the Delta Variant of SARS-CoV-2 Is Far Higher Compared to the Ancestral SARS-CoV-2 Virus. J Trav Med (2021) 28:taab124. doi:10.1093/jtm/taab124

CrossRef Full Text | Google Scholar

28. Zhang, M, Xiao, J, Deng, A, Zhang, Y, Zhuang, Y, Hu, T, et al. Transmission Dynamics of an Outbreak of the COVID-19 Delta Variant B.1.617.2 - Guangdong Province, China, May–June 2021. China CDC Weekly (2021) 3(27):584–6. doi:10.46234/ccdcw2021.148

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Hébert-Dufresne, L, Althouse, BM, Scarpino, SV, and Allard, A. Beyond R0: Heterogeneity in Secondary Infections and Probabilistic Epidemic Forecasting. medRxiv (2020).

Google Scholar

30. Zhang, Y, Li, Y, Wang, L, Li, M, and Zhou, X. Evaluating Transmission Heterogeneity and Super-spreading Event of COVID-19 in a Metropolis of China. Int J Environ Res Public Health (2020) 17:3705. doi:10.3390/ijerph17103705

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Wells, CR, Townsend, JP, Pandey, A, Moghadas, SM, Krieger, G, Singer, B, et al. Optimal COVID-19 Quarantine and Testing Strategies. Nat Commun (2021) 12:356. doi:10.1038/s41467-020-20742-8

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Lloyd-Smith, JO, Schreiber, SJ, Kopp, PE, and Getz, WM. Superspreading and the Effect of Individual Variation on Disease Emergence. Nature (20057066) 438:355–9. doi:10.1038/nature04153

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Endo, A, Abbott, S, Kucharski, AJ, and Funk, S, Centre for the Mathematical Modelling of Infectious Diseases COVID-19 Working Group. Estimating the Overdispersion in COVID-19 Transmission Using Outbreak Sizes outside China. Wellcome Open Res (2020) 5:67. doi:10.12688/wellcomeopenres.15842.3

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Wells, CR, Gokcebel, S, Pandey, A, Galvani, AP, and Townsend, JP. Testing for COVID-19 Is Much More Effective when Performed Immediately Prior to Social Mixing: MATLAB Code. California, US: GitHub (2020). Available from: https://github.com/WellsRC/Pre-travel_Testing.

Google Scholar

35. Mak, GCK, Cheng, PKC, Lau, SSY, Wong, KKY, Lau, CS, Lam, ETK, et al. Evaluation of Rapid Antigen Test for Detection of SARS-CoV-2 Virus. J Clin Virol (2020) 129:104500. doi:10.1016/j.jcv.2020.104500

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Nagura-Ikeda, M, Imai, K, Tabata, S, Miyoshi, K, Murahara, N, Mizuno, T, et al. Clinical Evaluation of Self-Collected Saliva by Quantitative Reverse Transcription-PCR (RT-qPCR), Direct RT-qPCR, Reverse Transcription-Loop-Mediated Isothermal Amplification, and a Rapid Antigen Test to Diagnose COVID-19. J Clin Microbiol (2020) 58:e01438–20. Available from. doi:10.1128/jcm.01438-20

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Tande, AJ, Binnicker, MJ, Ting, HH, Del Rio, C, Jalil, L, Brawner, M, et al. SARS-CoV-2 Testing Prior to International Airline Travel, December 2020-May 2021. Mayo Clinic Proc (2021) 96:2856–60. doi:10.1016/j.mayocp.2021.08.019

CrossRef Full Text | Google Scholar

38. Kissler, SM, Fauver, JR, Mack, C, Olesen, SW, Tai, C, Shiue, KY, et al. Viral Dynamics of Acute SARS-CoV-2 Infection and Applications to Diagnostic and Public Health Strategies. Plos Biol (2021) 19(7):e3001333. doi:10.1371/journal.pbio.3001333

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Long, QX, Tang, XJ, Shi, QL, Li, Q, Deng, HJ, Yuan, J, et al. Clinical and Immunological Assessment of Asymptomatic SARS-CoV-2 Infections. Nat Med (2020) 26:1200–4. doi:10.1038/s41591-020-0965-6

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Kissler, SM, Fauver, JR, Mack, C, Tai, CG, Breban, MI, Watkins, AE, et al. Viral Dynamics of SARS-CoV-2 Variants in Vaccinated and Unvaccinated Persons. N Engl J Med (2021) 385(26):2489–91. doi:10.1056/NEJMc2102507

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Townsend, JP, and Wells, CR. The Prognostic Value of an RT-PCR Test for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) Is Contingent on Timing across Disease Time Course in Addition to Assay Sensitivity. J Mol Diagn (2022) 24(1):101–3. doi:10.1016/j.jmoldx.2021.10.002

PubMed Abstract | CrossRef Full Text | Google Scholar

42. David Paltiel, A, Zheng, A, and Walensky, RP. Assessment of SARS-CoV-2 Screening Strategies to Permit the Safe Reopening of College Campuses in the United States. JAMA Netw Open (2020) 3(7):e2016818. 3. doi:10.1001/jamanetworkopen.2020.16818

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Bosetti, P, Kiem, CT, Yazdanpanah, Y, Fontanet, A, Lina, B, Colizza, V, et al. Impact of Mass Testing during an Epidemic Rebound of SARS-CoV-2: a Modelling Study Using the Example of France. Eurosurveillance (2021) 26(1):2001978. doi:10.2807/1560-7917.es.2020.26.1.2001978

CrossRef Full Text | Google Scholar

44. Landeros, A, Ji, X, Lange, K, Stutz, TC, Xu, J, Sehl, ME, et al. An Examination of School Reopening Strategies during the SARS-CoV-2 Pandemic. PLoS One (2021) 16(5):e0251242. doi:10.1371/journal.pone.0251242

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Puhach, O, Adea, K, Hulo, N, Sattonnet, P, Genecand, C, Iten, A, et al. Infectious Viral Load in Unvaccinated and Vaccinated Individuals Infected with Ancestral, Delta or Omicron SARS-CoV-2. Nat Med (2022) 2022. doi:10.1038/s41591-022-01816-0

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Pan, Y, Zhang, D, Yang, P, Poon, LLM, and Wang, Q. Viral Load of SARS-CoV-2 in Clinical Samples. Lancet Infect Dis (2020) 20:411–2. doi:10.1016/s1473-3099(20)30113-4

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Wölfel, R, Corman, VM, Guggemos, W, Seilmaier, M, Zange, S, Müller, MA, et al. Virological Assessment of Hospitalized Patients with COVID-2019. Nature (2020) 581:465–9. doi:10.1038/s41586-020-2196-x

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Miller, TE, Garcia Beltran, WF, Bard, AZ, Gogakos, T, Anahtar, MN, Astudillo, MG, et al. Clinical Sensitivity and Interpretation of PCR and Serological COVID-19 Diagnostics for Patients Presenting to the Hospital. FASEB J (2020) 34:13877–84. doi:10.1096/fj.202001700RR

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Fang, Y, Zhang, H, Xie, J, Lin, M, Ying, L, Pang, P, et al. Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR. Radiology (2020) 296:E115–E117. doi:10.1148/radiol.2020200432

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Padhye, NS. Reconstructed Diagnostic Sensitivity and Specificity of the RT-PCR Test for COVID-19. medRxiv (2020). doi:10.1101/2020.04.24.20078949

CrossRef Full Text | Google Scholar

51. Chang, JT, Crawford, FW, and Kaplan, EH. Repeat SARS-CoV-2 Testing Models for Residential College Populations. Health Care Manag Sci (2021) 24(2):305–18. doi:10.1007/s10729-020-09526-0

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Dave, D, McNichols, D, and Sabia, JJ. The Contagion Externality of a Superspreading Event: The Sturgis Motorcycle Rally and COVID-19. South Econ J (2020) 87:769–807. doi:10.1002/soej.12475

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Lewis, D Superspreading Drives the COVID Pandemic — and Could Help to Tame it, 590 (2021). p. 544–6. doi:10.1038/d41586-021-00460-xNature

PubMed Abstract | CrossRef Full Text

54. Aschwanden, C. How “Superspreading” Events Drive Most COVID-19 Spread. Scientific Am (2020).

Google Scholar

55. Wells, CR, Pandey, A, Fitzpatrick, MC, Crystal, WS, Singer, BH, Moghadas, SM, et al. Quarantine and Testing Strategies to Ameliorate Transmission Due to Travel during the COVID-19 Pandemic: a Modelling Study. Lancet Reg Health Eur (2022) 14:100304. doi:10.1016/j.lanepe.2021.100304

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: RT-PCR, COVID-19, travel medicine, travel safety, rapid antigen test, post-arrival transmission, event safety

Citation: Wells CR, Gokcebel S, Pandey A, Galvani AP and Townsend JP (2022) Testing for COVID-19 is Much More Effective When Performed Immediately Prior to Social Mixing. Int J Public Health 67:1604659. doi: 10.3389/ijph.2022.1604659

Received: 30 November 2021; Accepted: 30 June 2022;
Published: 27 July 2022.

Edited by:

Nino Kuenzli, Swiss Tropical and Public Health Institute (Swiss TPH), Switzerland

Copyright © 2022 Wells, Gokcebel, Pandey, Galvani and Townsend. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jeffrey P. Townsend, Jeffrey.Townsend@yale.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.