 Research
 Open access
 Published:
Quantifying the shift in social contact patterns in response to nonpharmaceutical interventions
Journal of Mathematics in Industry volumeÂ 10, ArticleÂ number:Â 28 (2020)
Abstract
Social contact mixing plays a critical role in influencing the transmission routes of infectious diseases. Moreover, quantifying social contact mixing patterns and their variations in a rapidly evolving pandemic intervened by changing public health measures is key for retroactive evaluation and proactive assessment of the effectiveness of different age and settingspecific interventions. Contact mixing patterns have been used to inform COVID19 pandemic public health decisionmaking; but a rigorously justified methodology to identify settingspecific contact mixing patterns and their variations in a rapidly developing pandemic, which can be informed by readily available data, is in great demand and has not yet been established. Here we fill in this critical gap by developing and utilizing a novel methodology, integrating social contact patterns derived from empirical data with a disease transmission model, that enables the usage of agestratified incidence data to infer agespecific susceptibility, daily contact mixing patterns in workplace, household, school and community settings; and transmission acquired in these settings under different physical distancing measures. We demonstrated the utility of this methodology by performing an analysis of the COVID19 epidemic in Ontario, Canada. We quantified the age and setting (household, workplace, community, and school)specific mixing patterns and their evolution during the escalation of public health interventions in Ontario, Canada. We estimated a reduction in the average individual contact rate from 12.27 to 6.58 contacts per day, with an increase in household contacts, following the implementation of control measures. We also estimated increasing trends by age in both the susceptibility to infection by SARSCoV2 and the proportion of symptomatic individuals diagnosed. Inferring the age and settingspecific social contact mixing and key agestratified epidemiological parameters, in the presence of evolving control measures, is critical to inform decision and policymaking for the current COVID19 pandemic.
1 Introduction
In response to the current COVID19 pandemic, interventions aimed at controlling local transmission such as school and nonessential business closures, physical distancing, contact tracing, enhanced surveillance and diagnostic testing have been adopted throughout many nations of the world [1]. The efficacy of these measures and their influence on the trajectory of local epidemics has been quantified in a series of mechanistic modelling studies [2â€“5], as well as in systematic reviews and metaanalyses [6â€“8]. Additionally, key factors associated with demographic heterogeneities such as agedependent social contact mixing and susceptibility to infection and their implications on transmission patterns of COVID19 have been explored in prior works [9â€“11]. While there has been increasing utilization of age and settingspecific contact mixing patterns to inform COVID19 pandemic public health decisionmaking, rigorously quantifying their variations during a pandemic intervened by changing public health measures presents a significant challenge in the absence of time and resources to conduct a highquality contact survey (e.g., as in prior work [11â€“13]). Moreover, a methodology for identifying such age and setting (workplace, household, school and community)specific contact mixing patterns using readily available data is in great demand and has yet to be established. Such contact mixing patterns are key for the retroactive evaluation and proactive assessment of the effectiveness of different age and settingspecific interventions. Further, a comprehensive modelling approach that integrates key heterogeneities by age/setting and a generalized intervention package accounting for evolving nonpharmaceutical interventions, diagnostic testing, contact tracing, and case isolation may be utilized for a broad spectrum of risk assessment, preparedness planning, reopening measures, scenario analysis and intervention evaluation.
Understanding age and setting (workplace, household, school and community)specific transmission is fundamental for retrospectively assessing the effects of nonpharmaceutical interventions on transmission, and essential for planning (smart) relaxation of measures while protecting the most vulnerable populations. The interruption of contact routes (through interventions such as physical distancing, the closing of schools, workplaces and community gathering places) naturally shifts contact patterns among different settings. We may thus expect to observe an increase in transmission in some settings. Understanding these changes is critical to avoid unwanted increases in transmission amongst vulnerable portions of the population. Since many of the nonpharmaceutical intervention measures taken to counteract the spread of COVID19 are unprecedented and highly disruptive to personal life, their effects are not completely understood and largely depend on the adherence of individuals and their behavior. Hence, retrospectively assessing the consequences of interventions provides important tools to evaluate the effectiveness of such measures, and to prospectively inform the expected outcomes of relaxations [11, 14] and possible reintroduction of intervention measures in the event of resurgence.
In addition to contact mixing patterns, recent attention has been given to agespecific epidemiological and clinical parameters for COVID19 [9, 10, 15], as they allow one to assess which portions of the population may be key drivers of the epidemic or which portion may be most vulnerable to infection. For instance, children and adolescents are likely key contributors to the spread of respiratory infections, as they tend to mix assortatively and have relatively high contact rates [16]. Consequently, school closure is one of the first nonpharmaceutical interventions considered to mitigate the spread of an emerging respiratory infection. However, if children and adolescents were demonstrated to have low transmissibility and/or susceptibility, their contribution to infection could be minor despite higher contact rates and highly assortative mixing patterns. In this light, understanding the agespecific contribution to infection in terms of transmissibility and susceptibility is key for planning interventions [9] and designing effective vaccination strategies and other pharmaceutical interventions.
Here we propose a general methodology to investigate the age and settingspecific contribution to the transmission of an infectious disease and illustrate the approach by taking the COVID19 epidemic in Ontario, Canada as a case. We develop and utilize a suitable transformation accounting for the specific demographic profile in Ontario so that for a given choice of age group divisions, agespecific contact patterns can be constructed from seminal works on contact mixing [16, 17]. The transmission model we propose accounts for two key control measures for communicable diseases, diagnosis of cases as a result of symptoms, and isolation through contact tracing [2â€“5]. By fitting the model output to agestratified incidence data, we inform critical parameters including the agestratified susceptibility to infection. Finally, by incorporating information about the features and timing of nonpharmaceutical interventions and the consequent shifts in contact patterns, the fitting procedure allows us to quantify such changes and retrospectively inform the effect of intervention measures on the social contact patterns and the setting of transmission events. Specifically, in Ontario we consider four key periods of control measure escalation which we denote by distinct phases: phaseÂ 0, monitoring and international travel advisories (until March 13); phaseÂ 1, public school closure (March 14â€“17); phaseÂ 2, state of emergency declaration and physical distancing advisories (March 18â€“23); phaseÂ 3, closure of nonessential workplaces (March 24â€“May 16). We explore the robustness of our estimates using several layers of uncertainty analysis.
2 Methods
2.1 Transmission model
We extended the COVID19 transmission dynamics model introduced in prior studies [2â€“5] to include age structure. The model captures essential epidemic features and key public health interventions. The population is divided into susceptible (S), exposed (E), asymptomatic infectious (A), infectious with symptoms (I), and recovered (R) compartments according to the epidemiological status of individuals, and further into diagnosed and isolated (D), quarantined susceptible (\(S_{q}\)), and isolated exposed (\(E_{q}\)) compartments based on control interventions involving testing, contact tracing, quarantine and isolation. In particular, the model accounts for contact tracing, where a proportion, q, of individuals exposed to the virus are quarantined. The quarantined individuals can either move to the compartment \(E_{q}\) or \(S_{q}\), depending on whether they are effectively infected or not, while the other proportion, \(1  q\), consists of individuals exposed to the virus who are missed from contact tracing and, therefore, move to the exposed compartment E once effectively infected, or stay in the compartment S otherwise. Furthermore, the population is stratified into n age groups, where the social interactions between age groups are described via a contact matrix, C, which incorporates information about agespecific contacts in different settings, including households, schools, workplaces and the general community. We assumed that the susceptibility and diagnosis rates depend on the specific age group, whereas all remaining parameters are constant across age groups.
The model reads
for each age group \(i=1,\ldots,n\), where \(N_{i}\) (\(N_{j} \)) denotes the total population in age group iÂ (j). Additionally, we allowed several parameters to be timedependent during phaseÂ 3, to account for a gradual adaptation of the society to the stricter physical distancing measures. The transmission dynamics in an agestratified population is illustrated in Fig.Â 1 with all model compartments and parameters defined in TablesÂ 1 andÂ 2, respectively. The model parameter definitions are also provided in the subsequent section.
Parameter definitions
The susceptibility to infection \(\beta _{i}\) (i.e., the probability of a susceptible individual being infected upon contact with an infectious individual) and the diagnosis rate from the symptomatic compartment \(\delta _{Ii}\) were assumed to be agespecific. We assumed the agedependent susceptibility to infection and the diagnosis rates to be constant for each age class during phasesÂ 0â€“3.
The incubation period \(1/\sigma _{i} =1/\sigma \), the quarantine period \(1/\lambda _{i} =1/\lambda \), the modification factor for asymptomatic transmission \(\theta _{ij} =\theta \), the recovery rates \(\gamma _{Ai} = \gamma _{A}\), \(\gamma _{Di} = \gamma _{D}\), \(\gamma _{Ii} = \gamma _{I}\), the diseaseinduced death rate \(\alpha _{i} =\alpha \), the ratio of symptomatic infections \(\varrho _{i} =\varrho \), and the quarantine proportion and diagnosis rates, \(q_{i} =q\) and \(\delta _{qi} = \delta _{q}\), were assumed to be equal for all age groups. All ageindependent parameters are listed in TableÂ 2. Most parameters were assumed to be constant through all the escalation phases, except for the quarantine rate, which was assumed to be exponentially increasing in phaseÂ 3, in order to capture the intensification of contact tracing effort from the public health system. We set
where \(q_{0}\) is the constant quarantine proportion prior to March 24, \(q_{b}\) is the maximum quarantine proportion after March 24 and \(r_{q}\) represents the exponential rate of increase.
In addition, we assumed timedependent contact rates in phaseÂ 3, to capture the gradual adaption of physical distancing in various locations during this period. To capture the change in contact patterns during different phases of escalation of physical distancing, we defined the social contact matrix C piecewise as follows:
where \(T_{S}\), \(T_{0}\), \(T_{1} \), \(T_{2} \) and T mark as the start date of phaseÂ 0, 1, 2, 3 and the end date of phaseÂ 3 (before the deescalation phases). The contact matrix in phaseÂ 3 was assumed to be timedependent, to describe a gradual adaptation of the society to adhere to the stricter measures enforced.
Each matrix \(C^{0}\), \(C^{1}\), \(C^{2}\), \(C^{3} (t)\) was constructed as a linear combination of the settingspecific contact matrices. Specifically, let \(C^{H}\), \(C^{W}\), \(C^{C}\), \(C^{S}\) denote the baseline contact matrices quantifying the daily contact rate of physical and nonphysical contacts in household, workplace, community and school settings. The superscripts H, W, C, S associated with contact matrices and model parameters will be used to refer to household, workplace and community settings, respectively. The entries of the contact matrices are the number of daily social contacts of a single individual in age class i with individuals in age class j (units contacts/day as defined by those contacts believed to be relevant for the spread of respiratory illnesses) [16]. In what follows, \(p_{l}^{k} >0\) denotes the relative increase (or decrease) in the weight of the daily individual contact rate matrix in setting k from intervention phaseÂ l. That is, the superscript k can be H, W, C or S to associate parameters with household, workplace, community or school settings, respectively. Note that, because of the different nature of contacts in different settings, a decrease in contact in one setting does not necessarily mean an equal increase in a different setting in terms of either weight or numbers (and vice versa). In fact, each escalation phase could change the contact patterns both qualitatively and quantitatively, and contacts lost in one setting do not necessarily shift completely to another. For this reason, we did not assume a specific relation between the coefficients \(p_{l}^{k}\) in each phase, allowing contact patterns in each setting to change independently. In the following, the contact matrix in each escalation phase is defined and discussed individually.
PhaseÂ 0: monitoring and international travel advisories
We assumed the contact mixing in the absence of physical distancing and mandatory closures is the linear combination of the four settingspecific matrices, each with an equal weight of 1:
PhaseÂ 1: public school closure
The phaseÂ 1 mixing matrix is given by:
Here \(p_{1}^{H}\) is the percent increase in the weight of the household contact matrix from phaseÂ 0 to phaseÂ 1. Similarly, \(p_{1}^{C}\) is the percent increase in the weight of the community contact matrix from phaseÂ 0 to phaseÂ 1. In the remaining equations, the school contact matrix is no longer written explicitly to simplify their appearance.
PhaseÂ 2: physical distancing advisories
The phaseÂ 2 mixing matrix is given by:
Here \(p_{2}^{H}\) is the percent increase in the weight of the household contact matrix from phaseÂ 1 to phaseÂ 2. Also, \(p_{2}^{C}\) is the percent reduction in the weight of the community contact rate matrix from phaseÂ 1 to phaseÂ 2 due to physical distancing advisories and closures.
PhaseÂ 3: closure of nonessential workplaces
During phaseÂ 3, we allowed the coefficients of each settingspecific matrix to be timedependent (either exponentially increasing or decreasing), to capture the gradual adaptation of society to the new more restrictive measures. Specifically, we assumed that workplace and community contacts were gradually decreasing, whereas household contact was gradually increasing, possibly with different rates. The phaseÂ 3 mixing matrix is given by:
where \(p_{3}^{H}\) is the maximal percent increase in the weight of the household contact matrix from phaseÂ 2 to phaseÂ 3. \(p_{3}^{W}\) and \(p_{3}^{C}\) are the maximal percent reduction in the weight of the workplace and community contact matrix, respectively, from phaseÂ 2 to phaseÂ 3 resulting from the closure of nonessential workplaces.
Age group subdivision
We stratified the population of Ontario into \(n=6\) age groups, comprised of ages 0â€“5, 6â€“13, 14â€“17, 18â€“24, 25â€“64, 65+, which broadly represent children (ages 0â€“5), elementary and middle school (ages 6â€“13), high school (ages 14â€“17), university (ages 18â€“24), workforce (ages 25â€“64) and seniors (ages 65+), and we ascribe the indices \(i=1, 2,\ldots, 6\) to these classes (TableÂ 3). We considered six age groups since most physical distancing measures taken in Ontario have been formulated and implemented corresponding to these six agegroups.
Initial conditions
The initial susceptible populations were fixed as the total population of each age class in Ontario, Canada which were obtained from Statistics Canada [20]. We considered the initial fitting date (\(t=0\)) to be February 26, which marks the date at which sustained case accumulation began in Ontario. Therefore, we supposed there were initially no recovered individuals, that is \(R_{i} ( 0 ) =0\) for each age classÂ i. The initial diagnosed populations were fixed as the numbers of cumulative cases for each class till February 26. Similarly, we set \(S_{qi} ( 0 ) = E_{qi} ( 0 ) =0\) for each age classÂ i. Since the confirmed cases for the three youngest age groups (ages 0â€“17) are zero for at least one week after February 26, we set \(E_{i} ( 0 ) = A_{i} ( 0 ) = I_{i} ( 0 ) =0\) for \(i=1,2,3\), while we estimated the conditions for \(i=4, 5, 6\). All the initial conditions for model (1) are listed in TableÂ 2 and TableÂ 4.
2.2 Data
We used prior results and data to construct the baseline social contact matrices for Ontario, Canada. We retrieved the agestratified population estimates for Ontario in year 2019 and Canada in year 2006 from Statistics Canada [20]. As part of the POLYMOD project, social contact surveys in eight European countries were conducted between May 2005 and September 2006 to quantify agespecific contact heterogeneity [16]. Countryspecific data on household structures, laborforce participation rates, and school enrolment were utilized to project the European social contact data to contact rates representative of 152 countries, including Canada [17]. We utilized the projected setting (household, workplace, community and school)specific contact matrices for Canada [17] in this study and adapted them to represent mixing in Ontario.
To proceed with model fitting, there are several additional data sources utilized within this study. While in this case study data specific to Ontario was utilized, we note this approach is based on a general methodology that can be applied broadly. First, we utilized the timeline of interventions taken by the government of Ontario, Canada. The escalation of physical distancing measures in Ontario consisted of three major steps: public school closure (from March 14), declaration of state of emergency, with closure of public venues and events and physical distancing advisories (from March 18), and closure of nonessential establishments (from March 24). On May 16, selected nonessential activities had resumed, marking the end of the nonessential establishment closure in Ontario. Second, we utilized the agestratified cumulative confirmed positive tests in Ontario, Canada. We obtained this data of the agespecific cumulative cases of COVID19 in Ontario from the Ontario Ministry of Health, which was made available to us through the Ontario COVID19 Modeling Consensus Table. Third, the agestructured demographic data specific to Ontario is available publicly by Statistics Canada [20]. These main sources of data enabled the fitting of mathematical model and all subsequent analyses.
2.3 Contact mixing matrices
We established the settingspecific contact matrices in the household, workplace, community, and school in Ontario, Canada denoted \(C^{H}\), \(C^{W}\), \(C^{C}\), \(C^{S}\), respectively (Fig.Â 2). We derived these mixing matrices from the Canadaspecific contact matrices [17] through a series of transformations to account for the Ontario demographic profile and the desired age group division, then utilized these as baseline contact patterns in the absence of physical distancing measures. The details, including the specific definitions and mathematical formulation of the baseline contact matrices, are included in Appendix A: Baseline contact matrices.
2.4 Model fitting procedure
To estimate model parameters, we fit the mathematical model to agestratified cumulative incidence data. We first informed model (1) with several parameter values from existing studies (TableÂ 2) and also the established social contact matrices. We then run model (1) forward from time \(t = T_{s}\) (chosen as February 26, corresponding to the date at which sustained case accumulation began in Ontario) to time T (chosen as May 16, the date of first easing of restrictions), and determined parameters which minimize the least square error against the agestratified cumulative incidence. In other words, we estimated parameters associated with model (1) by fitting to six lists of time series data representing cumulative incidence according to age class. To obtain confidence intervals for the estimated parameters, we used a bootstrap method to generate 1000 cumulative incidence time series from a Poisson distribution with mean given by the reported data and fitted the model to each dataset. We assumed a Poisson error structure in the newly reported cases to address noise in this time series data (for context of this topic, see [21]).
2.5 The control reproduction number
The control reproduction number \(R_{t}\) describes the average number of secondary cases that one random infected individual produces during its infectious period, under the control measures (diagnosis and quarantine). We obtained the control reproduction number of model (1) using the next generation method [22]. \(R_{t}\) is the spectral radius of the next generation matrix \(K(t)\). The (timedependent) next generation matrix for the parameters considered in this paper (i.e. with \(\beta _{i}\) and \(\delta _{Ii}\) both age specific) is
for \(i, j\in \{ 1, 2,\ldots, n \} \) where \(A_{j} = \frac{\rho }{\delta _{I,j} + \gamma _{I}} + \frac{\theta ( 1\rho )}{\gamma _{A}}\).
2.6 Infectious contacts
We compared the estimated values for the mean infectious contact, i.e., the mean number of contacts per day that result in an infection with a homogeneous mixing model of similar scope [2]. In the agestructured model (1) each contact contributes differently to transmission; hence, the mean contact rates estimated from the agestructured model in each phase are not directly comparable with the contact rate obtained by fitting a homogeneous model, as done in previous work [2]. For the homogeneous model, this is computed as Î²c, where c and Î² denote the contact rate and probability of infection upon contact previously estimated, respectively [2]. For the agestructured model, we considered the combination \(\frac{1}{N} \sum_{i} \beta _{i} N_{i} \sum_{j} C_{ij} (t)\), which accounts for the agestratified susceptibility to infection.
2.7 Contact rates and infections acquired in each setting
The settingspecific contact rate was computed based on each estimated settingspecific contact matrix and population profile in 2019 for Ontario. The mean connectivity, or the number of daily contacts averaged over all individuals in the population with mixing matrix C, is defined as
The allsetting social contact rates were calculated from the sum of the settingspecific contact rates. For the details of the terminology, definitions, and methods associated with the contact mixing matrices, see Appendix: Baseline contact matrices.
We computed the infections acquired in each setting by using the estimated model parameters (TablesÂ 2 andÂ 4) and model (1). Specifically, the infections acquired in each setting were tracked in time as the sum of the inflow to the exposed (E) and exposed quarantined (\(E_{q}\)) compartments. We added four additional compartments to the mathematical model, one each for workplace, school, household and community setting, and using the estimated model parameters and settingspecific contact matrices, solve the system of ordinary differential equations to assess the infections acquired in each setting.
2.8 Uncertainty analysis
The robustness of our estimates is explored with several layers of uncertainty analysis. First, we quantified parameters in terms of the uncertainty in reported cases by assuming a Poisson error structure and fit model (1) to 1000 corresponding realizations. The resulting uncertainty in the model fit is expressed in terms of uncertainty in the estimated model parameters. Second, we assessed the empirical distributions of several of the key estimated parameters. The empirical distributions of the agespecific susceptibility to infection and the estimated weights associated with the contact matrices were constructed to investigate the robustness of these estimates.
3 Results
3.1 Model fitting
Through model fitting, we estimated the ageindependent parameters (TableÂ 2) and agedependent parameters (TableÂ 4). The model fit with quantified uncertainty against the agestratified cumulative incidence data is shown in Fig.Â 3 and with all age classes combined in Fig.Â 4. By estimating the weights associated with the settingspecific contact matrices, we identified the mixing patterns in all four phases of escalation (Fig.Â 5) as well as the mean individual contact rate (Fig.Â 6). The fitted parameters allowed us to estimate the effective reproduction number (Fig.Â 7) and the mean infectious contact (TableÂ 5), for which we provide comparison with a homogeneous mixing model of similar scope [2].
3.2 Settingspecific social contact mixing
We estimated the agespecific contact mixing profile for each phase of escalation (Fig.Â 5). We estimated the mean contact rate (i.e., the average number of contacts per day of one random individual with the total population) in the absence of physical distancing measures to be 12.27 per day per person in Ontario. This contact rate was assumed during phaseÂ 0, which corresponds to the beginning of the epidemic in Ontario where no major physical distancing advisories were in effect (Fig.Â 6(A)). FigureÂ 6 shows the breakdown of contact rates by their respective setting (school, workplace, household, and general community). Relative to the preintervention value, the total increase of household contacts was 13% after school closure, 45% after the additional physical distancing measures, and 51% on May 16 after the closure of nonessential businesses (TableÂ 6). Measures following the closure of nonessential businesses were estimated to have an impact of 59% reduction in the total workplace contacts and 85% communityrelated contacts as of May 16 (TableÂ 6 and Fig.Â 6). TableÂ 6 shows a complete summary of the estimated shifts in terms of the mean daily contact rate in Ontario. We also depicted the empirical distributions of the weights of the phase and settingspecific contact matrices (Fig.Â 8).
3.3 Infections acquired in workplace, household, community and school settings
We quantified the number of cumulative infections acquired in each setting and age group (Fig.Â 9). During phaseÂ 0, the cumulative infections were estimated to primarily result from community contacts, followed by contacts at workplaces and households (Fig.Â 9). The community contacts played the primary role in contributing effective transmissions till the early stage of phaseÂ 3, when the infections from household contacts eventually took over the primary role (Fig.Â 9). Households are the locations where the highest number of infections were estimated to occur among all age groups by May 16 (Fig.Â 10). Communities were the second most popular location to gain infections for age groups of individuals younger than 17 and older than 65 (Fig.Â 10). The age classes composed of young children and individuals aged 65 and above were estimated to gain relatively few infections from workplace contacts, while the working group (ages 25â€“64) acquired a similar number of infections from workplaces compared to households (Fig.Â 10). The estimated infections from school setting contacts were relatively few due to the early closure of schools at the beginning of phaseÂ 1 (Fig.Â 10). Overall, the workforce age class (aged 25â€“64) consistently was estimated to acquire a higher number of infections at workplaces, communities and schools compared to other age groups (Fig.Â 11). This was followed by individuals aged 18â€“24 in workplaces and schools (Fig.Â 11(A)(D)), while households and communities were settings of considerable transmission for the senior age group (aged 65+), shown in Fig.Â 11(B)(C).
3.4 Agespecific susceptibility to infection and diagnosis probability
We estimated the agestratified probability of diagnosis for symptomatic individuals and susceptibility to infection (TableÂ 7). More precisely, the susceptibility to infection in our model refers to the probability of infection upon contact with an infectious individual. We also depicted the empirical distributions of the agespecific susceptibilities corresponding to the uncertainty analysis conducted (Fig.Â 12). The estimated agespecific susceptibilities are robust to error in the reported case counts, which can be observed from their respective empirical distributions (Fig.Â 12).
4 Discussion
We estimated that the susceptibility to SARSCoV2 infection increases with age, which is consistent with findings from prior works [9, 11]. From our estimates, younger age groups (17 and below) have relatively low susceptibility to infection (less than 3%) compared to the senior age class (65+), with a probability of 50.2% to be infected upon contact (TableÂ 7). Further, we estimated the senior class to be the most susceptible to infection (TableÂ 7). This comes in addition to the relatively high vulnerability of the senior age group [10, 15, 23, 24], and provides further support to the necessity of protecting these individuals. The relatively lower susceptibility of younger children suggests that they may not have been a major driver of the COVID19 epidemic in Ontario until May 16, if their transmissibility was comparable to the remaining age groups, confirming the existing literature [25â€“27]. We urge caution in interpreting these results, as in light of emerging data, that rapidly increased cases among nonseniors in Ontario indicate that mixing among these age groups and less abidance to physical distancing measures has been evident (for details see Appendix B: Caution in interpretation). Also, our findings of susceptibility are in line with a retrospective cohort observational study conducted in mainland China, which computed a secondary attack rate among household contacts of 12.4â€“17.1%, with a lower risk of developing the infection among the younger subjects with respect to the elderly [28]. We also estimated an overall increasing trend with age in the probability of diagnosis among symptomatic individuals (TableÂ 7). This finding is both logical and consistent with prior findings [15], as the severity of illness due to COVID19 has been found to increase with age and cases requiring medical attention may be more likely to be captured by the virologic surveillance system. Finally, our results are in line with the findings of the existing modeling studies [29â€“32] that have found that a timely and stringent implementation of nonpharmacological interventions are effective in curbing the spread of the ongoing outbreak, if they are enforced until the virus transmission has been significantly reduced.
In this study, we estimated a 46% (12.27 to 6.58) decrease in the mean individual contact rate following the implementation of a series of government interventions in Ontario (TableÂ 6). Studies which also estimated the social contact rates during the COVID19 era, consisted of contact surveys where participants were asked to provide details about the number and locations of their social contacts. Findings from these studies indicate that physical distancing measures have led to the reduction of daily social contact rates in China [11, 33], Luxembourg [13], and the UK [12], with varying degrees of reduction. The agestratified contact matrices, in the presence of government interventions, were identified in three studies [11, 12, 33] and their implications explored in terms of impact on the basic reproduction number [12] and modelbased analyses [11, 33]. In agreement with our study, the estimated contact mixing patterns following the implementation of interventions had closely resembled the household mixing pattern (Fig.Â 5) [11, 33]. The estimated average number of daily contacts per participant before and during lockdown, were from 7.9 to 2.2 (72.2% reduction) in Shenzhen, 10.8 to 2.8 (74% reduction) in the UK, 9.5 to 2.2 (76.8% reduction) in Changsha, 18.8 to 2.3 (87.8% reduction) in Shanghai, 17.5 to 3.2 (81.7% reduction) in Luxembourg, to 14.6 to 2 (86.3% reduction) in Wuhan [11â€“13, 33]. It is possible that the surveybased approaches underestimate the contact rate, as there is a risk of bias from sources such as selection and recall bias. Also, participants may not wish to disclose their true number of contacts during government interventions. These factors may explain differences between the estimates from the two methodologies. Even so, with the datadriven approach presented in this study or the surveybased approach, it has been estimated that a substantial decrease in the individual contact rate occurred following the implementation of government interventions, with a shift to household contact. Overall, through the reduction in social contact rate and alteration of the mixing patterns, modelbased analyses indicate interventions have been effective in mitigating transmission [11, 33].
As each physical distancing intervention may cause a shift in contact patterns, for instance by increasing the time that individuals spend at home, estimating the relative increase or decrease of the settingspecific daily contacts in each escalation phase enables the assessment of the expected shift of the infection towards different subpopulations and the contribution of contacts in each setting to the spread of infection. We estimated an effective decrease in contacts in the workplace and community settings; meanwhile, the household contact has increased by 51% from the preintervention phase to the end of lockdown phase on May 16 (TableÂ 6). Therefore, additional household transmission should be taken into account by decisionmakers when planning and implementing interventions, especially in light of the relatively high contact rates of seniors in household settings.
Estimates of the age and settingspecific social contact patterns during escalation of physical distancing, together with a deeper understanding of the agespecific susceptibility, allow to investigate different scenarios for reopening the economy, including businesses and schools [30â€“32]. These estimates provide needed tools to simulate scenarios of staged reopening or reopening targeted to specific subgroups, such as resuming of partial school classes, selected business sectors, etc. Additionally, this framework may be used for scenario analysis such as rotating workforce strategies, where the workforce is divided into groups with different working schedules. The specific choice of the age group subdivision in this study is motivated by age targeted intervention, in the spirit of assessing gradual resumption of schools and workplaces. Further, this framework can be used to incorporate vaccination of different age classes in the event an efficacious vaccine comes to light and identify optimal distribution strategies. Although we have focused primarily on agestratified contact mixing, susceptibility and symptomatic diagnosis probability in this study, we also used the modelling framework to quantify key control parameters related to the efficacy of contact tracing efforts (for the details, see Appendix C: Control parameter assessment).
This study and its data sources have several limitations. For our analyses, we primarily used cumulative incidence data, which is subject to several forms of error that may result in inaccuracies and biased estimates. Additional sources of error in our study may result from the specific circumstances in Ontario, in which a disproportionate number of health care workers were affected by COVID19 and outbreaks had occurred in longterm care homes. For a discussion of these details, see Appendix D: Limitations in incidence data.
5 Conclusions
The methodology introduced and illustrated in this study aims to provide the muchneeded tools for intervention evaluation in terms of inferring the age and settingspecific contact mixing in rapidly evolving circumstances, without the time and resources required for surveybased approaches. The datadriven, modelbased approach can provide insights in almost real time based on incoming data, which is key to inform decision and policymaking in an emergency situation, such as the current pandemic. We also note that the necessary surveillance data for COVID19 and demographic data for analyses is readily and publicly available in many regions worldwide. Similarly, the age and settingspecific mixing matrices utilized within are available in 152 countries [17]. Hence, the methodology can be readily adopted in many regions worldwide and could yield insights of the transmission risk and the effectiveness of different age and setting (workplace, school, community, and household)specific interventions.
Availability of data and materials
The datasets generated during and/or analyzed during the current study are available publicly except for the agestratified COVID19 incidence data.
References
World Health Organization. Responding to community spread of COVID19: interim guidance. 2020. Accessed Aug 7 2020.
Tang B, Scarabel F, Bragazzi NL, McCarthy Z, Glazer M, Xiao Y et al.. Deescalation by reversing the escalation with a stronger synergistic package of contact tracing, quarantine, isolation and personal protection: feasibility of preventing a Covid19 rebound in Ontario, Canada, as a case study. Biology. 2020;9(5):100.
Wu J, Tang B, Bragazzi NL, Nah K, McCarthy Z. Quantifying the role of social distancing, personal protection and case detection in mitigating COVID19 outbreak in Ontario, Canada. JÂ Math Ind. 2020;10(1):1â€“2.
Tang B, Bragazzi NL, Li Q, Tang S, Xiao Y, Wu J. An updated estimation of the risk of transmission of the novel coronavirus (2019nCov). Infect Dis Model. 2020;5:248â€“55.
Tang B, Wang X, Li Q, Bragazzi NL, Tang S, Xiao Y et al.. Estimation of the transmission risk of the 2019nCoV and its implication for public health interventions. JÂ Clin Med. 2020;9(2):462.
Chu DK, Akl EA, Duda S, Solo K, Yaacoub S, SchÃ¼nemann HJ et al.. Physical distancing, face masks, and eye protection to prevent persontoperson transmission of SARSCoV2 and COVID19: a systematic review and metaanalysis. Lancet. 2020;395(10242):1973â€“87.
NussbaumerStreit B, Mayr V, Dobrescu AI, Chapman A, Persad E, Klerings I et al.. Quarantine alone or in combination with other public health measures to control COVID19: a rapid review. Cochrane Database Syst Rev. 2020;4(4):CD013574.
Viner RM, Russell SJ, Croker H, Packer J, Ward J, Stansfield C et al.. School closure and management practices during coronavirus outbreaks including COVID19: a rapid systematic review. Lancet Child Adolesc Health. 2020;4(5):397â€“404.
Davies NG, Klepac P, Liu Y, Prem K, Jit M, CMMID COVID19 working group et al.. Agedependent effects in the transmission and control of COVID19 epidemics. Nat Med. 2020;26:1205â€“11.
Wu JT, Leung K, Bushman M, Kishore N, Niehus R, de Salazar PM et al.. Estimating clinical severity of COVID19 from the transmission dynamics in Wuhan, China. Nat Med. 2020;26(4):506â€“10.
Zhang J, Litvinova M, Liang Y, Wang Y, Wang W, Zhao S et al.. Changes in contact patterns shape the dynamics of the COVID19 outbreak in China. Science. 2020;368(6498):1481â€“6.
Jarvis CI, van Zandvoort K, Gimma A, Prem K, Klepac P, Rubin GJ et al.. Quantifying the impact of physical distance measures on the transmission of COVID19 in the UK. BMC Med. 2020;18:10.
Latsuzbaia A, Herold M, Bertemes JP, Mossong J. Evolving social contact patterns during the COVID19 crisis in Luxembourg. PLoS ONE. 2020;15(8):e0237128.
Liu Y, Gu Z, Xia S, Shi B, Zhou XN, Shi Y et al.. What are the underlying transmission patterns of COVID19 outbreak? An agespecific social contact characterization. EClinicalMedicine. 2020. https://doi.org/10.1016/j.eclinm.2020.100354.
Verity R, Okell LC, Dorigatti I, Winskill P, Whittaker C, Imai N et al.. Estimates of the severity of coronavirus disease 2019: a modelbased analysis. Lancet Infect Dis. 2020;20(6):669â€“77.
Mossong JL, Hens N, Jit M, Beutels P, Auranen K, Mikolajczyk R et al.. Social contacts and mixing patterns relevant to the spread of infectious diseases. PLoS Med. 2008;5(3):e74.
Prem K, Cook AR, Jit M. Projecting social contact matrices in 152 countries using contact surveys and demographic data. PLoS Comput Biol. 2017;13(9):e1005697.
Special Expert Group for Control of the Epidemic of Novel Coronavirus Pneumonia of the Chinese Preventative Medicine Association TCPMAssociation. An update on the epidemiological characteristics of novel coronavirus pneumonia (COVID19). Chin J Epidemiol. 2020;41:139â€“44.
Tang B, Xia F, Tang S, Bragazzi NL, Li Q, Sun X et al.. The effectiveness of quarantine and isolation determine the trend of the COVID19 epidemics in the final phase of the current outbreak in China. Int J Infect Dis. 2020;95:288â€“93.
Statistics Canada. TableÂ 1710000901 population estimates, quarterly. 2020.
Chowell G. Fitting dynamic models to epidemic outbreaks with quantified uncertainty: a primer for parameter uncertainty, identifiability, and forecasts. Infect Dis Model. 2017;2(3):379â€“98.
van den Driessche P. Reproduction numbers of infectious disease models. Infect Dis Model. 2017;2:288â€“303.
Report of the WHOâ€“China joint mission on coronavirus disease 2019 (COVID19). 2020. https://www.who.int/publications/i/item/reportofthewhochinajointmissiononcoronavirusdisease2019(covid19). Accessed 7 Aug 2020.
The Novel Coronavirus Pneumonia Emergency Response Epidemiology Team. The epidemiological characteristics of an outbreak of 2019 novel coronavirus diseases (COVID19). China CDC Wkly. 2020;2(8):113â€“22.
Saleem H, Rahman J, Aslam N, Murtazaliev S, Khan S. Coronavirus disease 2019 (COVID19) in children: vulnerable or spared? AÂ systematic review. Cureus. 2020;12(5):e8207.
Castagnoli R, Votto M, Licari A, Brambilla I, Bruno R, Perlini S et al.. Severe acute respiratory syndrome coronavirus 2 (SARSCoV2) infection in children and adolescents: a systematic review. JAMA Pediatr. 2020;174(9):882â€“9.
Ludvigsson JF. Children are unlikely to be the main drivers of the COVID19 pandemicâ€”aÂ systematic review. Acta Paediatr. 2020;109(8):1525â€“30.
Jing QL, Liu MJ, Zhang ZB, Fang LQ, Yuan J, Zhang AR et al.. Household secondary attack rate of COVID19 and associated determinants in Guangzhou, China: a retrospective cohort study. Lancet Infect Dis. 2020;20(10):1141â€“50.
Friston KJ, Parr T, Zeidman P, Razi A, Flandin G, Daunizeau J etÂ al. Dynamic causal modelling of COVID19. 2020. arXiv preprint. arXiv:2004.04463.
Milne GJ, Xie S. The effectiveness of social distancing in mitigating COVID19 spread: a modelling analysis. 2020. medRxiv.
Liu M, Thomadsen R, Yao S. Forecasting the spread of COVID19 under different reopening strategies. 2020. medRxiv.
Balabdaoui F, Mohr D. Agestratified model of the COVID19 epidemic to analyze the impact of relaxing lockdown measures: nowcasting and forecasting for Switzerland. 2020. medRxiv.
Zhang J, Litvinova M, Liang Y, Zheng W, Shi H, Vespignani A etÂ al. The impact of relaxing interventions on human contact patterns and SARSCoV2 transmission in China. 2020. medRxiv.
Arregui S, Aleta A, Sanz J, Moreno Y. Projecting social contact matrices to different demographic structures. PLoS Comput Biol. 2018;14(12):e1006638.
Acknowledgements
JW is a member of the Ontario COVID19 Modelling Consensus Table, and a member of the Expert Panel of the Public Health Agency of Canada (PHAC) Modeling group. This research was presented to both Ontario Table and PHAC group, and we appreciate very much comments and suggestions from colleagues of these provincial table and federal group. Reported COVID19 cases were obtained from the Public Health Ontario (PHO) integrated Public Health Information System (iPHIS), via the Ontario COVID19 Modelling Consensus Table. FS is also member of the INdAM Research Group GNCS. The authors would like to thank Michael Glazer for his assistance.
Funding
This project has been partially supported by the Canadian Institute of Health Research (CIHR) 2019 Novel Coronavirus (COVID19) rapid research program. YX is partially supported by Simon (429551) and NIH (1R01AI148551). The funding sources have had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Author information
Authors and Affiliations
Contributions
ZM, YX, FS, BT, KN and JW conceived and designed the study; ZM, YX, FS, BT, NLB, KN, JH and JW acquired, analyzed, or interpreted the data; ZM, YX, FS and BT drafted the work; ZM, YX, FS, BT, NLB, JH, AA, VKM, NO and JW revised the work. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Abbreviations
None.
Appendices
Appendix A: Baseline contact matrices
To establish a contact matrix representative of contact mixing in Ontario, we utilized the projected Canadian matrices [17] and further adapted the matrices for modelling purposes. Several of the requirements for the target contact matrix to be suitable for integration in the transmission model (1) are:

i.
Modified age group subdivisions (6Â age groups);

ii.
Reciprocity condition is satisfied;

iii.
Accounts for the specific age structure of Ontario, Canada, in 2019;

iv.
Mean connectivity is representative of individual mean contact rate in Ontario, Canada;

v.
Represents contact mixing in distinct social settings (household, workplace, community and other locations, school).
The topics of reciprocity and mean connectivity are discussed further in prior work [34]. Briefly, social contact survey data is subject to overrepresentation and underrepresentation of age groups, reporting error, etc.; hence, estimated populationlevel contacts are generally not symmetric. However, as contacts must be reciprocal, the number of total contacts from age group i to j must be identical to those contacts from group j toÂ i. Also, the mean connectivity of each contact matrix, or the average number of contacts per individual in the population, should be preserved during the transformations within the same year. We introduced a series of transformations which address items (i)â€“(v). We then utilized the resultant contact matrices in the simulations of the transmission model (1) to quantify the agespecific contact mixing in Ontario.
Method
Denote the reference contact matrices, which are representative of social contact mixing in Canada in year 2006, \(C^{H}\), \(C^{W}\), \(C^{C}\), \(C^{S}\) for household, workplace, community and school settings, respectively. The entries of the contact matrix are the number of daily social contacts of a single individual in age class i with individuals in age class j (units contacts/day as defined by those contacts believed to be relevant for the spread of respiratory illnesses) [16]. We utilized \(C^{\mathrm{Ref}}\) to obtain a matrix representative of contact mixing in Ontario, Canada to satisfy the properties (i)â€“(v) above. The subsequent process is applied separately to each of the settingspecific reference contact matrices.
Reciprocity correction
We corrected each settingspecific reference matrix \(C^{\mathrm{Ref}}\) for reciprocity to ensure that contacts between age classes at the populationlevel (extensive scale) were reciprocal. Specifically, we ensured symmetry of the populationlevel contacts and returned back to the individuallevel contact scale. Let \(E_{ij} = C_{ij}^{\mathrm{Ref}} N_{i}\) represent the extensive scale contact matrix between age class i and class j, where \(N_{i}\) represents the population of age class i in Canada in year 2006. To ensure the symmetry of matrix E, and thus populationlevel contacts, we applied the transformation \(E_{ij} \rightarrow \frac{1}{2} ( E_{ij} + E_{ij}^{T} )\). We then converted from populationlevel total contacts to the individuallevel contact scale to redefine \(C_{ij}^{\mathrm{Ref}}:= \frac{E_{ij}}{N_{i}}\). The resultant \(C^{\mathrm{Ref}} \) has now been corrected for reciprocity.
We then adjusted each reference matrix \(C^{\mathrm{Ref}}\), for Canada, to the matrix C, for Ontario, according to the demography of Ontario using an established method [34]. To accomplish this, we projected the reference contact matrix \(C^{\mathrm{Ref}}\) to the target matrix C using the transformation
where \(N_{j}\) (\(N_{i} \)) and \(N_{j} '\) (\(N_{i} ' \)) are the number of individuals in age class jÂ (i) in Canada and Ontario in 2006, respectively. Also, N and \(N'\) are the total numbers of individuals in the reference year Canada and Ontario in 2006, respectively. Equation (2) may be interpreted as an adjustment of the contact rate based on the ratio of the target population density of available contactees in Ontario and density of contactees in the reference setting in Canada. Since this transformation adjusted the matrix from the country setting to a provincial setting within the same year, we also normalize the matrix to have a mean degree (or mean connectivity) of 1 during the transformation in order to preserve the mean connectivity. After the transformation, we rescale the matrix C to the original degree of \(C^{\mathrm{Ref}}\) by multiplying the mean connectivity
We preserve the mean connectivity in this transformation, i.e., the average number of daily contacts per individual in the population is assumed to be equal in Ontario and Canada in the same year. We note that an alternative density transformation could also be used, which relaxes this assumption and allows the mean connectivity to depart from its original value (for instance, method M2 in [34]). To quantify the settingspecific contact mixing, we applied this above process, using Equation (2), to the established household, workplace, community, and school contact matrices for Canada [17].
Method to agetransform contact matrix
We outline the process used for generating contact matrices in the desired age subdivision format by utilizing known contact mixing data and Canadian demographic data. The key concept was to utilize established contact data which informed a \(16 \times 16\) contact matrix for age groups 0â€“4, 5â€“9, 10â€“14, 15â€“19, 20â€“24, 25â€“29, 30â€“34, 35â€“39, 40â€“44, 45â€“49, 50â€“54, 55â€“59, 60â€“64, 65â€“69, 70â€“74, 75+, and use a series of propertypreserving transformations to generate a desired or target \(6 \times 6\) contact matrix for age groups 0â€“5, 6â€“13, 14â€“17, 18â€“24, 25â€“64, 65+. Here, we conducted the transformation between different age groups for the year 2006. Based on the homogeneous mixing assumption and a conservation law on contacts received and offered in each age group, we calculated the entries of the target \(6 \times 6\) matrix using the following formula
where \(\overline{N}_{jl}\) (\(\overline{N}_{ik}\)) represents the overlapped population in the old age group jÂ (i) and new age group lÂ (k). And \(C_{ij}^{16}\) and \(C_{kl}^{6}\) are the entries of the contact matrix for the old and new age structure, respectively. \(N_{k}^{6}\) is the population in age group k for the new age structure. This transformation preserves the mean connectivity and reciprocity from the previous transformation.
Method to project contact matrix to different years
We now have obtained the contact matrix among 6 age groups in 2006, and the following transformation projects the contact matrix to 2019 based on the Canadian demographic data. In what follows, \(N_{j}\) and \(N_{j} '\) are the number of individuals in the jth age group in the original (i.e., 2006) and projected (i.e., 2019) year, N and \(N '\) are the total population in the original and projected year. Then, we have
The contactee correction terms of the form \(\frac{N N_{j} '}{N_{j} N '}\) represents the ratio of contactees in the projected year to those in the origin year. With the contactee density correction terms, we expressed all entries of the projected contact matrix in terms of the known, original contact matrix entries. Equations were kept general to hold true when N may differ from \(N'\). The above equation may also be interpreted as an adjustment of the contact rate based on the ratio of projected population density of contactees and density of contactees in the original setting. Due to the variations in population profile in different timing, the average connectivity is not preserved exactly; however is representative of mean contact rate in Ontario. We note that an alternative series of transformations could be utilized to preserve the mean connectivity of the Canadian reference contact matrix. Finally, this transformation preserves the reciprocity.
Results
The contact matrices resulting from the series of transformations outlined are shown in Fig.Â 2 and are representative of mixing in Ontario. We then utilized the resultant contact matrices \(C^{H}\), \(C^{W}\), \(C^{C}\), \(C^{S}\) in the simulation of transmission model (1) to quantify heterogeneity in agespecific and settingspecific contact mixing in Ontario.
Appendix B: Caution in interpretation
The predicted trajectory as of May 16 largely underestimated the cases reported in Ontario as of midJuly (Fig.Â 3). However, observing the agestratified model fit vs. cumulative incidence data (Fig.Â 4), we see that the disparity is among those aged less than 65. The underestimation may be due to the relaxation of measures starting from May 16 and/or decreased abidance to physical distancing measures. For instance, possible culprits include increased warm weather in Ontario and a national holiday weekend. While our study suggests that younger individuals are less susceptible; the observed cases following relaxation suggests increased transmission among these groups may be due to increased mixing among those nonsenior individuals.
Appendix C: Control parameter assessment
The transmission model accounts for two types of detection routes: contact tracing and the diagnosis of individuals presenting symptoms. Estimates of the parameters related to these processes can be utilized to assess the efficacy of interventions implemented and conduct modelling scenario analyses. Our estimates show that the fraction of infectious contacts that were effectively traced and isolated increased from 12% before phaseÂ 3 to a limit value of 73% during phaseÂ 3 (TableÂ 2). Parameterizing the transmission model with region or countryspecific demographic and incidence data could also allow a comparative evaluation of interventions between different regions. Furthermore, the evaluation of the current levels of contact tracing and diagnosis efforts is fundamental for planning public health policies [2, 3].
Appendix D: Limitations in incidence data
For our analysis we used cumulative incidence data, which is subject to several forms of error, including underreporting (COVID19 positive individuals not having their illness reported) and underascertainment (cases not seeking health care), as not all COVID19 cases are captured by the surveillance system. We note that there may be heterogeneity by age in the proportion of individuals seeking health care and testing due to illness, hence the estimated agespecific parameters are impacted by agespecific reporting rates and ascertainment rates. Specifically, the severity of illness due to COVID19 has been found to increase with age [15] and cases requiring medical attention may be more likely to be captured by the surveillance system, which is consistent with our findings of diagnosis rate increasing with age (TableÂ 7). However, we stress that testing protocols in Ontario have been variable during the course of the epidemic, altering the scope of individuals and symptoms that have been tested for COVID19, hence making it difficult to obtain robust estimates when those rates are assumed constant over time. Analyzing data while interventions are in place introduces natural biases: the low relative susceptibility in younger age groups may be a result of early school closure, which prevented transmission in younger age groups very early on in the Ontario epidemic. Such an effective containment measure may not have been possible in settings such as Ontarioâ€™s longterm care homes where the prominent age class is seniors and transmission continued.
Additional sources of error in our study result from the specific situation in Ontario. As of June 3, 2020, Greater Toronto Area public health units accounted for 66.4% of cases. It may then be more appropriate to consider modelling in smaller regions or public health units as cases are not evenly dispersed throughout the province. In addition, as of June 3, 2020, a proportion of 17.7% and 6.3% of all cases were among longterm care home residents and among health care workers associated with longterm care outbreaks, respectively. Heterogeneity in geographical location or finer granularity to the level of longterm care homes and hospitals are not captured by the current model.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the articleâ€™s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the articleâ€™s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
McCarthy, Z., Xiao, Y., Scarabel, F. et al. Quantifying the shift in social contact patterns in response to nonpharmaceutical interventions. J.Math.Industry 10, 28 (2020). https://doi.org/10.1186/s1336202000096y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1336202000096y