Documental basis
The documental basis consisted of 65 articles (highlighted with an asterisk in the References section). Articles were published between 1996 and 2019. Fifty studies were conducted in the U.S., eleven in Europe, and four in Latin American. Most of the studies adopted an experimental design (35 articles, 54%). An analysis of the objectives revealed that effectiveness, as well as maintenance at the individual-level, and implementation, in this order, are the most evaluated aspects. Investigating the adoption of SFP (10-14) and its maintenance at the setting-level were not a primary goal for any of the studies. Beyond these main objectives, some articles indicated or analyzed other RE-AIM components within their scope, treating them as secondary objectives or descriptions of SFP (10-14).
The version of SFP (10-14) analyzed
A large number of articles used a logic model to describe the mechanism of change expected from SFP (10-14). In 29 of the articles (45%), the logic model components were presented in textual format, 4 (6%) in a diagram or table, and 5 (8%) in both text and diagram or table.
Of the studies, 74% recruited SFP (10-14) participants in schools; 6% in health services; 3% in social assistance services; 2% in both health and social assistance services; 5% in other services (such as community centers and religious institutions); and 9% of the studies did not mention the recruiting location(s). As for the implementation setting, 49% of the articles did not report it, 42% implemented SFP in schools, 3% in social assistance institutions, 3% in health institutions, and 2% in other institutions, such as community centers. The article dealing with secondary data included studies with various recruitment and implementation sites (Hill, Cooper, & Parker, 2019).
Only 21 articles (32%) provided information about the program’s implementation agents. This included (a) education: bachelor’s degree (Cantu, Hill, & Becker, 2010; *Coatsworth et al., 2015; Coatsworth, Timpe, Nix, Duncan, & Greenberg, 2018; *Coatsworth, Duncan, Greenberg, & Nix, 2010; *Lindsay & Strand, 2013; *Riesch et al., 2012), health education professionals (*Aalborg et al., 2012; *Byrnes, Miller, Aalborg, & Keagy, 2012; Byrnes, Miller, Aalborg, Plasencia, & Keagy, 2010), nurses (*Semeniuk et al., 2010; Vasquez et al., 2010), and teachers (*Corea et al., 2012; *Skärstrand, Sundell, & Andréasson, 2014); (b) skills: experience working with youth, parents, or families (*Coatsworth et al., 2010, 2015, 2018), being bilingual (*Orpinas et al., 2014; *Reidy, Orpinas, & Davis, 2012), experience working with the Latino population (*Orpinas, Reidy, et al., 2014; *Reidy et al., 2012), community, health care, or social agency workers (*Coombes, Allen, Marsh, & Foxcroft, 2009; *Guyll, Spoth, Chao, Wickrama, & Russell, 2004; *Segrott et al., 2017; *Spoth, Guyll, Lillehoj, Redmond, & Greenberg, 2007); (c) specific SFP training (*Aalborg et al., 2012; *Byrnes et al., 2012; *Coatsworth et al., 2010, 2015, 2018; *Corea et al., 2012; *Hill et al., 2019; *Orpinas et al., 2014; *Reidy et al., 2012; *Riesch et al., 2012; *Segrott et al., 2017; *Semeniuk et al., 2010; *Skärstrand et al., 2014); (d) experience with other SFP implementations and (e) gender: 82% female (*Segrott et al., 2017).
Three types of session structures were identified: (1) a little over half the articles (53%) reported using the seven weekly sessions version, which is 2-h long—separate 1-h meetings for parents and adolescents, and 1 h for the family (joint meeting with both parents and adolescents); (2) around one-third (33%) used the seven weekly meetings version—consisting of six sessions of 1-h meetings for parents and adolescents and 1 h for the family, while the seventh and last session was a joint/family meeting of 1 h; (3) the smallest proportion (3%) used a composite version, comprising two parts: the first part had seven weekly meetings, with six sessions of separate one to one-and-a-half-hour meetings for parents and adolescents, and the seventh and last session was a 1-h family meeting; in addition, the second part consisted of five sessions, originally designed to be booster meetings, but inserted as standard sessions, four of which were separate 1-h meetings for parents and adolescents, while the fifth was a 2-h family session (*Skärstrand, Bränström, Sundell, Källmén, & Andréasson, 2009; *Skärstrand et al., 2014). Seven articles (11%) gave incomplete or no information about their structure of choice.
Follow-up sessions were carried out in 64% of the studies. Among these, the number of follow-up sessions varied from 0 to 12, with an average of 2.9. The first follow-up session took place between 3 and 18 months after SFP (10-14), and the last between 24 and 84 months after SFP (10-14). Three studies conducted four booster sessions (*Baldus et al., 2016; *Bröning et al., 2017; *Segrott, 2013); however, only one reported when the sessions took place: between 4 and 6 months after SFP (10-14) (*Bröning et al., 2017). Two studies transformed the booster sessions into standard sessions (*Skärstrand et al., 2009; *Skärstrand et al., 2014).
Reach of the SFP (10-14)
Although six studies were to understand some aspect of the reach, only one study reported on all Reach criteria (*Byrnes et al., 2012) (cf. Supplementary Appendix). The exclusion criteria for participants of the various studies focused on the characteristics of families and community. Adolescents in alcohol, tobacco, and other drugs (ATOD) treatment were excluded (*Aalborg et al., 2012; *Byrnes et al., 2010, Byrnes et al., 2012), as well as those who did not live with their parents (*Byrnes et al., 2012). Families not fluent in English (*Aalborg et al., 2012; *Byrnes et al., 2012), with parents who did not self-identify as Latinos (*Orpinas, Reidy, et al., 2014; *Reidy et al., 2012) or who did not speak Spanish, were excluded from the studies with Spanish-speakers living outside their home country (*Orpinas, Reidy, et al., 2014; *Reidy et al., 2012). Families from communities with an employment rate of more than 50%, where there was the availability of a preventive ATOD program, or with a member who had a university degree (*Spoth, Clair, Greenberg, Redmond, & Shin, 2007; *Spoth, Guyll, et al., 2007), were also excluded.
The number of participants in the experimental group (EG) was given as numbers of parents and adolescents or number of families. In the seven studies (11%) that provided the number of parents and adolescents, it ranged from a minimum of 13 parents and 15 adolescents to a maximum of 151 parents and 144 adolescents (in the pre-test). In the 39 studies (60%) that listed the number of families, the minimum was 12 and the maximum was 238, in the pre-test. Other articles did not provide the number of participants in the pre-test, or provided it for just one group, that is, either parents or adolescents.
Additionally, a percentage or the representativeness of the target population reached was not determined, since there was discrepancy in the adopted denominator, which was alternately (a) the number of invited adolescents or families (Errasti Pérez et al., 2009; *Segrott et al., 2017; *Semeniuk et al., 2010; *Trudeau, Spoth, Randall, Mason, & Shin, 2012; *Riesch et al., 2012) or (b) the number of eligible adolescents or families (Bamberger, Coatsworth, Fosco, & Ram, 2014; *Bröning et al., 2017; *Byrnes et al., 2012; *Chilenski, Welsh, Perkins, Feinberg, & Greenberg, 2016; *Lindsay & Strand, 2013; *Mason, Chmelka, Trudeau, & Spoth, 2017; *Skärstrand et al., 2014; *Spoth, Shin, Guyll, Redmond, & Azevedo, 2006; *Spoth, Clair, & Trudeau, 2014, *Spoth, Trudeau, Shin, Randall, & Mason, 2019; *Whitesell et al., 2019).
Regarding the participants’ characteristics, in 42 (65%) of the articles, the participants were low-income and eligible for social programs. In 40 (61%) articles, the households were two-parent families, and in 41 (63%) articles, families had an average of three children, with parents who had completed a high-school education. Despite being a minority, it is notable that, in three of the studies, the adolescents had a statement of special needs education or had experienced behavioral problems (*Lindsay & Strand, 2013), had hyperactivity (100% of the adolescents) and conduct problems (90%) (*Coombes et al., 2009), or were living in a community with high levels of social problems (Vasquez et al., 2010).
The methods used to recruit participants were personal invitation (10 articles, 15%), invitation addressed and mailed to residence (10 articles, 15%), phone call (5 articles, 8%), leaflets and/or flyers (3 articles, 5%), and others (2 articles, 3%). One article reported difficulty encountered during the recruitment: the recruiting agency was not the agency that implemented the program, because the latter would only invite “at-risk” families, while SFP (10-14) is a proposal for universal intervention (*Segrott et al., 2017). Two articles identified procedures that facilitated recruitment: a community leader carrying it out (*Orpinas, Reidy, et al., 2014), working to build bonds with the families since the invitation moment, and emphasizing that the program is not about judging the family’s resources or deficit, but rather about strengthening and solutions (*Segrott, 2013).
One article listed strategies for reducing obstacles to participation: reimbursing transportation expenses, offering games to non-participants accompanying the participants, and non-alcoholic beverages (*Segrott, 2013). Two other articles identified elements that influenced the family’s participation in SFP (10-14): the availability of childcare, a convenient place and time, affinity with the community, transportation, refreshment, payment, and the number of instruments to fill out (*Reidy et al., 2012). Thus, the following suggestions were emphasized: consider the benefit-cost ratio for families, simplify communication by explaining the study, training more implementation agents, and deliver the program in multiple services (education, health, social) to broaden its reach (*Segrott et al., 2017).
One article that investigated the recruiting process reached several conclusions. Specifically, (a) African-Americans were more likely to accept the invitation and show up at the meetings than Asians; (b) families from communities with high unemployment levels were less likely to participate; (c) families headed by single women presented a higher chance of participation; (d) Caucasians, Asians, people with a college degree, and older parents tended to participate more actively in the activities than African-Americans; and (e) the level of participation dropped by 44% with increasing high school dropout rates (*Byrnes et al., 2012).
Effectiveness of the SFP (10-14)
Due to the peculiar characteristics of effectiveness, we decided to present the data on a regional basis, the regions being the U.S., which contains most of the studies; Europe, represented by Germany, Spain, Poland, UK, and Sweden; and Latin America, represented by Bolivia, Chile, Colombia, Ecuador, Honduras, and Panama. Additionally, the data were organized so that the primary outcomes are presented first and then the secondary outcomes. Furthermore, to facilitate the reader’s understanding of the program’s effectiveness, data regarding maintenance at the individual-level—outcomes maintained for 12 months or more—were reported in this section. None of the mentioned studies reported data about broader outcomes, iatrogenic, or side-effects.
The U.S.
Plenty of evidence indicated the effectiveness of SFP (10-14) in the U.S., for several outcomes. Among the primary outcomes: delaying the use of alcohol and other drugs (e.g., *Spoth, Redmond, & Lepper, 1999; *Spoth, Reyes et al., 1999; *Spoth, Redmond, Shin, & Azevedo, 2004, *Spoth, Clair, Shin, & Redmond, 2006; Spoth, Shin, et al., 2006; *Spoth, Trudeau, Guyll, Shin, & Redmond, 2009), decreasing exposure to substance use (*Spoth et al., 2012), prevention of new users (*Spoth, Redmond, & Shin, 2001), a long-term decrease of drug abuse (e.g., *Spoth, Trudeau, et al., 2009; *Spoth et al., 2014), misuse of medications (*Spoth, Trudeau, Shin, & Redmond, 2008), long-term academic success, and school engagement (*Spoth, Randall, & Shin, 2008), and also effects on non-participating adolescents (Rulison et al., 2015). Moreover, some of the secondary outcomes were positive affect, support, involvement, and closeness (*Coatsworth et al., 2015), as well as direct and indirect effects on the improvement of parenting practices (e.g., *Cantu et al., 2010, *Coatsworth et al., 2010, *Orpinas, Reidy, et al., 2014, *Redmond, Spoth, Shin, & Lepper, 1999, *Spoth, Redmond, & Shin, 1998), affection (*Spoth et al., 1998), cohesion and family involvement (e.g., *Chilenski et al., 2016, *Riesch et al., 2012), and fewer depression-related symptoms in adulthood (*Mason et al., 2017, *Trudeau, Spoth, Randall, & Azevedo, 2007). Long-term decrease of antisocial behaviors (*Spoth, Redmond, & Shin, 2000), and risky sexual behavior (*Spoth et al., 2014), long-term positive relationship (*Spoth et al., 2019), and better problem-solving skills in the medium term (*Semeniuk et al., 2010) were also observed.
Europe
Mixed results were found in Germany and the UK; positive results in Spain; and null results in Poland and Sweden. In Germany, no significant difference was found concerning the following primary outcomes: first use of drugs, drug use in the past 30 days, the lifelong use of alcohol and marijuana (*Baldus et al., 2016), and general drug use (*Bröning et al., 2017). On the other hand, considering secondary outcomes, significant improvement in children’s behavioral problems (*Bröning et al., 2017), but no significant improvement concerning behavioral problems was found (*Baldus et al., 2016).
In the UK, when dealing with quantitative measures, the results indicated (a) significant decrease in secondary outcomes, such as child conduct problems (*Lindsay & Strand, 2013), youth difficulties in communication and emotional management, and parent emotional symptoms ((*Coombes et al., 2009); (b) significant decrease in the primary outcomes, such as misuse of alcohol and drugs (*Coombes et al., 2009); and (c) increase in secondary outcomes: parents’ mental well-being, parenting skills (*Lindsay & Strand, 2013), parenting limit setting, and prosocial behavior (*Coombes et al., 2009). However, one study reports no significant changes, both on primary and secondary outcomes. Nonetheless, when dealing with qualitative measures, improvements in secondary outcomes were reported, such as (a) in adolescent emotions, positive peer interactions, and communication and family interaction; and (b) family functioning (*Coombes et al., 2009).
In Spain, significant differences were found concerning both primary outcomes, in the use of drugs in the past 30 days, and secondary outcomes, as improvements were detected for the “parental attitudes in response to youth alcohol use” and “bonds between parents and children” when families participated in 8 sessions (seven sessions plus one booster) (Errasti Pérez et al., 2009). Both in Poland (*Foxcroft, Callen, Davies, & Okulicz-Kozaryn, 2017) and in Sweden (*Skärstrand et al., 2014), no significant differences were found, either concerning primary outcomes, for use of alcohol, tobacco, or other drugs; or secondary outcomes, which include parent-child relationships, parenting practices, and child behavioral problems in the Polish assessment and defiant behaviors in the Swedish assessment.
Latin America
Regarding secondary outcomes, decreases in yelling, insulting, and loss of control in light of adolescent bad behavior were reported in Chile (*Corea et al., 2012); improvements in parenting practices and parental self-esteem in Honduras (Vasquez et al., 2010); positive changes in adolescent behavior, parenting practices, marital and family relationship in Panama (*Mejia, Ulph, & Calam, 2015); improvement in positive parenting and parental hostility in Colombia and Bolivia; and in parental involvement, consistent discipline, parental monitoring, and parental communication about risky behaviors in Ecuador (*Orpinas, Ambrose, et al., 2014). Concerning primary outcomes, either null results were found in Chile (*Corea et al., 2012) and Honduras (Vasquez et al., 2010), or they were not evaluated such as in Bolivia, Colombia, and Ecuador (*Orpinas, Ambrose, et al., 2014) and in Panama (*Mejia et al., 2015).
Adoption of the SFP (10-14)
None of the articles aimed to understand the SFP (10-14) adoption. Furthermore, in 97% of the analyzed articles, no information was provided about the criteria in this dimension. Only two studies gave information about the criteria of service adoption (*Aalborg et al., 2012; *Segrott et al., 2017) and three about adoption by implementation agents (*Aalborg et al., 2012; *Orpinas, Reidy, et al., 2014; *Segrott et al., 2017). The data supplied information about the characteristics of the services or implementation agents who participated in the study, and about barriers and implementation agents for their adoption of SFP (10-14). No data were supplied about services or implementation agents who had been excluded from the study or not invited to participate in it. This omission did not allow to calculate the adoption rate of the intervention.
Moreover, the characteristics and availability of adequate space of the services were considered to carry out the program (*Aalborg et al., 2012), as well as the implementation agents, their interest in offering SFP (10-14) (*Aalborg et al., 2012), bilingualism (English and Spanish), and experience in working with Latinos (*Orpinas, Reidy, et al., 2014). *Segrott et al. (2017) used Extended Normalisation Process Theory to understand the interaction of SFP (10-14) with its delivery systems. The results listed the funding availability to sponsor SFP (10-14) in the services, its incorporation into its routines, and recruitment and maintenance of the implementation agents as difficulties for adopting the program.
Implementation of the SFP (10-14)
Fidelity was the most investigated implementation criterion. There were two criteria not reported in any article: uncounted intervention time and context.
Adaptations
In both studies by *Skärstrand et al. (2009, 2014), the focus age changed from 10 to 14, to between 12 and 14 years of age, content or items from the parent sessions were omitted, the parents’ presence was optional, the booster sessions were converted into standard sessions (renamed “part 2”), one extra session was added, family sessions were carried out only in the seventh session of part 1 and the fifth session of part 2, and the material prepared by the authors themselves about drugs and alcohol was added. Some of these modifications occurred due to practical problems, which prevented to simultaneously carry out the parent and adolescent sessions.
*Coatsworth et al. (2010) explained the creation of the Mindfulness-enhanced Strengthening Families Program (MSFP) that his research group evaluated in many articles. They argued that as original SFP already contained implicit principles of mindfulness, their “task was to make these implicit messages more explicit by adding short mindfulness activities and by altering some of the language within the program so that it more clearly reinforced principles and practices of mindfulness” (p. 04).
Other studies did not make any adaptations, but rather analyzed them. After analyzing implementation data from 97 SFP offers in the U.S., the authors concluded that adaptations in games, activities, random content, and group process accounted for 76% of all adaptation types; and that 79% of all adaptations made were justified by insufficient time, group attributes, and the number of participants (*Cooper, Shrestha, Hyman, & Hill, 2016). The inclusion of tribal language, as SFP was delivered to Indian-American families, social media, and substance use content did not impact SFP effectiveness in the short term (*Whitesell et al., 2019).
*Orpinas, Reidy, et al. (2014) did not introduce adaptations, but instead suggested some, based on an implementation experience with Mexicans living in the U.S.: (a) restricting group size; (b) more implementation agents per group; (c) fewer activities involving reading and writing; (d) presence of a translator; (e) offering information about drug use and sexual behavior; (f) addressing mistaken perceptions of cultural norms and expectations by age; (g) promoting appreciation of Latin culture; and (h) offering educational support for the community.
Dose
Two studies specifically included the dose criterion (*Riesch et al., 2012; *Segrott et al., 2017). *Riesch et al. (2012) defined the fully delivered dose as attending at least five of the seven sessions, while a partially delivered dose consisted of attending fewer than five. It was verified that a large number of family groups participating in the partial dose level received public assistance and reported being low-income. Meanwhile, in the full dose condition, parents reported being in a stable relationship. *Segrott et al. (2017) assessed dose delivery by the number of programs (and constituent sessions) delivered and dose received by the engagement of young people and parents/guardians. Another seven articles recorded the received dose using an attendance list (*Hill & Owens, 2013; *Orpinas, Reidy, et al., 2014; *Skärstrand et al., 2009; *Spoth, Guyll, & Day, 2002; Spoth, Guyll, Trudeau, & Goldberg-Lillehoj, 2002 *Spoth, Guyll, & Shin, 2009; *Spoth et al., 2014; *Trudeau et al., 2012).
Economic cost
Three articles carried out budget evaluations. They were all from the U.S. and focused on the drug abuse primary outcome. In the first publication, including the prevention of alcohol use, the intervention’s full cost was US$ 80,562, with 100 families per wave; the cost-effectiveness was US$ 12,459; the benefit-cost ratio was US$ 9.60 per US$ 1 spent; and the net-benefit was US$ 5923 per family (*Spoth, Guyll, & Day, 2002). In the second publication, for the prevention of methamphetamine use alone, the intervention cost was US$ 115,813 for the 117 families that received SFP; the cost per adolescent was US$ 990.00; the cost-effectiveness was US$ 25,385 to prevent each case; the benefit-cost ratio was US$ 3.84 per US$ 1 spent; the net benefit was US$ 2813 by the adolescent (*Guyll, Spoth, & Crowley, 2011). Moreover, in the third publication, although the objective was an economic analysis of PROSPER (Promoting School-University Partnerships to Enhance Resilience—a project that includes SFP and one school-based intervention), the authors reported that SFP’s cost varied between US$ 502 and US$ 572; the cost per participating family varied between US$ 278 and US$ 378; and the net benefit varied between US$ 6307 and US$ 6377 per family (*Crowley, Jones, Greenberg, Feinberg, & Spoth, 2012). Furthermore, one study detailed some intervention expenses, namely announcements to implementation agents, US$ 550.00; facilitator training, US$ 25,758; materials for the families, US$ 2,776; incentives for the family’s participation, US$ 13,620; website, US$ 5,385; intervention implementation, US$ 31,972; childcare, US$ 4620; and family transportation, US$ 445 (*Spoth, Guyll, & Day, 2002; Spoth, Guyll, Trudeau, & Goldberg-Lillehoj, 2002).
Fidelity
The documental basis contains different articles that published results from the same study/research project. Thus, the results reported here are those of the studies, instead of each article.
Most of the studies reported high fidelity indices. One study that compared SFP with family matters (FM) analyzed fidelity from two points of view: (a) adherence, that is, how much of the program was released as predicted in the handbook, and (b) “quality,” in other words, the implementation agents’ ability to conduct the intervention, for example, their enthusiasm and aptitude. The results indicated that, in SFP’s first offering, adherence was 66% and, from the third to the sixth offerings, it was 80%; while “quality,” in turn, remained stable at 66–67% across the offerings (*Aalborg et al., 2012). The average session adherence was 78% to 93%, having reached or exceeded the expected level (*Byrnes et al., 2010). A second study, which compared SFP to MSFP, analyzed fidelity from two different points of view: (a) adherence, which reached 89% and 93%, respectively; and (b) leader/facilitator effectiveness, concerning friendliness, acceptance, and clarity, which reached a mean M = 3.6 out of a maximum score of 4 or was classified as excellent, respectively (*Coatsworth et al., 2010, 2018).
A third study compared SFP to Preparing for the Drugs Free Years (PDFY) and analyzed fidelity under the adherence criterion, obtaining indices of 87% for family sessions, 83% for parent sessions, and 89% for adolescent sessions (e.g.: *Spoth, Redmond, & Lepper, 1999, Spoth, Clair, et al., 2006, Spoth, Shin, et al., 2006, Spoth, Randall, & Shin, 2008, Spoth, Trudeau, et al., 2008, Spoth, Trudeau, et al., 2009; *Trudeau et al., 2007), with an 85% average (e.g.: *Spoth, Trudeau, et al., 2008). In the PROSPER study, SFP’s fidelity surpassed 90% (*Spoth, Clair, et al., 2007). Finally, one study analyzed the UK’s SFP version, indicating adherence from 90 to 99% (*Segrott et al., 2017). Furthermore, when delivered to Indian-American families, fidelity was over 90%, across youth, adult, and family sessions (*Whitesell et al., 2019).
Three studies (5%) analyzed fidelity predictors, and also reported its level. The results indicated that fidelity was strongly and inversely related to the number of families in each SFP (10-14) offering and the years of experience of the implementation agents; and was strongly and positively related to the number of implementation agents, with the same minority status of the participant and facilitator (*Cantu et al., 2010). Fidelity was better evaluated when families were chosen to participate in SFP (10-14) than when they chose to participate. It was positively related to adolescent satisfaction but negatively related to parent satisfaction. Thus, the authors recommended medium level fidelity as ideal, since high fidelity implies low flexibility, and low fidelity implies a failure to deliver the core components (*Byrnes et al., 2010). When correlating fidelity from the point of view of the program’s content components (i.e., didactical instructions about the expected behaviors, communication, increase in family identity, and cohesion) and process components (i.e., facilitator’s actions when delivering the components, for example, encouraging discussion, availability of materials, etc.), with the expected parenting practice results, it was discovered that the majority of correlations were not significant for European-Americans, but were significant for participating ethnic minorities (*Hill & Owens, 2013).
One study verified whether the implementation adherence and quality of implementation (composed by (1) group engagement, (2) group participation, and (3) quality of delivery, that is “both positive and negative features of facilitators’ behavior” p. 417) had been maintained for 6 years. The results indicated that adherence, as well as group engagement, group participation, and the quality of delivery, were highly maintained over the period (*Spoth, Guyll, Redmond, Greenberg, & Feinberg, 2011).
Engagement
Four articles (6%) reported engagement or active participation in the group. The results demonstrated (a) a score of 3.7 out of a maximum of 4 and an excellent classification, both were monitored through an analysis carried out by trained observers (*Coatsworth et al., 2010, 2018, respectively); (b) high scores in 94% of the 22 delivered offerings analyzed by the implementation agents (*Segrott et al., 2017); (c) a high level of engagement in the first session (i.e., involvement, interest, resistance, and positive affect toward the implementation agents and group members) positively correlated with the parent’s educational level and parental involvement; and (d) an increase in engagement level throughout of the sessions had a positive correlation with session attendance and with a companion, and a negative correlation with baseline measurements of negative affect and parental avoidance (Coatsworth, Hemady, & George, 2017).
Additionally, two articles analyzed engagement. Bamberger et al. (2014) verified that engagement increased over time, linearly with some deceleration, and aspects of family tension were related to both initial levels and session-to-session changes in engagement. *Elreda, Coatsworth, Gest, Ram, and Bamberger (2016) analyzed the relationship between group process and participant progress and intervention outcomes. They concluded that participants, who were better connected and reciprocated, experienced greater participant progress. Moreover, regarding youth, discomfort in group experience was negatively correlated with self-worth and mastery, and connectedness was negatively correlated with internalizing symptoms. Regarding mothers, discomfort across sessions was negatively correlated with negative affective quality of the mother-adolescent relationship, recurring mother-adolescent conflict, use of harsh discipline, and self-judgment. On the other hand, connectedness was positively correlated with emotional awareness during parenting interactions and negatively correlated with parenting stress.
Retention
Participant retention rates throughout data collection (i.e., pre-testing, post-testing, and follow-up) and throughout SFP (10-14) sessions were directly correlated with the degree of adolescent substance abuse, education level, material quality, recruitment quality (*Spoth, Clair, et al., 2007), and the restrictiveness of attitudes toward adolescent alcohol use (*Skärstrand et al., 2009). Retention rates were inversely correlated with socioeconomic level (*Spoth, Goldberg, & Redmond, 1999), as well as the level of parental responsiveness and affection toward their children (*Skärstrand et al., 2009). One article cited retention rates varying from 69 to 72% (*Mason et al., 2017). Another article indicated strategies used to guarantee retention: serving refreshment immediately before the session begins; availability of transportation and childcare; and holding all the sessions in schools, community centers, churches, and/or clinics close to the families’ residences (*Riesch et al., 2012).
The dropout rate, in turn, was calculated by comparing the number of families who participated in the pre-test and the last data collection. By estimating the numbers given by the articles, the minimum number of families in the last data collection was 12, and the maximum was 562 (M = 173.5; SD = 112.5). This represents an average dropout rate of 34%, for families. In the data from articles that counted parent and child dropout separately, there was a minimum of 13 parents and 15 children, and a maximum of 136 parents and 132 children (M = 61, SD = 48). This represents an average dropout rate of 8% for parents and 7% for children.
Implementation barriers and facilitators
The variables that facilitated SFP’s implementation were the presence of childcare, and bilingual, bicultural, or experienced implementation agents (*Orpinas, Reidy, et al., 2014). The variables cited as implementation barriers were the implementation agents’ difficulty to meet prior to the sessions in order to plan them, because they worked in different organizations or had other work demands (*Segrott et al., 2017); family difficulties in showing up for 7 weeks; the session date and time; the perception that the program would require too much family time; very long meetings (2h); beliefs that the family was already doing a good job; the perception that adolescents were not taking risks (*Spoth, Redmond, Hockaday, & Shin, 1996); and the lack of school engagement (*Orpinas, Reidy, et al., 2014).
It is noteworthy that a study applied the qualitative comparative analysis (QCA) to verify the relationship between certain implementation characteristics and SFP effectiveness. The results indicated that a sufficient proportion of trained practitioners (at least 75%), a program size not greater than 12 families, and highly engaged participants are necessary conditions. Additionally, having practitioners who submitted high-quality attendance data, in programs serving at least eight families, is a sufficient condition. When these conditions are present, regardless of other implementation aspects, the program can achieve the targeted outcomes (*Hill et al., 2019).
Maintenance of SPF (10-14) in Services
Since maintenance at the individual-level results were reported in the effectiveness subsection above, this section would describe maintenance in services—institutions and teams—that implemented SFP (10-14). However, no information was provided by any of the articles.