on this site
Vol 1 Issue 1 2010
contact infoVincent T Francisco, PhD |
Connect to Protect® Researcher-Community Partnerships: Assessing Change in Successful Collaboration Factors over Time![]() Abstract: by Mauri A. Ziff, Nancy Willard, Gary W. Harper, Audrey K. Bangi, Jason Johnson, Jonathan M. Ellen and the Adolescent Medicine Trials Network for HIV/AIDS Interventions (ATN) Fifteen research sites within the Adolescent Medicine Trials Network for HIV/AIDS Interventions launched Connect to Protect community coalitions in urban areas across the United States and in Puerto Rico. Each coalition has the same overarching goal: Reducing local youth HIV rates by changing community structural elements such as programs, policies, and practices. These types of transformations can take significant amounts of time to achieve; thus, ongoing successful collaboration among coalition members is critical for success. As a first step toward building their coalitions, staff from each research site invited an initial group of community partners to take part in Connect to Protect activities. In this paper, we focus on these researcher-community partnerships and assess change in collaboration factors over the first year. Respondents completed the Wilder Collaboration Factors Inventory at five time points, approximately once every two to three months. Results across all fifteen coalitions show significant and positive shifts in ratings of process/structure (p<.05). This suggests that during the first year they worked together, Connect to Protect researcher-community partners strengthened their group infrastructures and operating procedures. The findings shed light on how collaboration factors evolve during coalition formation and highlight the need for future research to examine change throughout subsequent coalition phases. (Peer Reviewed) Article: (Download the PDF version of this article to access the tables and figures referenced.) INTRODUCTION There has been much written about what contributes to coalition success or failure. In their review of the extant literature published in the quarter-century from 1980 to 2004, Zakocs and Edwards (2006) summarize key factors as those related to governance procedures, leadership, active and diverse membership, collaboration, and group cohesion. Despite the attention this topic has received over the last two decades, there is still much to be learned—particularly with regard to generalizability and change over time. In large part, these two aspects are challenging to study due to the nature of coalitions themselves. The considerable variability in goals, infrastructures, communities, and target populations (Zakocs & Edwards, 2006) make it difficult to generalize findings. Additionally there are often significant barriers to examining change over time, including limited resources (e.g., lack of funding for long-term evaluation) and the reality that community coalitions are difficult to form let alone sustain (Kadushin, Lindholm, Ryan, Brodsky & Saxe, 2005). Successfully completed longitudinal studies unequivocally point to the need for further research. For instance, a seven-year (1995–2002) project funded by the Centers for Disease Control and Prevention involving teen pregnancy prevention coalitions in thirteen communities found that good coalition processes—though associated with short-term success—did not appear to influence coalition survival (Kegler, Williams, Cassell, Santelli, Kegler, Montgomery, Bell, Martinez, Klein, Mulhall, Will, Wyatt, Felice & Hunt, 2005). Such results underscore the value of assessing coalitions during various developmental stages; doing so will enhance understanding of how collaborative efforts evolve and are sustained. Focus of the Present Study C2P offers the opportunity to closely follow the formation, evolution, outcomes, and sustainability of fifteen community coalitions located in urban areas with high concentrations of youth HIV (see Ziff, Harper, Chutuape, Griffin-Deeds, Futterman, Francisco, Muenz & Ellen, 2006 for project overview). Each coalition aims to decrease HIV rates among youth by catalyzing community structural change. This strategy focuses on creating new or modifying existing policies, programs, and practices in ways that are expected to curb the spread of the disease. Each coalition examines their city’s particular situation and determines which structural changes, taken together, are likely to ultimately have an overall impact on youth HIV rates. There are many examples; here we list just a few: altering local zoning to disrupt open-air drug markets, extending neighborhood clinic hours to include more youth-friendly hours, changing physical structures so that high-risk behavior is discouraged (e.g., install lighting in public areas where risky behaviors are known to occur), and improving provider testing and counseling practices. Pursuing and achieving structural changes can take a great deal of time and other resources, thereby making ongoing successful collaboration among coalition members essential to the process. The goal of the present study is to shed light on how collaboration evolves during coalition formation stages. Specifically, we examine changes in collaborative factors during the first year that the research site staff and their community partners worked together on C2P endeavors. METHODS Study Population: The study population consists of the researcher-community partners from each of the fifteen coalitions. Researchers include ATN site staff such as adolescent medicine specialists, C2P project coordinators, and outreach workers. The number of staff members per site ranged from two to five, with an average of three. Each site staff group established formal relationships with an initial set of local community partners (referred to here as “charter” community partners). For complete details on how site staff identified and established relationships with community partners, see Straub, Griffin-Deeds, Willard, Castor, Peralta, Francisco and Ellen (2007). To provide needed context for this paper we briefly summarize the main steps below. First, site staff worked to establish C2P’s presence in the community by participating in relevant local events and meetings, networking with leaders and gatekeepers, talking to adolescents and young adults for their perspectives, and so forth. Second, while continuing to raise awareness of C2P in their respective cities, site staff assessed and catalogued existing local resources to better understand where, how, and when young people at higher risk for HIV are (or are not, as the case may be) reached. The work ultimately resulted in a printed directory of current resources for youth and those who care for and about them. Third, site staff conducted in-depth interviews with a subset of the catalogued community resources. The interviews served two purposes: (1) they provided site staff with additional data on which entities may be a good fit as a charter community partner in terms of interest, experience, knowledge, time available, etc. and (2) the process provided a built-in opportunity to grow and strengthen relationships, regardless of whether the entity subsequently formed formal ties with C2P. When drawing up their lists of potential charter community partners site staff were asked to consider not only agencies and organizations, but also to think more broadly about particular individuals who may need to be involved during the early stages in order to help legitimize the coalition and create a groundswell of support. Site staff approached those on their lists and, for interested parties, outlined initial expectations of community partners and discussed the various degrees to which they could be involved. Entities and individuals who agreed to play a more significant role in C2P activities as a “main” partner (in contrast to those who wanted to participate in more of a supporting or advisory role) signed a memorandum of understanding that detailed partnership responsibilities at this level (e.g., attending meetings; identifying venues where youth can be reached for C2P activities; helping to increase buy-in and ownership from community members). Overall, the number of charter community partners per site ranged from thirteen to twenty-one, with an average of nineteen. In response to a multi-factorial question, community partners described themselves as the following : community-based organizations (e.g., agencies providing case management, mental health and substance abuse care centers; 67%); government agencies (e.g., health and housing departments; 13%); spiritual/faith-based institutions (9%) and others (e.g., after school programs, local bar/club owners; 17%). Measures: The Wilder Collaboration Factors Inventory (Mattessich, Murray-Close & Monsey, 2001; see Table 1) assesses the presence of twenty successful collaboration factors, organized into six domains:
The items within each domain were rated on a five-point scale from strongly agree to strongly disagree. Higher mean domain scores point to greater strengths in that area. Procedures: Sites were required to hold five meetings with community partners throughout the year (every two to three months). The meetings were intended to foster successful coalition building and included activities designed to reinforce a shared understanding of purpose and increase readiness to take on complex collaborative tasks (Wolff, 2001). Examples of meeting activities included: (1) debating city-specific youth HIV prevention needs and opportunities; (2) sharing information on community risks and protective factors; and (3) utilizing ATN-provided instructional materials on topics such as selecting a decision-making model, building coalitions, and developing leadership. Copies of the Wilder inventory were distributed at each meeting (T1 to T5). Site staff and their community partners confidentially completed the inventories each time via paper and pencil and sealed their responses in unmarked envelopes. This process took approximately fifteen minutes. The sealed envelopes were subsequently mailed to Johns Hopkins University for data management and analysis. ANALYSIS RESULTS The majority of Wilder inventory domains had alphas approaching or exceeding .80, indicating high internal consistency reliability: purpose (.75), member characteristics (.74), communication (.79), and process/structure (.82). The environment and resource domains had low alphas (.63 and .50, respectively) and thus were excluded from subsequent analyses. Table 2 summarizes the domain mean, range, and standard deviation at each time point for the included domains. Table 3 summarizes linear regression and GEE results, which are significant for the process domain (p<. 05). The findings suggest that aspects such as decision-making opportunities and strategies, workload management, and understanding of roles and responsibilities improved over time. It is noted here that the composition of attendees at any given meeting may have differed, for any number of reasons (e.g., weather; out of town on business). Thus, we conducted a sensitivity analysis to determine whether varying participation accounted for the findings shown in Table 3. First, we examined frequency of community partners’ meeting attendance (Table 4). Over 30 % attended one meeting, 43 % attended two to three, and approximately a quarter attended four or five. Next regression analyses were conducted revealing results of the same effect size. This indicates that the findings summarized in Table 3 are unlikely to be a by-product of different people sitting at the table throughout the year. DISCUSSION Whereas process/structure appeared to evolve over time in Year 1, changes in the other domains we examined—communication, member characteristics and purpose—were not significant. This may be a result of the selected instrument used to measure collaboration. Alternatively, it is possible that changes in these three particular aspects as assessed by the Wilder inventory simply may not have yet occurred. Future analyses using additional time points will reveal whether (and at what stage of coalition development) shifts in these domains occur. Along the same vein, process/structure may not show change in future waves of analysis. This is possible if, for example, the group feels that it has these types of aspects “ironed out” from the groundwork laid during the first year. Such findings would be consistent with the notion that at each developmental stage different factors may be important for successful coalition functioning (Butterfoss, et al., 1993). The relative stability in communication, member characteristics, and purpose may also be a function of mandated C2P protocol tasks. First, pre-partnership activities such as formalized processes and procedures and clarity on roles and responsibilities could have fostered stable communication ratings (Foster-Fishman, Berkowitz, Lounsbury, Jacobson & Allen, 2001). Knowing that interpersonal relationships and a greater sense of inclusiveness have an impact on coalitions (Suarez-Balcazar, Harper & Lewis, 2005; Wells, Ford, McClure, Holt & Ward, 2007), all sites were expected to foster effective communication before formally establishing any partnerships within the community (see Straub, et al., 2007). Second, the lack of change in the member characteristics domain is unsurprising given that during the first year coalition membership was, by design, largely fixed and generally consisted of site staff and charter community partners. This requirement stemmed from previous research supporting active involvement of organizational representatives prior to cultivating broad support from a wide range of community sectors (Zakocs & Guckenburg, 2007). And third, the C2P general mission and purpose was made clear to all participants before sitting at the table. At the required meetings each coalition was, however, encouraged to modify the mission so that it included language specific to their communities. This likely contributed to the trend of increased shared purpose. Future Considerations Thus far, site staff members have adopted more of a leadership role (e.g., driving/executing many of the goals and activities) and community partners generally have played more of a consultative role (e.g., providing input and feedback on goals, activities, community perception). As the coalitions firm their foundations and expand in size and breadth, it will be necessary for site staff and their community partners to revisit leadership models and to determine the best fit. As just one example, a coalition may strive for more distributed or shared leadership in hopes of increasing the chances of coalition sustainability. This change in dynamics will almost certainly affect perceptions of process/structure among the group. Another consideration to be explored is that over a longer period of time, changes in collaboration factors may be non-linear. For instance, perceptions may fluctuate as the coalition achieves stated structural change objectives and then adds new ones that come with different facilitators and barriers. They may likewise vary non-linearly as some coalition members cycle in and out of the group as a function of coalition needs and/or natural attrition. CONCLUSIONS AND LESSONS LEARNED Researchers and community partners will have differing perceptions of process/structure aspects depending on the institutions and agencies they represent. We recommend that at the outset participants treat the coalition its own separate organizational unit – one that requires its own organizational structure/processes. Such an undertaking requires time and other resources, but the investment can help to avoid typical pitfalls young coalitions are prone to experience. Attending to these rudimentary issues early on—and monitoring them and addressing needs for change over time – can foster the solid infrastructure needed for effective functioning and long-term survival, so that coalition members can better focus on the larger issue at hand: facilitating community structural change to protect youth from HIV/AIDS. REFERENCES Foster-Fishman, P.G., Berkowitz, S. L., Lounsbury, D.W., Jacobson, S. & Allen, N. A. (2001). Building collaborative capacity in community coalitions: A review and integrative framework. American Journal of Community Psychology, 29(2), 241-261. Kubisch AC, Weiss CH, Shorr LB, Connell JP. Introduction. In: New Approaches to Evaluating Community Initiatives, Concepts, Methods and Concepts. New York, NY: Aspen Institute – Roundtable on Comprehensive Community Initiatives for Children and Families, 1995. Kegler, M.C., Williams, C.W., Cassell, C.M., Santelli J., Kegler, S.R., Montgomery, S.B., Bell, M.L., Martinez Y.G., Klein, J.D., Mulhall, P., Will, J.A., Wyatt, V.H.,. Felice ,T.L. & Hunt, S.C. (2005). Mobilizing communities for teen pregnancy prevention: Associations between coalition characteristics and perceived accomplishments. Journal of Adolescent Health, 37 (3), S31-S41, doi:10.1016/j.jadohealth.2005.05.011. Mattessich, P. W., Murray-Close, M., & Monsey, B. R. (1992). Collaboration: What makes it work (2nd ed.). Saint Paul, MN: Amherst H. Wilder Foundation. Peterson, J.W., Lachance, L.L., Butterfoss, F.D., Houle, C.R., Nicholas, E.A., Gilmore, L.A., Lara, M. & Friedman, A.R. (2006). Engaging the community in coalition efforts to address childhood asthma. Health Promot Pract, 7(2), 56S-65S, doi:10.1177/1524839906287067. Ramos R.L., Hernandez A, Ferreira-Pinto J.B., Ortiz M. & Somerville G.G. (2006). Promovisión: Designing a capacity-building program to strengthen and expand the role of promotores in HIV prevention. Health Promot Pract, 7(4), 444-449, doi:10.1177/1524839905278868. Roussos, S.T. & ¬ Fawcett, S.B. (2000). A review of collaborative partnerships as a strategy for improving community health. Annual Review of Public Health, 21, 369-402, doi:10.1146/annurev.publhealth.21.1.369. Straub, D.M., Griffin-Deeds, B., Willard, N., Castor, J., Peralta, L., Francisco, V.T. & Ellen, J. (2007). Partnership selection and formation: A case study of developing adolescent health community-researcher partnerships in fifteen U.S. Communities. Journal of Adolescent Health, in press. Suarez-Balcazar, Y., Harper, G. & Lewis, R. (2005). An interactive model of community university collaborations for research and action. Health Education & Behavior, 32(1), 84-101. Tandon, D., Parillo, K., Jenkins, C., Jenkins, J. & Duggan, A. (2007). Promotion of service integration among home visiting programs and community coalitions working with low-income, pregnant, and parenting women. Health Promot Pract 8, 79-87. Weiss, E.S., Anderson, R.M. & Lasker, R.D. (2002). Making the most of collaboration: Exploring the relationship between partnership synergy and partnership functioning. Health Education & Behavior, 29 (6), 683-698. Wolff, T. (2001). A practitioner's guide to successful coalitions. American Journal of Community Psychology, 29(2), 173-191. Zakocs, R. C., & Edwards, E. M. (2006). What explains community coalition effectiveness? A review of the literature. Am J Prev Med, 30 (4), 351-361, doi:10.1016/j.amepre.2005.12.004. Zakocs, R. & Guckenburg, S. (2007). What coalition factors foster community capacity? Lessons learned from the Fighting Back Initiative. Health Education & Behavior, 34 (2), 354-375. Ziff, M.A., Harper, G.W., Chutuape, K.S., Griffin-Deeds, B., Futterman, D., Francisco, V.T., Muenz, L.R., Ellen, J.M. & Adolescent Medicine Trials Network for HIV/AIDS Intervention (2006). Laying the foundation for Connect to Protect ®: A multi-site community mobilization intervention to reduce HIV/AIDS incidence and prevalence among urban youth. Journal of Urban Health, 83 (3), 506-522. PDF of ArticleAuthor
This research is funded by grant #U01 HD040533 from the National Institutes of Health through the National Institute of Child Health and Human Development, with supplemental funding from the National Institute on Drug Abuse, National Institute on Mental Health, and National Institute on Alcohol Abuse and Alcoholism. Connect to Protect has been scientifically reviewed by the ATN’s Behavioral and Community Prevention Leadership Groups (CPLG). The authors wish to acknowledge the input and support of ATN and CPLG leadership; the ATN Coordinating Center; Westat, Inc.; Connect to Protect’s National Coordinating Center; participating ATN clinical research sites; community partners; and youth involved in local and national community advisory boards. Comments (0)Add Comment |