(Peer Reviewed)
Research-based knowledge remains relatively underutilized by social practitioners. Many studies have shown that, in order to be used, research results have to be compatible with users’ needs and beliefs. The purpose of this needs assessment study was to identify the priority needs of community-based organization practitioners in terms of new research-based knowledge. The first phase of the study focused on a large-scale survey designed to identify what kind of information should be more available to practitioners. In this phase, we used concept mapping technology to construct a graphic representation of the participants’ main concerns. In the second phase, we conducted focus groups to develop a knowledge transfer strategy that takes into account the identified needs.
Please see the PDF version for the complete article, including tables and figures.
Peer Reviewed
Introduction
Researchers, practitioners and decision-makers are placing increasing importance on the use of empirical evidence for the improvement of population health and well-being (McQueen & Anderson, 2000; Nutley, Walter & Davies, 2007; Newman, 2002). Despite this trend, studies show that research-based knowledge remains relatively underutilized among practitioner and decision-making communities (Brown, 2000). Olsson (2007) reports that evidence-based practice not only encourages decisions that are based on the best available, valid, relevant evidence, but also synergistically combines this evidence with the practitioner’s expertise and with the values and expectations of those who receive care. Optimal use of research findings is not possible without taking into consideration the needs, concerns, and degree of receptivity of the potential users of this knowledge (Dagenais, 2006; Hanney, Gonzalez-Block, Buxton & Kogan, 2003). However, information about the particular needs of CBO workers for new knowledge is practically non-existent.
The community movement in Québec has contributed significantly to the province`s history and evolution. Distinct from government public services, community-based organizations (CBO) are established by citizens and aim to improve the lives of Québecers. To be recognized as a CBO, an organization must satisfy four criteria: 1) be non-profit, 2) be rooted in the community, 3) have an associative and democratic life, and 4) be free to determine its mission, approaches and practices. There are currently some 8,000 CBOs in Québec. Together, they represent more than 35,000 workers and $720 million in annual funding.
This article describes the methods and findings of a needs assessment study to determine the perceived need for new research-based knowledge by CBO workers in the province of Québec (Canada). We conducted the study with two objectives: 1) to identify the priority topics that could be the object of knowledge transfer (KT) for stakeholders in community-based organizations, and 2) to develop an appropriate KT strategy.
Research Problem
There is an emerging consensus in the scientific literature that efforts generally spent on making knowledge available are a necessary but insufficient condition for this knowledge to be actually used in practice (Bero, et al., 1998; National Center for the Dissemination of Disability Research [NCDDR], 1996a, 1996b; Rubin, Frommer, Vincent, & Phillips, 1998; Weill, 1990).
An examination of empirical studies on research-based knowledge transfer identifies a myriad of conditions that facilitate the KT process. These may be grouped into four categories: (1) Conditions associated with organizations: continuous support during implementation of the change (Joyce & Showers, 2002; Nutley, Walter, & Davies, 2003); leadership of key players (Fullan & Hargreaves, 1997; Nutley, et al., 2003; Rohrbach, et al., 2005; Walter, Nutley, Percy-Smith, McNeish, & Frost, 2004); organizational culture (Armstrong & Anthes, 2001; Lachat & Smith, 2005; Nutley, et al., 2003; Rohrbach, et al., 2005; Walter, et al., 2004). (2) Conditions associated with the KT strategy: involvement of potential users in research activities (Barker, 2005; Estabrooks, Floyd, Scott-Findlay, O'Leary, & Gushta, 2003; Huberman, 1990); formulation of explicit recommendations regarding actions to be taken (Denis, 2000; Hanney, Gonzalez-Block, Buxton, & Kogan, 2003; Hughes, et al., 2000); dissemination, at an opportune time, of answers to problem situations experienced by users (Hanney, 2004; Innvaer, Vist, Trommald, & Oxman, 2002; Jacobson, Butterill, & Goering, 2005; Waddell, et al., 2005); sustained personal contact between the disseminators of knowledge and potential users (Backer, 1991; Hanney, et al., 2003; Huberman, 1989; Landry, Amara, & Lamari, 2000; NCDDR, 1996b). (3) Conditions associated with available resources: the material and time required (Sleeter, 1992; Walter, et al., 2004), human and financial resources (Demers, 1997; McQueen & Anderson, 2000). (4) Conditions associated with individuals: congruence between the needs of users and the characteristics of the proposed change (NCDDR, 1996a, 1996b; Rohrbach, Ringwalt, Ennett, & Vincus, 2005); congruence between the proposed change and the values and beliefs of users (Breslin, Li, Tupker, & Sdao-Jarvie, 2001; Briscoe, 1991); the importance of taking the concerns of potential users into account when effecting KT (Dagenais, 2006; Elliott & Popay, 2000; Francis & Perlin, 2006; Hughes, McNeish, Newman, Roberts, & Sachdev, 2000). The present study focuses on this fourth condition, as little information is available about the needs for new knowledge on the part of CBO workers.
Various KT models are described in the scientific literature. These models may be categorized in different ways and the literature abounds with a variety of nomenclature. The four most documented models are: (a) The science push or knowledge push model, which postulates that high-quality knowledge will, of necessity, be rapidly used (Denis, Lehoux, & Champagne, 2004; Landry, Amara, & Lamari, 2001a). This model is unidirectional, moving from the realm of research to intervention. The evidence-based decision making stream flows from this model. (b) The demand pull or problem solving model, in which it is users who formulate research requests in order to solve problems (Denis, et al., 2004; Weiss, 1980). According to this view, the use of research findings will increase when findings provide concrete answers to user questions. Studies show, however, that this is not always the case and findings are seldom used when they do not fit user expectations (Landry, et al., 2001a). (c) The dissemination model which promotes developing mechanisms to disseminate research findings at an additional stage that is integrated into knowledge production (Landry, et al., 2001a). (d) The social interaction model, where exchange between researchers and users is bi-directional: they are equal partners (Blackburn & Demers, 1996). In this model, the more interaction between researchers and users intensifies and is regularized, the more knowledge is used (Landry, et al., 2001a; Landry, Amara, & Lamari, 2001b).
Each of the KT models is based on varying principles and mechanisms. Each is generally associated with a particular field where it proves appropriate. For example, in the field of health, the science push model largely predominates. No KT model, however, has been developed for the field of CBO practice.
Method
The procedure planned for this study began with preparatory activities to set up a Monitoring Committee and determine both the target population and the most appropriate methods. In the first phase (objective 1: identification of needs), we used interviews and concept mapping (CM) technology to identify priority needs in the selected organizations. In the second phase (objective 2: develop a knowledge transfer strategy), we validated results and identified the conditions for successful knowledge transfer by means of focus groups in each of the sectors and targeted regions. Lastly, we submitted the findings to the Monitoring Committee for analysis and developed a KT strategy adapted to the realities of the community organizations.
Preparatory Activities
From the very outset of the project, we considered it crucial to identify partners who were central to the world of community organizations in order to involve them in the process. Initial contacts targeted the Centre de formation populaire (CFP), a key player in the field of training throughout Québec, and Relais-femmes, a feminist organization whose mission is to foster social change and promote the rights of women and their organizations. Research, training and joint action are the main mandates of Relais-femmes. We also invited several other organizations working in the targeted regions or in cooperation with the sectors to take part in the project, including the Regroupement des organismes communautaires de la région Gaspésie-Îles-de-la-Madeleine (ROC GÎM), the Regroupement des organismes communautaires autonomes jeunesse du Québec (ROCAJQ), the Regroupement intersectoriel des organismes communautaires de Montréal (RIOCM) and the Regroupement des organismes communautaires de l’Estrie (ROC de l’Estrie). Note that each organization and community coalition received approval from its board to participate in the study. Next, we invited several groups of organizations working in the targeted regions to join the project’s Monitoring Committee. The Committee’s mandate was to monitor the study through each of its phases and to:
• support work planning;
• validate strategic and methodological choices;
• contribute to the identification of conditions for effective KT;
• contribute to the development of KT strategies; and
• contribute to the development of a dissemination plan for the results of the study.
The formation of the Monitoring Committee made it possible to integrate key leaders in the community sector, as well as an academic with extensive research experience in the practices of community organizations, into the entire process.
There are over 10,000 community-based organizations (CBOs) in the province of Québec. Considering the areas of expertise of the Center for Liaison on Intervention and Prevention in the Psychosocial Area (CLIPP), the large number and variety of community organizations and, by extension, the diversity of the content to be transferred, the Monitoring Committee decided to concentrate on organizations in three intervention sectors: a) Youth (e.g., youth centers, shelters, street outreach, advocacy), b) Women (e.g., women’s centers, advocacy, women’s shelters, sexual abuse intervention), and c) the Elderly (e.g., volunteer action centers, home support, advocacy). We initially approached the Child/Family sector; however, in consultation with the Monitoring Committee, we opted for the Elderly Sector instead. This change was due to the fact that organizations in the Child/Family sector had already been called on to take part in a number of studies in the two years prior and, in a change of reporting structure, were about to be assigned to a different government department. As well, when we contacted the Regroupement des organismes familles du Québec (ROFQ), it had just obtained funding for a knowledge transfer study that was already taking up a lot of practitioner time.
All CBOs in three representative regions were invited to participate. Although the project initially targeted organizations in all regions of Québec (n = 17representatives), the consultations we conducted led us to change our strategy and focus on three representative regions. These regions were strategically selected by the Monitoring Committee to reflect differences in terms of number of CBOs, level of urbanization, and presence or absence of universities. With regard to this last criterion, we hypothesized that the presence of nearby universities might influence the level of need for research-based knowledge on the part of organizations in these regions. Thus, Region 1 (Gaspésie-Îles-de-la-Madeleine) had fewer than 100 CBOs, was located in a rural area, and had no university within a 500-kilometre radius. Region 2 (Estrie) had between 101 and 150 organizations, was semi-urban and semi-rural, and was near a university. Region 3 (Montreal) had over 150 community organizations, and was located in an urban area with four universities. The targeted population for the study consisted of a total of 119 Youth sector organizations, 117 Women sector organizations, and 102 Elderly sector organizations.
The concept mapping technique (Dagenais & Bouchard, 2003; Kane & Trochim, 2006; Ridde, 2008; Trochim, 1989a, 1989b; Trochim, Cook, & Setze, 1994) makes it possible to identify the primary components, dimensions, and particularities of a reality and to determine their relative importance (Caracelli, 1989; Daughtry & Kunkel, 1993). The technique produces images that simultaneously represent the main concepts, ideas and dimensions at play, and their relative importance (Fisher, 1990). It also fosters collaboration among participants, who remain involved throughout the process (Daughtry & Kunkel, 1993; Trochim, 1989a, 1989b).
Our review of the literature on this method identified 145 articles published in peer-reviewed journals between 1985 and 2008. These articles cover 11 professional fields: health, mental health, general psychology, organizational psychology, industry, communication, education, social services, sociology, research and research methods. In the majority of these articles (55 articles: 37.9%), the technique was used to develop a theory or was applied in the context of program evaluations (31 articles: 21.4%). In 16 of these articles (n = 11.7%), concept mapping was used for the purposes of needs assessment studies. In the current needs assessment study, we used the technique to inventory participant viewpoints regarding topics that should be prioritized for eventual knowledge transfer. The technique also allowed us to identify regional differences and to compare intervention sectors. Since the procedure is well described in the literature (Dagenais, Ridde, Laurendeau, Souffez, 2009, 2010; Kane & Trochim, 2006; Ridde,2008), this article will only briefly describe the process and then concentrate on the findings. We applied the method in five steps for this study. In the first step, we inventoried the viewpoints of respondents on topics that should be prioritized for eventual knowledge transfer. This type of information gathering normally takes place during a brainstorming session. However, due to the number of organizations involved and their geographic locations, we used telephone interviews to gather this data. In the second step, we reduced the data on the numerous topics that were mentioned during the telephone interviews. In the third step, participants ranked the topics and grouped them into categories. We analyzed the data in the fourth step in order to produce the preliminary maps. Lastly, in the fifth step, we used focus groups in each region to validate the content of these maps.
Confidentiality was maintained throughout this needs assessment study and all participants signed an informed consent form.
Step 1: The telephone interview.The purpose of the telephone interview was to inventory the opinions of stakeholders on the topics that should be prioritized for eventual knowledge transfer. Each interviewee had to complete the following sentence: “It would be useful to your practice to have access to research results about subjects such as…”.
Step 2: Data reduction procedure. We used a data reduction procedure to bring the number of topics mentioned during the telephone interviews down to a manageable size for generating concept maps. The first data reduction step allowed us to eliminate topics that were too vague, confusing or not relevant to the study (e.g., How to solve poverty?; New short-term approaches: which are best?). A second data reduction step enabled us to eliminate duplications and merge closely related topics, and thereby reduce the list to 250 topics (e.g., Dropout intervention and Dropout intervention new practices). We used the third step to eliminate topics that occurred only once. Finally, in the fourth step, we conducted a more detailed analysis of the topics and identified opportunities for merging similar topics (e.g., Knowledge of youth interests and Better understanding of youth). We then invited participants to validate these shortened lists.
Step 3: Rating and grouping into categories. Participants who had agreed to participate in this stage proceeded to sort (Rosenberg & Kim, 1975) the topics in such a way as to create distinct categories which each represented an idea or concept. Respondents were allowed to create as many categories as they wished, but could not put the same topic into more than one category. They also had to rate each topic in order of importance on a scale of 1 to 5, with 5 indicating the most important.
Step 4: Data analysis and production of preliminary maps. After grouping the topics into categories, we developed a preliminary map for each sector and region. These concept maps were constructed using a series of three statistical analyses:
Step 5: Focus Groups. We validated results during focus groups composed of a sample of respondents from each of the regions and sectors. The primary objective of these groups was to finalize the preliminary maps, that is, to validate the results, establish a consensus about the optimal number of categories that should be retained, and choose an appropriate name for each category.
The consultations that were conducted via focus groups with participants from the three sectors and the targeted regions also served to acquaint participants with the conditions for knowledge use derived from the scientific literature in order to see to what extent these conditions would be applicable in CBOs. Two meetings with an expanded Monitoring Committee and a number of exchanges while this report was being prepared produced a series of recommendations about follow-up to this study. The culmination of this work, which was done in close collaboration with the main stakeholders, has made it possible to propose a knowledge transfer strategy adapted to the realities of community groups.
Results
Objective 1: Identify the priority topics that could be the object of knowledge transfer for CBOs. This section is divided into three parts that respectively present the results for the Youth, Women, and Elderly sectors.
Results for the Youth sector
It is important to point out that the methodology used caused the number of participants to decrease at each stage of the study (nested sampling). In total, 119 organizations were targeted, 72 workers agreed to participate in the telephone interviews, and 26 of them took part in rating the topics and grouping them into categories. Eleven of these 26 participants were involved in the focus groups. A list of 427 topics was compiled from the telephone interviews for the Youth sector. Data reduction brought this number down to 96 topics.
Construction of the concept map
A total of 26 participants rated and categorized the 96 topics on the final list. The statistical analyses used for concept mapping produced 11 categories. Figure 1 presents these categories in the form of islands, whose height, represented by the number of strata, indicates the importance assigned to the topics that compose them.
The categories “Love relationships”, “School dropout”, “Delinquency” and “Mental health” were each assigned five strata, which means that participants attributed greater importance to these topics. The categories “Organization of work”, “Family relationships” and “Assessment of practices” only had four. “Mobilization of youth”, “Addiction” and “Sexuality/STDs” had three strata. The category “Cultural aspects” was deemed least important and consisted only of a single stratum. Table 1 presents examples of the topics in each of these categories.
Validation of results by region
There are numerous distinctions to be made about the different regions. As this study is first and foremost about priority needs for new research-based
knowledge, only the categories considered most important by respondents will be dealt with here, i.e., those that had four or five strata. Table 2 presents a comparison of the relative importance of the categories for each of the three regions.
For region 1 (rural, remote from universities). When the mapping results were presented to a focus group (n = 11), participants found them to be very representative of the reality experienced in this region. In contrast to the interventions of organizations in other regions, which mostly focussed on target groups or specific problem issues, the work of these stakeholders tended to be more generalized; this explains why 10 of the 11 categories were all considered significant. Participants emphasized there was a great need to acquire new knowledge about almost all of the categories mentioned, due to limited access to resources (training, universities or other) and the related costs.
For region 2 (semi-urban, one university). In this region, 7 of the 11 categories were considered important. When presented with the results, focus group participants indicated that KT priorities should focus on mental health (due to limited access to training on this subject), assessment of practices, organization of work, and mobilization of youth.
The low level of importance given to “School dropout” is explained by the fact that several youth centres have chosen to leave this type of intervention to schools. As for the “Family relations” category, its low level of importance is due to the fact that the organizations do not work directly with families, but rather with youth.
For region 3 (urban, four universities). In this region, only four categories were judged to be important. As it was impossible to form a focus group in the region, members of the Monitoring Committee were asked to validate the content of the map. All of the members found that the proposed concept map was a good depiction of the reality in this region. For example, the category “Addiction” was deemed not important since organizations in the region have rapid access to information on this subject and, due to the local availability of a large number of specialized resources, they are able to proceed with referrals. In contrast, the category “Cultural aspects” was assigned five strata, due to the multi-cultural nature of the region.
Results for the Women sector
In total, 117 organizations in the Women sector were targeted and 66 of them participated in the telephone interviews. Twenty-two participants took part in rating the topics and categorizing them. Four people were involved in the focus groups.
A preliminary list of 194 topics was compiled from the telephone interviews. About ten organizations then proceeded with team reflection and produced a collective response. This method of operating is characteristic of the culture of women’s groups. As a result of data reduction, the final list was shortened to 96 topics.
Construction of the concept map
A total of 22 participants rated and categorized the 96 topics. Concept mapping operations led to eight identified categories in the final map. Figure 2 shows that the “Domestic violence” and “Studies and assessment” categories were deemed to be the most important and were composed of five strata. Only the “Masculinist discourse” category had four strata. The categories “Women and minorities” and “Organiza-tions and approaches” were each given three strata, while “Sexual assault” only had two. Finally, less importance was given to the “Health” and “Living conditions” categories. Table 3 presents examples of the topics grouped into these eight categories.
Validation of results by region
As was the case with the Youth sector, there were numerous differences among the various regions and only those categories deemed by participants to be most significant are treated here, namely those consisting of four or five strata. Table 4 presents a comparison of the relative importance of the categories for each of the three regions.
For region 1 (rural, remote from universities). The only category deemed important by participants from this region was “Masculinist discourse”, which had 5 strata. No other category was given more than 3 strata. The large number of participants in this region made it possible to compare the results obtained from two types of organizations in this sector, namely women’s centres and shelters; this was not possible in the two other regions. Of the four categories judged important by one or both types of organization, only the “Masculinist discourse” category was of comparable importance for participants. This finding highlights the fact that an analysis that is too global runs the risk of masking needs that are actually clearly identified. Indeed, it is only by taking into consideration the type of organization to which the participants belonged that needs associated with the “Domestic violence” category emerged for the shelters and those associated with “Living conditions” and “Organizations and approaches” emerged for women’s centres.
For region 2 (semi-urban, one university).The results for this region go completely against those of region 1. In fact, whereas “Masculinist discourse” was deemed the only important category in region 1, it was the only category not considered important in region 2.
For region 3 (urban, four universities). Participants in this region considered three of the eight categories to be very important. These were: “Studies and assessment”, “Domestic violence” and “Women and minorities”.
Results for the Elderly sector
In total, 102 organizations were targeted, 70 of them participated in the telephone interviews and 21 participants took part in rating and categorizing the topics. Three people participated in the focus groups. A preliminary list of 215 topics was compiled from the telephone interviews and then reduced to 96 items as a result of data reduction.
For region 2 (semi-urban, one university).The results for this region go completely against those of region 1. In fact, whereas “Masculinist discourse” was deemed the only important category in region 1, it was the only category not considered important in region 2.
For region 3 (urban, four universities). Participants in this region considered three of the eight categories to be very important. These were: “Studies and assessment”, “Domestic violence” and “Women and minorities”.
Results for the Elderly sector
In total, 102 organizations were targeted, 70 of them participated in the telephone interviews and 21 participants took part in rating and categorizing the topics. Three people participated in the focus groups. A preliminary list of 215 topics was compiled from the telephone interviews and then reduced to 96 items as a result of data reduction.
Construction of the concept map
A total of 21 people rated and categorized the 96 statements. Seven categories emerged from the concept mapping operation, as shown in Figure 3. The categories “Informal caregivers” and “The organization” were considered to be the most important ones and had five strata. The categories “Volunteerism” and “Studies and assessments” had four strata. The category “Health / Mental health” only had two strata. Finally, the categories “Social problems” and “Family relationships” were judged least important. Table 5 shows a few examples of the topics in these seven categories.
Validation of results by region.
As was the case with the previous sectors, there were numerous differences among the various regions and only the categories considered most important by participants are treated here, that is, those with four or five strata. Table 6 presents a comparison of the results by region.
For region 1 (rural, remote from universities). In this region, the category “The organization” was composed of five strata, whereas the categories “Informal caregivers”, “Volunteerism”, and “Studies and assessment” were only composed of four. Based on the comments received, this map highlights both the fact that volunteerism remains a central concern for volunteer agencies in the region, and that the importance accorded to statements in the “Informal caregivers” category is consistent with that accorded to them elsewhere in Quebec.
For region 2 (semi-urban, one university). In the map for region 2, only the “Informal caregivers” category had five strata. All the other categories were clearly less important and only contained one or two strata. This finding did not surprise focus group participants, as the topic was consistently raised at meetings of community organizations in the region’s Elderly sector. The fact that various needs appeared to be less of a priority for the organizations in this region may be explained by the active presence of an institute of geriatrics which facilitated access to research findings. Participation by community organizations in the regional prevention program also appeared to have satisfied certain needs.
For region 3 (urban, four universities). For region 3, the category “The organization” was deemed to be the most important, followed by the categories “Volunteerism” and “Studies and assessments”. The map for this region corresponds to provincial trends associated with the realities experienced by organizations in this sector. However, focus group participants thought that an additional category should have been represented. In fact, “ethnic diversity” is a concern of organizations in this region, both in terms of recruitment and supervision of volunteers, and in terms of home services and the aging population in ethnic communities.
Objective 2: Developing an appropriate knowledge transfer strategy for CBOs
The results of the meetings with the Monitoring Committee established that knowledge transfer in community-based organizations must respect several principles. Any effort to transfer new knowledge must, of necessity, be based on respect for context, local dynamics, and the environment of potential users. Also, such an effort must build on what already exists in these environments. The goal is not to remake the environment, but to recycle existing resources, expertise, and tools as a very first step. Only then should one seek elsewhere for what needs to be added to the knowledge that is already available, though perhaps not always accessible.
Two meetings with the expanded Monitoring Committee and a number of exchanges at the time of writing the report resulted in the production of a series of recommendations for follow-up to this study. Based on a set of recommendations made by the Monitoring Committee, we developed a KT strategy adapted to the realities of the given sectors and regions (Figure 4). The strategy’s starting point is the groups targeted for knowledge transfer (Who?), for whom a planned, systematic new knowledge needs assessment is carried out. The development of knowledge transfer activities (scenarios) flows out from a methodical examination of the users’ context. It is a matter of putting into practice the recommendations made by participants, namely:
Discussion
In this needs assessment study, we first identified the topics for knowledge transfer that were priorities for the stakeholders of Quebec CBOs in the Youth, Women, and Elderly sectors. We then presented the results of the first phase to participants so they could validate them and suggest useful and relevant ways for optimizing knowledge transfer strategies that could be developed to respond to the needs that were expressed. We also used the consultations, conducted in the context of focus groups with participants from the three sectors and the targeted regions, to describe the conditions for the use of the knowledge presented above and determine to what extent these conditions would be applicable in the community sector.
Considering the great diversity of topics put forward by the participants in the three sectors and the three regions, the use of concept mapping proved a judicious choice. Besides being an innovative and stimulating approach for participants, the technique is also more democratic, as it gives the same relative weight to each person’s point of view. It also has the significant advantage of presenting findings in the vocabulary of the principal stakeholders. Lastly, the fact that participants were only asked one question allowed them to reply spontaneously and required very little of their time. Several participants mentioned that they greatly appreciated this time saver.
It is clear that by allowing regional and sectoral differences to be highlighted, this study has made it possible to learn something quite new. In fact, no study to date has produced results that permit efforts for knowledge transfer to be concentrated on the regions that most need them. The data on the modalities of transfer deemed most appropriate by primary stakeholders also make it possible to develop a KT strategy that is adapted to the particularities of each of the targeted intervention communities.
The decision to conduct telephone interviews rather than a mail survey or brain-storming sessions proved to be advantageous. This approach avoided soliciting people whose responses would not have added anything new to the data and, at the same time, yielded very high response rates, even 100% in the case of the Youth organizations. The strategy thus ensured a good representative sampling for the first stage of the study.
Representative sampling was, however, jeopardized in the subsequent stages, which limits the scope of certain conclusions. Only three people in the Women’s sector for region 2 ranked and categorized the statements for the concept mapping operation. Low participation in the focus groups (50%) also prevented the results from being validated for these particular regions and sectors. It will, therefore, be necessary to conduct another type of validation for sectors affected by any knowledge transfer activities resulting from this needs assessment.
Our study allowed us, firstly, to develop collaborations with players on the ground in order to identify the priority needs in each of the intervention sectors and better understand the realities in the three regions. In the next step (Phase 1), we will draw on this rich information to conduct a systematic review of user context and collate available information. This preliminary step is essential for the production of new knowledge and new transfer and training tools (components 1, 3 and 4 of the model).
We will then (Phase 2) identify and establish mechanisms enabling community organizations to access this information, with a focus on the realities of the various regions and the importance of collaboration with players on the ground (component 2 of the model). Once we have identified and tested these mechanisms, we will experiment with mechanisms that ensure: 1) the strategic management of this information (updates, intelligence), and 2) sustainable and dynamic access for all community organizations throughout Québec.
In a third phase, we will field-test a knowledge transfer strategy in which accompaniment will be provided to ensure better integration of new knowledge on the management of community groups (a need that emerged as a high priority in our study).
Conclusion
We conducted this needs assessment in collaboration with community-based organizations in three intervention sectors across three regions of the province of Québec. It documented the magnitude of needs deemed to be priorities by stakeholders, and the need to implement a series of recommendations for appropriate follow-up to the study. This study on what constitute priority needs for the stakeholders of these CBOs made it possible to:
The knowledge transfer strategy developed is based on recommendations from the focus groups and the Monitoring Committee. Various elements must be taken into consideration, such as respect for context, local dynamics, and the environment of potential users. Sustainable development in CBO practices involves identifying training and transfer organizations that work in the community field; establishing collaborations with grassroots players; systematically identifying existing knowledge and tools at the local, regional and national levels; and, finally, identifying, in databanks, the programs and practices with the greatest potential for dissemination. Finally, the application of the transfer strategy developed in this study should be evaluated through a systematic assessment of the results it produces.
References
Armstrong, J., & Anthes, K. (2001). How data can help. American School Board Journal, 188(11), 38-41.
Backer, T. E. (1991). Knowledge utilization. The third wave. Knowledge: Creation, Diffusion, Utilization, 12(3), 225-240.
Barker, P. (2005). Research in schools and colleges. Unpublished working paper. City of Bristol College.
Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998). Closing the gap between research and practice: An overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. British Medical Journal, 317(7156), 465-468.
Blackburn, J., & Demers, A. (1996). Le transfert des connaissances. Montréal: Université de Montréal, Groupe de recherche sur les aspects sociaux de la santé et la prévention.
Borgen, F. H., & Barnett, D. C. (1987). Applying cluster analysis in counseling psychology research. Journal of Counseling Psychology, 34(4), 456-468.
Breslin, C., Li, S., Tupker, E., & Sdao-Jarvie, K. (2001). Application of the theory of planned behavior to predict research dissemination: A prospective study among addiction counselors. Sci Commun, 22(4), 423-437.
Briscoe, C. (1991). The dynamic interactions among beliefs, role metaphors, and teaching practices: A case study of teacher change. Sci Educ, 75, 185-199.
Brown, B. S. (2000). From research to practice: The bridge is out and the water’s rising. Advances in Medical Sociology, 7, 345-365.
Caracelli, V. J. (1989). Structured conceptualization: A framework for interpreting evaluation results. Evaluation Program Planning, 12(1), 45-52.
Dagenais, C. (2006). Vers une utilisation accrue des résultats issus de la recherche par les intervenants sociaux. Quels modèles de transfert de connaissances privilégier? Les sciences de l'éducation pour l'ère nouvelle, 39(3), 23-35.
Dagenais, C., & Bouchard, C. (2003). Contribution de la cartographie de concepts à la modélisation des interventions en situation de crise en protection de la jeunesse. La revue canadienne d’évaluation de programme, 18(1), 61.
Dagenais C, Ridde V, Laurendeau MC & Souffez, K. (2009). La méthode de cartographie conceptuelle pour identifier les priorités de recherche sur le transfert des connaissances en santé des populations: quelques enjeux méthodologiques. Revue canadienne d'évaluation de programme, in press.
Daughtry, D., & Kunkel, M. A. (1993). Experience of depression in college students: A concept map. Journal of Counseling Psychology(3), 316-323.
Demers, A. (1997). Avis #4 du comité aviseur sur la recherche et l’évaluation en toxicomanie sur le transfert des connaissances: Gouvernement du Québec.
Denis, J.-L. (2000). Le rôle des connaissances dans la transformation des pratiques. Courir deux lièvre dans le champ de l'intervention enfance/famille… ou faire avancer à la fois la science et la pratique. Paper presented at the 67e Congrès de l'ACFAS, Ottawa.
Denis, J.-L., Lehoux, P., & Champagne, F. (2004). Knowledge utilization in health care: From fine-tuning dissemination to contexualizing knowledge. In L. Lemieux-Charles & F. Champagne (Eds.), Using knowledge and evidence in health care: Multidisiplinary perspectives (pp. 18-40). Toronto: University of Toronto Press.
Elliott, H., & Popay, J. (2000). How are policy makers using evidence? Models of research utilisation and local NHS policy making. Journal of Epidemiology and Community Health, 54(6), 461-468.
Estabrooks, C. A., Floyd, J. A., Scott-Findlay, S., O'Leary, K. A., & Gushta, M. (2003). Individual determinants of research utilization: A systematic review. Journal of Advanced Nursing, 43(5), 506-520.
Fisher, K. M. (1990). Semantic-networking: The new-kid on the block. Journal of Research in Science Teaching, 27, 1001-1018.
Fitzgerald, L. F., & Hubert, L. J. (1987). Multidimensional scaling: Some possibilities for counseling psychology. Journal of Counseling Psychology, 34(4), 469-480.
Francis, J., & Perlin, J. B. (2006). Improving performance through knowledge translation in the Veterans Health Administration. Journal of Continuing Education in the Health Professions, 26(1), 63-71.
Fullan, M., & Hargreaves, A. (1997). What’s worth fighting for in your school (2 ed.). New York: Teachers College Press.
Hanney, S. (2004). Personal interaction with researchers or detached synthesis of the evidence: Modelling the health policy paradox. Evaluation and Research in Education, 18(1-2), 72-82.
Hanney, S., Gonzalez-Block, M. A., Buxton, M. J., & Kogan, M. (2003). The utilisation of health research in policy-making: Concepts, examples and methods of assessment. Health Res Policy Syst, 1(2). Retrieved from http://www.health-policy-systems.com/content/1/1/2
Huberman, M. (1989). Predicting conceptual effects in research utilization: Looking with both eyes. Knowledge in Society, 2(3), 6-24.
Huberman, M. (1990). Linking research and practitioners: A qualitative study. Educational Research Journal, 27(2), 363-391.
Hughes, M., McNeish, D., Newman, T., Roberts, H., & Sachdev, D. (2000). What works? Making connections: Linking research and practice. Essex, U.K: Bernardo’s.
Innvaer, S., Vist, G., Trommald, M., & Oxman, A. (2002). Health policy-makers perceptions of their use of evidence: A systematic review. Journal of Health Services Research and Policy, 7, 239-244.
Jacobson, N., Butterill, D., & Goering, P. (2005). Consulting as a strategy for knowledge transfer. Milbank Quarterly, 83(2), 299-321.
Joyce, B., & Showers, B. (2002). Student achievement through staff development. White Plains: Longman.
Kane, M., & Trochim, W. M. K. (2006). Concept mapping for planning and evaluation. Thousand Oaks: Sage Publications.
Kruskal, J. B., & Wish, M. (1978). Multidimensional scaling. Newbury Park: Sage Publications.
Lachat, M. A., & Smith, S. (2005). Practices that support data use in urban high schools. Journal of Education for Student Placed at Risk, 10(3), 333-349.
Landry, R., Amara, N., & Lamari, M. (2000). L’évaluation de l’utilisation de la recheche sociale subventionnée par le CQRS. Québec: Université Laval.
Landry, R., Amara, N., & Lamari, M. (2001a). Climbing the ladder of research utilization: Evidence from social science research. Science Communication, 22(4), 396-422.
Landry, R., Amara, N., & Lamari, M. (2001b). Utilization of social science research knowledge in Canada. Research Policy, 30(2), 333-349.
McQueen, D. V., & Anderson, L. M. (2000). Données probantes et évaluation des programmes en promotion de la santé. Ruptures, revue transdisciplinaire en santé, 7(1), 79-98.
National Center for the Dissemination of Disability Research (1996a). Improving links between research and practice: Approaches to the effective dissemination of disability research. Guides to improving practices Retrieved August 27, 2002, from http://www.ncddr.org/du/products/guide1.html
National Center for the Dissemination of Disability Research (1996b). Improving the usefulness of disability research: A toolbox of dissemination strategies. Guides to improving practices Retrieved 27 August, 2002, from http://www.ncddr.org/du/products/guide2.html
Newman, B. T. (2002). Developing evidence-based practice in social care. Locating, appraising and using research findings on effectiveness: Guidelines for practitioners Retrieved December 15, 2002, from http://www.ex.ac.uk/cebss/pages/publications/EvGuide%20latest.doc
Nutley, S. M., Walter, I., & Davies, H. T. O. (2003). From knowing to doing: A framework for understanding the evidence-into-practice agenda. Evaluation: The International Journal of Theory, Research and Practice, 9(2), 125-148.
Nutley, S. M., Walter, I., & Davies, H. T. O. (2007). Using Evidence. How Research can Inform Public Services. The Policy Press, Bristol, UK.
Ridde, V. (2008). Equity and health policy in Africa: Using concept mapping in Moore. BMC Health Services Research, 8, 90-100. Retrieved from http://www.biomedcentral.com/1472-6963/8/90. doi:10.1186/1472-6963-8-90
Rohrbach, L. A., Ringwalt, C. L., Ennett, S. T., & Vincus, A. A. (2005). Factors associated with adoption of evidence-based substance use prevention curricula in US school districts. Health Education Research, 20(5), 514-526.
Rosenberg, S., & Kim, M. P. (1975). The method of sorting as a data-gathering procedure in multivariate research. Multivariate Behavioral Research, 10(4), 489-502.
Rubin, G. L., Frommer, M. S., Vincent, N., & Phillips, P. A. (1998). Disseminating and implementing the evidence. Retrieved November 2, 2007, from http://www.menziesfoundation.org.au/conferences/ebm/ebm067rub.htm
Sleeter, C. (1992). Restructuring schools for multicultural education. Journal of Teacher Education, 43(141-148).
Trochim, W. M. K. (1989a). Concept mapping: Soft science or hard art? Evaluation and Program Planning, 12(1), 87-110.
Trochim, W. M. K. (1989b). An introduction to concept mapping for planning and evaluation. Evaluation and Program Planning, 12(1), 1-16.
Trochim, W. M. K., Cook, J. A., & Setze, R. (1994). Using concept mapping to develop a conceptual framework of staff’s views of a supported employment program for persons with severe mental illness. Consulting and Clinical Psychology, 62(4), 766-775.
Waddell, C., Lavis, J. N., Abelson, J., Lomas, J., Shepherd, C. A., Bird-Gayson, T., et al. (2005). Research use in children's mental health policy in Canada: Maintaining vigilance amid ambiguity. Social Science & Medicine, 61(8), 1649-1657.
Walter, I., Nutley, S. M., Percy-Smith, J., McNeish, D., & Frost, S. (2004). Improving the use of research in social care practice. London: Social Care Institute for Excellence.
Weill, C. (1990). Attitudes professionnelles et diffusion de la connaissance scientifique: les conférences de consensus sont-elles susceptibles de modifier les comportements des praticiens? Sciences Sociales et Santé, 8(4), 91-114.
Weiss, C. (1980). Knowledge creep and decision accretion. Knowledge: Creation, Diffusion, Utilization, 1(3), 381-404.
Acknowledgements
This needs assessment study would not have been possible without considerable support from a great number of players. The author wishes to thank:
It goes without saying that the identification of the priority needs of community organizations and the development of a transfer strategy adapted to their reality would not have been possible without the sustained involvement and interest of various players (collaborators and community organizations).
Christian Dagenais, PhD
C. Dagenais, is an expert in the field of evaluation research and knowledge translation, the discipline which he teaches at Université de Montréal. Since 2002, he is the evaluation director of an organization dedicated to knowledge translation, le Centre de liaison sur l’intervention et la prévention psychosociales (CLIPP). He continues to fulfill his function at the CLIPP ever since being hired in 2004 by the psychology department at the Université de Montréal. He is also the head of a team of researchers ardently invested in research on knowledge translation within their respective disciplines. The objective of this emergent research team is to develop the field of knowledge translation research through interdisciplinary and inter-university collaborations.
Christian Deagenis, PhD (chirstian.dagenias@montreal.ca)
Pav. Pavillon Marie -Victorin, 90 Avenue Vicent d'Indy Montreal
Add Comment
Download the PDF version to access the complete article.
Keywords: gjcpp, community practice, knowledge transfer, needs assessment, community-based organizations, research utilization
Based on a work at www.gjcpp.org. 
Printer friendly version