Semi Structured Interview

MMHE project 2nd Meeting Kellokoski – Finland (May 2008)

WP 5 LOUREIRO, Isabel; GOMES, José Carlos

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Wider audience

Project aims

Who else need to Know ab

What are the aims of our project? Management action What is our methodology?

Institutionalization How will we keep the results moving?

Expected outcomes What are the expected outcomes?

Communication

Who needs to know about the results an

Research performance indicators What indicators will we measure?

Feedback for adaptative management

Research performance Quality assuranceindicators evaluation

Quality control

Data collection Are we getting the data we need? Data management Loureiro, I.; Gomes, J.C. (Kellokoski, 2008) How will the results be recorded and stored?

What are the aims of our project? • To collect available data of a set of 31 structural indicators of social and environmental factors having impact on the positive mental health of the 17 European regions and their 13 national health authorities. • To produce a practical contribution of a window of indicators for environmental factors, to be opened in ECHI • To produce a report with 17 regional contributions with the data collected • To produce a semi-structured questionnaire about strategic planning as well as policy implementation and policy analysis in mental health promotion, and • To conduct a comparative mental health promotion policy analysis in these regions with the data gathered. Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Methodology • Have we a methodological problem?

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

What are the expected outcomes? • • • • • • • •

Data on 31 indicators… 17 regional reports… Report based on collected data… Increased common understanding… Didactic manual… Template… Promotion policies thought Europe… Translation in four different European Languages… • Dissemination plan… Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

What indicators will we measure? STEP 4

STEP 1

STEP 2

STEP 3

STEP 4

STEP 4

Research performance indicators Research evaluation performance indicators Research evaluation performance indicators evaluation Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Step 1 • Key areas are identified and reviewed • Meta analysis reports from research done on the past 20 years about each defined indicator are completed • Semi structured interview is prepared with the involvement of all institutions involved on the project • Internet site is created to fulfil dissemination and contact needs between all the researchers and stakeholders involved Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Step 2 • Identification and contacts with stakeholders related with the studied environments. Inclusion criteria will be previously discussed on a research team meeting. Meta analysis report must be provide to each of them • Characterization of the studied regions completed (based on the defined indicators); • Characterization of the population’s mental health on the studied regions completed; ( both characterizations must be done on a multidimensional and multi professional approach) • Translation available in 5 other languages

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Step 3 • Identification and analysis of mental health promotion plans of each region (Objectives, community involvement, expected results, financial issues, level of intervention: local, regional or national). This identification is achieved thought the analysis of semi structured interviews (recorded) and local, regional or national legislation. • Statistical analysis of all collected data to reinforce the relevance of the indicators (evidence-based) • And the effectiveness of mental health promotion plans

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Step 4

• Report about comparative situation of these 17 regions according with the collected data and interviews are completed • Papers are ready for publication in peer review publications (in at least 4 different EU languages) • Final report • Conferences are prepared and celebrate in at least 4 different countries (conferences are prepared to aim academic environments and local or regional governments, i.e., stakeholders involved in public health policies) • Summer course for European students, academics and heath politicians “monitoring of mental health environments” is realized in one of the countries involved in the project with the collaboration via internet of the other partners, using the internet site of the project Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Research performance indicators evaluation Key areas are identified and reviewed

Meta analysis reports from research done on the past 20 years about each defined indicator are completed Didactic manual Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Research performance indicators evaluation Semi structured interview is prepared with the involvement of all institutions involved on the project

Internet site is created to fulfil dissemination and contact needs between all the researchers and stakeholders involved Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection – The problem • A Very difficult task. • Unable to get an acceptable percentage of answers. • Unable to get all the information required.

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection – The problem Country

Nuts 1

Nuts 2

Nuts 3

Stakeholders

Answers

%

Portugal

Continente (PT 1)

Lisboa (PT 172)

Península de Setubal (PT 172)

4

1

25,0

Italy

Sud (IT F)

Basilicata (IT F5)

5

0

0,0

Nord-est (IT D)

Veneto (IT D3)

4

0

0,0

Noroeste (ES 2)

Pais Vasco (ES 21)

2

1

50,0

Este (Es 5)

Cataluña (Es 51)

5

1

20,0

France

Sud-ouest (FR 6)

Aquitaine (FR 61)

3

1

33,3

UK

Northeast (England) (UK C)

3

1

33,3

Southeast (England) (UK J)

1

1

100,0

Northwest (England) (UK D)

1

1

100,0

Spain

Verona (IT D31)

Pyrénées-Atlantique (FR 615)

Ireland

Ireland (IE 0)

Southern and Eastern IE 02

Dublin (IE 021)

1

1

100,0

Slovenia

Slovenija (SI 0)

Vzhodna Slovenija (SI 01)

Podnavska (SI 012)

4

1

25,0

Germany

Berlim (DE 3)

Berlim (DE 30)

Berlin (DE 300)

2

2

100,0

Suomi/ Finland

Nanner-Suomi (FI 1)

Lansi-Suomi FI 19

Pohjanmaa (FI 195)

6

1

16,7

Poland

Region Poludniowy (Pl 2)

Maloploskie (PL 21)

1

1

100,0

Macedónia

EU Eastern border country

1

0

0,0

Kazakistan

EU Eastern border country

1

1

100,0

TurKy

EU Eastern border country

1

0

0,0

Ukraine

EU Eastern border country

1

0

0,0

croatia

EU Eastern border country

1

0

0,0

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection – The problem • • • • •

Are the regions comparable? 3 nuts Level 1 4 nuts Level 2 7 nuts Level 3 …in 14 European regions.

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection – The problem • “It is extremely difficult to get information on mental health from a precise region or subregion in Portugal.” • “In general, in what concerns mental health issues, the available information is mainly directed to mental disorder rather than to positive mental health(…). Besides, there has been more investment (in particular through social services) directed towards people with mental deficiency/mental retardation than to people with mental illness.” Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection – The problem • “Many questions were left not answered, either “unknown” answers (associated with lack of data) or because some of them are not directly related with mental health (8.5, 8.6, …)” • “More time would be needed to allow several contacts and search to get an accurate answer. Others are very specific and results are not easily accessible (4.6, 6.1, 6.2, 7.1, 8.4, …).” Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data collection Searching for a solution… Rebuilt the questionnaire? Get data from other sources? • Direct interviews? • Search for data availability on statistical organizations across Europe (Eurostat? national statistic institutes?) • Identifying the gaps on mental health information Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Data management • www.mmhe.eu • Data stored on our web page • Actualization information on a two month base

That means that we must find a way to talk with each other on a phone conference every two months

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Feedback for adaptative management Data analysis of opinions about our web page (quantitative and qualitative analysis) Can we think about… • … having a different final set of indicators? • … including results from small surveys in these 17 European regions? How? Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Communication • 17 regional reports • Report about comparative situation of these 17 regions • Papers in peer review publications (in at least 4 different EU languages) • Conferences in at least 4 different countries (conferences are prepared to aim academic environments and local or regional governments, i.e., stakeholders involved in public health policies) • Summer course for European students, academics and heath politicians “monitoring of mental health environments” is realized in one of the countries involved in the project with the collaboration via internet of the other partners, using the internet site of the project Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Institutionalization • European Community Health Indicators (ECHI) • www.mmhe.eu – How can we keep our web page working until institutionalization? Is this an interesting question that deserves an answer? Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Wider audience • “Monitoring Mental Health Environments” web page translated in 5 languages: • Finnish • Deutsch • Portuguese • Slovene • Spanish Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Quality assurance in research • The system witch provides guidelines and advice to assure the quality of the processes used in research .

(University of Reading, 2006)

• The overall management system witch include the organization, planning, data collection, quality control, documentation, evaluation, and reporting activities of the group. (Patrick O’Connor, 2008)

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Quality control • The routine technical activities that are essentially in place to control error. (Patrick O’Connor, 2008)

Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)

Next step Research performance indicators • Identification and contacts with stakeholders related with the studied environments. Meta analysis report must be provide to each of them • Characterization of the studied regions completed (based on the defined indicators); • Characterization of the population’s mental health on the studied regions completed; ( both characterizations must be done on a multidimensional and multi professional approach) • Translation in other 5 languages of the web page is completed Loureiro, I.; Gomes, J.C. (Kellokoski, 2008)