Test Of Association 2007

Dependence test of selection decisions for research project applications in Slovenia in 2007/20

Method of evaluation of research project applications in Slovenia is defined in: Metodologija ocenjevanja prijav za mentorje mladim razis Research (alternative) hypothesis: there is positive association between the sums of scores of research team leaders and peer review de

Null hypothesis H0: there is no positive association (one-sided test). Level of significance: α=0,05. Fisher's exact test was calculated with statistical package available on http://www.langsrud.com/fisher.htm . Note: in few cases of different value from Fisher and Kullback test, the value of Fisher is taken. Note: in few cases of different values for different binning the value in favour for rejection is taken. Note: Research subfields are defined in http://www.arrs.gov.si/en/gradivo/sifranti/sif-vpp.asp .

Note: Research project applications are arranged in descending order regarding the sum of scores A. Result of peer review selection: from 711 research project applications in all 6 fields or 72 subfields 187 projects were selected. Result of statistical analysis: in 15 subfields (21%) with 270 project applications (38%) null hypothesis of no positive association can be s Conclusion: result shows significant progress in evaluation procedure from previous years if we swear on bibliometric and scientometric

Mark Score Score Score A= Se Co of A1 A2 A3 A1+A le unt resea 2+A3 ct er rch ed subfie re ld se ar Natural sciences and mathematics ch 1.01 3.6 0.11 0 3.71 pr 1 oj 1.01 3.22 0.16 0 3.38 1 1 1.01 1.24 1.92 0 3.16 ec 1 1.01 2.33 0.23 0 2.56 ts 1 (m 1.01 2.48 0.08 0 2.56 ar 1 ke 1.01 2.17 0.16 0 2.33 1 d 1.01 1.95 0.01 0 1.96 1 wit 1.01 1.39 0.13 0 1.52 h 1 1.01 1.15 0.31 0 1.46 1) 1 1.01 1.26 0.12 0 1.38 1 1.01 1.2 0.05 0 1.25 1 1.01 0.63 0.07 0 0.7 1

Contingency table (c.t.) Score category Observed frequencies 0-2,50 2,51-15 Row total Selected projects 0 1 1 Nonselected p. 7 4 11 Column total

7

5

12

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Correction for one null fre

Fisher's exact test prob

Additional Fisher's exact test on different categories: Additional Fisher's exac (Category limit is marked by line in column F) Re-binned c.t.: 0 1 10 1 Note: not enough selected projects for significant rejection.

1.02 1.02 1.02

5 4 5

5 4 3.96

3.61 13.61 1 2.89 10.89 1.05 10.01 1

1 Observed frequencies 0-4,00 4,01-8,00 8,01-15 1 Selected projects 1 2 4 1 Nonselected p. 21 8 2

Kullback 2Î test: 7 S1= 31 S2=

1.02 1.02 1.02 1.02 1.02

5 5 5 3.85 4

5 5 5 2.96 3

0 10 1 0 10 0 10 1 0.43 7.24 0 7

1 1 1 1 1

38 2Î=S1-S2=

1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02

2.28 4.76 4.06 1.51 1.18 3.01 3.86 2.26

4.01 1.41 1.59 0.16 1.23 0.56 0.42 1.95

0 0 0.19 3.29 2.36 0.74 0 0.03

6.29 1 6.17 1 5.84 4.96 4.77 4.31 4.28 4.24

1 1 1 1 1 1 1 1

Natural sciences and m

1.02 1.02

2.73 2.27

0.59 1.04

0.66 3.98 1 0.35 3.66

1 1

Subfield total sum

1.02

1.2

2.41

0 3.61

1

1.01

1.02

1.91

1.2

0.01 3.12

1

1.02

1.02

0.94

0.93

1.18 3.05

1

1.03

Column total

22

10

6

Fisher's exact tests:

1.02

2.64

0.3

0 2.94

1

1.04

1.02

2.36

0.4

0 2.76

1

1.05

1.02

2.28

0.22

0

2.5

1

1.06

1.02

0.81

1.49

0

2.3

1

1.07

1.02

2.02

0.11

0.15 2.28

1

1.08

1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.02 1.03

1.65 1.93 2.15 1.96 1.48 1.67 1.12 1.18 1.1 0.53 0.55 0.17 2

0.59 0.28 0 0.19 0.58 0.23 0.16 0.42 0.12 0.36 0.15 0 2.47

0.03 0 0 0 0 0 0.42 0 0 0.11 0.2 0 2.35

1 1 1 1 1 1 1 1 1 1 1 1 1

1.09 sum of projectss, where H sum of projectss, where H

1.03 1.03 1.03

0.65 3.59 2.56

0.43 0.53 0.89

5 6.08 0.97 5.09 1 1.43 4.88 1

1 Observed frequencies 0-4,87 4,88-15 1 Selected projects 2 3 1 Nonselected p. 16 1

1.03 1.03

0.19 0.79

0 0.51

4.67 4.86 2.56 3.86

1 1

1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.03 1.04

2.98 1.27 1.77 1.92 1.07 1.1 0.46 0.73 0.57 0.72 0.61 0.56 0.31 0.32 0.11 0.21 2.59

0.12 0.17 0.56 0.17 0.34 0.46 0.27 0.02 0.19 0 0.09 0.01 0.01 0.01 0 0.04 2.44

0.36 3.46 1.78 3.22 0.11 2.44 1 0.02 2.11 0.38 1.79 0 1.56 0.74 1.47 0.63 1.38 0 0.76 0 0.72 0 0.7 0.1 0.67 0.29 0.61 0 0.33 0.19 0.3 0 0.25 1 5 10.03 1

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

1.04 1.04 1.04 1.04

4.47 4 3.34 3.91

2.92 0.53 2.23 2.3

2.35 5 2.97 1.51

1 Observed frequencies 0-3,00 3,01-15 1 Selected projects 0 6 1 Nonselected p. 14 10 1 Column total 14 16

1.04 1.04

3.09 1.89

1.46 0.64

0.16 4.71 1 2.12 4.65

1 1

Correction for one null fre

1.04 1.04 1.04

2.88 1.67 2.73

1.19 0.44 1.09

0.44 4.51 2.24 4.35 0.39 4.21

1 1 1

Fisher's exact test: prob Additional Fisher's exac

1.04 1.04 1.04 1.04

0.69 2.87 2.89 1.56

0.18 0.9 0.62 0.75

3.26 0.2 0.33 1.52

1 1 1 1

2.27 2.21 2.15 2.15 2.06 1.9 1.7 1.6 1.22 1 0.9 0.17 6.82 1

9.74 1 9.53 1 8.54 7.72

4.13 3.97 3.84 3.83 1

Note: In this subfields statistica

Column total

18

4

5 17

Kullback 2Î test: S1= S2=

22

2Î=S1-S2= Fisher's exact test:

6 24 30

Kullback 2Î test: S1= S2= 2Î=S1-S2=

1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.04 1.05

2.03 2.04 1.69 1.53 1.19 2.29 1.34 1.49 1.8 1.34 1.43 1.44 0.17 0.82 0.78 0.6 3.75

1.58 1.48 1.26 1.08 0.11 0.25 0.61 0.74 0.39 0.17 0.26 0.21 0.01 0.08 0.01 0.15 3.04

0.01 3.62 0 3.52 1 0 2.95 0.03 2.64 1.3 2.6 0.04 2.58 0.55 2.5 0.26 2.49 0 2.19 0.66 2.17 0.04 1.73 0.03 1.68 1.37 1.55 0 0.9 0 0.79 0 0.75 3.38 10.17 1

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

1.05 1.05 1.05

1.68 2.16 1.69

4.9 0.63 1.16

1.54 8.12 1 1.33 4.12 0 2.85

1 Observed frequencies 0-2,50 2,51-15 1 Selected projects 2 2 1 Nonselected p. 6 2

1.05 1.05

2.08 0.53

0.4 1.53

0 2.48 0.01 2.07

1 1

1.05 1.05 1.05

0.49 0.84 0.66

0.82 0.75 0.75

0.66 1.97 1 0 1.59 0 1.41

1 1 1

1.05 1.05 1.05 1.06

1.31 0.67 0.44 0.7

0.03 0.08 0.14 0.18

0 0 0 4.23

1 1 1 1

1.06 1.06 1.06

3 1.39 1.56

1.19 0.1 0.03

0.02 4.21 2.06 3.55 0.97 2.56

1 Observed frequencies 0-2,50 2,51-15 1 Selected projects 2 1 1 Nonselected p. 11 4

1.06 1.06

0.16 0.47

0 0

2.38 2.54 1 1.82 2.29 1

1 1

1.06 1.06 1.06

1.91 0.45 1.2

0.03 0.47 0.02

0.14 2.08 0.51 1.43 0.19 1.41

1 1 1

1.06 1.06 1.06 1.06 1.06 1.06 1.06 1.06 1.06 1.07 1.07 1.07

1.18 1.01 0.68 0.76 0.4 0.46 0.17 0.2 0.26 4.66 3.74 3.03

0.17 0.17 0.11 0.01 0.12 0.02 0.27 0.01 0.02 1.23 1.44 1.45

0 0.05 0.18 0 0.01 0 0.04 0.08 0 0.04 0.19 0.4

1.35 1.23 0.97 0.77 1 0.53 0.48 0.48 0.29 0.28 5.93 1 5.37 4.88 1

1 1 1 1 1 1 1 1 1 1 1 1

1.07 1.07 1.08

0.65 1.45 4.5

0.4 0.84 5

2.28 3.33 0.7 2.99 5 14.5 1

1 1 1

1.08 1.08

0.09 2.54

0 1.51

4.48 4.57 0 4.05 1

1 Observed frequencies 0-2,50 2,51-15 1 Selected projects 0 3

1.34 0.75 1 0.58 5.11

Column total

8

4

4 8 12

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Fisher's exact test: prob Additional Fisher's exac

Column total

13

5

3 15

Kullback 2Î test: S1= S2=

18

2Î=S1-S2=

Fisher's exact test: prob Additional Fisher's exac

5

Fisher's exact test: prob

3

Kullback 2Î test: S1=

1.08 1.08

2.79 0.32

0.9 0.02

0.2 3.89 1 1.63 1.97

1 Nonselected p. 1 Column total

1.08

0.72

0.58

0.62 1.92

1

1.08

1.18

0.39

0.03

1

1.6

1.08 1 0.01 0 1.01 1 1.08 0.79 0.01 0 0.8 1 1.08 0.3 0.04 0.18 0.52 1 1.08 0.43 0 0 0.43 1 1.09 2.36 0.53 4.16 7.05 1 1 1.09 3.2 0.88 1.27 5.35 1 1.09 0.63 0.04 0 0.67 1 1.09 0.39 0.17 0 0.56 1 Engineering sciences and technologies 2.01 0.34 0.78 5 6.12 1

7 7

1 4

8 11

S2= 2Î=S1-S2=

Correction for one null fre Fisher's exact test:

4

2.01 2.01 2.01

0.16 1.51 1.93

0.27 0.09 0.18

5 5.43 1 2.23 3.83 1 1.08 3.19

1 Observed frequencies 0-2,50 2,51-15 1 Selected projects 1 2 1 Nonselected p. 3 2

3 5

Kullback 2Î test: S1= S2=

2.01

0.6

0

1.39 1.99 1

1

8

2Î=S1-S2=

2.01 2.01 2.01

1.52 0.84 0.59

0.07 0.01 0.02

0 1.59 0 0.85 0 0.61

1 1 1

2.02

5

3.89

5 13.89

1

2.02 2.02 2.02

3.9 3.54 2.99

1.32 1.22 1.65

5 10.22 3.7 8.46 2.78 7.42

1 Observed frequencies 0-2,50 2,51-15 1 Selected projects 0 1 1 Nonselected p. 10 6

2.02 2.02 2.02 2.02 2.02 2.02 2.02 2.02 2.02 2.02 2.02 2.02 2.02 2.03

2.68 2.03 0.36 1.7 0.98 1.39 1.24 0.72 1.27 0.85 0.53 0.29 0.3 1.15

0.63 1.86 0.02 0.39 0.12 0.33 0.23 0.05 0.28 0.05 0.1 0.11 0 0.21

1.87 0.86 2.64 0 0.71 0 0.16 0.86 0 0 0 0.07 0 5

1 1 1 1 1 1 1 1 1 1 1 1 1 1

2.03 2.03 2.03

4.2 2.88 1.09

0.09 1.55 0.01

2.03 2.03

1.29 1.02

2.03 2.03 2.03 2.03 2.03 2.03 2.03 2.03 2.03

Column total

4

4

Fisher's exact test: prob Additional Fisher's exac

1 16

Kullback 2Î test: S1= S2=

7

17

2Î=S1-S2=

1.09 5.38 0.37 4.8 2.34 3.44

1 Observed frequencies 0-2,50 2,51-15 1 Selected projects 1 2 1 Nonselected p. 9 7

3 16

Kullback 2Î test: S1= S2=

0.16 0.02

1.84 3.29 1.76 2.8

1 1

19

2Î=S1-S2=

2.21 2.43 0.16

0.12 0.14 0.39

0.45 2.78 1 0 2.57 1.96 2.51

1 1 1

0.27 1.1 1.35 1.27 0.96 0.87

0.02 0.06 0.15 0.04 0.07 0.17

2.08 1.09 0.61 0.69 0.42 0.11

1 1 1 1 1 1

5.18 4.75 1 3.02 2.09 1.81 1.72 1.63 1.63 1.55 0.9 0.63 0.47 0.3 6.36 1

2.37 2.25 2.11 2 1.45 1.15

Column total

Column total

10

10

9

Fisher's exact test: prob Additional Fisher's exac

2.03 2.03 2.03 2.03

0.9 0.58 0.42 0.78

0.2 0.13 0.11 0.04

0.03 1.13 1 0.39 1.1 0.51 1.04 0 0.82

1 1 1 1

2.04 2.04 2.04 2.04

5 5 4.79 3.44

3.39 2.23 2.25 0.46

3.43 11.82 3.03 10.26 1.31 8.35 3.82 7.72

1 Observed frequencies 0-3,00 3,01-6,00 6,01-15 1 Selected projects 0 2 5 1 Nonselected p. 22 14 4 1 Column total 22 16 9

2.04

4.32

1.93

1.34 7.59

1

2.04 2.04 2.04 2.04

3.38 1.36 2.05 3.89

0.64 0.47 0.07 1.54

3.01 4.74 4.26 0.89

7.03 6.57 6.38 6.32 1

1 1 1 1

2.04 2.04 2.04 2.04

4 0.51 1.95 2.67

1.48 0.22 0.62 2.18

0.34 5.82 5 5.73 1 2.93 5.5 0.19 5.04

1 1 1 1

Engineering sciences a

2.04 2.04

1.6 2.58

1.35 1.49

1.68 4.63 0.24 4.31

1 1

Subfield total sum

2.04

1.97

0.14

1.95 4.06

1

2.01

2.04

2.48

0.23

1.22 3.93

1

2.02

2.04

1.8

1

1.01 3.81

1

2.03

2.04

2.7

1.03

0.04 3.77 1

1

2.04

2.04

1.31

0.07

2.19 3.57

1

2.05

2.04

0.74

0.03

2.61 3.38

1

2.06

2.04

0.51

0.08

2.73 3.32

1

2.07

2.04

2.59

0.73

0 3.32

1

2.08

2.04

2.68

0.3

0.31 3.29

1

2.09

2.04

2.61

0.47

0 3.08

1

2.10

2.04

0.84

0.2

1.78 2.82

1

2.11

2.04

1.97

0.22

0.56 2.75

1

2.12

2.04

1.85

0.23

0.58 2.66

1

2.13

2.04

2.47

0.18

0 2.65

1

2.14

2.04

1.91

0.3

0.35 2.56

1

2.15

2.04

1.86

0.52

0 2.38

1

2.16

2.04

1.17

0.19

0.83 2.19

1

2.17

2.04

1.88

0.16

0 2.04

1

2.18

2.04

0.93

0.04

0.91 1.88

1

2.19

2.04

1.07

0.04

0.71 1.82

1

2.20

2.04

0.84

0.97

0 1.81

1

2.21

2.04 2.04 2.04 2.04 2.04 2.04 2.04 2.04 2.04 2.04

1.33 1.31 0.56 0.67 1.4 1.37 1.18 0.78 0.4 0.33

0.11 0.39 0.04 0.24 0.02 0.03 0.04 0.44 0.03 0

1 1 1 1 1 1 1 1 1 1

2.22 sum of projectss, where H sum of projectss, where H

0.37 0 0.99 0.58 0 0 0.16 0.01 0.33 0.2

1.81 1.7 1.59 1.49 1.42 1.4 1.38 1.23 0.76 0.53

1 1 1 1

Kullback 2Î test: 7 S1= 40 S2= 47 2Î=S1-S2=

Correction for one null fre

Fisher's exact test: prob

2.04 2.05 2.05 2.05 2.05 2.05 2.05 2.06

0.27 4.61 5 3.97 1.02 0.73 0.53 2.87

0.01 2.12 0.06 0.44 0.53 0.09 0.01 1.89

0 0.28 5 11.73 1 5 10.06 5 9.41 3.16 4.71 0 0.82 0 0.54 3.22 7.98

1 1 1 1 1 1 1 1

2.06 2.06 2.06

3.4 1.31 3.27

0.68 0.1 0.9

2.41 6.49 5 6.41 1.9 6.07 1

1 Observed frequencies 0-3,00 3,01-15 1 Selected projects 0 1 1 Nonselected p. 4 7

2.06 2.06 2.06 2.06 2.06 2.06 2.06 2.06 2.07

1.37 0.13 2.94 2.49 0.86 1.32 1.21 0.48 4.48

1.47 0.02 0.17 0.56 0.14 0.04 0.43 0.78 1.32

2.39 5.23 5 5.15 1.23 4.34 0 3.05 1.74 2.74 1.29 2.65 0.58 2.22 0.94 2.2 4.34 10.14 1

1 1 1 1 1 1 1 1 1

2.07 2.07 2.07

1.72 4.86 0.55

0 0.22 0.48

2.07 2.07 2.07

0.55 0.8 4.66

2.07 2.07 2.07 2.07 2.07

6

1 11

Kullback 2Î test: S1= S2=

8

12

2Î=S1-S2=

5 6.72 1.08 6.16 5 6.03

1 Observed frequencies 0-4,00 4,01-15 1 Selected projects 1 1 1 Nonselected p. 27 7

2 34

Kullback 2Î test: S1= S2=

0.48 0 0.58

5 6.03 5 5.8 0.36 5.6

1 Column total 28 1 1 Additional contingency table 2x3:

36

2Î=S1-S2=

1.4 1.99 0.37 2.11 2.02

1.4 0.09 0.05 0.63 0.07

1.79 1.9 3.14 0.59 1.11

4.59 3.98 3.56 3.33 1 3.2

1 Observed frequencies 0-3,00 3,01-6,00 6,01-15 1 Selected projects 0 1 1 1 Nonselected p. 22 8 4 1 Column total 22 9 5 1

2.07 2.07 2.07 2.07

1.99 1.21 1.1 2.58

1.16 0.1 0.03 0.06

0 1.74 1.74 0.14

3.15 3.05 2.87 2.78

1 1 1 1

2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07 2.07

1.49 1.27 1.74 1.51 1.35 0.86 1.03 0.87 0.84 1.18 1.21 1.03 0.76 0.8 0.62 0.71 0.6 0.63 0.45

0.02 0.07 0.12 0.47 0.62 0 0.04 0.01 0.3 0.16 0.01 0.02 0.03 0.01 0.05 0 0.04 0 0.02

0.86 0.9 0.29 0.06 0 1.01 0.61 0.59 0.21 0 0 0 0.13 0.09 0.13 0 0 0 0.03

2.37 2.24 2.15 2.04 1.97 1.87 1.68 1.47 1.35 1.34 1.22 1.05 0.92 0.9 0.8 0.71 0.64 0.63 0.5

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Column total

4

8

2 34 36

Fisher's exact test: prob

2.07 2.08

0.39 2.17

0 0.48

0 0.39 5 7.65 1

2.08 2.08 2.08

1.87 2.09 0.84

0.02 0.23 0.11

5 6.89 1 3.44 5.76 1 0.25 1.2

2.08

0.78

0.01

2.08

0.74

2.08 2.09

1 1 1 Observed frequencies 0-4,00 4,01-15 1 Selected projects 0 3 1 Nonselected p. 4 0

3 4

Kullback 2Î test: S1= S2=

0 0.79

1

7

2Î=S1-S2=

0.02

0 0.76

1

Correction for two null fre

0.16 5

0.01 0.63

0 0.17 5 10.63 1

1 1

Fisher's exact test: prob

2.09 2.09 2.09

4.86 1.71 0.79

2.38 0.09 0.27

1.93 9.17 1 4.91 6.71 1 5 6.06

1 Observed frequencies 0-6,00 6,01-15 1 Selected projects 2 3 1 Nonselected p. 2 1

5 3

Kullback 2Î test: S1= S2=

2.09

3.66

0.96

1.13 5.75 1

1

8

2Î=S1-S2=

2.09 2.09

3.9 1.11

0.12 0.15

0 4.02 1.56 2.82 1

1 1

2.09 2.10

0.53 4.73

0.14 1.21

0 0.67 5 10.94 1

1 1

2.10 2.10 2.10 2.10

0.76 2.86 3.93 3.49

0.02 0.55 0.14 0.38

2.10

2.94

0.84

0 3.78

2.10 2.10

1.24 2.4

0.16 0.24

2.10 2.10 2.10

2.3 1.43 0.92

2.10

5 2.32 0 0.17

5.78 5.73 1 4.07 4.04 1

Column total

Column total

4

4

3

4

Fisher's exact test: prob Additional Fisher's exac

1 Observed frequencies 0-4,00 4,01-15 1 Selected projects 0 3 1 Nonselected p. 13 2 1 Column total 13 5

3 15 18

Kullback 2Î test: S1= S2= 2Î=S1-S2=

1

Correction for one null fre

2.05 3.45 0.55 3.19

1 Additional: 1

Fisher's exact test: prob

0.48 0.06 0.02

0 2.78 1.23 2.72 1.31 2.25

1 Observed frequencies 0-2,50 2,51-15 1 Selected projects 0 3 1 Nonselected p. 8 7

3 15

Kullback 2Î test: S1= S2=

1.91

0.14

0 2.05

1

18

2Î=S1-S2=

2.10

0.65

0.05

0.96 1.66

1

2.10

0.88

0

0.71 1.59

1

2.10 2.10 2.10 2.10 2.11

1.18 1.09 0.2 0.08 2.7

0.25 0.01 0 0 1.06

0 1.43 0 1.1 0 0.2 0 0.08 0.08 3.84 1

1 1 1 1 1

2.11 2.11 2.11

0.93 1.75 1.01

0.06 0.3 0.08

1.93 2.92 1 0 2.05 1 0 1.09

1 Observed frequencies 0-1,00 1,01-15 1 Selected projects 1 3 1 Nonselected p. 2 1

4 3

Kullback 2Î test: S1= S2=

2.11

0.69

0.03

0.19 0.91

1

7

2Î=S1-S2=

2.11

0.49

0

0 0.49 1

1

2.11 2.12 2.12 2.12 2.12 2.13

0.45 0.76 2.86 0.65 0.36 4.37

0 0.02 0.19 0.01 0.2 0.71

0 0.45 5 5.78 0.2 3.25 1 0 0.66 0 0.56 5 10.08 1

1 1 1 1 1 1

2.13 2.13 2.13

4.21 1.74 2.21

0.84 0.29 0.2

1.44 6.49 1 2.21 4.24 1.63 4.04

1 Observed frequencies 0-4,00 4,01-15 1 Selected projects 1 2 1 Nonselected p. 2 2

3 4

Kullback 2Î test: S1= S2=

2.13

0.94

0.64

1.55 3.13 1

1

7

2Î=S1-S2=

Column total

8

10

Correction for one null fre

Fisher's exact test: prob

Column total

3

4

Fisher's exact test: prob

Additional Fisher's exac 4

Column total

3

4

2.13 2.13

1.73 1.02

0.02 0.12

0.41 2.16 0.65 1.79

1 1

Fisher's exact test: prob Additional Fisher's exac

2.14

2.92

0.36

5 8.28 1

2.14 2.14 2.14

2.46 2.72 1.65

0.62 0.19 0.19

3.08 6.16 1 0.9 3.81 0.48 2.32

1 Observed frequencies 0-2,00 2,01-15 1 Selected projects 0 2 1 Nonselected p. 6 3

2.14

0.49

0.08

1.51 2.08

1

2.14

1.14

0.03

0.44 1.61

1 Alternative:

2.14 2.14 2.14

1.19 0.93 0.65

0.17 0.01 0.01

0.24 1.6 0.13 1.07 0.27 0.93

1 Observed frequencies 0-3,00 3,01-15 1 Selected projects 0 2 1 Nonselected p. 8 1

2.14 2.14

0.34 0.23

0.02 0.05

0 0.36 0.02 0.3

1 1

Column total

2.15 2.15 2.15

1.35 0.89 0.67

0.33 0.06 0.14

0.19 1.87 0 0.95 0 0.81

1 1 1

3

2.16 2.17

0.72 1.64

0.05 0.03

1.19 1.96 1 0.78 2.45

1 1

1 1

Subfield total sum

2.19

1.25

0.14

0.06 1.45

1

2

3.01

2.19

0.6

0.01

0 0.61

1

2.20

0.84

0.15

5 5.99 1

1

2.20

1.07

0.01

0.94 2.02 1

1

3.04

2.20

0.37

0

0.73

1.1

1

3.05

2.21

2.35

0.04

0 2.39

1

2.21

1.17

0.3

0 1.47 1

1

2.22

2.68

0.76

0.33 3.77 1

1

1

Column total

6

5

8

3

2Î=S1-S2=

2 9 11

Kullback 2Î test: S1= S2=

2Î=S1-S2= Additional Fisher's exac

Medical sciences 2007

3.02 3

3.03

2

3.06 3.07

4

3.08

0 0.85 0 0.78 0 0.49

1 1 1

4.35 9.41 1

1

3.01 3.01 3.01 3.01

1.76 2.18 1.41 1.16

0.21 0.75 0.49 0.38

4.09 6.06 1 0.04 2.97 1 0 1.9 1 0.19 1.73

1 Observed frequencies 0-1,50 1,51-15 1 Selected projects 0 5 1 Nonselected p. 6 2 1 Column total 6 7

3.01

1.36

0.27

0.05 1.68 1

1

3.01

1.08

0.54

0 1.62

1

3.01 3.01 3.01

1.26 1.02 0.86

0.1 0.16 0.24

0 1.36 0 1.18 0 1.1

1 1 1

3.01 3.01 3.01 3.02 3.03

0.7 0.09 0.45 0.4 3.99

0.27 0.73 0.16 0.01 2.6

0 0 0 0 0.22

3.03 3.03 3.03

2.66 4.3 1.25

1.57 0.95 0.36

1.27 5.5 1 0.04 5.29 2.06 3.67 1

1 Observed frequencies 0-2,00 2,01-15 1 Selected projects 4 4 1 Nonselected p. 2 1

3.03 3.03

2.46 0.86

0.42 0.05

0.06 2.94 1 1.04 1.95 1

1 1

1 1 1 1 1

11

Kullback 2Î test: S1= S2=

Fisher's exact test: prob

2.22 0.81 0.04 2.22 0.73 0.05 2.22 0.38 0.11 Medical sciences 3.01 3.7 1.36

0.97 0.82 0.61 0.41 1 6.81 1

2 9

3.09 sum of projectss, where H sum of projectss, where H

5 8 13

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Correction for one null fre

Fisher's exact test: prob Additional Fisher's exac

1

Column total

6

5

8 3 11

Kullback 2Î test: S1= S2= 2Î=S1-S2=

3.03 3.03 3.03

1.66 1.29 1.25

0.12 0.18 0.05

0 1.78 0 1.47 1 0 1.3 1

1 1 1

3.03 3.03 3.04

1.04 0.48 3.37

0.03 0.3 0.18

0 1.07 1 0 0.78 0 3.55 1

1 1 1

3.04 3.04 3.04 3.04

2 1.79 1.1 1.35

1.47 1.67 1.27 0.25

3.04

1.68

0.29

0 1.97 1

1

3.04

0.65

0.2

0.54 1.39 1

1

3.04 3.04 3.04

0.98 0.65 0.98

0.29 0.19 0.09

0 1.27 0.3 1.14 1 0 1.07 1

1 1 1

3.04 3.04 3.04 3.04 3.05

0.77 0.74 0.6 0.51 0.52

0.09 0.09 0.01 0 1.73

3.05 3.05 3.05

1.63 1.25 1.5

0.55 0.61 0.4

0 2.18 1 0.18 2.04 0 1.9 1

3.05

0.62

0.91

3.05 3.05 3.05

0.76 0.79 0.42

3.06

0 0 0 0.54

0 0 0 0 0

3.47 3.46 2.37 2.14

1 1 1 1

0.86 1 0.83 1 0.61 0.51 2.25 1

Fisher's exact test: prob Additional Fisher's exac

1 Observed frequencies 0-1,50 1,51-15 1 Selected projects 5 6 1 Nonselected p. 3 0 1 Column total 8 6

11 3 14

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Correction for one null fre

Fisher's exact test: prob Additional Fisher's exac

1 1 1 1 1 1 Observed frequencies 0-2,00 2,01-15 1 Selected projects 3 2 1 Nonselected p. 2 1

5 3

Kullback 2Î test: S1= S2=

0 1.53 1

1

8

2Î=S1-S2=

0.51 0.09 0.26

0 1.27 1 0 0.88 0 0.68

1 1 1

2.93

1.17

0.23 4.33 1

1

3.06 3.06 3.06

2.27 2.34 2.33

0.52 0.15 0.03

0 2.79 0 2.49 0 2.36 1

1 Observed frequencies 0-1,70 1,71-15 1 Selected projects 2 3 1 Nonselected p. 4 3

3.06

1.87

0.28

0 2.15

1

3.06 3.06 3.06

1.78 0.91 0.9

0.2 0.04 0.14

0 1.98 1 0.56 1.51 1 0 1.04

1 1 1

3.06 3.06 3.06 3.06 3.07 3.07 3.07 3.07 3.08

0.74 0.84 0.34 0.04 2.23 2 1.2 0.54 1.28

0.17 0.05 0.08 0 0.31 0.27 0.22 0.13 0.77

0 0 0 0 0 0 0 0 1.14

1 1 1 1 1 1 1 1 1

3.08 3.08

2.48 0.87

0.16 0.22

0 2.64 1 0.04 1.13 1

3.08

0.63

0.08

3.08

0.62

0.03

3.08 3.08

0.48 0.37

0.05 0.02

0.03 0.56 0 0.39

1 1

3.09

3.39

0.48

4.96 8.83 1

1

0.91 0.89 0.42 0.04 2.54 2.27 1.42 0.67 3.19

1 1 1

1

Column total

5

3

Fisher's exact test: prob Additional Fisher's exac

Column total

6

6

5 7 12

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Fisher's exact test: prob Additional Fisher's exac

4

1 Observed frequencies 0-1,00 1,01-15 1 Selected projects 2 3

5

Kullback 2Î test: S1=

0 0.71 1

1 Nonselected p.

2

0

2

S2=

0 0.65 1

1

4

3

7

2Î=S1-S2=

Column total

Fisher's exact test: prob 6

3.09 3.09 3.09

1.18 0.82 0.73

0.32 0.09 0.01

3.09 0.61 0.1 3.09 0.26 0.03 Biotechnical sciences 4.01 1.38 0.37

0 1.5 0 0.91 1 0 0.74

1 1 1

0 0.71 0 0.29

1 1

5 6.75 1

1

5 5 0.27 2.61

4.01 4.01 4.01 4.01

0.69 0.28 3.5 0.74

0.08 0.07 0.22 0.01

4.01

0

0

3.29 3.29

1

4.01

0.24

0

2.96

3.2

1

4.01 4.01 4.01

0.85 1.98 0.52

0.48 0.14 0.22

1.69 3.02 0.9 3.02 0.96 1.7

1 1 1

4.01 4.01 4.01 4.01 4.01 4.01 4.02 4.02 4.02 4.02 4.02 4.02 4.02 4.02 4.02 4.02 4.02 4.02 4.03

1.11 1.2 0.46 0.31 0.24 0.14 0.55 0.03 0.35 1.85 0.07 1.66 0.32 0.56 0.49 0.37 0.29 0.28 1.45

0.26 0.03 0.23 0.1 0.01 0.02 1.02 0.02 0.05 0.7 1.5 0.26 0.37 0.01 0.05 0.01 0 0.01 0.42

0 0.03 0.56 0.29 0.45 0.14 5 5 3.16 0.38 0.46 0 0.23 0 0 0 0.02 0 4.88

1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

4.03 4.03 4.03

0.86 1.15 1.59

0.87 0.06 0.09

5 6.73 5 6.21 1 0.93 2.61

1 Observed frequencies 0-1,50 1,51-15 1 Selected projects 1 3 1 Nonselected p. 14 7

4.03 4.03

2.01 1.5

0.2 0.46

0.32 2.53 0.04 2

1 1

4.03 4.03 4.03

1.8 1.23 0.25

0.1 0.53 0.01

0.04 1.94 1 0 1.76 1 1.49 1.75

1 1 1

4.03 4.03 4.03

0.79 0.67 0.54

0.64 0.46 0.24

0.18 1.61 0.45 1.58 0.62 1.4

1 1 1

Biotechnical sciences 2

4.03 4.03

0.52 1.32

0.09 0.02

0.77 1.38 0 1.34 1

1 1

Subfield total sum

4.03

0.43

0.15

0.67 1.25

1

4.01

4.03

0.54

0.5

0.14 1.18

1

4.02

4.03

0.99

0.11

1.1

1

4.03

4.03

0.14

0

0.83 0.97

1

4.04

0

5.77 5.35 3.99 1 3.36

Fisher's exact test: p =

1.37 1.26 1.25 0.7 0.7 0.3 6.57 5.05 3.56 2.93 2.03 1.92 0.92 0.57 0.54 0.38 0.31 0.29 6.75 1

1 Observed frequencies 0-3,00 3,01-15 1 Selected projects 0 2 1 Nonselected p. 7 7 1 Column total 7 9

2 14 16

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Correction for one null fre

Fisher's exact test: prob Additional Fisher's exac

Column total

15

10

4 21

Kullback 2Î test: S1= S2=

25

2Î=S1-S2=

Fisher's exact test: prob Additional Fisher's exac

4.03

0.53

0

0.43 0.96

1

4.05

4.03 4.03 4.03 4.03 4.03 4.03 4.03 4.04

0.23 0.6 0.55 0.46 0.51 0.25 0.18 1.4

0.25 0.1 0.01 0.13 0.02 0.01 0.03 0.83

0.48 0.2 0.16 0.11 0 0 0 1.53

1 1 1 1 1 1 1 1

4.06 sum of projectss, where H sum of projectss, where H

4.04 4.04 4.04

1.11 0.78 0.75

0.26 0.18 0.08

1.21 2.58 1.16 2.12 0.9 1.73

1 Observed frequencies 0-1,70 1,71-15 1 Selected projects 0 1 1 Nonselected p. 4 4

1 8

Kullback 2Î test: S1= S2=

4.04 4.04 4.04 4.04 4.04 4.06

0.97 1.17 0.65 0.68 0.37 2.02

0.16 0.2 0.12 0.06 0 0.83

0.58 0.23 0.18 0.15 0 5

1 1 1 1 1 1

5

9

2Î=S1-S2=

4.06 4.06 4.06

4.34 1.05 2.13

0.9 0.48 1.58

1.65 6.89 1 5 6.53 1.85 5.56

1 Observed frequencies 0-3,00 3,01-15 1 Selected projects 0 3 1 Nonselected p. 8 5

3 13

Kullback 2Î test: S1= S2=

4.06

1.84

1.66

1.94 5.44 1

1

16

2Î=S1-S2=

4.06

0.29

0.05

5 5.34

1

4.06

1.34

0.19

3.18 4.71

1

4.06 2.64 0.5 4.06 1.47 0.74 4.06 1.95 0.69 4.06 0.47 0.01 4.06 0.89 0.38 4.06 0.87 0.16 4.06 0.79 0.03 4.06 0.26 0.4 4.06 0.27 0.08 Social sciences 5.01 3.26 1.67

0 0.73 0.07 1.57 0 0 0.03 0 0

3.14 1 2.94 2.71 2.05 1.27 1.03 0.85 0.66 0.35

1 1 1 1 1 1 1 1 1

0.75 5.68 1

1

5.01 5.01 5.01

1.18 2.19 2.19

0 0 0

3.28 4.46 1 1.24 3.43 0.04 2.23

1 Observed frequencies 0-4,00 4,01-15 1 Selected projects 0 2 1 Nonselected p. 5 0

2 5

Kullback 2Î test: S1= S2=

5.01

1.56

0

0.01 1.57

1

7

2Î=S1-S2=

5.01

0.34

0

0.75 1.09

1

5.01 5.02

0.59 1.56

0.16 0.03

0.01 0.76 5 6.59 1

1 1

5.02 5.02 5.02 5.02

0.77 1.97 0.9 3.75

0.02 0.02 0.05 0.23

4.2 2.83 3.11 0.07

1 Observed frequencies 0-3,00 3,01-15 1 Selected projects 0 2 1 Nonselected p. 17 3 1 Column total 17 5

5.02 5.02

1.73 1.59

0.79 0.3

0.26 2.78 0.86 2.75

1 1

5.02 5.02 5.02

1.86 1.58 1.17

0.07 0.28 0.02

0.17 2.1 0 1.86 0.59 1.78

1 1 1

5.02

1.06

0.03

0.44 1.53

1

0.96 0.9 0.72 0.7 0.53 0.26 0.21 3.76 1

1.71 1.6 0.95 0.89 0.37 7.85

4.99 1 4.82 4.06 4.05

Column total

Column total

4

8

8

Correction for one null fre Fisher's exact test:

Column total

5

2

Fisher's exact test:

2 20 22

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Fisher's exact test: prob Additional Fisher's exac

5.02 5.02 5.02 5.02 5.02 5.02 5.02 5.02 5.02 5.02 5.02 5.03 5.03

0.98 0.98 0.88 0.53 0.5 0.94 0.95 0.85 0.8 0.65 0.44 1.2 1.69

0.07 0 0.23 0.05 0.04 0.02 0 0 0.02 0.02 0.01 0.01 0.03

0.26 0.29 0.09 0.55 0.51 0 0 0 0 0 0.06 5 1.88

1.31 1.27 1.2 1.13 1.05 0.96 0.95 0.85 0.82 0.67 0.51 6.21 1 3.6 1

5.03 5.03

2.91 2.32

0.02 0.1

0.41 3.34 0.01 2.43

1 1

5.03 5.04

1.63 3.42

0.01 0.2

0.01 1.65 0 3.62

1 1

5.04

2.06

0

0.03 2.09

1

5.01

5.04

0.66

0.01

0.78 1.45

1

5.02

5.04

0.09

0

0 0.09

1

5.03

5.05

0.43

0

5 5.43

1

5.05

0.23

0

2.63 2.86

1

5.05

5.05

1.8

0

0

1.8

1

5.06

5.05

1.27

0

0.13

1.4

1

5.07

5.05

0.5

0

0.36 0.86

1

5.08

5.06

1.84

0

0.16

2

1

5.06

1.84

0.01

0.13 1.98

1

5.10

5.06

1.83

0

0.11 1.94

1

5.11

5.06

1.52

0.02

0 1.54

1

5.12

5.06 5.07 5.07

1.22 3.05 4.81

0.01 0 0.02

0.06 1.29 1 2.69 5.74 1 0.07 4.9 1

1 1 1

5.07 5.07 5.08 5.08 5.08 5.09 5.09 5.09 5.09 5.10

1.08 0.92 0.56 0.68 0.23 3.65 1.59 1.21 0.39 3.04

0.01 0.18 0.01 0 0 0.05 0.04 0.07 0 0.03

1.81 0.44 2.71 0.34 0 0 0 0 0 0.63

1 1 1 1 1 1 1 1 1 1

5.10 5.10 5.10

3.04 1.43 0.86

0 0 0.72

0.19 3.23 0.45 1.88 0.05 1.63

5.10

1.09

0

5.10 5.10 5.10 5.11 5.11 5.11

0.57 0.58 0.23 2.65 1.3 1.43

0.01 0 0.01 0 0 0

2.9 1.54 3.28 1 1.02 0.23 3.7 1 1.63 1.28 0.39 3.7

0 1.09 1 0.31 0 0 0.89 0.76 0.09

0.89 0.58 0.24 3.54 2.06 1.52

1 1 1 1 1 1 1 1 1 1 1 1 1

5

Fisher's exact test:

Social sciences 2007 Subfield total sum

4

5

5.04

5

5.09

5.13 sum of projectss, where H sum of projectss, where H

4

Fisher's exact test: 3

4

1 Observed frequencies 0-1,50 1,51-15 1 Selected projects 1 0 1 Nonselected p. 3 4

1 7

Kullback 2Î test: S1= S2=

1

8

2Î=S1-S2=

1 1 1 1 1 1

Column total

3

4

4

5.12 1.59 5.13 1.96 Humanities 6.01 4.01

0 0.07 0

0.03 1.62 0.26 2.29

1 1

1.98 5.99 1

1

0 0 0

5 1 5 1 5 1

1 1

6.01 6.01 6.01

5 5 5

0 0 0

6.01 6.01

4.56 4.02

0 0

0.08 4.64 0.33 4.35 1

1 1

6.01 6.01 6.01

4.06 3.83 2.88

0 0 0

0 4.06 0.03 3.86 1 0.42 3.3

1 1 1

6.01 6.01 6.01 6.01 6.01 6.01 6.02

3.19 3.17 2.7 2.11 1.97 0.75 4.19

0 0 0 0 0 0 0

0 0 0.06 0 0 0.08 5

3.19 3.17 2.76 1 2.11 1.97 0.83 9.19 1

1 1 1 1 1 1 1

6.02 6.02 6.02 6.02

4.87 3.54 2.92 2.53

0 0 0 0.01

0 0 0.26 0.18

4.87 1 3.54 1 3.18 1 2.72

1 Observed frequencies 0-3,00 3,01-15 1 Selected projects 1 4 1 Nonselected p. 3 0 1 Column total 4 4

6.02

2.5

0.11

0.04 2.65

1

Correction for one null fre

6.02 6.02 6.03

1.73 1.35 2.34

0 0 0

0 1.73 1 0 1.35 3.82 6.16 1

1 1 1

Fisher's exact test:

6.03 6.03 6.03 6.03 6.03 6.03 6.04 6.04 6.04

4.88 2.91 2.34 1.63 1.81 1.62 5 3.24 3.69

0 0 0 0 0 0 0 0 0

0 0.04 0 0.26 0 0 0 0.62 0

4.88 2.95 2.34 1.89 1.81 1.62 5 1 3.86 1 3.69 1

1 1 1 1 1 1 1 1 1

6.04 6.04 6.04 6.05

1.79 1.19 0.7 5

0 0 0 0

1.78 3.57 0 1.19 0 0.7 1 6 1

1 1 1 1

6.05 6.05 6.05

5 2.58 3.13

0 0 0

0 5 1 3.58 0.21 3.34 1

1 Observed frequencies 0-2,74 2,75-15 1 Selected projects 2 3 1 Nonselected p. 4 4

6.05 6.05

2.67 2.07

0 0

0.49 3.16 0.91 2.98 1

1 1

6.05 6.05 6.05

2.75 2.63 2.41

0 0 0

0 2.75 0 2.63 1 0.14 2.55

1 1 1

6.05 6.05 6.05 6.05 6.06

2.15 1.91 1.48 1.29 3.28

0 0 0 0 0

0.29 0.22 0 0 0.7

1 1 1 1 1

2.44 2.13 1 1.48 1.29 3.98 1

1 Observed frequencies 0-4,00 4,01-15 1 Selected projects 2 5 1 Nonselected p. 6 2 Column total

8

7

7 8 15

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Additional Fisher's exac

5 3 8

6

Column total

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Fisher's exact test: prob

6

7

5 8 13

Kullback 2Î test: S1= S2= 2Î=S1-S2=

Fisher's exact test: prob Additional Fisher's exac

4

Humanities 2007

6.06 6.06

1.84 1.13

0 0

0.03 1.87 1 0 1.13 1

1 1

Subfield total sum

6.06

0.7

0

0

0.7

1

6.01

6.07

4.35

0

0.95

5.3 1

1

6.07

1.96

0

0.21 2.17

1

6.08

2.57

0

0 2.57

1

6.08

1.59

0.02

0 1.61

1

6.09

4.53

0

0.1 4.63

1

6.09

4.15

0

6.09

2.91

0

0.16 3.07

6.09

2.56

0

0.08 2.64 1

6.09

2.25

0.12

0.22 2.59

1

6.10

6.09

2.06

0

0 2.06

1

6.11

6.10 6.10 6.10 6.10 6.11 6.11 6.12

5 3.75 1.76 1.36 5 3.26 4.78

0.01 0 0 0 0 0 0.02

0 0 0 0 0 0 0.56

6.12 6.12 6.12

3.28 4.31 3.6

0 0.01 0

1.04 4.32 0 4.32 0.15 3.75 1

1 Observed frequencies 0-3,00 3,01-15 1 Selected projects 3 2 1 Nonselected p. 1 3

6.12 6.12

2.91 2.24

0 0

0.53 3.44 0.72 2.96

1 1

6.12 6.12

2.38 2.25

0 0

0.08 2.46 1 0.1 2.35 1

1 1

6.12 2.05 0 0.02 2.07 1 Interdisciplinary studies

1

7 7 7

3.88 3.77 5.83

0.76 4.95 0.03

5 9.64 1 0.63 9.35 1.08 6.94

1 Observed frequencies 0-3,00 3,01-6,00 6,01-15 1 Selected projects 3 4 2 1 Nonselected p. 12 8 2

Kullback 2Î test: 9 S1= 22 S2=

7 7 7 7 7

6.19 0.83 1.35 4.41 2.16

0.01 0.13 0.08 0.65 0.19

0 5 4.22 0.41 2.53

6.2 1 5.96 5.65 1 5.47 4.88

1 1 1 1 1

31 2Î=S1-S2=

7 7 7 7 7 7 7 7 7 7 7 7 7 7

0.47 3.22 4.44 1.97 3.84 2.48 0.49 2.85 2.26 2.45 0.94 2.62 2.51 2.07

1.4 1.37 0.01 0.68 0 0.59 0.03 0.21 0.01 0.18 0 0.05 0 0.35

2.97 0.21 0 1.52 0 0.56 3.04 0 0.49 0.09 1.74 0 0.01 0

4.84 4.8 4.45 4.17 3.84 3.63 3.56 3.06 2.76 2.72 2.68 2.67 2.52 2.42

1 1 1 1 1 1 1 1 1 1 1 1 1 1

0 4.15 1

5.01 3.75 1.76 1.36 5 3.26 5.36

1 1

1 1

1

1 1

1 1

2

6.02 6.03

2

6.04 6.05

6 Fisher's exact test:

1

6.06

1

1

6.07

1

3

1

6.08

1

p=0,60

1 1 1 1 1 1 1

6.09

4

6.12 sum of projectss, where H sum of projectss, where H

2

Column total

4

5

5 4

Kullback 2Î test: S1= S2=

9

2Î=S1-S2=

Fisher's exact test: prob Additional Fisher's exac

Column total

15

12

4

Fisher's exact test:

7 7 7 7 7 7 7 7 7

2.04 1.49 0.45 1.2 1.21 1.18 0.85 0.79 0.25

0.01 0.04 0.17 0.02 0.01 0 0 0.26 0

0 0 0.72 0 0 0 0.21 0 0.18

2.05 1.53 1.34 1.22 1.22 1 1.18 1.06 1.05 0.43

1 1 1 1 1 1 1 1 1

Natural sciences and m Subfield total sum Results of Fisher's exact test Projects 2007

1.01

No. of subfields No. Projects

%

Natural sciences and mathematics 2007

1.02 1.03

sum of projects, where H0 is rejected 101

66

1.04

sum of projects, where H0 is not rejected 51

34

1.05

100

1.06

total sum on field

9

152

Engineering sciences and technologies 2007

1.07

sum of projects, where H0 is rejected 83

1.08

37

sum of projects, where H0 is not rejected 140 63 total sum on field 22 223 100 Medical sciences 2007 sum of projects, where H0 is rejected 20 26

1.09 sum of projects, where H sum of projects, where H Engineering sciences a

sum of projects, where H0 is not rejected 56 74 total sum on field 9 76 100

Subfield total sum

Biotechnical sciences 2007

2.01

sum of projects, where H0 is rejected 16

20

2.02

sum of projects, where H0 is not rejected 63

80

2.03

100

2.04

total sum on field

6

79

Social sciences 2007

2.05

sum of projects, where H0 is rejected 29 sum of projects, where H0 is not rejected 43 total sum on field

13

72

40

2.06

60

2.07

100

2.08

Humanities 2007

2.09

sum of projects, where H0 is rejected 21

27

2.10

sum of projects, where H0 is not rejected 57

73

2.11

100

2.12

total sum on field

12

78

Interdisciplinary studies 2007

2.13

sum of projects, where H0 is rejected 0

0

2.14

sum of projects, where H0 is not rejected 31 100

2.15

1

31

100

ALL FIELDS

2.16 2.17

sum of projects, where H0 is rejected 270

38

2.18

sum of projects, where H0 is not rejected 441

62

2.19

100

2.20

total sum on all fields

72

711

2.21

total sum of projects on 39 39 (54%) 178 subfields,25 where significant 2.22 rejection is not exp sum of projectss, where H

sum of projectss, where H Medical sciences 2007 Subfield total sum 3.01 3.02 3.03 3.04 3.05 3.06 3.07 3.08

3.09 sum of projects, where H sum of projects, where H Biotechnical sciences 2 Subfield total sum 4.01 4.02 4.03 4.04 4.05

4.06 sum of projects, where H sum of projects, where H Social sciences 2007 Subfield total sum 5.01 5.02 5.03 5.04 5.05 5.06 5.07 5.08 5.09 5.10 5.11 5.12

5.13 sum of projects, where H sum of projects, where H Humanities 2007 Subfield total sum 6.01

6.02 6.03 6.04 6.05 6.06 6.07 6.08 6.09 6.10 6.11

6.12 sum of projects, where H sum of projects, where H Interdisciplinary studies Subfield total sum

7.02 sum of projects, where H sum of projects, where H Calculation of limits for rejection of null hypothesis H 0 Rejection of H 0 is possible if at least the probability of most extreme combination is less or equal to α=0,05. Probability of most extreme combination: p = (n-k)! k! /n! n ... number of research project applications k ... number of selected project applications ! ... factorial operator Limits are calculated from: (n-k)! k! /n! ≤ 0,05

No. of selected projects

Rejec tion is not possi ble if n< 0 for all numb ers 1 2 3 4 5 6

… all applications selected

20 7 6 7 7 8 … for all numb ers

n Slovenia in 2007/2008 on bibliometric and other scores

ijav za mentorje mladim raziskovalcem za leto 2008 in za (so)financiranje raziskovalnih projektov v letu 2008, http://www.arrs.gov.si/sl/progproj/rproj/ak am leaders and peer review decisions for project selection.

ojects were selected. positive association can be significantly rejected at α=0,05. In 18 (25%) subfields with 263 project applications (37%) null hypothesis can not be reject ibliometric and scientometric indicators.

Critical value χ2 (α=0,05;df=1) =

Kullback 2Î test: 97.97 96.09

3.84

1.88
0.88 H0 is not rejected. 0.42 H0 is not rejected.

Additional Fisher's exact test p =

0.17 H0 is not rejected.

Correction for one null frequency in c.t.: 2Î=

Critical value χ2 (α=0,05;df=2) =

Kullback 2Î test: 454.23 443.71

H0 is rejected.

10.52 >Cr. χ2

Fisher's exact tests:

5.99

1 27

6 4 H is rejected. p=0,00048 0

4 2 H is rejected. p=0,0061 0

Natural sciences and mathematics 2007/2008 H0: there is no positive association No. of projects 152 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H is not rejected. H is not rejected. 12 0 0 H0 is rejected. 38 H0 is rejected. H0 is rejected. 22 H0 is rejected.

3 29

H0 is rejected. 30 H0 is rejected. H is not rejected. H0 is not rejected. 12 0 H0 is not rejected. 18 H0 is not rejected. 5 H0 is not rejected. H0 is rejected. 11 H0 is rejected. 4 H0 is not rejected. 101 51

In this subfields statistical analysis is not applicable.

Kullback 2Î test: 234.09 227.57

Critical value χ2 (α=0,05;df=1) =

H0 is rejected.

6.53 >Cr. χ2 Fisher's exact test:

Kullback 2Î test: 345.52 336.66 8.85

3.84

p=0,024

H0 is rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

H0 is rejected.

Correction for one null frequency in c.t.: 2Î=

7.85 >Cr. χ2

Fisher's exact test: probability p = Additional Fisher's exact test: p =

0.01 H0 is rejected. 4 2 H0 is rejected.

2 22

p=0,0072

Kullback 2Î test: 89.46 88.72

Critical value χ2 (α=0,05;df=1) =

H0 is not rejected.

0.73
2 8

p=0,091

Kullback 2Î test: 170.67 170.62

3.84

0.4 H0 is not rejected. 2 0 H0 is not rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

H0 is not rejected.

0.05
1 11

p=0,25

0.65 H0 is not rejected. 2 4 H0 is not rejected.

Fisher's exact test: probability p = 0 2 p=0,30

Kullback 2Î test: 86.59

2 1 H0 is not rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

78.2 8.39 Correction for one null frequency in c.t.: 2Î= Fisher's exact test:

Kullback 2Î test: 45.41 44.87

p=0,024

3.84

H0 is not rejected.

Fisher's exact test: probability p = Additional Fisher's exact test: p =

0 3

0.5 H0 is not rejected. 3 2 H0 is not rejected.

p=0,18 Critical value χ2 (α=0,05;df=1) =

3.84

H0 is not rejected.

1.86
Kullback 2Î test: 181.45 180.92

H0 is rejected.

Critical value χ2 (α=0,05;df=1) =

0.54
Kullback 2Î test: 163.88 162.02

7.39 >Cr. χ2 H0 is rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

H0 is not rejected.

0.54
1 11

0.46 H0 is not rejected. 2 5 H0 is not rejected.

Kullback 2Î test: 601.77 586.63 15.14

Critical value χ2 (α=0,05;df=2) =

Correction for one null frequency in c.t.: 2Î=

14.14 >Cr. χ2 H0 is rejected.

Fisher's exact test: probability p = 1 35 p=0,00027

6 5 H0 is rejected.

Engineering sciences and technologies 2007 H0: there is no positive association No. of projects 223 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H is not rejected. H is not rejected. 8 0 0 H0 is not rejected. 17 H0 is not rejected. H0 is not rejected. 19 H0 is not rejected. H0 is rejected. 47 H0 is rejected. 6 H0 is not rejected. H0 is not rejected. 12 H0 is not rejected. H0 is not rejected. 36 H0 is not rejected. H0 is rejected. 7 H0 is rejected. H is not rejected. H0 is not rejected. 8 0 H0 is rejected. 18 H0 is rejected. H0 is not rejected. 7 H0 is not rejected. 4 H0 is not rejected. H0 is not rejected. 7 H0 is not rejected. H0 is rejected. 11 H0 is rejected. 3 H0 is not rejected. 1 H0 is not rejected. 1 H0 is not rejected. 0 H0 is not rejected. 2 H0 is not rejected. 3 H0 is not rejected. 2 H0 is not rejected. 4 H0 is not rejected. 83 140

5.99

Kullback 2Î test: 97.97 97.12 0.86
Kullback 2Î test: 463.23 462.44 0.79
Critical value χ2 (α=0,05;df=1) =

3.84

H0 is not rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

H0 is not rejected.

Critical value χ2 (α=0,05;df=2) = 5.99 S1= 438.38 S2= 434.22 2Î=S1-S2= 4.17 Correction for one null frequency in c.t.: 2Î= H0 is not rejected. 3.17
Kullback 2Î test: 44.92 35.36

Critical value χ2 (α=0,05;df=1) =

H0 is rejected.

9.56 Correction for two null frequencies in c.t.: 2Î= Fisher's exact test: probability p = Kullback 2Î test: 45.41 44.87

3.84

H0 is not rejected. 0.5 H0 is not rejected. 2 3 p=0,18 3 0 H0 is not rejected.

Fisher's exact test: probability p = Additional Fisher's exact test: p =

Critical value χ2 (α=0,05;df=1) =

Correction for one null frequency in c.t.: 2Î= Fisher's exact test: probability p = Kullback 2Î test: 171.16 167.16

7.56 >Cr. χ2 p=0,029 H0 is rejected.

Critical value χ2 (α=0,05;df=1) =

0.54
Kullback 2Î test: 180.11 170.62 9.49

3.84

3.84

H0 is rejected. 8.49 >Cr. χ2 p=0,012 H0 is rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

4
0.15 H0 is not rejected.

Fisher's exact test: probability p =

Kullback 2Î test: 36.61 35.36

Critical value χ2 (α=0,05;df=1) =

Fisher's exact test: probability p = Additional Fisher's exact test: p =

0.2
3.84

H0 is not rejected.

1.24
Kullback 2Î test: 35.56 35.36

3
1 3

0.37 H0 is not rejected. H0 is not rejected. 3 p=0,11 0

Critical value χ2 (α=0,05;df=1) =

3.84

H0 is not rejected.

0.63 H0 is not rejected. 1 2 p=0,14 4 0 H0 is not rejected.

Fisher's exact test: probability p = Additional Fisher's exact test: p =

Critical value χ2 (α=0,05;df=1) = Kullback 2Î test: 3.84 83.62 79.92 Correction for one null frequency in c.t.: 2Î= H0 is not rejected. 3.7 2.7 Cr. χ2 Additional Fisher's exact test: p = 0 2 p=0,018 9 0 H0 is rejected. Kullback 2Î test:

3.84

Medical sciences 2007 H0: there is no positive association No. of projects 76 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H is rejected. H is rejected. 13 0 0 H0 is not rejected. 1 H0 is not rejected. H0 is not rejected. 11 H0 is not rejected. H0 is not rejected. 14 H0 is not rejected. H0 is not rejected. 8 H0 is not rejected. H0 is not rejected. 12 H0 is not rejected. 4 H0 is not rejected. H0 is rejected. 7 H0 is rejected. 6 H0 is not rejected. 20 56

Kullback 2Î test: 107.06 98.11 8.95

Critical value χ2 (α=0,05;df=1) =

Correction for one null frequency in c.t.: 2Î=

7.95 >Cr. χ2 H0 is rejected.

Fisher's exact test: probability p = Additional Fisher's exact test: p =

0.01 H0 is rejected. 5 1 H0 is rejected.

p=0,0047

Kullback 2Î test: 77.71 77.46 0.25
0 7

Critical value χ2 (α=0,05;df=1) =

3.84

3.84

H0 is not rejected.

Fisher's exact test: probability p = Additional Fisher's exact test: p =

3 2

p=0,42

Kullback 2Î test: 118.08 114.12 3.96

0.57 H0 is not rejected. 5 1 H0 is not rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

Correction for one null frequency in c.t.: 2Î=

2.96
Fisher's exact test: probability p = Additional Fisher's exact test: p =

0.15 H0 is not rejected. 7 0 H0 is not rejected.

4 3

p=0,096

Kullback 2Î test: 45.41 45.37

Critical value χ2 (α=0,05;df=1) =

H0 is not rejected.

0.04
Kullback 2Î test: 86.68 86.34

0 2

0.71 H0 is not rejected. 5 1 H0 is not rejected.

p=0,11 Critical value χ2 (α=0,05;df=1) =

3.84

H0 is not rejected.

0.34
Kullback 2Î test: 39.38

3.84

1 4

0.5 H0 is not rejected. 4 3 H0 is not rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

36.55 Correction for one null frequency in c.t.: 1.83 2Î=
0.28 H0 is not rejected.

Additional Kullback 2Î test for re-binned c Selected projects 0 Nonselected p.

2 2

Additional Fisher's exact test: p = 0 2

Fisher's exact test: p =

0 3

2 1 H0 is not rejected.

p=0,20

Kullback 2Î test: 145.98 143.46 2.52

Critical value χ2 (α=0,05;df=1) =

Correction for one null frequency in c.t.: 2Î= Fisher's exact test: probability p = Additional Fisher's exact test: p =

2.52
0 12

p=0,05

Kullback 2Î test: 268.67 266.25

3.84

Critical value χ2 (α=0,05;df=1) =

3.84

H0 is not rejected.

2.42
1 17

0.15 H0 is not rejected. 3 4 H0 is not rejected.

Biotechnical sciences 2007 H0: there is no positive association No. of projects 79 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) 16 H0 is rejected. H0 is not rejected. 12 H0 is not rejected. H is not rejected. H0 is not rejected. 26 0 H0 is not rejected. 9 H0 is not rejected.

0 H0 is not rejected. H0 is not rejected. 16 H0 is not rejected. 16 63

Critical value χ2 (α=0,05;df=1) = Kullback 2Î test: 3.84 61.73 60.46 H0 is not rejected. 1.27
Critical value χ2 (α=0,05;df=1) = Kullback 2Î test: 144.68 139.82 4.86
Kullback 2Î test: 46.11 37.73

3.84

3.86
H0 is not rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

χ2 2Î= 8.38 Correction for two null frequencies 6.38 >Cr. in c.t.: H0 is rejected. Fisher's exact test:

p=0,048

H0 is rejected.

Critical value χ2 (α=0,05;df=1) = Kullback 2Î test: 241.7 235.03 6.67 Correction for one null frequency in c.t.: 2Î= H0 is rejected. 5.67 >Cr. χ2 Fisher's exact test: probability p = Additional Fisher's exact test: p =

0 20

p=0,0043

0.04 H0 is rejected. 2 0 H0 is rejected.

3.84

Fisher's exact test:

0 3

2 0

H0 is not rejected. p=0,10 Social sciences 2007 H0: there is no positive association No. of projects 72 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H is rejected. H is rejected. 7 0 0 H0 is rejected. 22 H0 is rejected. 5 H0 is not rejected. 4 H0 is not rejected. 5 H0 is not rejected. 5 H0 is not rejected. 4 H0 is not rejected. 3 H0 is not rejected. 4 H0 is not rejected. H0 is not rejected. 8 H0 is not rejected. 3 H0 is not rejected. 1 H0 is not rejected. 1 H0 is not rejected. 29 43 Fisher's exact test:

Kullback 2Î test: 50.95 49.42

0 2

2 p=0.17 0

H0 is not rejected.

Critical value χ2 (α=0,05;df=1) =

3.84

1.53 Correction for one null frequency in c.t.: 0.52 2Î=
Kullback 2Î test: 124.38 121.03

Critical value χ2 (α=0,05;df=1) =

H0 is not rejected.

3.35
Additional Fisher's exact test: p =

0.1 H0 is not rejected. 5 1 H0 is rejected.

2 7

p=0,035

Kullback 2Î test: 50.95 44.87 6.09

3.84

Critical value χ2 (α=0,05;df=1) =

5.09 >Cr. χ2 H0 is rejected. 4 0 H0 is not rejected.

Correction for one null frequency in c.t.: 2Î= Fisher's exact test:

3.84

1 3 p=0,071

Fisher's exact test: probability p = 0 3

3 0 H0 is rejected.

p=0,050

Kullback 2Î test: 98.23 98.11

Critical value χ2 (α=0,05;df=1) =

H0 is not rejected.

0.12
Humanities 2007

3.84

H0 is not rejected.

0.58 2 5

3 3 H0 is not rejected.

H0: there is no positive association No. of projects 72 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H is rejected. H is not rejected. 15 0 0 H0 is rejected. 8 H0 is not rejected. 7 H0 is not rejected. 6 H0 is rejected. H0 is not rejected. 13 H0 is not rejected. 4 H0 is not rejected. 2 H0 is not rejected. 2 H0 is not rejected. 6 H0 is not rejected.

H0 is not rejected.

4 H0 is not rejected. 2 H0 is not rejected. H0 is not rejected. 9 H0 is not rejected. 29 43

Kullback 2Î test: 55.51 54.37

Critical value χ2 (α=0,05;df=1) =

H0 is not rejected.

1.14
3 2

Kullback 2Î test: 329.04 327.53

3.84

0.96 H0 is not rejected. 2 p=0,83 2 H0 is not rejected.

Critical value χ2 (α=0,05;df=2) =

5.99

H0 is not rejected.

1.52
4 6 H0 is not rejected.

Natural sciences and mathematics 2007 H0: there is no positive association No. of projects 152 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H is not rejected. H is not rejected. 12 0 0 H0 is rejected. 38 H0 is rejected. H0 is rejected. 22 H0 is rejected. H0 is rejected. 30 H0 is rejected. H is not rejected. H0 is not rejected. 12 0 H0 is not rejected. 18 H0 is not rejected. 5 H0 is not rejected. H0 is rejected. 11 H0 is rejected. H is not rejected. 4 0 101 51 Engineering sciences and technologies 2007 H0: there is no positive association No. of projects 223 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H is not rejected. H is not rejected. 8 0 0 H0 is not rejected. 17 H0 is not rejected. H0 is not rejected. 19 H0 is not rejected. H0 is rejected. 47 H0 is rejected. H is not rejected. 6 0 H0 is not rejected. 12 H0 is not rejected. H0 is not rejected. 36 H0 is not rejected. H0 is rejected. 7 H0 is rejected. H0 is not rejected. 8 H0 is not rejected. H0 is rejected. 18 H0 is rejected. H0 is not rejected. 7 H0 is not rejected. 4 H0 is not rejected. H0 is not rejected. 7 H0 is not rejected. H0 is rejected. 11 H0 is rejected. H is not rejected. 3 0 1 H0 is not rejected. 1 H0 is not rejected. 0 H0 is not rejected. 2 H0 is not rejected. 3 H0 is not rejected. 2 H0 is not rejected. 4 H0 is not rejected. 83

140 Medical sciences 2007 H0: there is no positive association No. of projects 76 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H0 is rejected. 13 H0 is rejected. H0 is not rejected. 1 H0 is not rejected. H0 is not rejected. 11 H0 is not rejected. H0 is not rejected. 14 H0 is not rejected. H0 is not rejected. 8 H0 is not rejected. H0 is not rejected. 12 H0 is not rejected. H is not rejected. 4 0 H0 is not rejected. 7 H0 is rejected. 6 H0 is not rejected. 20 56 Biotechnical sciences 2007 H0: there is no positive association No. of projects 79 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) 16 H0 is rejected. H0 is not rejected. 12 H0 is not rejected. H is not rejected. H0 is not rejected. 26 0 H0 is not rejected. 9 H0 is not rejected. 0 H0 is not rejected. H0 is not rejected. 16 H0 is not rejected. 16 63 Social sciences 2007 H0: there is no positive association No. of projects 72 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H0 is rejected. 7 H0 is rejected. H0 is rejected. 22 H0 is rejected. 5 H0 is not rejected. 4 H0 is not rejected. 5 H0 is not rejected. 5 H0 is not rejected. 4 H0 is not rejected. 3 H0 is not rejected. 4 H0 is not rejected. H0 is not rejected. 8 H0 is not rejected. H is not rejected. 3 0 1 H0 is not rejected. 1 H0 is not rejected. 29 43 Humanities 2007 H0: there is no positive association No. of projects 78 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H0 is not rejected. 15 H0 is rejected.

H0 is rejected. 8 H0 is not rejected. H is not rejected. 7 0 6 H0 is rejected. H0 is not rejected. 13 H0 is not rejected. 4 H0 is not rejected. 2 H0 is not rejected. 2 H0 is not rejected. 6 H0 is not rejected. 4 H0 is not rejected. 2 H0 is not rejected. H0 is not rejected. 9 H0 is not rejected. 21 57 Interdisciplinary studies 2007 H0: there is no positive association No. of projects 31 Fisher's exact Kullback test (α=0,05) 2Î test (α=0,05) H is not rejected. H is not rejected. 31 0 0 0 31

p://www.arrs.gov.si/sl/progproj/rproj/akti/metod-tapl-mr-130707.asp .

37%) null hypothesis can not be rejected. In 39 subfields (54%) with 178 (25%) project applications no significant statistical estimation can be made be

al Kullback 2Î test for re-binned c.t.: 5 5

Critical value χ2 (α=0,05;df=1) = S1=

46.11 37.73 Correction for two null frequencies in c.t.: 2Î=

0

2

S2=

5

7

2Î=S1-S2=

al Fisher's exact test: p = 5 p=0,048 0 H0 is rejected.

8.38

statistical estimation can be made because of to small population or not enough or to many selected.

lue χ2 (α=0,05;df=1) =

3.84

6.38 >Cr. χ2 H0 is rejected.