Nrf Evaluation and Rating

Content

Page 3 and 4 of the Facts and Figures booklet - Number of rated researchers per institution type (2003) 3

Page 6 and 7 of the Facts and Figures booklet - Description of NRF rating categories and number of researchers with a valid rating per rating category (2003) 4

Page 6 of the Facts and Figures booklet - Average number of reports on which a rating is based (2003) – social sciences and humanities and natural sciences and engineering 5

Page 8 of the Facts and Figures booklet - List of reviewers, selected by the Specialist Committee versus those nominated by the applicant and the grand total of approaches sent to reviewers (2003) 7

Page 8 of the Facts and Figures booklet – Reviewers as selected by the Specialist Committee versus those nominated by the applicant (2003); social sciences and humanities vs. natural sciences and engineering 7

Page 8 of the Facts and Figures booklet – First 70 foreign institutions to which reviewers who were approached were attached (2003 to 2004) (list stops at minimum of 10 persons approached) 8

Page 8 of the Facts and Figures booklet – List of countries where institutions, to which reviewers are attached, are located (2003 - 2004) 9

Page 9 of the Facts and Figures booklet – Number of reviewers approached (natural sciences and engineering): 1984 to 2002 10

Page 9 of the Facts and Figures booklet – Number of persons approached to do reviews per organisation type per social sciences and humanities (2002 – 2004) and natural sciences and engineering (2003 -2004) 10

Page 9 of the Facts and Figures booklet – Types and locality of institutions where the reviewers who were approached during 2003 were employed 11

Page 11 of the Facts and Figures booklet –Summary of appeals lodged against evaluation results: 1987-2003 12

Page 13 of the Facts and Figures booklet –Initial assessment of Specialist Committee and Assessor; social sciences and humanities vs. natural sciences and engineering 12

Page 14 of the Facts and Figures booklet –Total number of rated researchers per Specialist Committee and per rating category (all institutions) (2004)* 12

Page 15 of the Facts and Figures booklet – Comparison between the years 1986, 1997 and 2003, of the percentage of rated researchers per rating category in the natural sciences and engineering 15

Page 15 of the Facts and Figures booklet –Comparison of the distribution of valid ratings across rating categories between natural sciences and engineering vs. social sciences and humanities (2003) 15

Page 17 of the Facts and Figures booklet – Rated researchers in natural sciences and engineering at South African museums, technikons and universities: 1986, 1994 and 2002 16

Page 18 of the Facts and Figures booklet – Rated researchers in the natural sciences and engineering per Assessment Panels grouped according to sector (at all institutions): 1986 – 2002 16

Page 18 of the Facts and Figures booklet – Totals of evaluated researchers at SA Museums, technikons, universities and colleges of education per rating category (1984 – 2003) 17

Page 19 of the Facts and Figures booklet – Ratings per institution grouped according to institution type, across all disciplines (2004) (as at 18 March 2005) 17

Page 20 of the Facts and Figures booklet – Trends in the number of rated black and female researchers at SA museums, technikons and universities in all disciplines: 1996 - 2003 17

Page 20 of the Facts and Figures booklet – Distribution (as a percentage) of rated researchers by age at South African museums, technikons and universities in all disciplines: 2003 18

Page 21 of the Facts and Figures booklet – List of higher education institutions in South African according to the proportion of their staff with a valid NRF rating (2003) 18

Page 22 of the Facts and Figures booklet – Total and average value of grants claimed by rated and unrated principal grant-holders per programme: 2003 19

Page 23 of the Facts and Figures booklet – Total and average value of grants (to nearest thousand Rand) claimed by rated principal grant-holders vs. unrated principal grant-holders: 2003 19

Page 23 of the Facts and Figures booklet – Comparison of total and average value of grants claimed by rated researchers across rating categories in the NRF’s Focus Area Programmes, rounded to nearest thousand rand (excluding Indigenous Knowledge Systems): 2003 19

Page 25 of the Facts and Figures booklet – Performance of P- and Y-rated researchers at re-evaluation 20

Page 25 of the Facts and Figures booklet – A history of those applicants who have presented themselves for evaluation and rating at least four times - ratings per research cycle 22

Page 3 and 4 of the Facts and Figures booklet - Number of rated researchers per institution type (2003)

South African higher education institutions / 1306
South African museums / 18
Other South African institutions and national facilities / 34
Other (including foreign institutions) / 89
Total / 1447

As at 12 March 2004

Total number of persons in academic and related positions (2003)

Instruction/Research Professionals / 14 976

*Source: Higher Education Management Information System (HEMIS) Report, Department of Education (DoE) 2003

Page 6 and 7 of the Facts and Figures booklet - Description of NRF rating categories and number of researchers with a valid rating per rating category (2003)

[

Category / Definition / Total (2003)*
A / Researchers who are unequivocally recognised by their peers as leading international scholars in their field for the high quality and impact of their recent research outputs. / 47
B / Researchers who enjoy considerable international recognition by their peers for the high quality an impact of their recent research outputs. / 357
C / Established researchers with a sustained recent record of productivity in the field who are recognised by their peers as having:
produced a body of quality work, the core of which has coherence and attests to ongoing engagement with the field
demonstrated the ability to conceptualise problems and apply research methods to investigating them. / 807
P / Young researchers (normally younger than
35 years of age), who have held the doctorate or equivalent qualification for less than five years at the time of application and who, on the basis of exceptional potential demonstrated in their published doctoral work and/or their research outputs in their early post-doctoral careers are considered likely to become future leaders in their field. / 17
Y / Young researchers (normally younger than 35 years of age), who have held the doctorate or equivalent qualification for less than five years at the time of application, and who are recognised as having the potential to establish themselves as researchers within a five-year period after evaluation, based on their performance and productivity as researchers during their doctoral studies and/or early post-doctoral careers. / 166
L / Persons (normally younger than 55 years) who were previously established as researchers or who previously demonstrated potential through their own research products, and who are considered capable of fully establishing or re-establishing themselves as researchers within a five-year period after evaluation. Candidates should be South African citizens or foreign nationals who have been resident in South Africa for five years during which time they have been unable for practical reasons to realise their potential as researchers.
Candidates who are eligible in this category include
black researchers
female researchers
those employed in a higher education institution that lacked a research environment
those who were previously established as researchers and have returned to a research environment / 53

Page 6 of the Facts and Figures booklet - Average number of reports on which a rating is based (2003) – social sciences and humanities and natural sciences and engineering

Rating / Rating of reports / Number of ratings per category
1 / 1/2 / 2 / 4 / 3 / 2/3 / 5 / Grand Total / Rating / Total
A / 54 / 6 / 20 / 12 / 4 / 1 / 4 / 101 / A / 10
B / 214 / 52 / 177 / 100 / 41 / 32 / 55 / 671 / B / 76
C / 334 / 93 / 525 / 227 / 117 / 70 / 162 / 1528 / C / 191
L / 24 / 4 / 24 / 12 / 3 / 2 / 12 / 81 / L / 10
P / 6 / 6 / 3 / 2 / 17 / P / 2
Y / 65 / 22 / 94 / 55 / 25 / 8 / 29 / 298 / Y / 37
Grand Total / 697 / 177 / 846 / 409 / 190 / 113 / 264 / 2696 / Grand Total / 326
Rating of reports
Rating / 1 / 1/2 / 2 / 4 / 3 / 2/3 / 5 / Average number of reports
A / 5.40 / 0.60 / 2.00 / 1.20 / 0.40 / 0.10 / 0.40 / 10.10
B / 2.82 / 0.68 / 2.33 / 1.32 / 0.54 / 0.42 / 0.72 / 8.83
C / 1.75 / 0.49 / 2.75 / 1.19 / 0.61 / 0.37 / 0.85 / 8.00
L / 2.40 / 0.40 / 2.40 / 1.20 / 0.30 / 0.20 / 1.20 / 8.10
P / 3.00 / 0.00 / 3.00 / 1.50 / 0.00 / 0.00 / 1.00 / 8.50
Y / 1.76 / 0.59 / 2.54 / 1.49 / 0.68 / 0.22 / 0.78 / 8.05
Grand Total / 2.14 / 0.54 / 2.60 / 1.25 / 0.58 / 0.35 / 0.81 / 8.27

* As at 2 February 2005

Average number of reports on which a rating is based (1987) – natural sciences and engineering

Rating / Rating of reports / Grand Total
A / I / 1A / 1I / 2A / 2I / 3A / 3I
A / - / 1 / 38 / 5 / 14 / 2 / 2 / 1 / 63
B / - / 12 / 87 / 3 / 44 / 2 / 5 / 5 / 158
C / 1 / 15 / 166 / 5 / 120 / 10 / 30 / 32 / 379
P / - / 2 / 3 / - / 6 / - / - / - / 11
Y / 1 / 35 / 1 / 32 / 3 / 5 / 5 / 82
Grand Total / 1 / 31 / 329 / 14 / 216 / 17 / 42 / 43 / 693
Rating of reports
Rating / A / I / 1A / 1I / 2A / 2I / 3A / 3I / Average number of reports
A / - / 0.03 / 1.06 / 0.14 / 0.39 / 0.06 / 0.06 / 0.03 / 1.75
B / - / 0.24 / 1.78 / 0.06 / 0.90 / 0.04 / 0.10 / 0.10 / 3.22
C / 0.01 / 0.12 / 1.32 / 0.04 / 0.95 / 0.08 / 0.24 / 0.25 / 3.01
P / - / 0.67 / 1.00 / - / 2.00 / - / - / - / 3.67
Y / - / 0.04 / 1.25 / 0.04 / 1.14 / 0.11 / 0.18 / 0.18 / 2.93
Grand Total / 0.004 / 0.13 / 1.36 / 0.06 / 0.89 / 0.07 / 0.17 / 0.18 / 2.86

Average number of reports on which a rating is based (2002) - natural sciences and engineering

Rating / Rating of reports / Grand Total
1 / 2 / 3 / 4 / 5
A / 37 / 13 / 4 / 7 / 3 / 64
B / 319 / 135 / 21 / 60 / 49 / 584
C / 343 / 246 / 38 / 83 / 73 / 783
P / 5 / - / - / - / - / 5
Y / 79 / 74 / 9 / 23 / 22 / 207
L / 31 / 18 / 6 / 17 / 7 / 79
Grand Total / 1722
Rating of reports
Rating / 1 / 2 / 3 / 4 / 5 / Average number of reports
A / 4.63 / 1.63 / 0.50 / 0.88 / 0.38 / 8.00
B / 4.09 / 1.73 / 0.27 / 0.77 / 0.63 / 7.49
C / 3.04 / 2.18 / 0.34 / 0.73 / 0.65 / 6.93
P / 5.00 / - / - / - / - / 5.00
Y / 2.72 / 2.55 / 0.31 / 0.79 / 0.76 / 7.14
L / 2.82 / 1.64 / 0.55 / 1.55 / 0.64 / 7.18
Grand Total / 3.39 / 2.03 / 0.33 / 0.79 / 0.64 / 7.18

Average number of reports on which a rating is based (2002) – social sciences and humanities

Rating / Rating of reports / Grand Total / Number of ratings per category
1 / 1/2 / 2 / 4 / 3 / 2/3 / 5 / Rating / Total
A / 33 / 4 / 5 / 11 / 4 / 4 / 61 / A / 6
B / 137 / 44 / 149 / 96 / 41 / 21 / 42 / 530 / B / 59
C / 321 / 78 / 434 / 277 / 136 / 94 / 138 / 1478 / C / 178
L / 8 / 2 / 19 / 10 / 9 / 7 / 12 / 67 / L / 8
P / 2 / 1 / 7 / 5 / 3 / 1 / 3 / 22 / P / 2
Y / 24 / 6 / 41 / 18 / 7 / 8 / 19 / 123 / Y / 17
Grand Total / 525 / 135 / 655 / 417 / 200 / 131 / 218 / 2281 / Grand Total / 270
Rating of reports
Rating / 1 / 1/2 / 2 / 4 / 3 / 2/3 / 5 / Average number of reports
A / 5.50 / 0.67 / 0.83 / 1.83 / 0.67 / 0.00 / 0.67 / 10.17
B / 2.32 / 0.75 / 2.53 / 1.63 / 0.69 / 0.36 / 0.71 / 8.98
C / 1.80 / 0.44 / 2.44 / 1.56 / 0.76 / 0.53 / 0.78 / 8.30
L / 1.00 / 0.25 / 2.38 / 1.25 / 1.13 / 0.88 / 1.50 / 8.38
P / 1.00 / 0.50 / 3.50 / 2.50 / 1.50 / 0.50 / 1.50 / 11.00
Y / 1.41 / 0.35 / 2.41 / 1.06 / 0.41 / 0.47 / 1.12 / 7.24
Grand Total / 1.94 / 0.50 / 2.43 / 1.54 / 0.74 / 0.49 / 0.81 / 8.45

* As at 26 January 2005

Average number of reports on which a rating is based (2003) – social sciences and humanities and natural sciences and engineering

* As at 2 February 2005