INTERNATIONALISATION OF AUSTRALIAN UNIVERSITIES:
LEARNING FROM CYCLE 1 AUDITS Antony Stella and Colleen Liston
AUSTRALIAN UNIVERSITIES QUALITY AGENCY
August 2008
AUQA Occasional Publications Series AUQA’s Occasional Publications (AOP) Series provides a vehicle for the publication of research and reflection on quality assurance and quality enhancement in higher education, with an emphasis on topics of relevance to Australia. The Series includes conference proceedings, themed collections of articles, special issues, reports and monographs. Aims of the Series are to: • contribute to the enhancement of quality practices and quality assurance in Australian higher education (wherever offered) and internationally • provide a means for sharing insights, research and analysis that is responsive to identified or emerging needs of quality facilitators in higher education • stimulate discussion and reflection on directions, evolution and progress in quality improvement relevant to higher education and external quality assurance agencies • explore the breadth and diversity of approaches to quality assurance in Australian higher education • provide substantial scholarly contributions to the literature on quality assurance in higher education that would otherwise not be available to a wide audience. The AOP Series is not intended to duplicate the function of other academic journals that address quality in higher education. Rather, it is intended to provide a vehicle for the publication of works relevant to AUQA’s activities and the Australian higher education sector, as indicated above. Works in the AOP Series are expected to demonstrate a high standard of research, scholarship and critical reflection. Publications in the Series will be substantial works such as monographs, edited compilations or analytical reports, normally between 10,000 and 30,000 words. The Series also includes the Proceedings of the annual Australian Universities Quality Forum (AUQF). For a list of current publications visit the website: http://www.auqa.edu.au/qualityenhancement/publications/index.shtml. AUQA Occasional Publications Number 14 ISSN 1446‐4268 ISBN 978 1 877090 89 9 © Australian Universities Quality Agency 2008 All rights reserved. No part of this publication may be reproduced by any means without permission from the publisher. Published by: Level 10, 123 Lonsdale Street Melbourne, VIC 3000 Ph 03 9664 1000 Fax 03 9639 7377
[email protected] www.auqa.edu.au The Australian Universities Quality Agency receives financial support from the Australian Government and State and Territory Governments of Australia. The views expressed in this report do not necessarily reflect the views of the Australian Government.
TABLE OF CONTENTS 1
INTRODUCTION ......................................................................................................... 1 1.1 1.2 1.3
2
EARLIER ANALYSES .................................................................................................... 4 2.1 2.2 2.3 2.4 2.5
3
I NCREASING ATTENTION TO INTERNATIONALISATION ................................................... 14 I NTERNATIONALISATION STRATEGIES ...................................................................... 14 U NDERSTANDING INTERNATIONALISATION ............................................................... 17 S UPPORTING AND COORDINATING INTERNATIONALISATION ........................................... 19 I NTERNATIONALISATION OF THE CURRICULUM ........................................................... 20 S TUDENT AND STAFF EXCHANGE ........................................................................... 22 I NTERNATIONALISATION OF RESEARCH .................................................................... 23 I NTERNATIONAL BENCHMARKING .......................................................................... 24
FINDINGS FROM AUDIT REPORTS ON INTERNATIONAL STUDENTS ONSHORE .......... 26 5.1 5.2 5.3 5.4 5.5
6
T ERMINOLOGY — I NTERNATIONALISATION ................................................................8 S IGNALS FROM C OMMENDATIONS , A FFIRMATIONS AND R ECOMMENDATIONS (CAR S ).............9 B ROADER SIGNALS ........................................................................................... 10 I NCREASING INTERNATIONAL PRESENCE OF A USTRALIAN UNIVERSITIES .............................. 10 T HE FUTURE ................................................................................................... 11 S UMMARY .................................................................................................... 12
FINDINGS ON INTERNATIONALISATION FROM THE AUDIT REPORTS ........................ 14 4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8
5
‘I NSTITUTIONAL A UDIT R EPORTS : A NALYSIS AND C OMMENTS ’ (2002)...............................4 ‘M ETA ‐A NALYSIS OF AUQA I NSTITUTIONAL R EPORTS 2002–4’ ......................................5 AUQA O BJECTIVE 4 R EPORT (2005) ......................................................................6 L EARNING FROM C YCLE 1 R EPORTS (2006) ...............................................................6 AUQA O CCASIONAL P UBLICATION (2007) ...............................................................7
CONTEXT OF THIS REPORT ......................................................................................... 8 3.1 3.2 3.3 3.4 3.5 3.6
4
T HEMATIC ANALYSES ..........................................................................................1 T HE NATURE OF AUQA AUDITS .............................................................................1 S TRUCTURE OF THIS R EPORT .................................................................................2
R ECRUITING INTERNATIONAL STUDENTS — THE USE OF AGENTS ...................................... 26 S UPPORTING INTERNATIONAL STUDENTS ................................................................. 27 E NGLISH L ANGUAGE PROFICIENCY ......................................................................... 29 C ULTURAL ACCLIMATISATION .............................................................................. 30 I NTERNATIONAL STUDENT PROGRESSION ................................................................. 30
FINDINGS FROM AUDIT REPORTS ON TRANSNATIONAL EDUCATION ....................... 32 6.1 6.2 6.3 6.4 6.5
R ATIONALE FOR TNE ACTIVITIES .......................................................................... 32 Q UALITY A SSURANCE FOR TNE PROGRAMS ............................................................. 33 C OORDINATION AND CONSOLIDATION .................................................................... 36 A WARENESS OF OBLIGATIONS .............................................................................. 37 E DUCATIONAL COLLABORATIVE PARTNERSHIPS .......................................................... 37
6.6 6.7 6.8 6.9 6.10 6.11 6.12 6.13 6.14 6.15 6.16
7
GOOD PRACTICES VALIDATED BY AUQA................................................................... 61 7.1 7.2
8
AUQA G OOD P RACTICE D ATABASE (GPDB) ........................................................... 61 O THER GOOD PRACTICES .................................................................................... 62
PROGRESS MADE AFTER THE AUDITS....................................................................... 64 8.1 8.2
9
M ARKETING AND PROMOTION ............................................................................. 41 A DMISSIONS .................................................................................................. 43 E NGLISH LANGUAGE ISSUES ................................................................................. 44 T EACHING IN LANGUAGES OTHER THAN E NGLISH (LOTE) ............................................. 46 P EDAGOGY FOR OFFSHORE TEACHING ..................................................................... 46 S UPPORTING OFFSHORE COURSES AND STUDENTS ...................................................... 49 P ROFESSIONAL DEVELOPMENT AND CULTURAL AWARENESS ........................................... 51 Q UALITY OF OFFSHORE TEACHING ......................................................................... 52 S TANDARDS , CONSISTENCY AND EQUIVALENCE .......................................................... 53 S TUDENT FEEDBACK AND MONITORING STUDENT PROGRESS .......................................... 55 A SSESSMENT , MODERATION AND EXAMINATION SECURITY ............................................ 56
P ROGRESS REPORTS ......................................................................................... 64 E FFECT WITHIN INSTITUTIONS .............................................................................. 64
IMPLICATIONS FOR CYCLE 2 AUDITS ........................................................................ 66
APPENDIX 1
LIST OF UNIVERSITY AUDIT REPORTS ....................................................... 67
APPENDIX 2
MAJOR CYCLE 1 AUDIT FINDINGS ............................................................ 68
APPENDIX 3
AUQA’S TRANSNATIONAL EDUCATION FRAMEWORK.............................. 82
APPENDIX 4
THE AUTHORS ......................................................................................... 87
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
1
Introduction
1.1
Thematic analyses
AUQA audited all the Australian universities over the years 2002 to 2007. Since the first cycle of audits was completed, AUQA has produced various ‘thematic analyses’ of the audit reports. These publications take one area of academic activity and synthesise and summarise the findings about that activity or area as reported in the audit reports. The audits took place over a six‐year period, therefore any analyses are not snapshots of the respective activities in the university sector at one point in time, nor do they support trend analyses. However, there is evidence in progress reports provided by universities that the first cycle of audits has led to positive changes across a range of areas. 1.2
The nature of AUQA audits
This Report should be read in the context of certain aspects that characterise the nature of AUQA audits and the audit reports, namely: the objectives of the auditees; the five‐ to six‐year time span of the audit reports; the impact of the structure and public nature of the audit report on an auditee, and the effect on other institutions. First, AUQA accepts an auditee’s objectives as the starting point of the audit and it is explicitly the responsibility of the auditee to devise a systematic process for evaluating its objectives with respect to criteria which may include relevance, desirability, feasibility, distinctiveness, and measurability. As each auditee will have systems relevant to its own objectives and character, the actual procedures used and the way they are implemented vary from auditee to auditee. Audit panels do not investigate the absolute value of these strategies but the extent to which they support the auditee in achieving its objectives, including the ones related to internationalisation. To that extent, the scope of the investigation of the panels and the depth and rigour of those investigations are determined, to a large extent, by the goals and objectives of the auditees. Second, the audit reports considered for this analysis have been published over a period of about five years, October 2002 to October 2007. In a rapidly changing higher education sector, this time span makes generalisations difficult. This Report only highlights how audit panels have commented on certain international activities as they existed at the time of audits. It does not describe the present state of internationalisation in the Australian higher education sector which, as the next two points makes clear, is significantly advanced from several years ago.
1
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Third, the public nature of audit reports encourages institutions to attend to areas noted in the audit reports as needing improvement. The post‐audit progress reports submitted by many universities indicate that institutions have taken action on most matters identified by AUQA as needing attention. They have also experimented with new strategies and consolidated others that are working well. The structure of the AUQA audit reports is also relevant. Each AUQA audit report contains a summary of findings together with lists of Commendations, Affirmations and Recommendations (CARs). A Commendation (defined by AUQA as: the achievement of a stated goal, or to some plan or activity that has led to, or appears likely to lead to, the achievement of a stated goal, and which in AUQA’s view is particularly significant) gives the auditee public credit for successful actions, and may provide ideas for other institutions. A Recommendation refers to an area in need of attention, whether in respect of approach, deployment or results, which in AUQA’s view is particularly significant. As noted, institutions are acting on the majority of these, and they also provide hints to other institutions about where they might be alert to potential problems. An Affirmation indicates a matter that needs attention which was identified by the institution in advance of the external audit process. The uses of Affirmations reinforces to institutions that their self‐ review activities are meaningful, and are acknowledged by AUQA. Fourth, the situation is changing rapidly. AUQA is just beginning to visit institutions in Cycle 2 to validate the progres reports and the actions taken. However, the progres reports show that significant institutional efforts have gone into better and more effective approaches to internationalisation, and there is evidence of significant cross‐institutional sharing of experience. 1.3
Structure of this Report
While this analysis has a specific focus on international activities of Australian universities, some other analyses carried out or commissioned by AUQA have commented on internationalisation as a part of a broader remit. The observations made in those analyses are in line with the findings of this Report. Conclusions from those earlier analyses are given briefly in Section 2, while Section 3 presents some general and contextual comments. Acknowledging the tendency in the sector to analyse major audit conclusions (e.g. Recommendations) alone, this Report highlights how any such limited analysis must be interpreted with caution, and, in Section 4, provides a detailed analysis of AUQA Reports under headings related to internationalisation. Section 5 continues the analysis for international students onshore, while Section 6 provides information on analyses around topics associated with transnational education. As a quality enhancement strategy, AUQA has a Good Practice Database (GPDB) where Commendations that have a high transferability value to other organisational settings are published. The Database serves as a record of some
2
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
good practices within the Australian university sector that have been validated by audit panels. Section 7 briefly presents Good Practice Database entries regarding international activities and draws attention to a range of good practices that are found only in the text of the audit reports. Finally, this Report briefly analyses the progress on actions evident from the post‐audit progress reports (Section 8) and notes some implications for AUQA’s next audit cycle (Section 9). Appendix 1 lists the audit reports of the 39 Australian universities considered for this Report and Appendix 2 lists Commendations, Affirmations and Recommendations from those reports. The names of individual universities have been omitted from the list in Appendix 2 and in references in this Report, although institutions are named in Section 7 on the Good Practice Database. To provide the context for how AUQA determined which offshore activities to sample and investigate in audit Cycle 1, and to indicate where attention will focus in cycle 2, AUQA’s Transnational Education Framework is detailed in Appendix 3.
3
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
2
Earlier Analyses
One of AUQA’s founding objectives (Objective 4) was a requirement to report on the standards and quality assurance processes of the Australian higher education system, as a result of information obtained during the audit process. (A similar objective remains in the revised Constitution but with the scope to draw on a wider range of data sources.) Towards meeting this objective through the first audit cycle, AUQA carried out or commissioned analyses of its audit reports to gain an overview of the information arising from the institutional audits. These analyses indicate many valuable lessons for the quality assurance of internationalisation. Six of these analyses need a specific mention. Four of them are overall analyses but with some findings on internationalisation and the other two have specific reference to transnational higher education (TNE). They are: 1.
2002 Institutional Audit Reports: Analysis and Comments by Dr. Anne Martin that covered 8 audit reports
2.
Meta‐Analysis of AUQA Institutional Reports 2002–4 by Professor Susan Holland that covered 19 audit reports
3.
Quality Assurance and Standards of Australian Higher Education: Based on the Institutional Audit Reports of AUQA by Dr Antony Stella (known as AUQA Objective 4 Report) that covered 25 audit reports published till 2005
4.
‘Areas that need emphasis in Cycle 2 of AUQA audits: Learning from the Cycle 1 Audit Reports’ by Dr Antony Stella produced for the AUQA Board in September 2006 that covered 33 audit reports published till 2006
5.
Quality Assurance and Audit for Transnational Higher Education, edited by Dr Jeanette Baird, AUQA Occasional Publication No.10 has many chapters on what AUQA and the AUQA auditors have learnt through the AUQA audits; particularly the chapter entitled ‘Quality Assurance Issues in Transnational Higher Education – Developing Theory by Reflecting on Thematic Findings from AUQA Audits’ by Martin Carroll and David Woodhouse.
Finally, a report made to DEST in 2006 on work carried out by AUQA using the special‐purpose TNE funding, also included reference to the transnational audit experience of AUQA. 2.1
‘Institutional Audit Reports: Analysis and Comments’ (2002)
The fact that the Australian institutions were paying increased attention to their international activities emerged as a significant finding from the first set of institutional audits. The analysis of the audit reports of 2002 pointed out that the Australian universities have a very active international presence.
4
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA started its first institutional audits in 2002 and the Board of AUQA commissioned Dr Anne Martin early in 2003 to prepare a thematic summary of the 2002 audit reports. At the time of commissioning, eight audit reports had been published. Dr Martin’s report presented an analytic overview of themes and issues emerging from the audit reports. Among the 71 issues presented in the report (39 key issues and 32 other issues) under 12 themes, ‘International Activities’ emerged as one of the major themes. This report revealed that outreach teaching in all its forms — offshore campuses, partnerships and external delivery — was identified as an issue that presented challenges for maintaining consistency of standards, of resourcing and of planning. However, the report also noted that, ‘Despite an evident need for tightening up, and one or two examples of lax practice, there is, however, no overriding sense emerging from the Audit Reports of significant poor practice across the sector.’ 2.2
‘Meta‐Analysis of AUQA Institutional Reports 2002–4’
In September 2004, Professor Susan Holland was commissioned by the AUQA Board to undertake a meta‐analysis of the institutional reports published to date. By then a total of 19 institutional audits (the half‐way mark in the first audit cycle) had been completed and the respective reports publicly released. The main purpose of the meta‐analysis was to analyse the reports for coverage of aspects relevant to academic activities. The report was written for guidance of the AUQA Board and staff rather than for public release. Among other findings, the report pointed out that ‘International Activity’ emerged as one of the four major areas of activity of the Australian universities, the other three being Teaching, Research, and Quality Assurance Systems and Governance. The report also noted that the international activities of Australian universities were covered adequately by the AUQA audit reports. In terms of ranking by total citations, 10% of the citations in the audit reports were related to International Activity and it was ranked fourth. Recommendations were almost double the number of Commendations and they were skewed heavily towards processes rather than the outcomes. The report identified the following nine sub‐themes under International Activities: 1.
Quality assurance systems for international programs
2.
Standards and quality of offshore teaching
3.
Services to international students
4.
Use of agents
5.
Problems with international programs
6.
English language Issues
7.
Professional development for internationalisation
8.
Pedagogy of offshore teaching
9.
Internationalisation strategy.
5
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
2.3
AUQA Objective 4 Report (2005)
In October 2005, to fulfil its mandate to ‘report on the relative standards of the Australian higher education system and its quality assurance processes, including their international standing’ (given by its then Objective 4), AUQA initiated an analysis, carried out by Dr Antony Stella, of the 25 audit reports of Australian universities published by then. That report looked at international activities to the extent that this served as an indicator to reflect the relative standards of the Australian higher education system and in that context looked at the quality assurance systems and processes in place for the quality assurance of offshore programs. In the context of the international standing of Australian universities, the analysis commented that: •
Compared to the audit conclusions on quality assurance of operations within the country, the offshore programs have received more Recommendations on basic quality assurance arrangements.
•
Quality assurance processes for and standards of offshore programs have received adequate attention by the audit panels. Universities have been commended for certain aspects of offshore teaching and service to international students.
•
Recommendations under offshore operations are on paying more attention to management of off‐campus academic programs, monitoring of offshore partners, clarity in lines of responsibility and accountability, systems for review of transnational programs, internal audit reports regarding international arrangements, staff orientation, policies governing entrance and advanced standing and consistency in standards.
2.4
Learning from Cycle 1 Reports (2006)
In its meeting held in June 2006, the Board of AUQA had extensive discussions on Cycle 2 audits. Directors suggested that to identify areas where AUQA should pay more attention further analysis of Cycle 1 audit reports might be useful. This might throw light on areas where the sector has done well and areas where more emphasis has to be placed by AUQA in Cycle 2. A note was prepared by Dr Antony Stella in response to that suggestion, to facilitate the Board’s discussions in its meeting held in September 2006. By July 2006 there were 33 audit reports of AUQA in the public domain and all of them were considered. As a part of that analysis, the Commendations, Affirmations and Recommendations (CARs) were codified following the schema developed by Professor Susan Holland with some CARs coded under more than one area. The graphs given in the following pages present the spread of CARs under the nine areas of functions used for the codification. Graph‐1 illustrates the comparative occurrence of CARs. It also gives an idea about the coverage. If the occurrence of CARs is high it can indicate the areas that have been
6
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
investigated more by the audit panels and might also indicate how significant those areas are to the quality of education.
Spread of CARS under major areas of Number of occurrences CARs
functions of SAIs 250 200 150
Comms Recs & Affs
100 50 0 A1
A2
A3 A4 B1 B2 B3 Areas of Functions
A - Major Functions
B4
B5
B - Support Functions
A1 - International Activity (33C, 68R) A2 - Teaching and Learning (137C, 218R) A3 - Research and Research Training (95C, 118R) A4- Community Engagement and Partnerships (41C, 25R) B1 - QA Systems and Governance (63C, 136R) B2 - Leadership and Strategy (49C, 61R) B3 - Student Services (26C, 33R) B4 - Staff Services (29C, 63R) B5 - Corporate Services (21C, 30R)
2.5
AUQA Occasional Publication (2007)
‘Quality Assurance Issues in Transnational Higher Education – Developing Theory by Reflecting on Thematic Findings from AUQA Audits’ by Carroll and Woodhouse in Quality Assurance and Audit for Transnational Higher Education pointed to the significant retrenchment of non‐viable or poor quality activities and argued that such retrenchment ought to be viewed in a constructive light as poor quality activities pose a reputational risk to the whole higher education sector. This paper also reported that the ad hoc approach to managing TNE operations was changing quickly, although universities still had difficulties managing legacy operations. The manner by which a university closed down programs and relationships with students and transnational partners was seen as an area that warranted improvement. The authors were hopeful that once this period of retrenchment passed, the remaining transnational higher education operations could be guided by carefully planned and regularly reviewed and refined quality assurance processes.
7
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
3
Context of this Report
The scope of AUQA’s audits of Australian universities over the years 2002 to 2007 comprised all academic activities carried out in the institution’s name, no matter where or by whom they were carried out. This means that AUQA has investigated overseas operations and operations through partners in Australia. Before the special purpose funding was made available, AUQA was visiting an average of two offshore operations during an institutional audit. This has increased to an average of four visits to offshore operations within an institutional audit, generally in two to four countries, though some auditees do not have enough overseas activity to warrant much overseas visiting. AUQA also targets offshore operations where there are known quality assurance issues. The strengthened attention to offshore operations made a significant contribution to what AUQA learnt about issues that needed greater attention in ensuring the quality and quality assurance arrangements of the Australian universities. This publication addresses the international activities of Australian universities, whether in Australia or overseas, under the title of ‘internationalisation’. 3.1
Terminology — Internationalisation
‘Internationalisation’ is an over‐used and misused word in higher education. Indeed there is evidence from cycle 1 audits that its interpretation by universities is variable, not well understood by staff and students, sometimes inappropriate to the university’s particular context or mission, and rarely embedded. Some individuals see it as ‘academia’s response to globalisation’, making graduates ready for global mobility through changing the curriculum and encouraging study abroad; some see it primarily in aid terms, such as the Colombo Plan model with foreign students in Australia; some see it in economic terms and think primarily of foreign students of Australian universities studying overseas. AUQA’s consideration of the term includes all of these. A widely accepted definition is that internationalisation is ‘the process of integrating an intentional, intercultural or global dimension into the purpose, functions and delivery of post‐secondary education’ (J. Knight, 2006). AUQA interprets this widely, to include the following: •
Arrangements for the teaching and learning of international students in Australia (including partner arrangements and campuses)
•
Arrangements for teaching and learning of international students overseas (transnational education, including partner arrangements and campuses)
8
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
•
Internationalisation of the curriculum
•
Other international activities, such as research collaboration, study abroad, staff mobility.
Many universities state an equally wide definition but then in practice mean by it only one of the aspects above. In such cases, AUQA has not recommended that they spread more widely, but told them to match their actions to their objectives — spread one or reduce the other. 3.2 Signals from Commendations, Affirmations and Recommendations (CARs) There are 31 Commendations that explicitly relate to internationalisation in the 39 published audit reports. There are 13 Affirmations and 77 Recommendations. An audit panel investigates a university’s activities taking institutional goals and objectives as the starting point. The panel findings that lead to the major audit conclusions are, most probably, the ones that have a very significant bearing on progress towards those goals and objectives. Therefore, if internationalisation finds a notable mention as a Recommendation for one auditee, it does not necessarily mean that the auditee is weak in that aspect. It might mean that in the context of the goals and objectives of that auditee, internationalisation requires further attention. At the same time, an AUQA audit considers certain external reference points as well, and the audit panels investigate how well the auditees perform against those reference points. Amidst diversity, Australian universities have embraced certain common elements and have made commitments to various guidelines, codes of practice, and external requirements. In particular, irrespective of the diversity in goals and objectives, all Australian universities have made a commitment to the Australian Vice‐Chancellors’ Committee’s (AVCC) Code of Practice and Guidelines in the Provision of Education to International Students and the Education Services for Overseas Students (ESOS) Act 2000. These provide anchor points for audit panels to look at common patterns. If panels find that improvements are required in these areas, this would lead to a Recommendation irrespective of whether the auditee has a goal of ‘international eminence’ or ‘regional emphasis’. Seen from this point of view, and without taking the number of Commendations or Recommendations in an audit report as some sort of ‘quality index’, an analysis of the CARs can throw light on some broad areas of internationalisation that need attention and areas of good practice. It can be inferred that highly prevalent Commendations are the areas where the Australian higher education institutions in general have demonstrated their potential and strengths. Similarly, highly prevalent areas of Recommendations may be considered as areas where many Australian higher education institutions need to make improvements, whether in absolute terms or primarily in relation to individual institutional objectives, and therefore might indicate in general the areas of weaknesses of the system. These are the areas that AUQA is likely to look at closely in Cycle 2. 9
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
3.3
Broader signals
Some readers pay attention only to the major audit conclusions, namely the CARs. While this serves certain purposes, it also provides some misleading signals, if taken out of context, because there are many other observations relating to internationalisation throughout the audit reports. In many cases, there are favourable comments or endorsements of an institution’s actions which for various reasons did not become Commendations. Some of these reasons are: newness of the activity; lack of evidence to demonstrate the sustainability and benefits of those efforts; and the activity not being very significant to the strategic priorities of the institution. For example, one auditee was at a very early stage in the process of implementing a new policy on research centres but stated that it would provide targeted assistance to research centres to develop or extend their international links. It was too early for changes to have resulted at the time of the audit, but the panel endorsed the approach. Some CARs that have a bearing on transnational education are mentioned under sections other than international activities. For example, in one of the universities, the audit panel’s attention was drawn to the ‘subject packs’ that were increasingly being used by subject coordinators. These packs expanded upon the subject outlines by including such additional information as teaching materials, assessment schedules and teaching notes. They were equally applicable to offshore as onshore courses, and hence were beneficial to offshore as well as onshore students. 3.4
Increasing international presence of Australian universities
AUQA cannot (and should not) investigate all a university’s activities through its audit process but expects each university to do a comprehensive self‐ review, either as a continuous activity or as a specific prelude to the AUQA audit. On the basis of this total picture, in its Cycle 1 audits AUQA investigated in detail a sample of areas and activities. The sampling is across different dimensions. AUQA addresses some areas of high risk, some areas that seem to be exhibiting significant success, areas of major importance to the institution, and other areas as necessary to ensure that no major academic function is overlooked. In this context, international activities have featured significantly, in the category ‘of major importance to the institution’. Australia has become a leading exporter of (higher) education, and Australian institutions rely heavily on the income from foreign students. Among international activities, transnational higher education received most attention from AUQA. Although Australian universities’ offshore programs cater for about one third of international university students, they are categorised as high risk because of the difficulty of managing these programs effectively. They pose, in military terms, a logistic problem at the end of a relatively long ‘supply chain’. As a
10
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
consequence of the level of attention paid to transnational higher education programs in audits, TNE occupies a relatively large portion of this Report. Other reasons for this emphasis on TNE include the following: •
The institution’s own performance portfolios. Although institutions used the term ‘internationalisation’ in strategies and plans, institutional actions and evidence in the portfolio were presented more for TNE with less coverage of other dimensions. Development in other dimensions of internationalisation is still emerging and consequently processes have been initiated but there are few tangible outcomes of those processes. However, in TNE, institutions have been better able to evaluate the ADRI dimensions.
•
Coherence of planning. Furthermore, in other aspects of internationalisation, institution‐wide planning and involvement of the highest level of executives are not evident. Although TNE started as a devolved activity, the current situation is much improved with institution‐ wide planning and monitoring but this is yet to happen in other areas of internationalisation. For example, internationalisation of curriculum and research much depends on the departments and faculties. That also has contributed to inadequate attention to those dimensions in the whole of institution analysis.
•
Visibility. Australian operations overseas are much more open to international scrutiny than domestic operations, so getting them right is particularly vital for the reputation and health of the institution and the Australian HE sector in general. In consequence, the quality of TNE is of great importance to the Australian sector and to the national quality assurance body
•
Federal government attention. For the second half of the first audit cycle, the Federal government provided AUQA with a special purpose grant to permit AUQA audit panels to visit a greater number of TNE operations, at no cost to the auditee. (These funds are also supporting additional training programs for AUQA auditors on TNE issues and increased bilateral activities with other quality assurance agencies.) The government is likely to continue its concern for and attention to the evident achievement of quality and standards in this area.
Despite the many cogent reasons for a high level of attention to TNE work, AUQA has been criticised for spending more time on this area than on the experience of international students onshore. 3.5
The future
For all these reasons, international activities will continue to be important to Australian institutions of higher education, and therefore to AUQA. The second cycle of audits of universities will concentrate on two areas or ‘themes’ in each university, and will pay greater attention to the standards actually being achieved by the institutions. For most university audits in 2008, internationalisation will be one of the two themes, and so standards of
11
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
international activities will be closely scrutinised. Without diverting attention from TNE, it is likely that the quality systems surrounding onshore international students will be given greater prominence. Cycle 2 audits will also follow‐up how institutions have made progress after the Cycle 1 audit and, therefore, areas that need further improvement including internationalisation. 3.6
Summary
This Report draws on the totality of the audit reports, not merely the Commendations, Affirmations and Recommendations (CARs). However, focusing for the moment on those, the most highly mentioned areas were: •
Quality assurance systems for international programs
•
Standards and quality of offshore teaching
•
Services to international students, and
•
Internationalisation strategy.
These headings include English language issues; and academic and general staff professional development, as well as the use of agents and the pedagogy of offshore teaching. Among the sub‐themes that had a high number of citations, ‘services to international students’ emerges as an area of commendation while ‘quality assurance systems for international programs’ and ‘internationalisation strategy’ emerge as areas that need improvement. ‘Standards and quality of offshore teaching’ was high on both Commendations and Recommendations, implying that audit panels have found both areas of weaknesses as well as exemplary practices in this aspect. The findings from the audit reports show many good practices, many opportunities for improvement, and actions being taken by universities to implement such improvements. Overall, areas that appear to need more attention are: management of off‐campus academic programs; monitoring of offshore partners; clarity in lines of responsibility and accountability; systems for review of transnational programs; internal audit reporting regarding international arrangements; staff orientation; policies governing entrance and advanced standing; and consistency in standards. The reports indicate that partnership activities that are well managed in respect of maintaining educational standards have a highly professional operation grounded in several key concepts: •
all enrolment decisions are made at the Australian institution
•
when distance education is used, it is based on the provision of excellent materials
12
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
•
provision of support staff of the Australian institution who are highly regarded by students, dedicated to the offshore activities
•
provision of staff of the overseas partner who are professional, competent, well‐versed in the character of the Australian institution, and well‐supported
•
all assessment is conducted by the Australian institution, and
•
there are explicit mechanisms for cross‐mode and cross‐location consistency in admissions, curriculum, teaching and assessment.
13
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
4
Findings on internationalisation from the audit reports
4.1
Increasing attention to internationalisation
Universities are responding to globalisation by enhancing the international dimension of teaching and research, having international staff and students, and facilitating the international experience of their students and staff abroad, a process often known as internationalisation. Universities have drawn their approach to internationalisation in alignment with their vision, goals or strategic plans and made explicit statements about their international focus. The portfolios submitted by the auditees and the audit reports contain statements of vision or goals or strategies such as ‘The university will further enhance its position as a university of high standing in the international community of scholars’. Another one wants to be ‘… Australian in character yet international in perspective …’. ‘A strong international focus in all activities’ is the goal of another university. Yet another auditee seeks to be ‘a borderless university in an increasingly global society’. These explicit statements were fewer a decade ago and might have gone buried under many other competing priorities, but due to the increased attention to internationalisation, these priorities have come to the forefront. 4.2
Internationalisation strategies
In general, universities have an internationalisation strategy with varying foci. (The progress report from one institution that did not seem to have an internationalisation plan at the time of audit, in spite of its international focus, indicated that it had acted on that Recommendation). A few which did not have internationalisation written into their vision or mission had at least strategic objectives related to international focus. Australian universities seem to be aware of the wider implications of internationalisation and, consequently, the internationalisation plans include aspects such as internationalising the curriculum and research, staff exchange, student mobility, and cultural variety, as well as developing educational markets, attracting international students, establishing teaching partnerships, etc. However, the emphasis on the various aspects of the definition varies significantly.
14
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
One of the auditees defines internationalisation in terms of the following objectives: 1.
Strengthening the university’s teaching and learning programs by broadening their scope, internationalising their curricula and employing quality staff with international experience and expertise
2.
Fostering active and productive international research networks for the benefit of the university’s researchers and the enhancement of its research programs
3.
Providing high‐quality education, including research training, to qualified international students for their benefit and as a mechanism to enhance the educational experience of Australian students
4.
Collaborating in making the research and intellectual resources of the university available to overseas researchers and institutions and to projects and communities overseas and
5.
Increasing Australian students’ exposure to international issues and international education through study abroad opportunities.
The Strategic Plan of another university identifies the following priority goals: 1.
Develop international exchange and student mobility as a normal expectation for studying at the university and develop academic programs in each Faculty that include an international placement.
2.
Optimise opportunities for postgraduate students to engage in highly strategic research collaborations with leading international universities and research institutes.
3.
Create new opportunities for academic and general staff to collaborate and participate in exchange programs with selected foreign partner institutions in order to deepen our international relationships and foster a global outlook amongst our staff.
4.
Develop new and effective strategies to attract to our permanent staff the best researchers from the world’s most prestigious institutions to strengthen further our international research profile and standing.
Some of them have specific targets to be achieved within a timeframe such as the following: •
A 10% increase in international students enrolled in undergraduate and postgraduate courses by XX;
•
A 100% increase in the number of students in international student exchange programs by XX;
•
Approximately a four‐fold increase in the number of short‐term, fee‐ paying exchange and study abroad students by XX; and
•
Approximately a 100% increase in the number of international students enrolled in on‐line and offshore courses by XX.
15
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
It is clear from these projections and approaches that internationalisation is becoming a strategic priority for Australian universities. In their pursuit of internationalisation, the universities plan to take up a suite of strategies and initiatives such as: ‘…through engagement in the offshore delivery of courses, the enrolment on campus of increasing numbers of international students, participation in voluntary and aid projects overseas and by having our Australian students go abroad as part of their study,…’. Another university says that in pursuing its goal of internationalisation it will: •
ensure local, national and international community recognition of the contributions made by the research, development and scholarly activities of students and staff;
•
identify, encourage and reward contributions to international activities by students and staff;
•
establish a system of international benchmarks within selected disciplines and activities designed to demonstrate and test the quality of performance in all areas of the university;
•
foster the expansion of strategic international alliances providing enriched learning, research and cultural opportunities for students and staff;
•
identify and develop focused international programs which enhance the function and international image of the university;
•
ensure optimal collaboration within the university in international ventures; and
•
position itself as a key provider of educational programs, applied research and consultancies in partnership developments within the Asian region.
In relation to internationalisation another university says that it will: •
promote cultural sensitivity and understanding among staff and students
•
advance international partnerships in research, scholarship and professional programs
•
provide the opportunity for all students to engage with and learn from a multicultural context in their studies and social interaction
•
support the diversification of the student profile
•
review and enhance the quality of our relationships with academic offshore partners.
Yet another Strategic Plan includes ‘confirming and strengthening the university’s market identity and raising the international profile of the university through strategic international partnerships and alliances’ and ‘enhancing the university’s reputation as a provider of flexible distance education offshore’.
16
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
While the strategic plans for internationalisation have significant action points many of them do not provide clear rationale or parameters for international activities. Audit panels have advised that priorities for international activities should be derived from a comprehensive analysis of the academic quality and reputational risks to which the universities were being exposed. Audit reports include the following Recommendations on internationalisation strategies: AUQA recommends that the University determine its desired direction in respect of its international activities and finalise its incipient internationalisation plan. AUQA recommends that the University clarify its strategy with respect to internationalisation, identifying priority objectives, targets, benchmarks and associated resource implications, and clearly specify the expected outcomes. AUQA recommends that in order to achieve its aims in internationalisation in teaching, research and service, the University identify more specific performance indicators and targets, and strategies for achieving them. AUQA recommends that the University pay special attention to reviewing the financial viability and strategic directions of its existing and any new offshore initiatives, and that the University communicate to relevant stakeholders its planned path, scale and ultimate profile for the further development of its International Education program. AUQA recommends that the University develop a quality assurance plan in respect of its international activities that includes,... AUQA recommends that in finalising its Strategic Framework for Internationalisation, the University clarify the strategy’s role in identifying priorities with regard to locations and modes of operation abroad, the likely effect on the University’s international student recruitment in Australia and consider how the University might more effectively harness the considerable market intelligence available from its own staff and from its various partners. 4.3
Understanding internationalisation
Institutions have defined internationalisation in different ways. One of the auditees defined it as ‘the process by which the university promotes and facilitates international perspectives and activities among staff and students, with a view to integrating the university and its programs into global developments’. In some cases, the definitions were not yet generally accepted by staff, and staff understanding of the broad context of internationalisation was lacking. While the strategic plans identify very broad values of
17
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
internationalisation and link them to mission statements, interpretations vary and ‘lack of clarity’ about internationalisation strategies has been mentioned in a number of audit reports. The audit panels recommended that further attention be paid to identifying an agreed definition of what is meant by the term ‘internationalisation’ and that this then be promulgated widely. In their portfolios some institutions focused their attention on offshore provision, rather than internationalisation more broadly. If this is the institution’s defacto definition of internationalisation, panels quite properly concentrate on that aspect. Consequently, the comments made in those audit reports related more to TNE aspects than to other activities under internationalisation. The focus of Recommendations in the audit reports on understanding internationalisation is generally as follows: •
Clarify/develop better understanding of the concept of ‘internationalising’, also regarding internationalised curriculum and inform staff
•
Finalise international plan, monitor progress against objectives and identify specific performance indicators and targets for internationalising teaching, research and service
•
Clarify the strategy’s role in identifying priorities with regard to locations and modes of operation abroad, the likely effect on the university’s international student recruitment in Australia and consider how the university might more effectively harness the market intelligence available from its own staff and from its various partners.
•
Clarify the locus of responsibilities for international activities so that all within the university understand where responsibility lies.
Audit reports also contain a range of Recommendations for universities on developing an agreed interpretation of ‘internationalisation’ within the university: AUQA recommends that, in developing the Internationalisation Master Plan, further attention be paid to identifying an agreed definition of what is meant by the term ‘internationalisation’ at the University and that this then be promulgated widely. AUQA recommends that the University continue and extend its program of education to develop a general understanding of internationalisation, and to draw attention to the meaning and significance of an internationalised curriculum. AUQA recommends that the University develop a ‘Statement of International Purpose’ to support and integrate the understanding of internationalisation more effectively into the activities of the University.
18
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University pay special attention to reviewing the financial viability and strategic directions of its existing and any new offshore initiatives, and that the University communicate to relevant stakeholders its planned path, scale and ultimate profile for the further development of its International Education program. 4.4
Supporting and coordinating internationalisation
Divisions and schools of the auditees are supported in their international activities by many internal structures. In one of the auditees these included an International Strategy Group, an International Policy Committee, an International Marketing Committee, 15 Country Reference Groups (each responsible for one main geographic area of interest), divisional committees, International Students Advisory Group, International Fees Working Group, International Office, Pro Vice‐Chancellor (International & Enterprise), and divisional co‐ordinators. Compared to the institution‐wide support available for internationalisation five years ago there are more dedicated, systematic support structures available now. In addition to the increase in the committees and structures that support internationalisation, involvement of senior executives whose position title includes the word ‘international’, such as Pro Vice‐Chancellor (International) is also increasing. Success with internationalisation is highly variable among the auditees and within institutions mainly due to lack of coordination. Universities give various reasons for the attention to internationalisation that included: •
To position the university as a major international institution
•
To be profoundly and increasingly engaged within the Asia‐Pacific region across the full range of the university’s responsibilities, including undergraduate education, research and research training, and civic and community service
•
To strengthen the brand value of the university
•
To open up access to university courses to students from other countries
•
To enrich and broaden the experiences of its staff and students
•
To help further develop cultural awareness
•
To enrich the local communities
•
To broaden the revenue base of the university, and
•
To contribute to the development of transnational education.
However, many of the staff interviewed in audits were unclear why their institutions were engaged in certain international activities and precisely how those activities were intended to reinforce the core teaching and research. The audit panels have commented that, in part, this was a consequence of the international activities being pursued in an uncoordinated manner.
19
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Some auditees claimed that internationalisation was mainstreamed. However, in practice the audit panels found only nodes of leadership centrally and also within faculties. Communication between these levels seemed to be lacking, resulting in lack of clarity in coordination of activities, targets and strategies. There was some uncertainty within the universities as to where the locus of responsibility for some aspects of the international activities rested, and the panels commented that this was a matter that needed to be clarified without undue delay, especially considering the ongoing strategic significance of this area for many universities. This again is an example of the coordination issue. Many institutions were in the process of restructuring their units that handled international activities, a move which in part was due to the recommendations of commissioned external reviews of the operation of their international activities. The audit panels have commented positively that when these things settled down, there would be better coordination in the various institutional efforts regarding internationalisation. The audit reports have Recommendations on supporting and coordinating internationalisation as follows: AUQA recommends that the University, through the University Institute for Higher Education or otherwise, ensure that academic staff are supported in its objective of internationalising not only course content but also their approach to teaching. AUQA recommends that the University implement the recommendation of its 2002 Internal Audit Report and develop guidelines and procedures relating to the implementation of international arrangements. AUQA recommends that the University ensure that it has the means to monitor progress towards the achievement of all its internationalisation objectives. AUQA recommends that the University clarify the locus of responsibilities for international activities so that all within the University understand where responsibility lies. 4.5
Internationalisation of the curriculum
Many auditees aim to incorporate a national and international dimension into their academic offerings. Within institutions, divisions and schools tried to translate their intention to introduce an international perspective in courses. Some schools introduced units with an international focus, but the evidence was strong only in some course offerings. A coherent central policy and approach to internationalising the curriculum often seemed to be missing. However, the audit panels found some significant instances of internationalisation of the curriculum and commented on instances of the
20
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
curriculum being refined to incorporate international aspects. Examples of courses being tailored to reflect cultural sensitivities and international perspectives, including contextual case studies and culturally sensitive debates on various legislations, were evidence of this attention. Some auditees list cultural diversity as a graduate attribute and used internationalisation of curriculum as a means to inculcate this attribute. One auditee in its Learning and Teaching Report discussed its initiative that involved developing subjects and courses that contribute to an appreciation and valuing of international models and perspectives within a discipline. A Cultural Inclusivity Working Party and the development of an international minor (to the bachelors degree) involving 24–28 credit points were a few other strategies in place. The audit panels found some evidence that attention to foster greater interaction between Australian and international students was increasing. In one of the auditees, at the doctoral level, it was anticipated that most PhD candidates would spend about six months of their studies in other countries. Already, strategies were being pursued to enable this, such as cotutelle arrangements with a number of French universities, and the audit panel recognised that it would take some time for the university to fully realise this intention. Another auditee was aiming to develop a shared view across both higher education and its Technical and Further Education (TAFE) activities of ways in which the concept of internationalising the curriculum can be defined. This institution had developed a guide that provided some advice to staff, and information on resources in regard to meeting the needs of international students, internationalising the curriculum and equivalence in onshore and offshore programs. Other initiatives that were being taken by the university included diversity workshops, a new Bachelor of International Studies, efforts to map the current strategies and approaches to internationalisation of the curriculum at the Faculty/School level. While the strategies all appeared positive, there were as yet no measures of success. It is probable that the universities have made considerable progress, and the panels advised that development of measures would greatly assist with the further management, promotion and exploitation of internationalisation initiatives. One example of an audit report Recommendation on internationalisation of the curriculum is: AUQA recommends that the University continue and extend its program of education to develop a general understanding of internationalisation, and to draw attention to the meaning and significance of an internationalised curriculum.
21
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
4.6
Student and staff exchange
Australian universities have study abroad and student exchange programs whereby domestic students can pursue study opportunities at partner institutions in other countries. Most of them have specific plans and targets to promote these programs. In the case of one auditee, it is one of its priorities ‘to provide all students with an international perspective either through study tours or study abroad opportunities, from interactions with foreign students and international teachers on campus in Australia and through an internationalised curriculum’. In most cases, the level of uptake is well below the available opportunities. The universities do not yet have a means for assessing the impact of study abroad and student exchange on student learning outcomes. While the availability of the programs has been satisfactory, it is clear from the audit reports that there was considerable scope for improvement in terms of embedding these programs into the university experience. The study abroad/exchange students bring many opportunities to enrich the international dimension of the campus with their international experience and the Australian universities aim to build actively on the multicultural dimension of the campus community. One of the auditees had student exchange and study abroad agreements with 129 institutions in 27 countries. In one of the semesters in 2003, the university had 9.5% of the national study abroad enrolments. The study abroad/exchange students tend to come from different geographic regions (mostly United States and Europe) than the full‐time student enrolments (mostly South East Asia), and the universities acknowledged the importance of these schemes for exposing domestic students to a wide range of cultures. The difficulties the study abroad/exchange students face in culturally acclimatising to living and studying in Australia has been noted by the audit panels. Australian universities support sending Australian students abroad and receiving foreign students by a number of activities. Typically, universities set up a number of institutional cooperation agreements with institutions in other countries and establish academic and research partnerships; some with longstanding reputation. Some universities have well established protocols for the establishment and management of international cooperation agreements. For example, one of the auditees requires all agreements to be approved by the Deputy Vice‐Chancellor (International & Development), and they are monitored by regional reference groups within the university. Partner institutions are regularly visited by members of senior management to consolidate relations and to receive progress reports on existing partnerships. As a strategy to facilitate the exchange of students and to attract high numbers of foreign students some universities have obtained international accreditation of courses or areas where it is relevant. Accreditation under
22
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
EQUIS and AACSB (Association to Advance Collegiate Schools of Business) are examples of international accreditation. Optional overseas study opportunities in some courses enable students to undertake a six‐week placement in the United States Government, and final year medical electives being taken offshore are a few specific forms of encouraging study abroad. Scholarships and financial support for exchange programs is another evidence for institutional commitment to internationalisation beyond recruitment of fee‐paying international students. One of the auditees offered funding of $100,000 for up to 50 exchange agreement scholarships each year. The audit panel commented that this was an impressive commitment to the exchange agreement program, creating significant opportunities for a considerable number of students. Another audit report commented that the university had already allocated $500,000 for travel grants during that year for student and staff. To enhance opportunities for study abroad programs, one of the auditees organised an exchange fair. Membership in networks such as the International Network of Universities also facilitates staff exchanges. Universities recognise that mobility entails a significant cost. Institutions that had a stronger emphasis on internationalisation have been advised to establish appropriate structures and monitor the financial support needed to reach their targets. Overall, the audit panels found that the support for student exchange programs has been managed well by the universities but the uptake needs improvement. Audit reports contain the following Commendations on student and staff exchange: AUQA commends the University for providing strong backing for its exchange agreements, thereby supporting its teaching and learning goals. AUQA commends the University for its internationalisation activities through XX and in particular for its student exchange programs and support of international students. AUQA commends the University for its support and management of periods of international study experience for Australian students through either the International Exchange Student Scheme or the Bachelor of Arts in International Studies. 4.7
Internationalisation of research
The audit reports revealed that many Australian universities enjoyed and contributed to international research networks. Most of the research plans
23
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
have an international dimension. For example, one auditee had a strategy to: ‘Build prestigious international alliances with key research‐led universities that embrace teaching and research, student and staff exchange, and other links’. Nonetheless, many auditees did not have specific strategies at the level of the international projects. Most of the international research partnerships depended on individual researchers or research groups. Each research group chose its particular ‘end market’, and thus, the process was driven from the bottom up. Overseas academics come to the Australian universities, on sabbatical visits, as members of advisory boards, and so on and this strengthens the internationalisation of research. One of the universities had an ‘innovator in residence’ from overseas for three months. 4.8
International benchmarking
The audit reports commented on a number of benchmarking initiatives the Australian universities had with appropriate partners nationally and internationally. Membership in significant international consortia and memoranda of understanding that offer the potential for international benchmarking have been noted. However, it was not evident to the panels that the universities had obtained particular benefit from these opportunities. At the faculty level, there were many benchmarking activities with international universities and organisations. These tended to be mostly informal, although very helpful. One of the auditees had an objective to ‘establish a system of international benchmarks within selected disciplines and activities designed to demonstrate and test the quality of performance in all areas of the university’. The audit panels suggested that the universities look for good practice amongst their localised benchmarking activities with a view to identifying approaches that could be more systemically adopted. Another auditee, on the basis of similarity in size, vision, status and location, developed a research partnership with another international partner. It also had a target to establish systematic benchmarking of research performance for the whole university against all other Australian universities and selected universities in the United Kingdom, United States and New Zealand. The audit panel believed that in addition to the specific benchmarking initiatives mentioned above, and any internal benchmarking activities already underway or planned, the university could benefit from benchmarking itself strategically, and more widely against another highly regarded international university closer to home, ideally one which is also similar in ‘size, vision, status and location’ and with shared aspects of academic profile.
24
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Some universities have participated in an Australian trial of the MaXemizE benchmarking project. This assesses the marketing performance of the participating university against 22 United Kingdom universities. The overall impression one gets after reading the audit reports is that, in practice, internationalisation often tended to be understood in terms of attracting international students and the benefits of internationalising curriculum, teaching and research have not been fully understood. The universities should now broaden this view. Auditees themselves acknowledge that they are currently in transition from ‘an opportunistic phase’ to a more ‘strategic and planned’ phase in the evolution of their internationalisation plans.
25
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
5
Findings from audit reports on international students onshore
Many universities are looking to international student recruitment to overcome the limited growth available in local HDR enrolments. For that reason, among others, issues related to international students on campus are of increasing importance for the Australian universities in both research and teaching. 5.1
Recruiting international students — the use of agents
With respect to the recruitment of international students, the international plans of many universities have clear targets and strategies. One of the universities aims to ensure: ‘that there is a critical mass of appropriately qualified international students in all undergraduate programs and in relevant postgraduate programs’. Some institutions have IDP Education as their exclusive offshore recruitment agency for international students, while others use other agents. Universities are looking to make improvements to their processes for recruiting and inducting international students. These include the trialing of real‐time online orientation conferences for prospective students and their families in key locations in order to ensure that students have all the information they need prior to commencing with the university. The universities are also concerned to improve their quality assurance processes for reviewing and verifying the quality of international student recruitment agents. Choosing a satisfactory agent in each country and facilitating sharing of experience and information with other potential agents for any new ventures was commended as a good practice of one institution. One of the auditees that used a number of agents in other countries to assist with recruitment commenced a practice of bringing these agents to the university for orientation briefings in order to improve the effectiveness and quality of their recruitment activities. All prospective agents were subject to probity checks prior to appointment. The audit panel commended the university for these practices. Very few institutions had formal mechanisms to measure the performance of agents and to use the appraisal in their re‐appointment. Monitoring whether agents follow the contract/agreement on responsibilities was still a grey area. The contractual relationships with agents offshore included a mix of highly successful and somewhat unsuccessful partnerships. The audit reports indicate that a more formal due diligence process could be undertaken prior to entering into a partnership, and that periodic reviews could be built into the agreements.
26
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Audit reports have various Commendations on the use of agents: AUQA commends the University for its thorough process for appointing international student recruitment agents. AUQA commends the University for its new practice of inducting offshore agents to help assure the quality of the recruitment process. Audit reports also contain recommendations on the use of agents: AUQA recommends that the University establish and implement a specific system for assuring the quality of all its programs delivered offshore, including (inter alia): a robust process of due diligence for partners and agents; quality controls for translation services; comparisons of learning outcomes for students in offshore and equivalent onshore programs as one indicator of equivalent quality. AUQA recommends that the University explore opportunities for integrating and sharing evaluative information with its offshore agents. 5.2
Supporting international students
With respect to the support of international students, the international plans of many universities have clear targets and strategies. One of the universities aims to ensure: that international students’ views on their teaching and learning experiences and the quality of student support services provided to them are sought on a regular basis and that this is part of the continuous quality improvement process so that any problems are addressed. The universities are proactive in identifying and responding to the support needs of onshore international students, and addressing risks to the success and satisfaction of international students. Structures include the Educational Services for Overseas Students ( ESOS) Advisory Groups, International Offices, units within the office of the Pro Vice‐Chancellor (International), and the like. Provision of educational services to international students and the level of support have been commended in many reports. A mentor program, information services provided to international students, use of data from survey of international students to reduce attrition rates, and other proactive measures have been noted by the audit panels. On‐campus international students met by the audit panels felt generally well supported. Many universities are projecting an increase in the number of on‐campus full‐fee paying international students and from an increasingly diverse range of source countries. Current management systems and resourcing will need to be examined in order to meet these increased demands.
27
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Audit reports indicate that international students coming to Australia are well advised before arrival about the different services available, and where to go for help. The same information is then provided again after arrival. The structures and units that manage the operations of the international students evaluate their services and the emerging needs of international students through surveys and focus groups. Many of them have representatives on the student advisory committees. There are many examples of action on feedback and the international students are able to make an impact on improving their learning environment. However, the situation is not so positive with TNE students. Audit reports have Commendations on support services provided to international students as follows: AUQA commends the mentor program for international students at the University as an effective means of supporting international students. AUQA commends the University for the Excellence in Cultural Experiential Learning and Leadership program. AUQA commends the University for the information and support services it provides to international students. AUQA commends the University for the level of support it provides to international students at its campuses in XX. AUQA commends the University for being proactive in identifying and responding to the support needs of onshore international students, for example via the ESOS Advisory Group. AUQA commends the University for the efficient organisation and effective implementation of international student services, which are successfully delivered through the complementary provision of central and faculty level support. AUQA commends the University for its Global Opportunities Program which is highly valued by students, and through which participants are well supported. AUQA commends the University for its Homestay Program, which places English Language Program students with families in the region and is supported by robust quality assurance processes.
28
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Audit reports have the following Recommendations on support services provided to international students: AUQA recommends that the University review the system in place for ensuring that students in transnational programs are aware of the University grievance procedures, and that those procedures are able to be effected. AUQA recommends that in light of its plans to increase the number and cultural diversity of its on‐campus international students, the University develop a fully planned, integrated and resourced approach to service delivery to these students. AUQA recommends that the University improve its planning and focus in the area of international student recruitment, with some reference to its own identified ‘near Asia’ region. AUQA recommends that, in finalising its Strategic Framework for Internationalisation, the University clarify the strategy’s role in identifying priorities with regard to locations and modes of operation abroad, the likely effect on the University’s international student recruitment in Australia and consider how the University might more effectively harness the considerable market intelligence available from its own staff and from its various partners. 5.3
English Language proficiency
English language entry standards and language support are important for ensuring that students who enter a course of study are reasonably able to participate in their studies and complete them. English language entry requirements are usually specified by universities against IELTS or TOEFL test scores, or equivalences for direct entry programs. One auditee ensures that its entry standards are adhered to by certain safeguards and codification in the data system, so that warning flags will be raised if students are entered into the system without the necessary entry requirements being evident. The audit reports noted a view among some staff and Australian students that many international students or others with English as an additional language were not adequately competent in English to work effectively in groups on tasks that would be assessed. Recognising that this is a culturally complex issue that involves a blend of fact and perception, the audit panels have generally suggested that the universities identify and consider strategies for addressing the cultural implications of a growing number of international and permanent resident students in the universities’ learning communities.
29
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Audit reports have a small number of Recommendations on English language proficiency: AUQA recommends that the University reconsider the application of its English language entrance standards in light of the overall demands of the teaching, reading materials and assessment methods. AUQA recommends that the University ensure sufficient level of English proficiency for the entry of NESB international students into all programs, but particularly those in China. 5.4
Cultural acclimatisation
Aligned with the issue of English language proficiency is that of cultural acclimatisation. Universities have identified this as an ongoing challenge. Indeed, a report published by one of the universities identified cultural acclimatisation as a potential causal factor behind low progression rates of international students in some courses. Addressing this issue may require more specific ownership of the issues and focused strategies, to be effective in generating the desired changes. It ought also to be recognised that in the case of some Australian universities many staff are from other countries, so there is a high level of awareness of international issues in higher education. 5.5
International student progression
The data on student progress in certain institutions showed that international students had lower progression rates than domestic students. In such cases, although the universities had analysed the situation, the audit panels were not clear how those issues were being systematically taken up for follow‐up. There have been some good practices too. A study of comparative academic performance of international and domestic undergraduate students undertaken by one university showed that, during the period under study, the academic progression rates of international students surpassed domestic students at unit level. When the retention rates of international students were found to be statistically significantly lower than those for domestic students in a particular year, the institution made some improvements to the provision of student support services. It had plans to repeat this research and the panel endorsed this intention. One of the auditees collated examination results by funding type to investigate any systematic differences in student outcomes. These figures showed very little difference in pass rates between domestic and international students in Australia. In another institution, the audit panel sought, at random, a comparative analysis of the results of certain student cohorts. Specifically, it asked for a comparison of full‐fee paying students (almost entirely international students) with HECS‐liable students in the Faculty of 30
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Commerce. The report showed that the full‐fee students’ failure rate was significantly above HECS students. The audit panel did not conduct an exhaustive analysis of this phenomenon across all faculties or fields of study. However, as the Faculty of Commerce had the largest number of international students, it formed a view that there was an issue there for the institution to pursue. The potential for COGNOS to facilitate evidence‐based assessments of such issues was seen by the panel as an important capability for the institutions to monitor the progression of international students. Within institutions, there are examples of some schools monitoring the comparative progress of students in the same courses in the domestic and international cohorts, which allows staff to be confident that students are performing to a generally equivalent level. This is not happening across all schools and panels have recommended that the comparative progress of students in different cohorts (whether on‐campus, off‐campus or offshore) be routinely monitored so as to ensure the equivalence of teaching onshore and offshore. One audit report recommendations on international student progress is: AUQA recommends that, as signalled in the Performance Portfolio, the University develop processes for the University‐wide annual review of the international student academic performance. Most benefit from this would be obtained if it were part of a broader, systematic review of teaching and learning outcomes undertaken by the Academic Board. Many of the Commendations and Recommendations on internationalisation are equally applicable to onshore and offshore delivery to international students. Because much of the focus in portfolios and therefore in audit reports was on transnational education, the following section includes matters which should be considered as important onshore as offshore, for example, professional development of staff to engage with international students.
31
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
6
Findings from audit reports on transnational education
Transnational higher or just ‘transnational education’ (TNE) refers to those programs offered by Australian universities and delivered through collaborative arrangements with offshore partners and at fully‐ or partly‐ owned campuses offshore. Current offshore activities of the Australian universities fall into one of four categories: •
Australian university programs being taught offshore wholly by university staff
•
university programs being taught offshore by a combination of university staff and others; a twinning program, with teaching of the program provided by staff of the partner organisation
•
articulation agreements, where students successfully completing the coursework of other institutions are awarded advanced standing into Australian university programs.
6.1
Rationale for TNE activities
Through one or more of these modes many universities are expanding their programs offshore. However, many audit reports indicate that the strategic plans for offshore expansion of many universities provided no rationale or parameters for the countries or regions in which they planned to operate. The plans did not include the preference for the modes of operation. Consideration of such issues became a part of the international marketing plan which was more commercial than academic in nature. Audit panels have commented that priorities for TNE activities should be derived from a comprehensive analysis of the academic quality and reputational risks to which the universities were being exposed. In practice, priority was being given to student numbers and financial outcomes which are only two elements of a bigger picture. Panels saw many instances where marketing plans identified various types of agreement that can be pursued but set no guidelines around the strategic imperatives for the development of these various forms of arrangement in various locations. Many staff were unclear why their institutions were engaged in offshore activities and precisely how onshore and offshore activities were intended to be mutually reinforcing. In part, this was a consequence of the TNE activities being pursued via a structural split such as a separate commercial entity of the institution.
32
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
In terms of planning and risk management, the audit reports imply that the universities were not taking full advantage of the accumulated knowledge and experience of their staff working transnationally nor of their international partners to develop an informed view of environmental factors that could affect the sustainability of its operations such as changes in foreign government regulation and so on. In other words, in most cases, the rationale for TNE, if other than commercial, was not clear to the campus community and consequently not convincing to the audit panels. One audit report Recommendation on the rationale for TNE delivery states: AUQA recommends that the University identify and implement ways to promulgate information about the University’s TNE operation amongst its staff, students, and other stakeholders more effectively. 6.2
Quality Assurance for TNE programs
The audit reports indicate that institutions had a reasonably well developed quality assurance framework (QAF) in place in the case of domestic operations. There are many Commendations about the overall framework and the Recommendations are mostly about implementation and monitoring. Compared to the audit conclusions on quality assurance of operations within Australia, the offshore programs received more Recommendations on basic quality assurance arrangements. The quality assurance arrangements for transnational activities seemed to range from excellent to poor. The arrangements varied a lot with partners having highly variable levels of involvement. The general picture that emerged was that a university’s usual quality assurance system did not necessarily suffice for its transnational activities. Guidelines of different types to monitor TNE were being developed. But audit panels commented that although systems had been established, the principles were not being met in all instances. In particular, active involvement of Academic Board in monitoring the quality of courses delivered offshore and assuring equivalency with the onshore courses was not apparent. In many cases where an International Office had become established, it took a lead in developing, in collaboration with the Academic Board, a quality assurance framework within which the offshore activities took place. Some institutions had established and implemented systems of thorough and constructive set‐up checklists and reviews for their teaching programs offshore. Some of them had country reference groups with different levels of responsibility and decision‐making. Recommendations in audit reports are mostly about establishing models for contracts and due diligence/operation of all offshore programs, including
33
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
provider/partner and agent agreements, academic standards, translation services, evaluation of learning outcomes and quality of teaching. Many institutions handled the offshore operations through commercial arrangements/units. The need to clarify lines of responsibility and accountability and role of Academic Board compared to commercial units that handle offshore activities found a mention in the audit reports. The reports reveal that there were instances where the balance between commercial and academic perspectives had not been ensured adequately, leading to gaps in the procedures for approval and review of transnational programs and in monitoring the implementation of those programs. The Recommendations drew attention to the need for principles to guide the development, management and monitoring of transnational programs and the maintenance of consistent and appropriate admission standards. Audit reports include many Recommendations on quality assurance for TNE programs, as the following extracts demonstrate: AUQA recommends that the University develop a comprehensive system for deciding which offshore activities to engage in, for planning, implementing and controlling them, and for incorporating an effective quality assurance system. AUQA recommends that the University ensure that a comprehensive framework for the quality assurance of its courses offered through XX be implemented without delay. The University has recognised the need for this framework and is in the process of constructing a suitable action plan. AUQA recommends that the planned development of an overall framework for quality assurance of the University courses delivered offshore be undertaken and implemented. AUQA recommends that the University establish and implement a specific system for assuring the quality of all its programs delivered offshore, including (inter alia): a robust process of due diligence for partners and agents; quality controls for translation services; comparisons of learning outcomes for students in offshore and equivalent onshore programs as one indicator of equivalent quality. AUQA recommends that the University’s Academic Board resolve, with urgency, the accreditation status of the courses being offered through XX and that the current academic and professional accreditation status of these courses be made clear to students. More generally, the Academic Board should assure itself that its decision‐making processes with regard to all the University’s courses offered offshore are sufficiently robust.
34
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University establish a more comprehensive framework for the quality assurance of its offshore activities, perhaps overseen by a high level University committee. AUQA recommends that the University draw upon its successes in transnational education and the availability of supporting resources, such as cultural awareness training, to develop a comprehensive quality assurance manual that will be a key resource for other Schools seeking to establish transnational programs. AUQA recommends that the University strengthen its quality assurance system for transnational education, including approval of marketing and promotional materials, student support processes, student orientation and evaluation of offshore teaching staff. AUQA recommends that the University reconsider the approach to offering transnational award programs to ensure that the University reputation is strong and that quality is assured in practice. AUQA recommends that the lines of responsibility, accountability and authority in the management and quality assurance of offshore teaching programs be clarified as a matter of urgency and that the University ensure that its quality assurance procedures for offshore partnership programs are consistently implemented. AUQA recommends that the University revise its quality assurance arrangements for programs taught offshore to include explicit guidance on the strategic selection of offshore partners, a requirement for explicit consideration of the ways in which equivalence will be achieved, and a requirement for comparisons of success among different student cohorts. AUQA recommends that the University satisfy itself that requisite host country approvals are in place for the MBA program offered in Malaysia, taking into account planned changes to the program that may bring into question its status as an online program. Further, that the University review admissions processes and partner procedures to ensure that appropriate entrance standards are being maintained, and there is adequate validation of applicant information. AUQA recommends that the University take immediate steps to address the fundamentally unacceptable situation with respect to the unauthorised offering by XX of a full‐time XX program and in particular, that it urgently undertake a detailed audit of the records associated with the students who have been enrolled in this offering of the XX via XX, prior to deciding on their individual academic status.
35
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University ensure that it has effective mechanisms to monitor the operations of its offshore programs, that they are well aligned with their own stated objectives, continue to meet the expectations of their partners and are in compliance with the terms of the contract. It is further recommended that, in relation to the postgraduate program offered at the XX, the University immediately address the program problems raised by students. AUQA recommends that the University undertake a major review of the quality assurance systems in place for the design, approval, delivery and review of transnational programs, including in the scope of the review the respective roles of the Academic Board, International Committee and Entrepreneurial Committee, and also incorporating a detailed assessment of the effectiveness of quality assurance systems being applied in respect of the current and recently‐terminated transnational programs. 6.3
Coordination and consolidation
The trend to move away from a decentralised approach to a more centrally‐ coordinated approach to TNE operations can be seen from some audit reports. Establishing International Offices, assigning responsibilities to personnel to oversee the management of TNE at least in some aspects such as student recruitment and strategic alliances could be seen. However, for offshore teaching arrangements the picture that emerges is that it is managed at the faculty level and requires more coordination with the central administration. The need to recognise, support and coordinate more appropriately the work being undertaken by the various groups within the faculties with third party providers was mentioned in a few reports. Audit reports have the following Recommendations on coordination and consolidation: AUQA recommends that the University take immediate steps to ensure that it is fully aware of all offshore ventures in which students are enrolled with the University. AUQA recommends that the University draw upon its successes in transnational education and the availability of supporting resources, such as cultural awareness training, to develop a comprehensive quality assurance manual that will be a key resource for other Schools seeking to establish transnational programs. AUQA recommends that the University recognise and support more appropriately the work being undertaken by the various groups within the Faculty of XX and the Faculty of XX to develop and strengthen the entirety of the University’s activities with third party providers.
36
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University consider establishing an internal relationship between its various business‐related Masters programs in XX (specifically the XX, the XX and the XX) so as to consolidate the range of electives available, thereby providing a better quality of service to students, and that the University’s marketing materials clearly indicate, where applicable, that electives are offered subject to sufficient enrolments. 6.4
Awareness of obligations
The audit reports comment that, for most Australian universities, the institutional members working on TNE activities were aware of the commitments they had made to TNE students and legal obligations they had in partnerships. Many universities had conducted reviews and audits of their TNE operations and some of them ensured that all activities were compliant with certain requirements of the Educational Services for Overseas Students (ESOS) Act 2000 and with the provisions of the National Code of Practice for Registration Authorities and Providers of Education and Training to Overseas Students which they had voluntarily taken up to cover TNE as well. In the split management of TNE by commercial wings of the universities there were comments that the staff of the commercial unit that handled offshore operations management needed more awareness about these obligations. 6.5
Educational collaborative partnerships
Some institutions have been commended for the detailed procedures and guidelines they had in place to choose and induct partners. One of the auditees had a mechanism to check prospective partners through a Country Reference Group, to ensure that these providers are not of low standing in their own country. However, in most cases this was an area that needed improvement and the institutions were advised to give more consideration to identifying credible and reputable partners. Very few institutions had formal mechanisms to measure the performance of partners and to use the appraisal in their re‐appointment. Monitoring whether the partners follow the contract/agreement on responsibilities was still a grey area. While memoranda of understanding with offshore partners include expectations of the student support and facilities that the partner will provide (such as library resources, computers, text books and classroom equipment, including laboratory equipment), documented processes for ensuring these expectations were being met were not yet in place. Panels recommended that the universities establish robust systems for assuring themselves that the terms of agreements with offshore education providers were being met. Many reports note that limited numbers of personnel were involved in the decision‐making and review processes of the contracts and agreements. The agreements varied considerably and reflected different levels of delegation to the partner, but typically involved the provision by the Australian university of 37
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
course materials supplemented by teaching from tutorial staff employed by the partner. Given the fact many universities have plans to develop new offshore partnerships, effective procedures and tools will need to be further developed for the evaluation and approval of prospective partners as well as the existing ones. In light of the commitment made by many universities to ensuring that third party students are provided with equivalent student support and learning experiences as the on‐campus students such investigations must extend beyond financial probity. The audit reports indicate that many universities got into risks generally from inappropriate arrangements with third parties as a result of inadequate due diligence processes and poor business planning and management practices. This is an issue that many universities have acknowledged and consequently, they have developed plans to address this issue. There are institutions where the risk analysis does not include the offshore operations and offshore partners. Given the importance of partnerships to the international activities offshore, the audit panels suggested that the risk management should include consideration of the systems in place for managing relationships with offshore partners. That said, and on the basis of its sample, the audit panels found a number of partnerships with reputable offshore partners which are operating very successfully. In some cases, the partnerships have been successful for more than a decade. Some auditees have adopted the strategy of focusing on a few key partnerships — a strategy that evolved over time through experience – and the audit panels found that proved to be effective. Some auditees have been commended for the establishment of relationships, for offshore programs in particular, with various well‐regarded international institutions that can afford to be selective in their choice of partner. The audit panels have also noted the support extended by some auditees for certain developing countries, such as Timor‐Leste, with aid projects and research. Audit reports contain the following Commendations on partnerships: AUQA commends the University for its offshore international operations strategy of focusing on a few key partnerships, with robust quality assurance systems based on its ESOS manual, and strong partnership management. AUQA commends the University for the establishment of an effective partnership with XX, which has provided a strong framework for the provision of well‐supported award programs.
38
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA commends the University for some good examples of positive and well‐managed relationships with offshore partners which help enable the University to provide quality education to students overseas. AUQA commends the University for negotiating partnerships with some well‐regarded offshore partners, including the introduction of the Joint Management Committees to oversee relationship management; and for commissioning the Guthrie and Johnston reviews of TNE operations. AUQA commends the University for establishing and maintaining strong relationships in the delivery of offshore programs with several well‐ regarded international partner institutions. Audit reports contain numerous Recommendations on partnerships, as follows: AUQA recommends that the University review its management of partnerships, particularly with a view to: (a) improving mechanisms for assessing prospective partners; (b) integrating of quality assurance provisions, including periodic review, into the agreements; and (c) involving relevant academic staff in the above. AUQA recommends that the University establish robust systems for assuring itself that the terms of its agreements with offshore education providers are being met. AUQA recommends that the University clarify the respective roles and responsibilities of its own staff and staff of offshore partner organisations, with respect to responsibility for curriculum development and for quality assurance. AUQA recommends that the University establish effective communication mechanisms and ensure that robust quality assurance systems are in place for its operations with offshore partner organisations within the University Global Learning Network so that it has the means to ensure that the partner’s activities (as they relate to the University courses) are fully compliant with the University policy and practice. AUQA recommends that the University establish and implement a specific system for assuring the quality of all its programs delivered offshore, including (inter alia): a robust process of due diligence for partners and agents; quality controls for translation services; comparisons of learning outcomes for students in offshore and equivalent onshore programs as one indicator of equivalent quality.
39
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that following the recent establishment of pro‐ forma agreements to govern all future offshore operations, it is recommended that the University revise all existing agreements to conform to the new format and process. AUQA recommends that the University develop principles to guide the development, management and monitoring of transnational programs and partnerships, including probity and due diligence procedures and the maintenance of consistent and appropriate admission standards, including English competency. AUQA recommends that the University adopt a risk‐oriented approach in the scheduling of its evaluation of current third party providers and that it develop more effective tools for the evaluation of prospective third‐party teaching partners and agents and devise appropriate formal approval protocols. AUQA recommends that the University develop and implement a system for monitoring and reviewing offshore partnerships and programs that involves all key stakeholders and that is integrated into the other review processes of the University. AUQA recommends that in offering XX training opportunities in XX, including programs introduced for the school‐leaver market, the University examine with its XX partner the possibility of registering with the XX Ministry of Education and Training in order to gain designation as a ‘foreign university’s XX campus’. AUQA recommends that the University recognise and support more appropriately the work being undertaken by the various groups within the Faculty of XX and the Faculty of XX to develop and strengthen the entirety of the University’s activities with third party providers. AUQA recommends that the lines of responsibility, accountability and authority in the management and quality assurance of offshore teaching programs be clarified as a matter of urgency and that the University ensure that its quality assurance procedures for offshore partnership programs are consistently implemented. AUQA recommends that the University revise its quality assurance arrangements for programs taught offshore to include explicit guidance on the strategic selection of offshore partners, a requirement for explicit consideration of the ways in which equivalence will be achieved, and a requirement for comparisons of success among different student cohorts.
40
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University satisfy itself that requisite host country approvals are in place for the XX program offered in XX, taking into account planned changes to the program that may bring into question its status as an online program. Further, that the University review admissions processes and partner procedures to ensure that appropriate entrance standards are being maintained, and there is adequate validation of applicant information. AUQA recommends that the University develop a quality assurance plan in respect of its international activities that includes, inter alia, a model contract with partnerships, due diligence of partners prior to approving contracts, provision for program and unit approvals and regular reviews, communication systems with partners, ….. AUQA recommends that for the two courses offered with XX, the University ensure that delivery arrangements, student information and partner agreement provisions are consistent with arrangements for prior credit as stated on academic transcripts. AUQA recommends that the University ensure that it has effective mechanisms to monitor the operations of its offshore programs, that they are well aligned with their own stated objectives, continue to meet the expectations of their partners and are in compliance with the terms of the contract. It is further recommended that, in relation to the postgraduate program offered at the XX College, the University immediately address the program problems raised by students. 6.6
Marketing and promotion
Students’ early expectations of the quality of a university are formed, in part, by the promotional materials put to them. The audit panels consider a range of brochures used to promote onshore and offshore offerings to international students and investigate what promises the promotional materials make, how accurate they are and how well the university fulfills those promises. One of the difficulties for the universities in attending to the marketing materials is the complex structure for their recruitment activities. The majority of marketing and recruitment is conducted through agents or commercial partners. The universities need to clarify their procedures for approving offshore promotional materials, but the action required goes further. The universities need to develop clear standards for their promotional materials, and to introduce an effective quality assurance system to ensure that no materials can be released without having met these standards. Most of the agreements provide for the partner organisation to undertake marketing and promotion on behalf of the Australian institution, conditional on approval of copy content by the Australian university. When this formal approval process is not taking place routinely, there have been instances of ‘window dressing’ that gave ambiguous information to students. There is also
41
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
a risk that marketing material prepared in other languages may not be translated accurately and thereby make erroneous representations. Where the recruiting practices have been successful, clear alignment of strategic intent and practice can be observed. Audit reports have Recommendations on marketing and promotion as follows: AUQA recommends that the University take steps to ensure students are receiving accurate, consistent and sufficient information concerning the accreditation status of the programs in which they are intending to enrol, having regard to their local context and reasonable suppositions. AUQA recommends that the promotional material for the University degrees clearly state the different course structures in the different locations. AUQA recommends that the University’s Academic Board resolve, with urgency, the accreditation status of the courses being offered through XX and that the current academic and professional accreditation status of these courses be made clear to students. More generally, the Academic Board should assure itself that its decision‐making processes with regard to all the University’s courses offered offshore are sufficiently robust. AUQA recommends that the University strengthen its quality controls in relation to how it promotes itself and its programs, with particular emphasis on its promotion to international markets. AUQA recommends that the University develop, implement and monitor systems for effectively controlling all marketing relating to its offshore activities. AUQA recommends that the University ensure that its validation of courses of other institutions is unambiguously represented in all marketing materials as meaning only that those courses qualify for credit transfer for equivalent University units upon enrolling with the University. AUQA recommends that the University strengthen its quality assurance system for transnational education, including approval of marketing and promotional materials, student support processes, student orientation and evaluation of offshore teaching staff.
42
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University consider establishing an internal relationship between its various business‐related Masters programs in XX (specifically the XX, the XX and the XX) so as to consolidate the range of electives available, thereby providing a better quality of service to students, and that the University’s marketing materials clearly indicate, where applicable, that electives are offered subject to sufficient enrolments. AUQA recommends that for the two courses offered with XX, the University ensure that delivery arrangements, student information and partner agreement provisions are consistent with arrangements for prior credit as stated on academic transcripts. AUQA recommends that the University ensure that the meaning of the presence of the University crest on XX degree parchment (and within XX promotional materials) is unambiguously and clearly communicated to current and prospective XX students. 6.7
Admissions
Offshore enrolments are facilitated by the universities’ partners. In some partnerships, the partner collects all original documentation and forwards it to the Australian university for verification and processing. In other partnerships, the partner collects and verifies the students’ original documentation, and then forwards only the application to the Australian university for processing. In the case of the latter, it will be necessary for the Australian university to have in place a robust audit system to ensure that the original documentation is appropriately verified; the audit reports indicate that there were many instances where it was not apparent that such a system was in place. Many contracts and agreements with partners and agents indicate what the minimum number of student enrolments should be for a course to be financially viable and the numbers seemed indicative rather than fixed requirements. The panels endorsed the use of minimum enrolment numbers for financial purposes, but considered it to be crucial that the enrolment quotas are employed consistently across the overseas courses, and that admission standards are not lowered in order to fill the quota. Admission into a number of the Australian programs offshore involves the determination of advanced standing for enrolling students. Some universities are more generous than others, or are inconsistent in the amount of advanced standing they are prepared to give. Whether this approach is taken to be more competitive or to offer students an opportunity to demonstrate their ability to complete the course, universities owe a duty of care to students to ensure they are not disadvantaged.
43
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Audit reports provided these Recommendations on admissions: AUQA recommends that the University Academic Board review the University’s entrance criteria, including English language requirements, in accordance with relevant national and international standards, and asserts control over these criteria through a robust monitoring system. AUQA recommends that the University develop principles to guide the development, management and monitoring of transnational programs and partnerships, including probity and due diligence procedures and the maintenance of consistent and appropriate admission standards, including English competency. AUQA recommends that the University consider developing a risk identification and management process, prior to the commencement of teaching, for programs delivered in languages other than English. AUQA recommends that the University establish and implement a specific system for assuring the quality of all its programs delivered offshore, including (inter alia): a robust process of due diligence for partners and agents; quality controls for translation services; comparisons of learning outcomes for students in offshore and equivalent onshore programs as one indicator of equivalent quality. 6.8
English language issues
Most of the teaching and assessment undertaken at the partnerships is conducted in English (unless the program is conducted in another language). However, many students are from countries outside of the partner organisation’s base (e.g. students from China studying an Australian course offered by a Singaporean partner). Therefore the issue of English language competence has been explored by audit panels. There have been partnerships where the English language entrance standard for enrolment had been lowered in order to maintain a viable number of student enrolments. However, students cannot complete the course without reaching the required entrance standard and the partner assists the students with additional English language support and courses. The audit panels recognised this as a method for ensuring that the standards of degree programs are maintained, whilst also addressing obstacles to students in non‐ English speaking countries in accessing Australian higher education. This raises the fundamental question of whether the English language competence is required foremost as essential for undertaking the particular learning process, or is required as a learning outcome of the program. In order to know whether the method is educationally sound, the audit panels advised that it would be appropriate to compare the assessment results of students entering with different IELTS scores.
44
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
In another case, individual course coordinators were able to waive English language requirements. This was creating difficulties for students who were unable to cope with the demands of academic work. The university reviewed this practice, and ensured that any waivers of English language entrance standards required the approval of the Pro Vice‐Chancellor (Academic). The level of students’ English language competence has been a cause of tension among some staff and students. Universities have responded to this by actions such as increasing web‐based support resources in this area and additional support programs through language teaching centres. Audit reports have the following Recommendations on English language issues: AUQA recommends that the University ensure that it has full control of the entry of students to its onshore off‐campus programs. AUQA recommends that the University ensure that its policies governing entrance and advanced standing are implemented offshore using the same standards as onshore. AUQA recommends that the University Academic Board review the University’s entrance criteria, including English language requirements, in accordance with relevant national and international standards, and asserts control over these criteria through a robust monitoring system. AUQA recommends that the University develop principles to guide the development, management and monitoring of transnational programs and partnerships, including probity and due diligence procedures and the maintenance of consistent and appropriate admission standards, including English competency. AUQA recommends that the University satisfy itself that requisite host country approvals are in place for the XX program offered in XX, taking into account planned changes to the program that may bring into question its status as an online program. Further, that the University review admissions processes and partner procedures to ensure that appropriate entrance standards are being maintained, and there is adequate validation of applicant information. AUQA recommends that for the two courses offered with XX, the University ensure that delivery arrangements, student information and partner agreement provisions are consistent with arrangements for prior credit as stated on academic transcripts.
45
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
6.9
Teaching in languages other than English (LOTE)
Australian universities have developed program offerings in other languages in response to market demands and it demonstrates entrepreneurial leadership. Teaching in other languages brings in practices contrary to the normal practices of the Australian institutions. For example, the programs taught in languages other than English might have to be assessed by local offshore staff and be subject to moderation. The combination of this weaker method of quality assurance with the higher risks associated with teaching in another language makes this an area worthy of further consideration. In practice, this being new territory, inevitably institutions come across problems, and try to confront them and work through to a solution. One of the auditees took steps to resolve these problems, which included the reimbursement of students who were adversely affected by the unsatisfactory operation. It also involved appropriate exit strategies. It is an example of an institution’s quality assurance systems picking up a problem and finding a solution. In view of this experience, the audit panel recommended that the institution acknowledge the additional risks involved and pay close attention to ensuring that the system meets quality standards prior to full implementation and this holds good/valid for any other program in LOTE. Institutions have a range of arrangements to monitor the English language related issues and their effectiveness varies. With a few exceptions where institutions have good practices in place and are able to demonstrate improvements in English related issues and/or in relation to bilingual activities, most of the citations are about existing gaps in the arrangements. Audit reports give Recommendations on the following lines: • • • •
Consider risk management processes for teaching in LOTE Ensure appropriate entry level of English proficiency (especially from China) Review (Academic Board) control over criteria for English language competency levels Reconsider the application of English language entrance standards in light of the overall demands of the teaching, reading materials and assessment methods.
6.10 Pedagogy for offshore teaching Reconsidering the pedagogical models to place greater emphasis on equivalence of learning outcomes, assessing educational effectiveness of teaching models used offshore and developing a fully planned, integrated and resourced approach to offshore teaching find a mention as areas for attention. Contextualising materials and adding local examples and explanations to the essentially Australian curriculum have been appreciated. However, a potential problem arises with the possibility of onshore staff and offshore tutors offering different interpretations of materials and tasks. Many offshore 46
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
partners expect the students to channel all queries through their local academic support person and for the local tutor to contact the Australian staff member if necessary. This places the students at a disadvantage if the onshore staff and the local tutor are interpreting the curriculum differently. This is an insidious issue, because the student may not be aware that they have been subject to conflicting interpretations until their work has been marked, leaving the appeals procedure as their source of redress. Domestic students, on the other hand, are able to directly access the staff member marking their work and so are not subject to this potential problem. The main point here concerns the briefing of local tutors prior to the commencement of a teaching/learning activity and ongoing communication between local and Australian teachers, and audit reports have cautioned the Australian universities to address this issue through appropriate staff development and training programs. In general, Australian staff visit offshore programs and stay in contact with students by teleconferencing, video conferencing and email. The frequency of such visits varies, and can relate to whether the students are enrolled at the partner institution or at the Australian institution. The visits are welcomed by both students and local staff, and the audit panels also noted that they tend to be ad hoc in terms of timing, whether they happen at all, and whether they are undertaken by relevant academic staff. Also, they do not always involve the local tutors, resulting in missed opportunities to ensure curriculum and student progress matters are thoroughly addressed. The problems in ‘block teaching’ and ‘intensive teaching’ by Australian staff and how equivalent these learning experiences could be, when the students are not yet ready for intensive study, have been raised in a few reports. In typical TNE operations, course content and design are the responsibility of the Australian institution, with the offshore partner providing facilities and administrative support. Teaching is sometimes supplemented by local tutors. Assessment tasks are set and marked by the Australian staff. This model is sound and gives the Australian staff a high level of control over the standard of teaching and assessment. Most teaching in offshore courses is shared between the Australian staff and the partner staff, with the partner staff providing more tutorial support. Where the Australian staff had a key role this has been central to the maintenance of course quality, and has been highly appreciated by the students. However, the panels have noted that the partners are taking on an increasing proportion of the overall teaching role. In order for this to be appropriate, the universities will need to implement additional quality assurance processes concerning approval of staff selection, moderation and teaching induction, support and evaluation. The panels have found instances where such processes were clearly not in place. For example, in one partnership, partner staff who were teaching a subject had neither qualifications nor specific experience in the relevant area. At another partnership, the staff advised that they had no contact with their
47
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Australian course coordinators, no teaching induction, and received no feedback on their teaching unless they specifically requested it. The audit reports indicate that the panels found little evidence of a teaching‐ research nexus and the staff used offshore were mostly research inactive. The provision of an equivalent student learning environment was, to that extent, called into question. The Australian university retains the right of final approval of third party staff who will be teaching into its courses. In some onshore arrangements, this means that the university staff are sometimes involved in interviewing candidates prior to appointment. Typically, the offshore partners send the resume of the selected candidate for approval. On the whole this system allows the Australian university the appropriate degree of control. A significant proportion of academic staff offshore work under contract. Some are employed (also often under contract) at other universities, or in professional employment. The high dependency on contract and casual staff has an effect on the student learning environment, in terms of continuity over time and across the University. It is not the calibre of these staff that is in question but rather the extent of their involvement in the total teaching process. Teaching in the classroom and marking assignments is part of a broader commitment to the student which ought to include research‐informed curriculum development and review, availability for consultation, active reflection on the overall teaching process and constant engagement with the subject matter. To that extent, the audit panels have expressed concerns about teaching models that have heavy reliance on contract staff and recommended that those models require further refinement. Audit reports have Recommendations on offshore teaching pedagogy as follows: AUQA recommends that the University’s XX campus pedagogical model be reconsidered, to place greater emphasis on the equivalence of learning outcomes, rather than standardised inputs, and to recognise the pedagogical relevance of contributions by the XX‐based academic staff in customising the programs for that student group. AUQA recommends that the University clarify the respective roles and responsibilities of its own staff and staff of offshore partner organisations, with respect to responsibility for curriculum development and for quality assurance. AUQA recommends that the University establish a systematic plan to ensure consistency and ongoing communication among all Distance Education tutors (both onshore and offshore) prior to and throughout the delivery of a course.
48
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University implement an effective mechanism for systematically assessing the teaching being carried out in its courses by staff of local partner organisations. AUQA recommends that the University find more effective mechanisms to ensure that staff employed by third party providers to teach the University’s courses have a clear understanding of the philosophy of the University’s approach to learning and teaching, and particularly, its standards of student assessment. AUQA recommends that the University strengthen its quality assurance system for transnational education, including approval of marketing and promotional materials, student support processes, student orientation and evaluation of offshore teaching staff. AUQA recommends that the University develop procedures to introduce local staff involved in courses taught as part of collaborative teaching arrangements offshore to the University values, such as student‐centred and flexible learning, to ensure that the study experience is equivalent. 6.11 Supporting offshore courses and students The scope of the ESOS Act applies to international students studying in Australia. However, one of the auditees developed an audit model that was equally applicable to its international student activities at its offshore partnerships. The audit panel commented that this was a good practice which helped ensure the equivalence of service standards offshore and onshore. There were examples of good distance education programs with materials of high standard produced to be stand‐alone in terms of any requirement for extra tuition. In certain circumstances, however, agencies acting for the universities added tuition support and it had a beneficial impact on mean course progression rates — particularly for undergraduate students — and retention rates. Without extra support, these two measures tended to be poorer for offshore students than for domestic students and international students on‐campus. Again, the audit panels have commended such additional support. One of the areas noted frequently by the panels as requiring improvement is the library facility. Usually the Australian institution might provide limited access to its online resources and the offshore partner becomes responsible for the IT and library facilities. The audit reports reveal that TNE students make little use of the library online and instead prefer to use the local resources. Although the partner is contractually obliged to arrange for students to have borrowing rights from ‘an appropriate library’ in many cases there is no standing arrangement for borrowing rights. Many panels recognised that students studying through partners at offshore locations perceived themselves as internal students and, in some cases, this perception reinforced their expectations that they get all facilities equivalent
49
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
to onshore students. However, the level of service they receive from the libraries is not comparable with the level of service that internal students at Australian campuses receive. Indeed, upon further exploration of this issue at the Australian campuses, it became apparent to the panels that in many cases, the libraries had had very little involvement in the universities’ strategies of expansion into offshore markets. Given the importance of the library to the overall quality of education, many audit reports have commented that it is vital that Australian universities involve the libraries more fully in this important strategy. The audit reports note that in some cases even an effort to understand the expectations of the offshore students regarding library support and documented processes for ensuring these expectations were being met were not yet in place. In most cases the level of library involvement in the establishment and servicing of offshore programs was limited to providing online services. Some countries are not well served with Internet connectivity and there appeared to be no involvement from the universities’ information technology services in planning or delivering courses offshore. Therefore, at some partnerships, the bandwidth was a significantly constraining factor. As a consequence, Internet access to the online library facilities was frustratingly slow. The issue of access to the library’s electronic resources for off‐campus students featured strongly among the improvement opportunities. Some partners provided a library, but this amounted to little more than single copies of the prescribed textbook being available. The fact that the provision of suitable bandwidth in some parts of a country is beyond the universities’ control demands that the universities develop alternative means of ensuring students have equivalent/comparable access to education. Integrating library and information technology services into the overall management of offshore activities has been recommended to ensure that offshore students receive an equivalent level of service in support of their education. Other issues addressed in Recommendations include: •
Consulting with international students to be more responsive in meeting their needs, and service needs of domestic and international students at all campuses
•
Considering establishing internal relationships between providers in host country to give a better level of service to students
•
Ensuring students in international programs are aware of grievance procedures and student rights and responsibilities.
50
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Audit reports have the following Recommendations on supporting offshore courses and students: AUQA recommends that the University ensure sufficient resources, including library resources, are available to students studying off‐ campus. AUQA recommends that the University fully integrate Library and Information Technology Services considerations into the overall management of offshore activities in order to ensure that offshore students receive an equivalent level of service in support of their education. AUQA recommends that the University strengthen its quality assurance system for transnational education, including approval of marketing and promotional materials, student support processes, student orientation and evaluation of offshore teaching staff. 6.12 Professional development and cultural awareness Many auditees provided cultural awareness training programs and ran workshops and fora on intercultural issues. The adoption of a more coherent approach to cultural awareness and implementation has been recommended. Many reports indicate that the auditees are yet to embed cultural awareness training in staff induction and career development programs and had plans to do so. The audit reports mention the need for cultural diversity programs for academic staff. Institutions have been asked to strengthen the induction program for all offshore teachers (including locally recruited staff) and ensure professional development opportunities exist. Introduction of performance appraisal and supporting academic staff to internationalise course content also find a mention. Aligned with the issues associated with low levels of English language proficiency, mentioned earlier, is the matter of cultural acclimatisation which many students need to undergo in another country or when taking courses offered by foreign institutions in their own country. Universities have identified this as an ongoing challenge. Indeed, the report published by one of the universities identified cultural acclimatisation as a potential causal factor behind low progression rates of international students in some courses. Addressing this issue may require more specific ownership and focused strategies to be effective in generating the desired changes. There is a view among some staff and Australian students that many international and permanent resident students are not conversing in English at an appropriate level, and that this is disadvantaging other students who may work with them in assessed team projects. This is a culturally complex issue, involving a blend of fact and perception, and the audit panels suggested that
51
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
the universities identify and consider strategies for addressing the cultural implications of a growing number of international and permanent resident students in the universities’ learning community. Audit reports provide these Recommendations on professional development and cultural awareness: AUQA recommends that the University provide centrally coordinated induction and support for all staff teaching overseas. AUQA recommends that the University ensure all personnel involved in the provision of offshore teaching receive suitable professional development and performance appraisal. AUQA recommends that the University develop a University‐wide formalised induction program and supporting information for all staff involved in teaching the University programs overseas. AUQA recommends that the University draw upon its successes in transnational education and the availability of supporting resources, such as cultural awareness training, to develop a comprehensive quality assurance manual that will be a key resource for other Schools seeking to establish transnational programs. 6.13 Quality of offshore teaching This area has both Commendations and Recommendations, indicating examples of good practices and areas of concern. Institutions have been commended for aspects such as: •
maintenance of educational standards for offshore students
•
robust manner in which certain programs are offered offshore with maintenance of equivalent standards
•
quality outcomes and international recognition of certain programs
•
effective partnership that provides framework for well supported award programs
•
thorough self‐review of offshore programs to ensure standards
•
good practices regarding offshore teaching at postgraduate level
•
good examples of positive and well‐managed relationships with offshore partners which help to provide quality education to students.
Recommendations address the following topics: •
Developing processes for annual review of international students’ academic performance
•
Addressing issues regarding the equivalence of assessment between transnational and domestic versions of programs 52
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
•
Reviewing the student profile, including the balance between full‐time and study abroad students, in the light of a university’s academic and corporate goals; and the nature of the programs offered to study abroad students, in relation to content and academic standards
•
regularly conducting comparative analyses of onshore and offshore student performance in equivalent programs, with a view to ensuring equivalent student learning outcomes
•
centralising coordination of offshore international student enrolment, in order to ensure that standards are implemented consistently.
•
establishing a mechanism for ensuring that moderation is appropriately and consistently implemented for all applicable offshore courses, and that results for comparable onshore and offshore courses are considered as one means for determining equivalence.
6.14 Standards, consistency and equivalence Some auditees have made explicit commitments that the teaching and assessment standards of all their campus activities (both onshore and offshore) will be or is equivalent. For example, one of the internationalisation objectives included in the draft internationalisation strategy of an auditee is ‘to ensure that the quality of its courses delivered offshore is academically equivalent to the same courses delivered in Australia’. In consequence, the panels focused on the extent to which the deployment of the various contractual agreements was able to ensure this. The audit reports have some successful examples in practice. One of the audit reports indicates that the audit panel was impressed to learn of examples where the university had turned down students and possibly lucrative new niche markets on the grounds that this could compromise standards. For example, the university chose to avoid a niche offshore postgraduate market when it became apparent that entry standards would need to be varied. Similarly, it avoided a market where the engagement of offshore principal supervisors with potentially poorer qualifications and experience would have been necessary. There are other examples from different institutions. Acknowledging this determination to maintain standards when delivering to offshore student markets, the audits panels have commended the universities. Consistency in different aspects of offshore programs emerges as a major area of recommendation. Ensuring consistency in the approach to teaching and student assessment, especially when staff employed by third party providers teach the offshore programs; ensuring that policies governing entrance and advanced standing are implemented offshore using the same standards as onshore; and ensuring that the quality assurance system is implemented consistently, including the online and offshore courses, have been recommended. There are observations about considering the contextual factors of the host country, and implementing the recommendations of an internal audit report on international arrangements.
53
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
One of the problems identified with regard to the definition of course standards is the variation in the interpretation given by offshore partners. In one partnership, the Australian university offered programs which were governed by the same regulations as for those programs in Australia. However, the translation of those regulations into the revised agreement between the university and its partner was insufficiently rigorous and resulted in a lack of clarity as to what was required of students to attain their degrees. This suggests that the universities will need to be particularly diligent in ensuring strong communication between those persons responsible for the partnership contracts and those responsible for the academic standards of the programs. Audit reports have Recommendations on standards, consistency and equivalence: AUQA recommends that the University regularly review XX to ensure that the courses it conducts are of appropriate academic standard, and are consistent with the University’s Mission. AUQA recommends that the University establish and implement a specific system for assuring the quality of all its programs delivered offshore, including (inter alia): a robust process of due diligence for partners and agents; quality controls for translation services; comparisons of learning outcomes for students in offshore and equivalent onshore programs as one indicator of equivalent quality. AUQA recommends that the University regularly conduct comparative analyses of onshore and offshore student performance in equivalent programs, with a view to ensuring equivalent student learning outcomes. AUQA recommends that, as further follow‐up to its external audit of offshore programs, the University analyse the degree of equivalence between onshore and offshore programs in relation to academic requirements, including assessment and feedback to students, and the student experience. AUQA recommends that the University develop procedures to introduce local staff involved in courses taught as part of collaborative teaching arrangements offshore to the University values, such as student‐centred and flexible learning, to ensure that the study experience is equivalent. AUQA recommends that the University revise its quality assurance arrangements for programs taught offshore to include explicit guidance on the strategic selection of offshore partners, a requirement for explicit consideration of the ways in which equivalence will be achieved, and a requirement for comparisons of success among different student cohorts.
54
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University’s XX campus pedagogical model be reconsidered, to place greater emphasis on the equivalence of learning outcomes, rather than standardised inputs, and to recognise the pedagogical relevance of contributions by the XX‐based academic staff in customising the programs for that student group. AUQA recommends that the University establishes a mechanism for ensuring that moderation is appropriately and consistently implemented for all applicable offshore courses, and that results for comparable onshore and offshore courses are considered as one means for determining equivalence. 6.15 Student feedback and monitoring student progress Audit panels usually consider the more general issue of student feedback on the courses undertaken. The audit reports indicate that international students coming to Australia are well advised before arrival about the different services available, and where to go for help. The same information is then provided again after arrival. The structures and units that manage the operations of the international students evaluate their services and the emerging needs of international students through surveys and focus groups. Many of them have representatives on the student advisory committees. There are many examples of action on feedback and the international students are able to make an impact on improving their learning environment. However, the situation is not so positive with TNE students. The panels noted that student feedback was systematically introduced to some offshore courses immediately prior to the offshore audit visit. Student feedback on the quality of the courses is an important aspect of the overall system for ensuring that courses meet and maintain appropriate standards. Audit panels have commented that it is important feedback is incorporated into the general planning and approval framework for offshore activities. Student evaluation of teaching is a valuable mechanism in the system for assuring and improving courses. There are instances where both the Australian institution and the local partners offshore operate systems for student evaluation of teaching and courses. However, when the two systems operate independently of each other without any systematic sharing of evaluative information about the course’s teaching or administrative arrangements, they are unhelpful to students, suggest a lack of cooperation and fail to make best use of the information gathered. While there is a recognised division of labour involved in these independent evaluations and the purpose of evaluations can differ, sharing information would better inform both the onshore and offshore providers concerning the services that students are receiving, and create an opportunity for better understanding and collaborative improvement. This emerges as an area that needs further attention.
55
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Within institutions, there are examples of some schools monitoring the comparative progress of students in the same courses in the domestic and offshore cohorts, which allows staff to be confident that students are performing to a generally equivalent level. This is not happening across all schools that have arrangements for course delivery off‐campus and offshore. Panels have recommended that the comparative progress of students in different cohorts (whether on‐campus, off‐campus or offshore) be routinely monitored so as to ensure the equivalence of teaching onshore and offshore. Audit reports have Recommendations on student progress and monitoring student feedback: AUQA recommends that the comparative progress of students in different cohorts (whether on‐campus, off‐campus or offshore) be routinely monitored so as to ensure the equivalence of the University’s teaching with that of its partners. AUQA recommends that the University establish and implement a specific system for assuring the quality of all its programs delivered offshore, including (inter alia): a robust process of due diligence for partners and agents; quality controls for translation services; comparisons of learning outcomes for students in offshore and equivalent onshore programs as one indicator of equivalent quality. AUQA recommends that the University revise its quality assurance arrangements for programs taught offshore to include explicit guidance on the strategic selection of offshore partners, a requirement for explicit consideration of the ways in which equivalence will be achieved, and a requirement for comparisons of success among different student cohorts. AUQA recommends that the University develop a quality assurance plan in respect of its international activities that includes, inter alia, a model contract with partnerships, due diligence of partners prior to approving contracts, provision for program and unit approvals and regular reviews, communication systems with partners, defined assessment processes and responsibilities, academic security provisions, evaluation of student learning outcomes against the University’s domestic students as a benchmark, evaluation of teaching using an accepted methodology. 6.16 Assessment, moderation and examination security The control the Australian institution has over assessment varies. In situations where the university was beginning to devolve responsibility for some assessment to its delivery partners, audit panels have considered such devolution as a significant departure from the existing quality assurance system. Among the reasons provided for this change is the need to speed up assessment turnaround for students at a distance. The audit panels agreed
56
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
that turnaround of assessment was an issue worthy of consideration, but were not convinced that this was sufficient grounds for such a major shift in policy. The audit reports emphasise that moderation only provides an added quality check against the established responsibilities of the examiner. It assumes that the assessment and examination processes are essentially robust, and serve as a regular means of ensuring the University maintains vigilance in this regard. In itself, it does not provide adequate protection for students from unsatisfactory examiner performance. Where the task of the examiner (in respect of assessment as well as final examinations) has been delegated to an offshore local staff member, then the weight of responsibility on the moderation process could exceed its capabilities. From this point of view, although the assessment policies and regulations usually incorporate the role of the moderator, in many cases they do not articulate how the moderation process is best conducted in TNE. Given that it is such a critical aspect of maintaining educational standards, the universities might benefit from more clearly articulated moderation procedures, allowing for such variances as may be appropriate in relation to, for example, disciplines, modes or levels of study. Consequently, institutions have been advised to develop formal moderation guidelines for application across all modes and study options. One of the auditees had devised a moderation policy which requires a sample of five student assignments, or a sample of 10% of assignments, whichever is the greater. The policy required that the sample must include the highest and lowest assigned marks, with the remainder around the 50% mark. The panel questioned whether this sample size was sufficient to ensure appropriate moderation and equivalence of standards with those courses taught on‐ campus. Assessment tasks are typically set by the Australian university although in some cases partner staff are allowed to devise the assessment, conditional to approval by the Australian university. The latter most typically occurs where the arrangement with the partner has been longstanding and good working relationships have developed between the Australian university and the partner’s academic staff. In some instances, such an arrangement will apply only for a particular partner, due to individual negotiations. Where such an arrangement is in place, the Australian university has to maintain an appropriate level of scrutiny. Where assessment is undertaken by the Australian staff, students expressed a measure of satisfaction. However, where the assessment is undertaken by partners’ staff, the students reported lack of feedback to assist their learning. The number of cases in which assessment is being conducted by the partners’ staff is growing. In those cases, the university uses moderation as a key means of assuring quality. Therefore, the audit panels have investigated the overall process for moderation and found considerable variety in practice. At some
57
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
partnerships, there was little evidence to prove that moderation is always taking place as required by the applicable policies, but at other partnerships it was clear that moderation is being fully and effectively implemented. In most instances, the agreements provide for the third party teaching staff to mark student assignments, which are then moderated by the Australian university staff. Sampling for moderation varies. One university requires that ten items or 10% of the total class (whichever is the larger) will be sampled for moderation, and that the sample should be from the top, middle and bottom of the range. In that particular case, the panel found that a great deal of attention is applied by the university to upholding this policy. However, different patterns of moderation have been noted by the audit panels and in some cases for the same courses offered in different locations. In some, moderation occurs at a distance, with couriers and email being used to forward materials for moderation and the results of moderation to and from the university. In others, the university staff make moderation site visits to the partner organisation. These differences appear to result from resource constraints, both financial resources and staff time. Moderation reports examined by the audit panels indicate that the Australian academic staff place a great deal of significance on this activity. Where staff adjust the marks given by partner staff, they are most commonly scaled down and some reports contain comments on the reasons for these changes, such as inappropriate referencing by students. In the partnerships where academic staff are making moderation site visits, and therefore talking directly to the partner staff, such difficulties are being resolved in an efficient and collegial fashion. While endorsing these efforts, panels have also commented that, in the interests of ensuring continuous improvement, the universities need to take a more active approach to educating third‐party staff who are teaching in its programs about the expected standards. At one partnership there is an arrangement to have assignments and examinations marked, moderated and results returned to students within 45 days of their final exam; at another partnership the time span is 20 days. This suggests that there is an opportunity for improvements to be generated if staff involved in offshore activities exchange information about their practices. The audit reports commented on instances where moderation had been inconsistently undertaken, and the management of the overall process — and particularly the timing/sequencing of certain stages — had become lax. It is necessary, therefore, for the University to also address this systemic issue in order to ensure there can be no recurrence of this problem. Additional to the moderation of assignments and examinations is the more macro‐analysis of student results in comparable onshore and offshore courses. Such analyses are not being conducted in a number of cases. These analyses are an important step in determining the equivalence of onshore and offshore
58
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
courses, as required by Australia’s National Protocols for Higher Education Approval Processes. Audit panels have noted that the procedures for operating examinations were suitably stringent and meticulously applied in many cases. Curiously, some partners applied their own examination protocols rather than the auditee’s examination protocols. This did not appear to compromise academic security, but raised questions as to the extent of compliance by partners with requirements of the Australian institutions. Audit reports provide the following Recommendations on assessment, moderation and examination security: AUQA recommends that the University review whether the role and methods of moderators, as developed in respect of courses where the examiners are University staff members, are appropriate when applied in respect of courses where the examiners are not University staff members. AUQA recommends that the University develop formal Moderation Guidelines (or a consolidated section on Moderation in the Assessment Policy and Regulations) for application across all modes and study options. AUQA recommends that the University, through its Academic Board, develop moderation protocols for use in arrangements where the University courses are being delivered off‐campus by external partners and ensure these protocols are appropriately applied. AUQA recommends that the University find more effective mechanisms to ensure that staff employed by third party providers to teach the University’s courses have a clear understanding of the philosophy of the University’s approach to learning and teaching, and particularly, its standards of student assessment. AUQA recommends that the University establishes a mechanism for ensuring that moderation is appropriately and consistently implemented for all applicable offshore courses, and that results for comparable onshore and offshore courses are considered as one means for determining equivalence. AUQA recommends that the University develop a quality assurance plan in respect of its international activities that includes, inter alia, … defined assessment processes and responsibilities, academic security provisions, …
59
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that, as further follow‐up to its external audit of offshore programs, the University analyse the degree of equivalence between onshore and offshore programs in relation to academic requirements, including assessment and feedback to students, and the student experience.
60
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
7
Good practices validated by AUQA
7.1
AUQA Good Practice Database (GPDB)
As a quality enhancement strategy AUQA administers a searchable collection of good practices. A good practice is a system or activity that has been commended through national audit processes by AUQA as adding value for the auditee and its stakeholders, and that can be adapted and transferred to other organisational settings. Only audit report Commendations are considered for the Good Practice Database (GPDB). With the permission of the auditees, these good practices are made freely available on the GPDB website, available at http://www.auqa.edu.au/gp/search/index.php. Good practices are classified under thirteen topics and ‘International Activities’ is one topic. Each practice can be classified under up to three topics. Of the 31 Commendations on internationalisation, seven have been included in the GPDB. They are: •
Educating Global Citizens through International Student Mobility’ (University of Technology, Sydney)
•
Bilingual Programs (Edith Cowan University)
•
Educational Services for Overseas Students (ESOS) Operating Manual (Version 4) (Central Queensland University)
•
International Mentor Program (Swinburne University of Technology)
•
Quality Assurance for Courses Offered Overseas (Curtin University of Technology)
•
Quality Assurance Systems in Transnational Education (University of South Australia)
•
Quality of Offshore Programs (Edith Cowan University).
Two more practices namely ‘Effective Conciliation Services for International Students’ of the Department of Education Services (DES), Western Australia and ‘Unit Packs for External Programs’ of La Trobe University have relevance to international students and have been included in the GPDB under ‘International Activities’, although they do not come under the 31 Commendations mentioned above (the Commendation for La Trobe University was essentially for teaching and learning). The Commendation of DES is also in addition to the 31 Commendations analysed in this report as the audit reports of the state and territory accrediting agencies have not been included in this analysis. In Cycle 1 audits, internationalisation was only one of the several major areas of the ‘whole of institution’ audit. In Cycle 2 audits, the audits will focus on two themes, one of which for most universities is international activities. This is the case for seven universities in 2008, therefore, when these audit reports
61
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
are published in 2008–2009, one can expect more contributions to the good practice database on various aspects of international activities. 7.2
Other good practices
As mentioned earlier, audit reports make positive observations throughout their text and a reading of the full report is necessary to identify some of the good practices appreciated by the audit panel. A few of these relevant to international activities are: •
Support staff at offshore agencies are outstanding in their dedication to students and commitment to quality assurance and improvement
•
Distance education materials are of a universally high standard produced to be stand alone in terms of any requirement for extra tuition
•
Country reference groups ensure that prospective offshore partners are not of low standing in their own country
•
Good and frequent communication between agents and the university
•
A handbook for staff lecturing offshore
•
The annual cultural awareness week for raising staff and student awareness of the other cultures represented in the university
•
Workshops and fora on intercultural issues to increase international awareness amongst staff and the survey conducted of international students to assess their perception of the cultural awareness of staff
•
The university is taking seriously its current responsibilities for the quality assurance of a rather scattered off shore teaching program
•
Good connections established by staff in Vietnam with the ‘home’ university in student affairs, IT and some academic schools
•
Swift response to the findings of the university’s international student satisfaction survey
•
A ‘series of a checklists and a variety of suggestions’ developed by faculties to use in internationalising their current curricula
•
Library staff members travel to offshore locations to train students in how to access library resources
•
A high level of awareness among the students and partners of the university’s plagiarism policy
•
Arrangements for the final approval of third party staff that allow the university to have the appropriate degree of control
•
A study of comparative academic performance of international and domestic undergraduate students undertaken by the university to monitor the progress of international students
•
The high level of satisfaction expressed by the students and partners with the manner in which the university promotes itself and its courses
62
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
•
Staff induction through a tailored materials and workshop program which inter alia deal with cultural and cross‐cultural issues, as well as TNE teaching and learning and course design issues
•
The high level of awareness among staff of the university’s international aspirations and the priorities given to these.
A closer reading of the audit reports indicate that several institutions have good examples of international activities that are effective and appropriate to those institutional contexts. Again, many of these good practices were very new at the time of the audit and the next round of audits will investigate how well institutions have progressed on these initiatives.
63
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
8
Progress made after the audits
8.1
Progress reports
As mentioned earlier, the AUQA audit reports have been published over a period of five years — October 2002 to October 2007. At the time of writing, progress reports are available from a significant number of universities; an institutional progress report is expected to be available 18 months after publication of the university’s AUQA audit report. The progress reports indicate that institutions have taken action on almost all Recommendations recorded in the audit reports, or have developed plans to do so. Progress reports mostly address action taken on Recommendations and Affirmations. Some institutions have covered the other suggestions for improvement noted by the panels in the text of the audit reports. In general, the reports indicate how well institutions have progressed in areas that needed improvement at the time of audit. Although AUQA does not encourage investigating only CARs, to keep the progress report requirement non‐intrusive, AUQA expects institutions to report on Affirmations and Recommendations at a minimum. AUQA assumes that the auditee will consider the audit report in totality and integrate appropriate actions with its other planned activities. It is left to the institutions to include in their progress reports action taken on other observations. As a result, some institutions have reported in an exhaustive manner including Commendations and observations while some others reported only on Affirmations and Recommendations. This section looks at only the actions against Affirmations (A) and Recommendations (R). 8.2
Effect within institutions
Of the 39 audit reports considered, 35 received either Affirmations and/or Recommendations that relate to international activities. In the case of the other three institutions, the audit panels have made observations on areas that need improvement in the text of the report without making an affirmation or recommendations. Out of the 35 auditees that received a combination of Affirmations and or Recommendations (in addition to Commendations in some cases), a progress report has been analysed for 27 institutions, as indicated in Appendix 2. A reading of the progress reports reveals that clearly a good deal of work has gone into maintaining the momentum generated through the preparation for an AUQA audit. An analysis prepared by AUQA in 2006 of institutional actions indicated that auditees for which progress reports were available have reported an average of over 50 improvement actions per institution. It is reasonable to generalise this overall finding on improvement aspects with
64
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
specific reference to international activities, since this is an area that has been cited very often in the Recommendations and Affirmations. It is also true that in some universities the progress report statements against the Recommendations on international activities are statements of intent rather than the results of action. A few universities have explained some delays in acting on the Recommendations due to change in leadership, or major institutional restructuring. These instances are in the minority and AUQA has followed‐up if progress reports appear unsatisfactory although, as noted above, AUQA does not validate the actions reported in progress reports. These progress reports were produced 18 months after the publication of the audit report and during the time that follows, institutions may have taken additional actions.
65
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
9
Implications for Cycle 2 audits
In broad terms, there are many audit findings to suggest that Australian universities have good quality assurance arrangements in respect of internationalisation and international operations. The audit recommendations focus on an understanding of the aims of internationalisation and, particularly in relation to transnational education activities, consistency in standards, accountability, risk management and equivalence of awards. Progress reports indicate that many universities have taken action to refine or strengthen those elements. As Australian institutions enter a mature phase of transnational education, it is to be expected that there will be some ‘raising of the bar’ in respect of quality assurance and enhancement. In Cycle 2 audits, AUQA has been asked to adopt an ‘academic risk assessment’ approach and pay attention to ‘evidence of setting, maintaining and reviewing institutional academic standards and outcomes, together with evidence of the institution’s comparative national and international performance, …’. To implement this new emphasis, AUQA has developed a framework describing an approach to standards, evidence and outcomes. This standards framework will be used in the context of appropriate external reference points and the application of comparative benchmarks. The emphasis on standards, benchmarking and outcomes in Cycle 2 audits applies to academic standards of offshore activities in just the same way as it does to onshore activities. Institutions are expected to demonstrate the effectiveness of their quality assurance arrangements for offshore activities, including the outcomes achieved by students studying offshore.
66
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Appendix 1
LIST OF UNIVERSITY AUDIT REPORTS
S. No. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39
Month and Year of Release of Audit report October 2002 October 2002 November 2002 December 2002 January 2003 March 2003 March 2003 June 2003 July 2003 September 2003 October 2003 November 2003 December 2003 April 2004 April 2004 May 2004 August 2004 September 2004 October 2004 November 2004 December 2004 February 2005 February 2005 March 2005 August 2005 October 2005 November 2005 January 2006 February 2006 March 2006 March 2006 August 2006 August 2006 December 2006 December 2006 December 2006 January 2007 February 2007 November 2007
Name of the Institution University of Southern Queensland Curtin University [Progress Report (PR) considered] University of Ballarat (PR considered) Australian Catholic University The University of Newcastle University of Adelaide (PR considered) Swinburne University (PR considered) University of Canberra (PR considered) Macquarie University (PR considered) University of Queensland (PR considered) Southern Cross University (PR considered) Notre Dame University (PR considered) Royal Melbourne Institute of Technology Griffith University (PR considered) University of Western Australia The University of New England University of South Australia (PR considered) James Cook University (PR considered) Edith Cowan University Charles Sturt University (PR considered) The University of Sydney Deakin University (PR considered) Bond University (PR considered) Latrobe University (PR considered) Queensland University of Technology Charles Darwin University University of Tasmania The University of Melbourne Central Queensland University University of Wollongong University of New South Wales Murdoch University University of Technology, Sydney Flinders University Monash University Victoria University University of Western Sydney University of the Sunshine Coast Australian National University
67
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Appendix 2
Major Cycle 1 Audit Findings
C OMMENDATIONS Internationalisation AUQA commends the University for its determination to maintain educational standards when delivering to offshore student markets, through the application of assessment and examination policies identical to those applied in Australia. AUQA commends the University for promoting an international dimension to the student experience. AUQA commends the University for its offshore international operations strategy of focusing on a few key partnerships, with robust quality assurance systems based on its ESOS manual, and strong partnership management. AUQA commends the University for its support and management of periods of international study experience for Australian students through either the International Exchange Student Scheme or the Bachelor of Arts in International Studies. Onshore international students AUQA commends the University for its new practice of inducting offshore agents to help assure the quality of the recruitment process. AUQA commends the University for its thorough process for appointing international student recruitment agents. AUQA commends the University for providing strong backing for its exchange agreements, thereby supporting its teaching and learning goals. AUQA commends the mentor program for international students at the University as an effective means of supporting international students. AUQA commends the University for the Excellence in Cultural Experiential Learning and Leadership program. AUQA commends the University for the information and support services it provides to international students. AUQA commends the University for the level of support it provides to international students at its campuses in XX.
68
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA commends the University for being proactive in identifying and responding to the support needs of onshore international students, for example via the ESOS Advisory Group. AUQA commends the University for its internationalisation activities through XX and in particular for its student exchange programs and support of international students. AUQA commends the University for its use of Foundation Units as a distinctive feature of the educational experience of undergraduate students. AUQA commends the University for achieving consistently high outcomes in the course experience questionnaire survey, and for flexibility in meeting the learning needs of a broad array of students; such as through the creation of Careers ‘Combo’ courses at the XX Campus. AUQA commends the University for its Homestay Program, which places English Language Program students with families in the region and is supported by robust quality assurance processes. Transnational Education AUQA commends the University for the very thorough, rigorous and effective process of quality assurance in place in relation to courses offered overseas. The University is commended for its involvement in the non‐income generating program in XX that expresses its values and commitment to community engagement. AUQA commends the University for the robust manner in which the XX and XX are offered offshore, having high regard for maintenance of standards equivalent to those applied to these programs within Australia. AUQA commends the University for the establishment of an effective partnership with XX, which has provided a strong framework for the provision of well‐supported award programs. AUQA commends the University for examples of good practice in relation to offshore teaching at the postgraduate level, including those involving supervision of research components. AUQA commends the University for its quality assurance system for transnational programs.
69
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA commends the University for having put an appropriate Quality Assurance framework in place in the form of the Management of Off‐ Campus Academic Programs Policy. AUQA commends the University for establishing and implementing a system of thorough and constructive Set–up Checklists and Triennial Reviews for its teaching programs offshore. AUQA commends the University for demonstrating improvements to its quality assurance processes in relation to bilingual activities in light of its experiences in this area. AUQA commends the University for some good examples of positive and well‐managed relationships with offshore partners which help enable the University to provide quality education to students overseas. AUQA commends the University for negotiating partnerships with some well‐regarded offshore partners, including the introduction of the Joint Management Committees to oversee relationship management; and for commissioning the reviews of TNE operations. AUQA commends the University for the efficient organisation and effective implementation of international student services, which are successfully delivered through the complementary provision of central and faculty level support. AUQA commends the University for establishing and maintaining strong relationships in the delivery of offshore programs with several well‐ regarded international partner institutions. AUQA commends the University for identifying the risks associated with international partnerships and offshore teaching, initiating external audits to refine the risk analysis and systematically working to implement the audit recommendations. AUQA commends the University for its Global Opportunities Program which is highly valued by students, and through which participants are well supported. A FFIRMATIONS Internationalisation That the University address issues relating to the equivalence of assessment between transnational and domestic versions of the same program.
70
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA affirms the University’s finding that increased monitoring and evaluation of the performance of its off‐ and onshore partners is required. AUQA affirms the University’s recognition of the need to develop a coordinated approach to its international positioning through the development of an Internationalisation Plan. AUQA affirms the University’s intention to pursue further strategies to internationalise teaching and learning and to take a more strategic and longer‐term approach to international partnerships. AUQA affirms work being undertaken by the University which, when fully implemented, will strengthen its quality assurance processes for international education, including introduction of a formalised agreement template, student evaluation of topics and teaching offshore, staff manuals and workshops, consideration of standards across multiple locations within its course review process, an offshore annual reporting template and process, and a DVD to support offshore students. AUQA affirms the University’s intention to ensure that the level of English language competency of some staff is improved and that support is offered to assist staff in improving their level of cultural awareness and their English language skills through initiatives such as the CLEAR program. Onshore International Students AUQA affirms the University’s efforts to further integrate the virtual and physical teaching environments and focus on developing OLT into a system aimed at enhancing the teaching and learning environment. Transnational Education That the University in resolving the issue of the long term offshore provider for its XX and XX programs put in place appropriate transition arrangements for students to protect the quality of the programs and the reputation of the XX. AUQA affirms the University’s action plan to address the various quality improvements needed in its management and quality assurance of offshore teaching partnerships. AUQA affirms the University’s decision to centralise coordination of offshore international student enrolment for now, in order to ensure that standards are implemented consistently.
71
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
In affirming the review activity applied to the TNE operation, AUQA supports the University in its progress on and further intentions to implement the recommendations arising from the TNE reviews, but also encourages careful analysis of the advantages and risks of further growth in this sector, including maintaining appropriate entry and exit standards of English language proficiency. AUQA affirms the University’s approach to bring greater focus and consistency to its transnational education activities and relationships with overseas partners and that greater attention should be paid to the preparation of inexperienced academic staff, and their involvement in the delivery of their course material. AUQA affirms the work being undertaken by the University to strengthen quality assurance processes for transnational education, including revised agreement templates, annual audit meetings, and comprehensive checklists to be used in establishing and monitoring partnered activities. R ECOMMENDATIONS Internationalisation AUQA recommends that the University develop formal Moderation Guidelines (or a consolidated section on Moderation in the Assessment Policy and Regulations) for application across all modes and study options. AUQA recommends that the University take steps to ensure students are receiving accurate, consistent and sufficient information concerning the accreditation status of the programs in which they are intending to enroll, having regard to their local context and reasonable suppositions. AUQA recommends that the University ensure sufficient resources, including library resources, are available to students studying off‐ campus. AUQA recommends that the University, through its Academic Board, develop moderation protocols for use in arrangements where the University courses are being delivered off‐campus by external partners and ensure these protocols are appropriately applied. AUQA recommends that the comparative progress of students in different cohorts (whether on‐campus, off‐campus or offshore) be routinely monitored so as to ensure the equivalence of the University’s teaching with that of its partners.
72
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the promotional material for the University degrees clearly state the different course structures in the different locations. AUQA recommends that, as signalled in the Performance Portfolio, the University develop processes for the University‐wide annual review of the international student academic performance. Most benefit from this would be obtained if it were part of a broader, systematic review of teaching and learning outcomes undertaken by the Academic Board. AUQA recommends that, in developing the Internationalisation Master Plan, further attention be paid to identifying an agreed definition of what is meant by the term ‘internationalisation’ at the University and that this then be promulgated widely. AUQA recommends that the University determine its desired direction in respect of its international activities and finalise its incipient internationalisation plan. AUQA recommends that the University implement the recommendation of its 2002 Internal Audit Report and develop guidelines and procedures relating to the implementation of international arrangements. AUQA recommends that the University continue and extend its program of education to develop a general understanding of internationalisation, and to draw attention to the meaning and significance of an internationalised curriculum. AUQA recommends that the University clarify its strategy with respect to internationalisation, identifying priority objectives, targets, benchmarks and associated resource implications, and clearly specify the expected outcomes. AUQA recommends that the University ensure that it has the means to monitor progress towards the achievement of all its internationalisation objectives. AUQA recommends that the University, through the XX or otherwise, ensure that academic staff are supported in its objective of internationalising not only course content but also their approach to teaching. AUQA recommends that the University Academic Board review the University’s entrance criteria, including English language requirements, in accordance with relevant national and international standards, and asserts control over these criteria through a robust monitoring system.
73
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that in order to achieve its aims in internationalisation in teaching, research and service, the University identify more specific performance indicators and targets, and strategies for achieving them. AUQA recommends that the University regularly conduct comparative analyses of onshore and offshore student performance in equivalent programs, with a view to ensuring equivalent student learning outcomes. AUQA recommends that the University ensure that its validation of courses of other institutions is unambiguously represented in all marketing materials as meaning only that those courses qualify for credit transfer for equivalent University units upon enrolling with the University. AUQA recommends that in finalising its Strategic Framework for Internationalisation, the University clarify the strategy’s role in identifying priorities with regard to locations and modes of operation abroad, the likely effect on the University’s international student recruitment in Australia and consider how the University might more effectively harness the considerable market intelligence available from its own staff and from its various partners. AUQA recommends that the University clarify the locus of responsibilities for international activities so that all within the University understand where responsibility lies AUQA recommends that the University reconsider the application of its English language entrance standards in light of the overall demands of the teaching, reading materials and assessment methods. AUQA recommends that the University improve its planning and focus in the area of international student recruitment, with some reference to its own identified XX region. AUQA recommends that the University ensure that the meaning of the presence of the University crest on XX degree parchment (and within XX promotional materials) is unambiguously and clearly communicated to current and prospective XX students. AUQA recommends that the University strengthen its quality controls in relation to how it promotes itself and its programs, with particular emphasis on its promotion to international markets. AUQA recommends that the University develop a ‘Statement of International Purpose’ to support and integrate the understanding of internationalisation more effectively into the activities of the University.
74
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University develop procedures to introduce local staff involved in courses taught as part of collaborative teaching arrangements offshore to the University values, such as student‐centred and flexible learning, to ensure that the study experience is equivalent. Onshore International Students AUQA recommends that the University explore opportunities for integrating and sharing evaluative information with its offshore agents. AUQA recommends that the University ensure that it has full control of the entry of students to its onshore off‐campus programs. AUQA recommends that in light of its plans to increase the number and cultural diversity of its on‐campus international students, the University develop a fully planned, integrated and resourced approach to service delivery to these students. Transnational Education AUQA recommends that the University review its management of partnerships, particularly with a view to: (a) improving mechanisms for assessing prospective partners; (b) integrating of quality assurance provisions, including periodic review, into the agreements; and (c) involving relevant academic staff in the above. AUQA recommends that the University establish a systematic plan to ensure consistency and ongoing communication among all Distance Education tutors (both onshore and offshore) prior to and throughout the delivery of a course. AUQA recommends that the University review whether the role and methods of moderators, as developed in respect of courses where the examiners are the University staff members, are appropriate when applied in respect of courses where the examiners are not the University staff members. AUQA recommends that the University consider developing a risk identification and management process, prior to the commencement of teaching, for programs delivered in languages other than English. AUQA recommends that the University provide centrally coordinated induction and support for all staff teaching overseas. AUQA recommends that the University implement an effective mechanism for systematically assessing the teaching being carried out in its courses by staff of local partner organisations.
75
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University develop a comprehensive system for deciding which offshore activities to engage in, for planning, implementing and controlling them, and for incorporating an effective quality assurance system. AUQA recommends that the University regularly review XX to ensure that the courses it conducts are of appropriate academic standard, and are consistent with the University’s Mission. AUQA recommends that the University establish and implement a specific system for assuring the quality of all its programs delivered offshore, including (inter alia): a robust process of due diligence for partners and agents; quality controls for translation services; comparisons of learning outcomes for students in offshore and equivalent onshore programs as one indicator of equivalent quality. AUQA recommends that the University establish robust systems for assuring itself that the terms of its agreements with offshore education providers are being met. The University’s self‐assessment has identified this as an area of concern. AUQA recommends that the University’s Academic Board resolve, with urgency, the accreditation status of the courses being offered through XX and that the current academic and professional accreditation status of these courses be made clear to students. More generally, the Academic Board should assure itself that its decision‐making processes with regard to all the University’s courses offered offshore are sufficiently robust. AUQA recommends that the University ensure that a comprehensive framework for the quality assurance of its courses offered through XX be implemented without delay. The University has recognised the need for this framework and is in the process of constructing a suitable action plan. AUQA recommends that the University clarify the respective roles and responsibilities of its own staff and staff of offshore partner organisations, with respect to responsibility for curriculum development and for quality assurance. AUQA recommends that the University establish effective communication mechanisms and ensure that robust quality assurance systems are in place for its operations with offshore partner organisations within the XX Network so that it has the means to ensure that the partner’s activities (as they relate to the University courses) are fully compliant with the University policy and practice.
76
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the planned development of an overall framework for quality assurance of the University courses delivered offshore be undertaken and implemented. AUQA recommends that the University pay special attention to reviewing the financial viability and strategic directions of its existing and any new offshore initiatives, and that the University communicate to relevant stakeholders its planned path, scale and ultimate profile for the further development of its International Education program. AUQA recommends that the University consider establishing an internal relationship between its various business‐related Masters programs in XX (specifically the XX, the XX and the XX) so as to consolidate the range of electives available, thereby providing a better quality of service to students, and that the University’s marketing materials clearly indicate, where applicable, that electives are offered subject to sufficient enrolments. AUQA recommends that the University take immediate steps to address the fundamentally unacceptable situation with respect to the unauthorised offering by XX of a full‐time XX program and in particular, that it urgently undertake a detailed audit of the records associated with the students who have been enrolled in this offering of the XX, prior to deciding on their individual academic status. AUQA recommends that the University take immediate steps to ensure that it is fully aware of all offshore ventures in which students are enrolled with the University. AUQA recommends that the University develop a quality assurance plan in respect of its international activities that includes, inter alia, a model contract with partnerships, due diligence of partners prior to approving contracts, provision for program and unit approvals and regular reviews, communication systems with partners, defined assessment processes and responsibilities, academic security provisions, evaluation of student learning outcomes against the University’s domestic students as a benchmark, evaluation of teaching using an accepted methodology. AUQA recommends that the University ensure all personnel involved in the provision of offshore teaching receive suitable professional development and performance appraisal. AUQA recommends that the University ensure sufficient level of English proficiency for the entry of NESB international students into all programs, but particularly those in XX.
77
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that following the recent establishment of pro‐ forma agreements to govern all future offshore operations, it is recommended that the University revise all existing agreements to conform to the new format and process. AUQA recommends that the lines of responsibility, accountability and authority in the management and quality assurance of offshore teaching programs be clarified as a matter of urgency and that the University ensure that its quality assurance procedures for offshore partnership programs are consistently implemented. AUQA recommends that the University’s XX campus pedagogical model be reconsidered, to place greater emphasis on the equivalence of learning outcomes, rather than standardised inputs, and to recognise the pedagogical relevance of contributions by the XX‐based academic staff in customising the programs for that student group. AUQA recommends that the University ensure that it has effective mechanisms to monitor the operations of its offshore programs to ensure that they are well aligned with their own stated objectives, continue to meet the expectations of their partners and are in compliance with the terms of the contract. It is further recommended that, in relation to the postgraduate program offered at the XX College, the University immediately address the program problems raised by students. AUQA recommends that the University draw upon its successes in transnational education and the availability of supporting resources, such as cultural awareness training, to develop a comprehensive quality assurance manual that will be a key resource for other Schools seeking to establish transnational programs. AUQA recommends that the University develop and implement a system for monitoring and reviewing offshore partnerships and programs that involves all key stakeholders and that is integrated into the other review processes of the University. AUQA recommends that the University review the system in place for ensuring that students in transnational programs are aware of the University grievance procedures, and that those procedures are able to be effected.
78
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University undertake a major review of the quality assurance systems in place for the design, approval, delivery and review of transnational programs, including in the scope of the review the respective roles of the Academic Board, International Committee and Entrepreneurial Committee, and also incorporating a detailed assessment of the effectiveness of quality assurance systems being applied in respect of the current and recently‐terminated transnational programs. AUQA recommends that the University ensure that its policies governing entrance and advanced standing are implemented offshore using the same standards as onshore. AUQA recommends that the University develop, implement and monitor systems for effectively controlling all marketing relating to its offshore activities. AUQA recommends that the University recognise and support more appropriately the work being undertaken by the various groups within the Faculty of XX and the Faculty of XX to develop and strengthen the entirety of the University’s activities with third party providers. AUQA recommends that the University adopt a risk‐oriented approach in the scheduling of its evaluation of current third party providers and that it develop more effective tools for the evaluation of prospective third‐party teaching partners and agents and devise appropriate formal approval protocols. AUQA recommends that the University find more effective mechanisms to ensure that staff employed by third party providers to teach the University’s courses have a clear understanding of the philosophy of the University’s approach to learning and teaching, and particularly, its standards of student assessment. AUQA recommends that the University develop principles to guide the development, management and monitoring of transnational programs and partnerships, including probity and due diligence procedures and the maintenance of consistent and appropriate admission standards, including English competency. AUQA recommends that the University establishes a mechanism for ensuring that moderation is appropriately and consistently implemented for all applicable offshore courses, and that results for comparable onshore and offshore courses are considered as one means for determining equivalence.
79
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University fully integrate Library and Information Technology Services considerations into the overall management of offshore activities in order to ensure that offshore students receive an equivalent level of service in support of their education. AUQA recommends that the University develop a University‐wide formalised induction program and supporting information for all staff involved in teaching the University programs overseas. AUQA recommends that the University identify and implement ways to promulgate information about the University’s TNE operation amongst its staff, students, and other stakeholders more effectively. AUQA recommends that the University establish a more comprehensive framework for the quality assurance of its offshore activities, perhaps overseen by a high level University committee. AUQA recommends that in offering XX training opportunities in XX, including programs introduced for the school‐leaver market, the University examines with its Japanese partner the possibility of registering with the XX Ministry of Education and Training in order to gain designation as a ‘foreign University’s XX campus’. AUQA recommends that the University revise its quality assurance arrangements for programs taught offshore to include explicit guidance on the strategic selection of offshore partners, a requirement for explicit consideration of the ways in which equivalence will be achieved, and a requirement for comparisons of success among different student cohorts. AUQA recommends that for the two courses offered with XX, the University ensure that delivery arrangements, student information and partner agreement provisions are consistent with arrangements for prior credit as stated on academic transcripts. AUQA recommends that, as further follow‐up to its external audit of offshore programs, the University analyse the degree of equivalence between onshore and offshore programs in relation to academic requirements, including assessment and feedback to students, and the student experience. AUQA recommends that the University reconsider the approach to offering transnational award programs to ensure that the University reputation is strong and that quality is assured in practice.
80
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
AUQA recommends that the University satisfy itself that requisite host country approvals are in place for the XX program offered in XX, taking into account planned changes to the program that may bring into question its status as an online program. Further, that the University review admissions processes and partner procedures to ensure that appropriate entrance standards are being maintained, and there is adequate validation of applicant information. AUQA recommends that the University strengthen its quality assurance system for transnational education, including approval of marketing and promotional materials, student support processes, student orientation and evaluation of offshore teaching staff.
81
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Appendix 3
AUQA’s Transnational Education Framework
AUQA audits have a special emphasis on the ‘transnational education (TNE)’ arrangements. The primary reason for this emphasis is that these operations are inherently more difficult to control, being at a great distance from the base of the university’s operations, embedded in a different culture, and under the charge of another organisation. Therefore, it is harder to get them right. Because there is little experience world‐wide in the exercise of an external quality assurance role over operations outside the country where the quality agency is based, AUQA set up a two‐part structure. The first part, using a risk‐ based approach, is a group of factors that guide the audit panels in this area of high importance and visibility. Part 1: Sampling — Factors in deciding whether and which overseas operations to visit AUQA’s detailed investigation is based on sampling. AUQA audit panels talk to samples of staff and students, inspect sample documents for a range of processes and activities, investigate a sample of research centres, and so on. This sampling includes operations on multiple campuses, operations with partner organisations, and operations overseas. To assist panels in selecting overseas samples, AUQA has set down five factors for panels to consider in order to decide which overseas activities warrant a visit, and two more factors relating to practical aspects of carrying out such visits. i.
Materiality: The panels consider whether the numbers of staff and students involved in an offshore venue are significant enough to warrant particular attention.
ii.
Strategic Significance: If the overseas activities are significant to the organisational strategies such as the subject of a major growth strategy then the audit panel may deem them sufficiently significant to warrant particular attention, even if the activity is currently quite small.
iii. Risk Management: The likelihood and consequences of things going wrong with the overseas activities and the integrity of the institution’s risk management system will be considered.
82
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Risk to Students: An institution may lack experience in the provision of necessary systems for overseas students, and hence pose a greater risk to students. iv. Host Country Accreditation: Most overseas locations in which Australian institutions operate have external quality mechanisms of their own and the panels will consider to what extent their outcomes can be used to provide some of the information required for AUQA audit. On the basis of these factors, the audit panel decides whether any TNE operations merit close attention, and if so, which ones. The panel then decides what sort of attention is feasible, by reflecting on: i. Practicality: An auditee may have a large number of relatively small‐ scale operations widely dispersed around the world, and it may be impractical to visit many but of dubious value to visit only one. The panel will consider the time available, and the spread and scale of the activities and choose the sample. ii. Necessity: Once the audit panel has decided on the level of attention needed, further information can always be obtained in various ways including additional documentation request, web search, and personal interaction through teleconferencing, video‐ conferencing, and even email. Thus, a physical visit overseas is only one option among a number of strategies available to an audit panel to carry out its investigations. Each audit panel considers these seven factors and weighs their total effect, adequacy and value in deciding how to gather all the information it needs, and specifically which of an auditee’s overseas activities to visit (or in rare cases, whether to undertake visits overseas at all). Part 2: Audit Investigation Much of the information gathered by audit panels and the evidence assessed by them is the same for operations through partners and/or overseas as for operations in Australia on the university’s campus. Other information is more peculiar to these outreach operations. The second part of AUQA’s TNE structure for its investigations of partner and particularly overseas operations is a 17‐point framework. It is also noticeable that many universities have over‐ estimated the similarity of campus and partner operations, and have inadequate processes in place to reliably handle the different situation. They too have benefited from AUQA’s TNE investigation framework as it has made institutions examine the arrangements related to these aspects more carefully.
83
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
In general, the following areas are considered by AUQA in investigating operations through partners and/or operations overseas. i.
Philosophy and Rationale: What is the purpose of the university’s transnational activity? What values underpin it? Who are the stakeholders/beneficiaries, what are their interests, and how are their interests being represented? What are the particular features of the selected location? How does all this influence the overall model?
ii.
Partners and Agents: What kind of partner is it (public university; private university; business provider; silent investor; controlled entity etc.)? What are the partner’s motivations? Was a thorough due diligence undertaken first? Have potential risks been explored, identified and appropriately managed? Are agents experienced and trained? How are they monitored and reviewed?
iii.
Contract/Agreement: Was there appropriate consultation? (Contract consideration); Who signed the contract? (Contract authorisation); Are the academic QA issues covered in a clear manner? Are the risk management provisions adequate? (Contract scope); Are there good communication processes? Is the contract subject to review? Is the program financially sound ‐ i.e. are students at risk? Are the obligations of the parties clear including exit strategies? (Contract management)
iv.
Quality Control: Does the auditee have necessary and appropriate host country approvals (eg registration)? Do the partner and program have appropriate host country approvals (eg accreditation)? Does the program have appropriate professional accreditation?
v.
Governance: With whom are the students enrolled? With whom will they graduate? Are they quite clear about this? Do the university’s policies apply (eg plagiarism, grievances etc.)? If so, are there appropriate training, communication, and operational and appeals processes in place? To what extent does the partner also impose policies, and do these affect the impact of university policies?
vi.
Staffing and Staff Development: Are there appropriate selection, induction, briefing, support & review processes for teachers? Does induction include training on cultural issues? Who employs, supports and monitors the staff? Is there student evaluation of staff? Do the university and the partner share the information? How does it feed into development opportunities?
84
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
vii.
Curriculum: Was the curriculum specifically approved within the auditee for transnational delivery? What did this entail (eg changes to teaching methods; assessment amendments; advanced standing)? Is the curriculum identical, equivalent, significantly tailored or unique? Is it appropriately contextualised (eg case studies, cultural sensitivity)? Are professional accreditation issues made clear to students?
viii.
Marketing & Promotion: Is there an ESOS‐type audit process in place? In what language is the program promoted? If not English, what quality control is in place? Who is doing the promotion and to what guidelines? Is it consistent with domestic promotion regarding curriculum and policies? How accurate is the promotion, e.g. regarding availability of electives? Is the text ambiguous or open to misinterpretation by the student?
ix.
Entry Standards: How do entrance and advanced standing standards compare with the home campus? How are the advanced standing provisions approved? How do they compare with the AQF and AVCC Policy Guidelines on Cross‐Sector Qualification Linkages? Who handles the admissions process? How are the student records checked (eg regarding validity of the evidentiary requirements)?
x.
Language: In what language are the teaching and teaching materials? In what language is the assessment? If assessment is in English, what are the English Language requirements? Are these set at entry or at exit? How do they compare with the sector? If not English, how are the implications for marking and moderation handled? What appears on the testamur?
xi.
Teaching: Who does the teaching – the Australian university or the partner? Does the auditee claim a teaching‐research nexus? If so, how is this effected transnationally? Does the teaching schedule provide adequate time for student reflection and assignments? Do students conduct teacher evaluations? Run by whom? What happens with the results?
xii.
Standards and Assessment: How are standards set and monitored? Is the assessment schedule identical, equivalent or different to the home program? Who does the marking? Is assessment moderated? Are results compared against the home program results? How is this information used? How is the robustness of academic security provisions (eg invigilation) assured? Do students get timely feedback on assessed work?
85
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
xiii.
Academic Support: How are the learning support needs of the students assessed and responded to? What access to library services and resources exist? How are these determined and evaluated? How do these support services compare with the support provided at the home campus? What form of evaluation is in place?
xiv.
Pastoral Support: Are the decisions made in respect of pastoral support services deliberately based on an assessment of student support requirements? How do these support services compare with the Australian campus? What form of evaluation is in place? Are cultural issues taken into account?
xv.
Research: How is the link between teaching and research achieved? For research degrees, how is supervision provided? Nature of research links to home campus? Provision of research support?
xvi.
Community links: How does the institution define its ‘community’? Is there a relation with the local community in the host country? Are there institutional contributions to the local community? What are the provisions for community input and feedback (eg from employers, government)?
xvii.
Evaluation & Review: What are the local QA arrangements? Is there a regular process for reviewing the equivalency of the student learning environment? Who is involved? What information is considered and what happens to the results? How is the academic program reviewed? If it is incorporated into the review of the home program, does it receive sufficient attention? How and how often is the contract/agreement reviewed? Who is involved and what information is considered?
The areas listed above are only indicative. Depending on the nature of the operations and areas of risk, AUQA determines the areas that need further examination.
86
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Appendix 4
The Authors
Antony Stella Dr Antony Stella is Audit Director at the Australian Universities Quality Agency (AUQA). In addition to carrying out audits, Dr Stella has significantly contributed to AUQA’s publication program by her thematic analyses of audit reports. She contributes extensively to AUQA’s international work, leading audits in Bahrain, Fiji and Mauritius, and developing a global database for good practices in quality assurance (QA). On behalf of AUQA she wrote the scoping survey reports on the QA arrangements of APEC economies and the Brisbane Communiqué signatories for the Australian government. Before moving to AUQA in August 2005, Dr Stella worked with the National Assessment and Accreditation Council (NAAC), India. With a PhD in educational technology, she has written more than 100 papers and ten books, four on educational technology and the rest on QA. For the International Institute for Educational Planning of UNESCO, she has authored reports and training modules about external quality assurance and co‐edited two books on international perspectives and developments in QA. She has worked as a consultant in the Bangkok regional office of UNESCO, done overviews for UNESCO of the quality assurance mechanisms of the Asia‐ Pacific region, and was a member of the UNESCO‐OECD expert group that drafted guidelines for QA of cross‐border education. Dr Stella is a recipient of a Shastri Indo‐Canadian Faculty Research Award and a Fulbright Post‐doctoral Fellowship. She is a member of the APQN Board, for which she is developing a global database of consultants and reviewers, and of the Expert Group on QA of higher education in Small States established by UNESCO. She is leading a project group on Small States for the International Network of Quality Assurance Agencies in Higher Education. Colleen Liston Professor Colleen Liston was Director of International Planning and Quality at Curtin University of Technology until August 2006. Dr Liston is currently Adjunct Professor in the Office of the Vice‐Chancellor at Curtin and a private consultant on tertiary education quality assurance, accreditation and standards. She has been involved in tertiary education since the late seventies (Health Sciences), and in quality management and international education issues since the late eighties. Her PhD researched ‘The Structure of Educational Accreditation’. She has presented at international conferences, and published widely, on health science research and managing quality and standards.
87
Internationalisation of Australian Universities: Learning from Cycle 1 Audits
Colleen is an Australian Business Excellence Framework Evaluator, an ISO Auditor and an Australian Universities Quality Agency (AUQA) Auditor. She was on the panel which undertook the inaugural AUQA university audit, and was involved in preparing the documentation for AUQA’s audit of Curtin University of Technology. She is a member of the Editorial Board for AUQA’s Occasional Publications. Professor Liston is appointed by the Minister of Education in Western Australia to Chair higher education accreditation panels. She serves as a Subject Specialist for the US Distance Education and Training Council Accrediting Commission. Colleen was part of an international panel which undertook a review of the procedures for accreditation of higher education courses for the New Zealand Vice‐Chancellors’ Committee, and is on the register of auditors for the Hong Kong, New Zealand, Oman and Bahrain quality agencies. She has conducted independent reviews for a number of Australian universities in relation to partner offshore programs, internationalisation, academic governance, standards and benchmarking. Colleen has been a panel member or chair for several AUQA audits and ‘practice’ audits, as well as assisting providers in preparing progress reports to AUQA. She has presented at AUQA auditor training workshops on auditing transnational activities, briefed university staff in Bahrain, and given invited keynote papers on the topic at major international conferences in Australia, Dubai, Edinburgh, Santiago, Auckland and Beijing.
88