Home >  Blog >  Changes to Senior Assessment - your say

Changes to Senior Assessment - your say

Posted by Fiona Laing, ETAQ President on 4 October 2014

Below are shown the recommendations from the Matters/Masters report  -  

Redesigning the secondary-tertiary interface: Queensland Review of Senior Assessment and Tertiary Entrance

At the end of most recommendations are queries/comments (shown as a, b, c etc). Please post at the end the following:

  • your own comments about these recommendations
  • further questions you believe should be asked
  • your thoughts about the existing comments

A meeting will be called, in the coming weeks, to seek input to develop an ETAQ response to the recommendations. 

Recommendation 1

The OP system should be discontinued and the interface between secondary completion and university selection should be redesigned. The implications are that SAIs would no longer be generated, OAIs, OPs and FPs would no longer be calculated, and the QCS Test would be discontinued. Under the new model, Subject Results would be reported on a finer scale for use by universities in their selection decisions.

a. Does the “finer scale” mean that syllabuses will be rewritten to provide for more than 5 levels of achievement? Does the vocabulary exist in English for 10 levels or more to be explicitly described?
b. There is a need here to indicate a marking scale that will be used. Each item in a folio currently has 15 levels of achievement, from A+ to E-. If school based pieces are marked out of 10, that would constitute fewer levels? If the external ‘piece’ is marked out of 30, the skills required of markers would be very high indeed – or will there actually be 3 pieces in the exam, each marked out of 10?
c. Don’t the states have an agreement to report on student achievement on a 5 point scale?

Recommendation 2
Responsibility for certifying student attainment in senior subjects should be separated from responsibility for selecting applicants for admission to university courses. The former should be the responsibility of QCAA, working directly with schools. The latter should be the responsibility of the universities and their agent QTAC.

a. Will this separation be real? Schools will continue to be judged by university admission rates and will therefore be influenced by whatever system the universities put in place.
b. Will the government or QCAA have any input into any process of scaling various subjects eg comparing English to English for ESL Learners?

Recommendation 3
Student attainment in each Authority Subject should be reported by QCAA in the form of a "Subject Results" indicating the level of knowledge, understanding and skill that the student has attained. These should be directly comparable across teachers and schools and function as standalone measures of senior secondary attainment, independently of how they might subsequently be used.

a. Only Authority Subjects are mentioned here. What system would apply to subjects like English Communication?
b. If the OP is to be abolished, will it still be meaningful to distinguish between “Authority” and “Authority-registered” subjects?
c. If there are still two tiers of subjects, those which contribute to university entrance and those which don’t, will not some schools continue to direct large numbers of students into the non-tertiary entrance subjects (appropriately or inappropriately depending on one’s perspective)?

Recommendation 4
The certification of student attainment in each senior subject should be based on a set of four specified types of assessment activities. QCAA should specify the nature of each activity, the conditions under which it is to be completed and the marking scheme for assessing students' performances. One of the four assessment activities should be externally set and marked by QCAA.

a. What would the 4 types of assessment activities be? For English would they include: extended writing, oral presentation, multimodal digital text, short answers, multiple choice questions?
b. When would the assessment activity externally set and marked by QCAA be conducted? In Term 3 of Year 12? In Term 4?
c. Would the QCAA assessment be one piece of writing (one genre only)? If so would it not skew the balance of the profile, being worth 50% of the total? 50% essay or 50% creative writing or whatever it is?
d. Does this recommendation really mean “four specified types of assessment activities” or just four assessment activities?
e. Does this assume the QCAA assessment will lead to ‘set texts’ on which to base this assessment?

Recommendation 5
Students' Subject Results should be reported as integers on a scale of 1 to 60, with the suppression of a total mark of 0. Each Subject Result should be calculated as the sum of a student's mark on the external assessment (in the range 0 to 30) and marks on the three assessment activities set and marked by teachers (each in the range 0 to 10). Teachers' assessments should not be statistically scaled against the external assessment.

a. Currently, under the existing criterion-based system, it is seen as inappropriate for schools to just sum marks for different assessment tasks.
b. A similar comment to that made for Recommendation 1 is relevant here. For how many levels of achievement will explicit verbal descriptions be possible? 10? 60? Will we still really be operating in a criterion-based system?

Recommendation 6
An External Assessment in each subject should be set and marked by QCAA and completed at the same time under the same supervised conditions in all schools. If resourcing is an issue, priority should be given to developing External Assessments for subjects with high enrolments, subjects which are foundational for university courses, and subjects for which external assessment is most practicable. For the vast majority of senior subjects, the External Assessment should contribute 50 per cent of the Subject Result.

a. English would surely be a candidate for the proposed external assessments.
b. The problem of the percentage of the cohort that takes English Communication as opposed to English would still remain.
c. Recommendation 3 refers only to Authority Subjects. Would these external assessments apply to Authority-registered subjects like English Communication?

Recommendation 7
Three School Assessments should be specified for each subject. The nature, intentions and parameters for these three assessment activities should be specified by QCAA, with teachers in schools annually designing local versions of each. The three School Assessments and the External Assessment should be designed jointly to provide appropriate coverage and balance of the subject syllabus and in general should address different kinds of learning and achievement within the subject.

a. This recommendation says “each subject”. Does it really mean that, or just each Authority Subject?

Recommendation 8
QCAA should assure the validity and reliability of School Assessments in each subject through a revised approach to moderation that includes three elements:

• "Endorsement" of proposed assessment activities - For each of the three School Assessments, QCAA checks locally-devised assessment activities/instruments and marking schemes for their consistency with QCAA specifications  and endorses their use with students.

• "Confirmation" of accurate application of marking schemes - For each of the three School
Assessments, QCAA checks that schools' applications of marking schemes are accurate and consistent across teachers and schools. This is done through "moderation" meetings in which teachers undertake blind re-assessments of student work against the relevant 10- point scale. QCAA also conducts annual spot sampling and blind re-assessments to check the consistency of marking across schools. Where a problem is identified, all student work in that subject in that school is re-marked.

a. How, by whom and when would all student work be re-marked? There are significant resources and teacher workload implications here.
b. Contrary to the intention of the review to “recognize and preserve strengths of the current arrangements’ amongst which it includes “the use of classroom teachers’ judgements of students’ performances and work, and believe that this aspect of the current system must be preserved as significant element of future assessment arrangements”, the approach here reads as opposite to the current moderation approach where panels look to support school decisions, or providing advice, justified using evidence matched to syllabus standards. Surely there would be a scale of tolerance regarding the difference of judgement about individual items?
c. What principles will underpin this moderation process? What about “fullest and latest” which recognizes the progress (often significant) of students throughout the course, especially students with English as an Additional Language, socio-economically disadvantaged studetns, or other students who begin the course academically behind their peers?


• "Ratification" of Subject Results - At the end of Year 12, QCAA checks each school's results on the four assessments for anomalies. If anomalies are identified, then these are investigated and resolved before verifying students' marks on the four assessments. Once anomalies are resolved, the ratification of students' Subject Results for certification follows.

d. Time frame for ratification will be interesting. Is this ratification process happening whilst students are still at school?

An appeals process will be available to students after they receive their Senior Statements from QCAA (or in some other way as determined by QCAA). QTAC should be included in discussions about the appeals process.

Recommendation 9
QCAA should establish a guild of Assessment Supervisors to provide guidance in relation to the proposed moderation processes (the endorsement of assessment activities; the confirmation of marking standards; and the ratification of Subject Results) and to assist in teacher capacity building.

a. This is probably a good idea but training would need to be provided for such people to have credibility.

Recommendation 10
The Senior External Examinations currently developed by QCAA should be discontinued. Instead, all students who are undertaking a senior subject should be required to complete the four assessment activities specified by QCAA for that subject (the three School Assessments and one External Assessment).

Recommendation 11
Tertiary institutions should make as transparent as possible the basis on which applicants are selected for admission to tertiary courses. This should include clarity about the nature of the evidence to be considered (for example, subject results, aptitude test scores, interviews), course prerequisites, any preferential weighting to be applied to subject results, and any processes for aggregating student results to rank applicants.

a. Tertiary institutions would need to make all decisions on subjects available 3 years before this process begins. Otherwise, students making subject selections in years 9 and 10 may be seriously disadvantaged.


Recommendation 12
The current responsibilities of QTAC for processing applications  to undergraduate courses and implementing institutions' admission rules and procedures should be extended to include any scaling and aggregation  of senior Subject Results to produce rankings of course applicants.

a. It is noted that there is no indication of how the scaling might work in this document. It is to be hoped that schools will have input into the process since subject selection will be heavily impacted by decisions around scaling of subjects.
b. Will there be a further report on proposals for scaling and possible university entry requirements? Will current arrangements around universities allowing the entry of students studying English for ESL Learners be maintained?

Recommendation 13
If tertiary institutions choose to construct an ATAR, then this should be computed using an inter­ subject scaling of Subject Results reported by QCAA (each on a 60-point scale). In setting new eligibility rules tertiary institutions should consider reducing the number of subjects and restricting combinations of subjects.

Recommendation 14
Tertiary institutions, in collaboration with QCAA, should conduct ongoing monitoring of the impact of tertiary selection processes on the senior secondary school (particularly possible impacts on students' choices of senior subjects). Institutions should also continue to explore improvements to their selection processes and alternatives to rankings such as ATAR.

Recommendation 15
The Queensland Government should make the legislative changes required to divest the QCAA of its current responsibilities relating to tertiary selection (including scaling and aggregating results to produce rank orders of tertiary applicants).

a. Is the QCAA not the body most responsive to schools, understanding the effects on subject selection etc? Staffed by those coming from schools?


Recommendation 16
The Queensland Government should invest additional funding in the creation of high-quality assessment and certification processes to underpin a reformed senior secondary credential. A priority order of subjects should be established in the event that it is not possible to fund
the development  of externally  set and marked assessments in all senior subjects.

a. Not yet hearing of the need for funding for schools/teachers to be upskilled to be able to meet this ‘brave new world’ of external exams? To introduce such a change will require high levels of PD for teachers in order to not disadvantage students in the first years of implementation.


Recommendation 17
The QCAA should continue to build its staff capacity in educational assessment, educational measurement and information and communication technologies.

Recommendation 18
The QCAA should build into its assessment processes a greater focus on skills and attributes now being identified in senior secondary curricula as essential to life and work in the 21st Century (for example, teamwork, problem solving, creativity, verbal communication).

a. These skills (teamwork, problem solving, creativity, verbal communication etc) are very laudable yet seem to be just the skills not at all likely to be covered in what will now be the 50% component of the new program, the external exam – in English, the big essay? Those skills have now been reduced to a maximum of 1/6 of the whole mark in English, it would seem.


Recommendation 19
The Queensland Government should devise a multi-platform information strategy to precede and accompany any significant changes or reforms to senior assessment and tertiary entrance.

a. Teachers and subjects associations would be looking for significant funding prior to such changes. Professional development of senior teachers and administrators will be crucial for this system to have credibility.
b. Recent announcements of curriculum being announced in The Courier-Mail during the September/October break and expected to be taught by teachers in term 4 (around alcohol and drug education) is an eg of politicians not understanding how schools work nor the time it takes to implement a program in a school.


Recommendation 20
Queensland tertiary institutions should undertake a review of their admissions processes, including options for comparing and selecting applicants to competitive tertiary courses. This review should consider the appropriateness of constructing a single rank order of school leavers regardless of the course or institution to which they are applying, and options for ranking course applicants (ATAR; a "points system").

a. Is funding available for universities to undertake this work? Given universities operate on federal funds, is consideration of resources being considered?


Recommendation 21
Queensland tertiary institutions should consider enhancing technical capacity within QTAC to undertake any new scaling procedures to produce rank orders of course applicants. Consideration also should be given to establishing a high-level Technical Committee to oversee the technical quality of these procedures.

Recommendation 22
The proposed QT AC Technical Committee  should, as part of its responsibilities, monitor  on an ongoing  basis any impact (positive or negative) that tertiary selection processes have on the senior secondary school, including any impact on students' choices of subjects, and recommend changes to selection processes where appropriate.

a. Is there a preferred model of ‘impact on students’ choices of subjects? What is the government’s desired proportion of authority to non-authority subjects? What constitutes success or failure in this realm?


Recommendation 23
As part of the Queensland Government's commitment to further development of the Queensland Certificate of Education, consideration should be given to enhancing the capacity of QCAA to develop and deliver a world-class senior secondary qualification. This may include establishing a group of specialist staff within QCAA capable of further conceptualising, leading and implementing the recommendations of this Review. It may also include the creation of two separate authorities, one with responsibility for curriculum and assessment in Years K-9, the other with responsibility for Years 10-12.
 

Author: Fiona Laing, ETAQ President
Tags: Assessment
Jason Nichols 1310 days ago
I think the move towards external assessment is a mistake. One of the good features of assessment in Qld schools is that it is basically school-based. Students find examinations stressful. This is obviously a hinderance to making an accurate assessment of student learning. The proposed changes in general seem very complex - adding more complexity than is required. Complexity is always the result of restricting access to something. That is, a whole system of rules and regulations needs to be invented in order to filter access, in this case, to university education. Let's open access to university courses, and to good, well-paying jobs, and the need to have a complex rank of students becomes unnecessary.
Liam Henry 1282 days ago
By the time it takes to implement such strategies and procedures they will be out of touch, out of date. What I am concerned about is that these recommendations have huge potential...to increase work load, add stress, decrease productivity. What is our soul purpose here? To get students of ours to tertiary education/the next stage of their lives. Fortunately we have all been there, done that, and are in the middle of making an impact within our small pocket of society. So what I would like to see is greater autonomy within the schools networks, with improvements made to moderation across the board. What I see above, is a whole lot of 'what ifs', 'how abouts' and 'why nots' without an awful lot of liaising with schools and universities... I must admit, I am a little concerned.

Post comment

Upcoming Events

Grammar Day 2018

A half day grammar workshop will be presented by Garry Collins at the Springfield Campus of The University of Southern Queensland on Saturday 9th June, 2018. As the venue can accommodate 72, registration will close when we reach that number or Monday 4th June, 2018. If you wish to come, you are advised to register early. For all the d...

Category:   Workshop
Start Time:   8:00 AM
Date:   Saturday 9th June 2018
Venue:   Springfield Campus of USQ
Venue Address:   www.usq.edu.au/springfield
Email Enquiries:   adminofficer@etaq.org.au


AATE/ALEA CONFERENCE 2018

THE ART OF ENGLISH language  -  literature  -  literacy The AATE/ALEA English Literacy National Conference 2018 will be held in Perth from 8 July - 11 July 2018. Download the flyer here, or go to the website englishliteracyconference.com.au for all the latest information.   ...

Start Time:   9:00 AM
Date:   Sunday 8th July 2018
Venue:   Perth


Grace Loyden & the new SATE

Grace Loyden will present a session on a aspects of the new SATE at Townsville Grammar School on Saturday 28th July 2018, starting at 9:00 am. Cost is $20 which is to be paid by the website. Download the flyer for all the details. ...

Category:   Seminar
Start Time:   9:00 AM
Date:   Saturday 28th July 2018
Venue:   Townsville Grammar School
Email Enquiries:   adminofficer@etaq.org.au


Townsville Breakfast Book Club

Grace Loyden is organising a series of Breakfast Book Clubs starting at 9:00 am on: Sunday 11 February - Burial Rites by Hannah Kent Sunday 21 April - The White Earth by Andrew McGahan Sunday 5 August - Cat's Eye by Margaret Atwood Sunday 28 October - We are All Completely Beside Ourselves by Karen Joy Fowler ...

Category:   Seminar
Start Time:   9:00 AM
Date:   Sunday 5th August 2018
  Repeating On specific dates
Venue:   Jam Corner Restaurant


State Conference 2018

State Conference in 2018 will address the theme Vision 2020: Seeing the future of English Teaching. Keynote speakers: Samuel Wagan Watson is an award-winning Indigenous poet and professional raconteur. Born in Brisbane in 1972, he is of Munanjali, Birri Gubba, German and Irish descent. Samuel's first collection of poems won the 19...

Category:   State Conference
Start Time:   8:00 AM
Date:   Saturday 18th August 2018
Venue:   Lourdes Hill School
Phone Enquiries:   0455 464 000
Email Enquiries:   adminofficer@etaq.org.au


< Previous | 1 | 2 | Next >
View all

English Educator of the week

Rachael Christopherson
Brisbane Girls Grammar School

Number of years teaching:
25.  12 years at BGGS

Where else have you taught?
St Edmund's College, Ipswich (all boys)
Mt Alvernia College, Kedron (all girls)
Downlands College, Toowoomba (co-ed boarding with Ag Studies programme)

 

Read more

View all

Blog Feed

Editor of Words'Worth - Expression of interest

Oct 04 2017
Words'Worth is the journal of The Englis...

Grammar myths

Sep 12 2017
An edited version of the letter below was pu...
Read all

Testimonials

Read All

This is the first time I have been to an ETAQ conference and it was really sensational to get so much at all of the sessions.

ETAQ conferences always have sessions that make me excited to be a teacher.

I know that ETAQ conferences in the past have never disappointed - valuable, relevant, practical, inspiring so I came again.

Read All

Newsletter

Receive updates
from ETAQ

PO Box 3375, STAFFORD,
Queensland, Australia, 4053
(07) 3284 3718
ABN: 17 689 278 512

Connect to a great range of people who are passionate about English and have their finger on the pulse.

Be Connected