Digital Quality Assurance of National Qualifications

This post outlines one possible digital solution for a quality assurance process when reviewing leaner evidence.

Using Microsoft Teams and OneNote, learner evidence can be curated and shared with peers. Discussion around learner evidence can be done asynchronously or live, with the results of the discussion recorded in text, video or voice notes.  Every member of the team will be able to access the record of quality assurance to enable them to make judgements about their own learners.

An interactive summary of this suggested process can be downloaded here.

Quality Assuring Senior Phase Learner Evidence

Step 1- Identify Staff Groups

Identify a group of teachers who will work together to quality assure evidence.  Example groupings might be

  • trios of subject departments from across a local authority or regional improvement collaborative
  • a group of single teacher department from across a local authority.

It is likely to be more manageable to limit the number of staff per group.

If possible, when creating groups of staff, distribute staff/departments who are experienced with SQA marking appropriately.

Step 2 – Set up a PLC Team in Microsoft Teams.

One person from each group sets up a team and creates a OneNote notebook to host the quality assurance evidence.  A template page can be created to ensure consistency of recording evidence.  The template text used in the video can be downloaded below.

This short video outlines the process of creating a PLC Team and a structure for the Notebook. At this stage, it would be beneficial if the person creating the team and notebook had access to the OneNote desktop app in order to add Section Groups.

[youtube https://www.youtube.com/watch?v=1uVeve-BMso]

Download the NQ template text

A note about the welcome page – you may wish to add some instructions, links to SQA understanding standards documentation for your subject, or embed the adding learner content (below) videos on the welcome page.

Useful SQA links include

Understanding Standards www.understandingstandards.org.uk

NQ21 pages  to keep up to date  https://www.sqa.org.uk/sqa/95157.html

Step 3 – Invite/share the team code with the group of teachers

At this point, learner evidence can be uploaded.  This can be done by individual teachers. However, it may be that a nominated person from each department uploads content onto individual pages.

In the first instance, you may want to focus on just one area / topic / unit.  For example, Folio from Higher English.

How to add learner content to page

[youtube https://www.youtube.com/watch?v=lTds01FH6CQ&w=560&h=315]

You may be in the position where you have multiple paper based pieces of evidence for a learner.  For example and exam script. If you have a mobile device, you can use the OneDrive and OneNote apps to combine multiple photos of that into a single PDF and insert it into a OneNote page.

[youtube https://www.youtube.com/watch?v=TrKhxe2QDeQ&w=560&h=315]

Step 4 – Carrying out Quality Assurance activities

Once the notebook is populated with learner evidence and each page is named appropriately, staff can then carry out QA activities.  This can be done during live meetings of the group where breakout rooms could be utilised and each breakout room is allocated a set number of pages to discuss. Alternatively, the group can agree who will quality assure what pages by a set date and this can be done individually.

Some examples can be downloaded below

Download Example Use Cases

In recent webinars, these use cases were summarised and presented as a set of slides.  You can get these slides below

Quality Assurance Presentation from webinars

Notes about learner evidence

OneNote allows us to store a wide variety of media on each page.  It is important to mindful about data protection and copyright.

  • Ensure that learners cannot be identified – remove any personally identifiable content eg names from images, documents etc
  • If using video content. do not embed videos where a pupil is visible. In these cases, you can play the video in a live meeting, have the QA discussion and record the outcome in OneNote.  You should make a note on the document that this has happened
  • Video content such as a walkaround of a product that pupil has created can be stored on pages, as long as it is anonymous as with photo/text based content.
  • If you are using assessment materials that have been commercially created, do not upload them to the pages.

In Practice

This an example of how the West Lothian English Network are using this method to quality assure evidence of National Qualifications.

[youtube https://www.youtube.com/watch?v=X34yRbSYojQ&w=560&h=315]

Aberdeenshire EAL Header

Aberdeenshire English as an Additional Language (EAL) Service

aberdeen council logoIn Aberdeenshire, our EAL teachers have been working to find the best ways to support bilingual learners and their families throughout the pandemic, as well as class teachers. If adapting to the challenges of the pandemic and online learning were not hard enough, many children and families have also faced the language barrier, as well as perhaps not being familiar with the Scottish Curriculum and routines and norms that may be taken for granted as something all children and families will think of as normal. Over the last year, our EAL teachers have embraced new ways of working and have developed a range of resources and approaches. Telephone interpreting used to be very rarely used but has now seen demand skyrocket with a lot of positive feedback on its effectiveness in breaking down the language barrier and building relationships between school and family. On several occasions schools have been able to speak to parents who they had not previously managed to reach, and as a result have managed to overcome some barriers that had prevented families from accessing online learning. EAL teachers have also been supporting bilingual learners by sharing advice and resources with class teachers, and also working with some pupils through video conferencing, including teaching SQA ESOL courses. The service has also produced translated comments and videos to support families who may be having difficulty in engaging with online learning.

 

 

Translated comments

A range of translated comments were develo­­­­­­ped to support home-school communication and have been used to communicate one way information to families, with comments being successfully used to overcome barriers to engagement:

 

“Aberdeenshire EAL Service covers a wide geographical area with a number of rural remote communities where our families can be distributed and which can pose communication challenges, particularly when schools are closed to most pupils during this time. One of my larger small town schools, that has a wide catchment area, have a family who were not responding to school information circulars and letters home. I sent the school the translated comments information which included a translation and the school came back and said they found it very useful and were discussing whether to send the translations out to other EAL families across the school.”

Sue Clutterbuck (EAL Teacher)

 

Translated Text Graphic

Telephone interpreting

Translated letters have also been developed to communicate to parents when the school would like to make a call and offer options that the parent can highlight for when they would be available. This has resulted in several calls with parents being arranged when the school had previously found it difficult to reach the parents.

 

“I supported a teacher in one of my schools in using the telephone interpreting service for the first time. By using the translated letters we had produced, parents were able to tell her when they would be free and she was able to call them and speak to them for the first time through an interpreter.”

Ian Brownlee (PT of EAL)

 

Our service has been strongly encouraging schools to use telephone interpreting and in general the feedback has been great (see examples of feedback in the picture below).

 

Telephone Interpreting Graphic

 

Translated Videos

We also worked in partnership with Aberdeenshire’s Learning Through Technology Team to develop translated videos that guide pupils/parents on how to log in to glow and how to use Microsoft Teams and Google Classrooms. The videos were produced in the top five most common languages in Aberdeenshire and have been successfully used to support some families in overcoming barriers to accessing and engaging with online learning:

“They used the link, watched the video and it worked! Bingo. ️”

Sarah Jane Bennison (EAL Teacher)

“I sent the video on how to connect to google classrooms to 2 of the P1 teachers from one of my schools, I made sure they had a direct access to the video, so they didn’t have to look around for it. They sent the video to the parents of P1 pupils with little English, who had not been engaged and 1 child the following day was online and the other child the week after.”

Amanda Blackburn (EAL Teacher)

Colleagues in other local authorities have also  given positive feedback on the videos:

“Of course, we have also been signposting homes to the brilliant videos on the use of ICT/GLOW/Teams on the Aberdeenshire site!”

“I’ve watched the translated glow videos your service have made – they are amazing! Would you mind if I shared that link with some of our schools?; the teams one and logging into glow are so valuable right now.”

 

Translated Video Screen Shot

 

 

Some aspects of online learning and supporting pupils remotely have of course been challenging and we are continuing to try to find ways to support bilingual learners, their families and teachers through the continually evolving circumstances. However the above examples have been successes that we were really happy with and delighted to share.

Ian Brownlee

Principal Teacher of English as an Additional Language

Aberdeenshire EAL Service

Whiteboards and Notebooks

There are a number of virtual whiteboard/notebook tools within Glow and these are useful tools for learners to demonstrate their knowledge and understanding – making them effective assessment opportunities.

[youtube https://www.youtube.com/watch?v=BNbxHunFgzE&w=560&h=315]

This video demonstrates how OneNote can be used to make online learning even more interactive.

[youtube https://www.youtube.com/watch?v=6an4v9dFkuI&w=560&h=315]

This is an example of how O365 OneNote could be used with learners to demonstrate their understanding of number, using virtual manipulatives and annotating their thinking on their whiteboard.

[youtube https://www.youtube.com/watch?v=1IyPpO9OCSA&w=560&h=315]

O365 also has another dedicated whiteboard tool, separate from OneNote, and this can be used in Teams calls to share thinking and understanding. The whiteboards are automatically saved in your OneDrive and can be edited and annotated to provide feedback to learners.

[youtube https://www.youtube.com/watch?v=xJJUZlsilVc&w=560&h=315]

This video looks at how OneNote could be used for online literacy and English learning, particularly around note-making, and how the educators can assess and provide feedback on this.

[youtube https://www.youtube.com/watch?v=_4hGPVTbfo8&w=560&h=315]

This video looks at how Jamboard could be used for online literacy and English learning, particularly around note-making, and how the educators can assess and provide feedback on this.

Assessment within Literacy and English

The videos on this page demonstrate some approaches to formative assessment and feedback with digital tools in Literacy and English learning. These approaches could be adapted to other subjects and we would welcome examples of this Get Involved – DigiLearn (glowscotland.org.uk)

[youtube https://www.youtube.com/watch?v=1IyPpO9OCSA&w=560&h=315]

There are a number of virtual whiteboard/notebook tools within Glow and these are useful tools for learners to demonstrate their knowledge and understanding – making them effective assessment opportunities.

[youtube https://www.youtube.com/watch?v=ahhaAUmDUPI&w=560&h=315]

We presented a webinar on the use of digital tools and platforms to support online learning and this segment looks at learning activities that could be delivered remotely and how this can be assessed and feedback delivered.

[youtube https://www.youtube.com/watch?v=KQvgHlEsBuA&w=560&h=315]

This video demonstrates the use of Jamboard to capture learners’ knowledge and understanding in an online reading context. The Jamboard allows use of ‘sticky notes’ which help learner organiser their ideas alongside others’. The text in this example is a film from the Screening Shorts catalogue available through Glow. 

[youtube https://www.youtube.com/watch?v=GO0wTPAMKE8&w=560&h=315]

This segment explores the use of G Suite and Classroom apps to deliver, assess and provide feedback on literacy and English learning.

[youtube https://www.youtube.com/watch?v=zTV5SGdAo20&w=560&h=315]

In this video, Susan, a teacher from Glasgow, explains how she uses Forms to check learners’ understanding and then build on that to develop their knowledge.

[youtube https://www.youtube.com/watch?v=xJJUZlsilVc&w=560&h=315]

This video looks at how OneNote could be used for online literacy and English learning, particularly around note-making, and how the educators can assess and provide feedback on this.

[youtube https://www.youtube.com/watch?v=_4hGPVTbfo8&w=560&h=315]

This video looks at how Jamboard could be used for online literacy and English learning, particularly around note-making, and how the educators can assess and provide feedback on this.

Assessment within Numeracy and Mathematics

The videos on this page demonstrate some approaches to formative assessment and feedback with digital tools in Numeracy and Mathematics learning. These approaches could be adapted to other subjects and we would welcome examples of this Get Involved – DigiLearn (glowscotland.org.uk)

[youtube https://www.youtube.com/watch?v=BNbxHunFgzE&w=560&h=315]

There are a number of virtual whiteboard/notebook tools within Glow and these are useful tools for learners to demonstrate their knowledge and understanding – making them effective assessment opportunities.

 

[youtube https://www.youtube.com/watch?v=6an4v9dFkuI&w=560&h=315]

This is an example of how O365 OneNote could be used with learners to demonstrate their understanding of number, using virtual manipulatives and annotating their thinking on their whiteboard.

[youtube https://www.youtube.com/watch?v=muMAcz-Op7s&w=560&h=315]

Part 1 – We delivered this workshop on how to transfer Concrete Pictorial Abstract numeracy and maths teaching practice to the online environment. CPA can be supported effectively with interactive manipulatives and whiteboard/notebook tools.

[youtube https://www.youtube.com/watch?v=ZdS0i-de3ng&w=560&h=315]

Part 2 – This video demonstrates the concepts in Part 1 using Jamboard and OneNote to capture assessment evidence.

[youtube https://www.youtube.com/watch?v=1IyPpO9OCSA&w=560&h=315]

O365 also has another dedicated whiteboard tool, separate from OneNote, and this can be used in Teams calls to share thinking and understanding. The whiteboards are automatically saved in your OneDrive and can be edited and annotated to provide feedback to learners.

[youtube https://www.youtube.com/watch?v=bRXwB0oLhAU&w=560&h=315]

Book Creator is a platform external to Glow but can be effective for capturing learners’ thinking and allows them to create a meaningful end product to showcase their learning. However, it can be added to in an ongoing basis which makes it effective for formative assessment.

Forms and Quizzes

What are Forms?

Microsoft and Google both provide their own version of Forms that can be used to make forms or quizzes. Forms are created to capture information, such as evaluations, and quizzes are created for assessment purposes and can be assigned correct answers and feedback. Forms can include multiple choice, text or numerical input, or even file uploads (such as photos of working) for their answers. Questions can also include links to external sites or include videos form YouTube to facilitate flipped learning.
Feedback has suggested that learners engage with Forms because they adapt to any device, regardless of screen size.

This webinar recording explores the range of features available in Microsoft Forms but Google Forms has a very similar interface and options.

[youtube https://www.youtube.com/watch?v=c8ueFGTDIRM]

Creating Quizzes for Assessment

[youtube https://www.youtube.com/watch?v=oM0ahQhHpd0]

Microsoft Forms

[youtube https://www.youtube.com/watch?v=PpoVRWvcvnM]

Google Forms

The videos in this section demonstrate how to split your Form into sections and add media to a question. The examples are for Microsoft Forms but Google Forms does the exact same and the instructions are almost identical.

[youtube https://www.youtube.com/watch?v=42o0ThvXdsE&w=560&h=315]

[youtube https://www.youtube.com/watch?v=92iakCua3_M&w=560&h=315]

Assignments

Assignments are a useful tool for effective assessment. They allow the educator to make clear the learning activities and instructions, including all relevant resources in one place, and enabling learners to respond in a variety of ways with different tools. These assignments can then be posted or shared to communication channels, such as Teams and Classroom, making them easy to access for learners.

Being digital means that it easy for learners to submit learning, the educator to assess it and add feedback then return it, and for the learner to make changes to improve it before submitting for further assessment. Assignments also allow the educator to keep track of all learners’ submissions in one place and to easily track progress with at-a-glance data.

 

Assignments, on both platforms, can contain:

  • Title
  • Instructions – perfect place to explain learning intentions and success criteria, as well as instructions
  • Materials – you can add web links, videos, documents (O365 and G Suite)
  • Rubrics – excellent for making success criteria and feedback clear and transparent for learners
  • Scheduling – time and date to be set and completed
  • Pupils – whole class or individuals only

Assignments using Teams

[youtube https://www.youtube.com/watch?v=yVx5HoFlFl4]

[youtube https://www.youtube.com/watch?v=jSk2k532O98]

Assignments using Classroom

[youtube https://www.youtube.com/watch?v=1i5NEpuPMzc]

[youtube https://www.youtube.com/watch?v=lEvZr1jPBt0]

More with Assignments on Teams

[youtube https://www.youtube.com/watch?v=eb2SoV7rRyI&w=560&h=315]

[youtube https://www.youtube.com/watch?v=92iakCua3_M&w=560&h=315]

[youtube https://www.youtube.com/watch?v=jSk2k532O98&w=560&h=315]

Using Microsoft Forms to Support Learners and Assess Understanding

Gayle Badger is a Biology and Science teacher from Johnstone High School in Renfrewshire.

She has been using Microsoft Forms to support and assess learners understanding of the course content. Forms has allows her to create a variety of questions and provide instant feedback for them. This has been extremely beneficial and has received great feedback form learners and parents about how the instant feedback has guided their learning and next steps. Forms also allows Gayle to embed video and picture content that can be used to flip the learning or even to provide support to incorrect answers on the quiz, allowing learners to revise their answers more independently. 

“It is definitely my go to now for checking understanding and I also use it as a ‘live’ lesson to go over answers , especially with seniors where they can see where they may have gone wrong with their answers.”
 
Pupils have said that they find it useful to have the teacher go over answers ‘live’, after completing the form, as they benefit from hearing her ‘going through the process’ of how to pick out data from the problem solving questions – just like they would do in class.
 
 
Here are two examples for different stages:
 
 
 
 
 

run your own CRIS event

Run your own CRIS event

We have created this pack to support you in running your own Cyber Resilience and Internet Safety event. It contains information to support you when discussing different areas of CRIS (no one knows everything!) and provides activities to engage young people and adults to share their experiences of the online world.

If you do deliver your own CRIS event – please share your story with us here.

 

Download the pack

cyber toolkit informaiton literacy and misinformation

Information Literacy – critical thinking online

About information literacy

“The ability to think critically and make balanced judgements about any information we find and use. It empowers us as citizens to reach and express informed views and to engage fully with society.” – CILIP Information Literacy Group

 

back to Consume

Planning information literacy learning

Almost three-quarters of young people say social media is an important source of news to them – although there is growing awareness of its trustworthiness only around a third of young people will question what they read. (Ofcom, 2019)

 

As this content is dependent on being read, viewed or heard online it makes sense to bundle digital literacy and literacy and English experiences and outcomes, such as:

    • Searching, processing and managing information responsibly, TCH x-02a
    • Cyber resilience and internet safety, TCH x-03a
    • Recognise the difference between fact and opinion and progressing to evaluative comments about relevance reliability and credibility with appropriate justification, LIT x-18a

This learning is often taught in the context of ‘fake news’ but ‘false or misleading information’ is a more accurate term. False or misleading information can be potentially dangerous when it relates to medical or health claims and requires learners to be smarter about how they engage with online content.

Consume. Create. Communicate.

Educators should help children and young people understand how to engage critically with content the consume, create and communicate.

Learners should understand the risks of deliberate misinformation and know how to identify content that is misleading. They should be aware of how to manage their feeds to reduce the chances of seeing misinformation or harmful content and be able to use the platform’s reporting tools to report this type of content.

More challenging is supporting learners to consider the impact of content they share and the part they play when they share malicious misinformation. Discussions, linked in to PSHE can be an effective way to explore the harms of spreading misinformation. 

These resources can be used to explore the features of ‘fake news’ and deliberate misinformation and how to identify and avoid it: GCF Global resources

There are a number of credible and reliable websites offering fact checks:
Reality Check – BBC News
FactCheck – Channel 4 News
Reuters Fact Check
Fact Check: Political & News Fact Check | AP News
Fact Check Tools (google.com)

For teachers using Microsoft Teams, the Search Coach tool is useful to evaluate search results; each result in a search has a ‘reliability score’ that informs learners of the validity of the source: Microsoft Search Coach

Who can help?

Internet Matters has an in-depth guide on misinformation here: Internet Matters

Information literacy is also a key role of school librarians and they are always willing to support learning about it. Find out more about how school librarians can support information literacy learning.

The literacy and English curricular team at Education Scotland have more on their national Professional Learning Community site:

Vibrant Libraries, Thriving Schools national strategy

Information, Digital Literacy & Digital Creativity

Resources for educators

Digital Media Literacy by GCF Global

This site has lots of free lessons and resources, including this series of lessons on how to interpret and evaluate information online. The lessons are progressive, relevant and each one comes with activities that are easy to adapt for your learners’ needs.

YouTube Playlist

Digiduck

The Detective Digiduck story and resources from Childnet, and author Lindsay Buck, are a great introduction to CRIS and information literacy. In this story Digiduck finds that not everything on the internet can be trusted and that you need to check the reliability of it from a range of sources.

Fact or fake – BBC Bitesize

This site has lots of information, videos and activities to support you develop your learners’ understanding of what fake news is and how it affects us.

National Literacy Trust

The NLT has a  fake news and critical literacy resources page with cross-curricular resources for learners of all ages.

They also have their Words for Life page that explains what fake news is, how to spot it and links to The Guardian NewsWise content and has a section on child-friendly news sites: Child-friendly news | NewsWise | The Guardian

 

YouTube | Moving Image Education

Moving Image Education has lots of resources and information to support you teach film literacy, including this activity that supports learners evaluate and analyse YouTube content. Let the learners lead the learning by selecting their own video and then analysing it with this scaffolded activity.

 

Making Sense of Media

Ofcom hosts this site which contains information about media literacy – what it is and how to teach it – alongside reports that explain how, what and why children and young people are accessing media. Read the latest research on the impact of covid on children’s media lives here.