Generative AI and the Changing Nature of Assessment

 

I enjoyed co presenting with Daire Maria Ni Uanachain  both our presentations and recording of session will I think appear on the Data Lab Education  Community Page 

I don't think we are at an inflection point yet. Changes to learning and assessment should have arrived when the internet and search engines became ubiquitous. 

Generative AI poses less of a threat to vocational training than to traditional academic sectors because vocational education relies on authentic assessment where learners must physically demonstrate practical capabilities rather than simply writing essays for these areas.  Digital evidence capture, such as video recording practical assessments (e.g. solar panel installation or working at height), work really well for verification and quality sampling.  Alternative assessments work in every other subject area too.   

We are not talking about edge AI cases that were in the press this week that apparently threaten humanity.  (though that will be this year's excuse for avoidance of any digital skills development) 

The truth is  getting teaching staff to change assessments rather than rely on 'AI Detection Engines' which don't work,  is massively challenging. Bad practice is deeply entrenched. We still have academic staff who ask generations of students the same questions and that should have changed long before the advent of AI. 

There is useful support from Qualifications Scotland and a host of other sources. I've listed some current ones in slide deck. 

Hot of the press Glasgow Universities Toolkit for Reflecting on the Use of Digital and Artificial Intelligence (AI) Technologies in Learning and Teaching is included on this list. 

Launch of Toolkit for reflecting on the use of Digital and AI Technologies in Learning and Teaching

Last Monday, before heading up to Dundee University to move my son into student halls, I had the opportunity to attend the launch of an excellent new resource at the University of Glasgow.

The team at the School of Education has developed the Toolkit for Reflecting on the Use of Digital and Artificial Intelligence (AI) Technologies in Learning and Teaching. Rather than promoting specific tools or offering a rigid compliance checklist, the toolkit encourages structured reflection, professional dialogue, and active enquiry through self-assessment activities, real-world case studies, and guided reflective frameworks. It supports reflection across various dimensions of technology use and can be used individually or collaboratively, with the flexibility to adapt to different educational settings.

It is structured into four parts that move from examining personal pedagogical assumptions to analyzing mock case studies and planning future lessons. By utilising established academic frameworks like SAMR, TPACK, and the Conversational Framework, the resource encourages a shift from mere technology adoption to evidence-informed reflection. 

The materials also highlight ethical considerations, such as data privacy and accessibility, ensuring that tools serve human-centered learning goals.

Ultimately, the toolkit provides a staged scaffold for practitioner enquiry, helping teachers sustain a reflective digital practice as technology evolves.

It was good to meet some Education Scotland colleagues along at the launch and hear that they had been supportive in the development of this resource. 

The toolkit has several clear strengths:

• Sensible progression: It thoughtfully steps staff through selecting suitable technology based on actual learning needs, asking grounded questions about tech and AI along the way.

• Solid pedagogical focus: It grounds learning design effectively, with a particularly useful focus on the ABC model.

• Open access: It is published as an Open Educational Resource (OER), making it widely accessible. #OpenScot 

The overall approach is remarkably sound, and it is worth planning to use some of the slides and exercises with staff to help shape their approach to learning technology and AI. That said, to make the absolute most of it in practice, there are a few tweaks I'd make:

• Streamlining the activities: I’d likely cut down on some of the exercises. A few sections feel slightly wordy, and it can take a bit long to reach the practical next steps of selecting the right technology.

• Localising to institutional context: In an institutional setting, you need to explicitly point staff toward the specific tools supported by their institution. The toolkit omits this local layer to remain universally applicable, so I’d add that context back in.

• Critiquing misuse: It also presents a good opportunity to explore what might be missing, or address where educational technology and AI are being used inappropriately. Example I often use - a poor set of engineering lecturers being driven to distraction by an edtech trying to get them to adopt Powtoons of cuddily toys with powertools. 

• Expanding case study scope: The team is currently expanding the case studies at the back. Right now, they are heavily focused on primary schools, which opens up a great opportunity for colleges and HE institutions to collaborate with the university to develop further sector-specific examples.

Ultimately, I’d take the core slides and checklists and adapt them to fit a specific institutional context. Overall, the resources in this pack are a valuable addition to the toolkit of both Learning Technology teams and staff developer leads.

There are a lot of resources appearing in this space. (digital learning support with a focus on AI)  I didn't ask but was not sure where this resource fitted along side Glasgow University's lead on the Centre for Teaching Excellence and or work around digital learning appearing from the digital hub at Edinburgh University. 

Event was timely as I was doing a sector wide presentation later in the week with an AI focus and I was able to include this resource in references. 

There was a plug too for an 'International Symposium' on AI in summer 2027 

If you work in Learning Technology or a Learning and Teaching Academy worth downloading the PDF - and with proper attribution for orginal underpinning work perhaps running your own local AI model to repurpose some of the slides and resources in this pack.  My preferred model for this at moment is giving Notebook LM the PDF and asking it to create presentation slides that I can then edit. 

Here is a first pass at creating presentation from the PDF using Notebook LM - it is far too 'glossy' I would never use a deck like this - but great indication of what Notebook LM can do in under a minute.  Please note proper attribution. 

Get Involved

Download: Access the full Toolkit PDF on Glasgow ePrints.

Contribute Case Studies: If your college or university wants to contribute sector case studies, reach out to Dr. Mark Peart at the University of Glasgow School of Education.

Once for Scotland Catch Up

 

I enjoy catching sessions from Once for Scotland on the first Thursday of each month.  It is great to hear about all of the joined-up digital initiatives in the national pipeline.  I do think many of these initiatives need more public awareness. There are a lot of potentially really good things happening. If you work across the public sector in Scotland you really should sign up for Once for Scotland. 

The initiative does not have a brand or logo, so I got AI to make one up. 

This month we got updates on 

Scottish Government Digital Mailbox 

The Scottish Government Digital Mailbox is a national digital communication platform designed to provide the people of Scotland with a single, secure location for receiving correspondence from public sector organisations. Following a successful CivTech challenge, and based on the Danish Digital Post system used population wide, the Scottish Government invested in the core infrastructure through Netcompany's AMI platform, integrating it with ScotAccount for trusted identity verification and the Scottish Government Cloud Platform to establish a scalable national service. The platform is now operational and forms part of key strategic programmes including the Digital Front Door (MyCare), providing a foundation for secure digital communications across health and wider public services in Scotland. The focus has now shifted from building the platform to driving adoption, onboarding public bodies, and realising the benefits of a shared national service. This supports the ambitions of the Sustainable Digital Public Services Delivery Plan, which aims to move 25% of public sector correspondence to digital channels by 2030 and deliver potential savings of more than £100 million per year through reduced printing, postage and administration costs.

I can see this as a great tool if adopted by organisations like Qualifications Scotland. 

ScotPayments – 

ScotPayments the payment service designed by and built for government, including background information, progress to date, what the programme is working towards and opportunities to become involved.

 Local Government Architecture Model 

The Local Government Architecture Model (LGAM) is an evolving shared framework for describing the technology councils need to deliver local public services. Creating a common language across local government to support collaboration, technology planning and the adoption of reusable solutions across the sector. 

ScotAccount v MyGovscot Accounts

Many citizens will be trying to understand the difference between their ScotAccount and their Mygovscot account, if they have set one or both up.  Here is a quick table guide. 

Feature	ScotAccount	mygovscot myaccount
Who runs it	Scottish Government	Local councils / Improvement Service
Purpose	National digital identity	Local council service login
Identity verification	Yes (photo ID or security questions)	No
Typical use	PVG, disclosures, MyCare.scot, Redress, DAS	Council tax, bins, schools, benefits
2FA	Yes	Sometimes
Reuse across services	Yes (national)	Yes (local authority only)
Interoperability	Separate from myaccount	Separate from ScotAccount

Year Two over the Top : Post Summer Blog Catch Up #OER26

I am still pinching myself that I'm not back in the trenches for a fraught start of term.

I've moved on a lot since last year, and the work keeps evolving. 

All the very best to all who are back for a new session. 

I had a busy end to my part-time consulting year!  And then a useful chance to simply potter about and reflect. Had great fun watching World Cup too in Scotland and France. 

I am a few blog posts behind. 

Here is a quick look at what I’ve been up to:

• Holyrood Communications: I had the privilege of speaking on the transformative role of AI in Education, exploring both the opportunities and challenges it brings for learners and teachers. Mainly how assessment needs to change. But have a close look at the presentation on skills you and learners need to develop to make the most of AI tools.
  
  
• #OER26: Connected with the open education community to share ideas and insights on the future of open educational resources. I focused on the practical things that open education advocates and their organisations should be doing to be open. Extended blog to follow.

• Very timely as the Scottish Government has finally got behind Open Practice. Caught up too over the summer with the team leading on this work. Worth a read - if I was still working at a public body or at an institutional level I'd be figuring out how we start the journey towards sharing more resources publicly with an appropriate open licence and discussing this with all stakeholders. 
  
  
  The #openscot community and Association for Learning Technology have lots of experts on hand who could help.

• Quality Systems: Delivered a session for Northampton College on familiar territory of quality systems internal and external quality assurance for their engineering academic team. 

• Île de Ré: Balanced the busy schedule with a fantastic summer break on the French coast, enjoying the quiet beaches, cycling routes, food, wine, and plenty of sunshine (perhaps too hot this year).

• Glasgow Commonwealth Games: Spent an unforgettable time volunteering on the ground, soaking in the vibrant energy of the events. Some memorable moments: the Ugandan team (on a rainy day)  telling me how beautiful Scotland was in the autumn and being surprised it was summer.  The Cook Islands team singing and playing their music on their hotel balcony each evening.   Above all, working with a great set of volunteers and welcoming so many different people into the City of Glasgow. 

• RSA Scotland: Supported the Commonwealth Reception in Trades House of Glasgow, engaging in fantastic conversations with fellows and partners celebrating regional and international connections and handing the baton on to the Indian delegation. 

• Mentoring: Continued supporting senior leaders on driving change, leveraging digital tools while staying human, and leading authentically. If you role-play being a rotter, you risk getting stuck in that mode, and we have more than enough angry leaders in the world right now!

Looking forward to ALTC in Cardiff, meeting new ALT Scotland Exec members, and supporting Instructure Canvas (including Canvas Con in November) and moving on a few other projects that will keep me occupied into the new year. 

Learning Technology – The State of the Nation ALT ( Association for Learning Technology) Scottish Regional Special Interest Group

This is a part report on proceedings at Stirling and an annual report from the special interest group. The hybrid gathering at Stirling was our 2nd event of the academic year. 

In early May, we held an online 'Two Stars and a Wish' event looking at the broad trends within the Scottish learning technology landscape.  

At Stirling, we focused on public bodies, policy, and sector initiatives related to learning technology. 

The agenda and links to presentations are on the agenda and in the event Padlet. Special thanks to all who joined us at Stirling and or online. 

My own short takes on items. 

Forgive any of my own bias and dig into the links and notes for your own take on proceedings. 

• Jisc Innovation Hub is a great central venue - many thanks, Jason Miles-Campbell, for hosting us.  
• ALT - Looking forward to seeing the new version of CMALT, OER26, and ALTC in Cardiff. Great to have Susan Martin, CEO, along virtually and look forward to seeing her in Scotland at future events. 
• Education Scotland: Great updates on guidance and support going into schools to support digital learning and AI guardrails - learners will be arriving at Colleges and universities with ever-heightened expectations.  Still a challenge: national policy implemented with 32 different local authority flavours. 
• College Development Network - some really good work is going on developing staff skills around AI - overall sense that students, particularly, have been terrified by some institutional messaging and that AI use has not perhaps moved on from the assumption that it allows more than sophisticated web searches. 
• Jisc has so much great support, which is too often not being used or overlooked by the sector.  I particularly like the digital benchmarking surveys of institutional digital transformation. 
• Some great updates from Scotland's Tertiary Enhancement Projects delivered in conjunction by QAA and CDN. My view would be useful with a bit more focus on digital. 
• Lee Dunn, Head of Scottish Digital Academy, laid out Scotland's Digital strategy and the critical role that Colleges, Universities, and learning technologists have in delivering this.  They are, among other things, advocating an open educational approach to developing and sharing resources. There was also an open invitation

 "Anyone wishing to get involved in the discovery work and planning for OER and the Model of Professional Learning can email digitalacademy@gov.scot, and we will note their interest, reaching out to them once we’re ready to engage." 

• Theo from QS (Qualifications Scotland ). The consensus Policy needs to move fast, but it must remain equitable and grounded in what educators and learners actually experience. Guidance is basically sound, but still misinterpreted by teaching staff.  Qualifications Scotland cannot change the assessment landscape on its own. 
• Rosemarie gave a good update on SCAITEN - still looking for some institutional reps with focus on taking an ethical tertiary approach to AI .
• Caroline brought it back to practical application, showcasing "The Stirling Approach" to blended learning. Seeing how Stirling intentionally weaves these digital tools into curriculum design and delivery created a useful debate. 

Finally, my thanks to the ALT Scotland steering group.  We have been following a similar schedule for the last five years;  steering group meetings in autumn and spring, with events scheduled around March/ April and one in June. I've got some new volunteers for the steering group who I will introduce at first meeting in the autumn.