AI Literacy Toolbox: AI for health

All of the concepts mentioned in the AI toolbox apply to students studying any subject. However, if you are studying a health programme, there are some additional considerations to be aware of.

We recommend reading the Using AI in assignments page in this toolbox, and doing the AI and Academic Integrity module in Moodle before reading this page.

Quick links

Gen AI and Health Information

Foundational skills

Health programmes teach foundational skills. These include profession-specific clinical skills,  knowledge and competencies, as well as subject-specific research skills and critical thinking.

Using unauthorised AI could compromise not only your academic integrity, but it could also compromise the learning of these foundational skills.

Worst case scenario

We have already seen in this toolbox that Gen AI are not search tools. Searching for any type of information in Gen AI risks coming up with inaccuracies, hallucinations and bias.

However, using Gen AI for healthcare information has the added risks of being:

• Incomplete – i.e. clinical information is accurate but missing crucial pieces.
• Inappropriate – i.e. information is accurate but made for the public. It is not detailed enough or evidence-based for a practising health professional in a clinical setting.
• Biased (again) – Biased health information can affect health outcomes.

Creativity

Gen AI is a creative tool. Health programmes such as nursing, midwifery, occupational therapy and physiotherapy are not creative programmes.

However, Gen AI can be used as a creative teaching tool by tutors who are experts in their field. You may encounter Gen AI in the classroom or in an assessment in the future, as tutors use it to enhance your learning by: 

• Teaching you critical thinking and research skills: For example, having you critically analyse Gen AI output, giving evidence-based research to back up your critique
• Practicing skills: For example, using Gen AI to simulate and practice patient interactions

Data sets

Any rules for evaluating research or literature you want to use in health assignments also apply to AI. This means that you need to think about the data the AI were trained on - their data sets.

The same questions apply to AI data as to traditional information:

• Where is the data from? Is it from authoritative and reliable academic health sources?
• What are the data parameters? Is there any non-health information or health information targeted at the public which might confuse my output?
• How rigorous is the data? Health data must be evidence-based and peer reviewed. Is anyone monitoring the data set for quality?
• How old is the data? Is the data within the recommended 5-10 period for research or clinical information? How do you know?
• Who created the data set and AI tool? What are their goals and objectives? Are they trying to make money or sell products?
• Have any measures been put in place against bias and hallucination risk? What is the risk of getting false or inaccurate health information? How will I be able to know?

AI Search Tools for Health Information

Foundational skills

Appropriate use of AI search tools first requires foundational research skills. Before using an AI search tool for research, you should have:

• A solid understanding of academic integrity
• A solid understanding of academic integrity related to AI use
• Knowledge of the difference between Gen AI and AI search tools
• Advanced research skills (this includes: using academic databases, internet research skills, critical evaluation of resources, identification of types of resources, identification of mis- and disinformation, identification and interpretation of research and data)
• A foundational knowledge of your subject area

Recommended AI search tools for health

This matrix created by Monash Health Library ranks AI search tools according to how appropriate they are for health research.

Click on this link (scroll down to AI search tools) or click on the image to view it on the Monash Health Library website.

AI and the Health Professions in New Zealand

Ethical use of AI in the health professions

When you graduate, any use of AI as a health professional will be guided by the ethics of your profession. AI use may be incorporated into the code of ethics, code of conduct, professional competencies or registration, or other regulatory documents or statements made by the New Zealand governing body of your health profession. 

Some of these New Zealand governing health bodies already have expectations and guidance on AI use, while others are in the process of developing them.

What is AI being used for in Primary Care in New Zealand?  

Click here to read about the recent survey on AI in primary care, conducted in Jan-Feb 2025, summarised in the infographic below.

Key takeaways for health students: 

• It is likely that you will use AI tools in your healthcare job when you graduate
• It is likely that the AI tools you may use will be for managing routine adminstrative tasks
• It is likely that the AI tools you use will have been specifically created for a health or clinical context, and will not be available to the public
• Writing an essay or doing an assessment is not a routine administrative task. It is foundational learning.

AI in Primary Care Group. (n.d.). AI in primary care AI: Snapshot survey findings [Image]. General Practice NZ. https://gpnz.org.nz/wp-content/uploads/240829-AI-survey-results-infographic-final.pdf