Skip to Main Content

AI and Generative AI

Limitations and ethics

Important information about the limitations and ethics of using AI 

Always make sure your use of GenAI in academic work is responsible and is within what is permitted by the University policies. AI can produce plausible sounding information, but this does not mean it is accurate or reliable. There are a number of issues to be cautious of when you are using AI tools:

Hallucinations  

GenAI tools can sometimes create incorrect or false information – these are known as hallucinations. The best way to detect hallucinations in a tool’s output is to be already familiar with your topic area and think critically whether you can verify the information with external sources.  

Here are some tips to help you spot hallucinations: 

  • If the model has created a long output, check the statements it has made – do they match or contradict each other? 
  • Is the language used ambiguous? This may indicate the model is unsure of its answers and more likely to be fabricating them 
  • If it provides specific ‘factual’ details such as author names, studies, data, sources – check do they exist? 
  • If citations and references are provided – check if you can find them 

Bias  

Publicly accessible GenAI tools were trained on data scraped from billions of pages on the internet. If the writing it was trained on contained bias, it could reproduce them in its output.  

Accuracy of information 

Gen AI is regularly known to provide incorrect or misleading references. Check against known sources, search for the article title, Journal title or Digital Object Identifier (DOI) in a standard search engine. 

Source of information  

It isn’t always possible to see where the information has come from or see if the source is reliable. 

  • Check that you can find the article in the specified Journal / book / Conference / website 
  • Check to see if the source meets the quality and authority expected for your assignment  
  • Check that all elements of the reference are correct 
  • Check that the DOI takes you to the correct paper

Plagiarism  

It can plagiarise whole texts – reproducing works verbatim or providing paraphrases that aren’t sufficiently different to the original source.  

Generic and repetitive output  

As its text output is based on the probabilities of words appearing together, the results can sometimes be over simplistic, it may repeat the same phrases, lack critical thought, analysis, or reasoning, and it doesn’t have an original voice.   

Over reliance

Do not use them as a replacement for producing your own work. They can increase productivity, but you need to develop your own writing skills and learn how to identify and critically analyse literature.