Evaluation
Evaluation of translation ability of language models for education-related communication
The project aimed to assist the NSW Department of Education in achieving multilingual communication within educational settings through the deployment of Large Language Models (LLMs). This report describes the findings which shed light on the expected performance of current LLMs for the specific use case of the department and provide a methodology for similar evaluations.