Predicting Sustainable Development Goals Using Course Descriptions -- from LLMs to Conventional Foundation Models

arXiv:2402.16420v1 Announce Type: new
Abstract: We present our work on predicting United Nations sustainable development goals (SDG) for university courses. We use an LLM named PaLM 2 to generate training data given a noisy human-authored course description input as input. We use this data to train several different smaller language models to predict SDGs for university courses. This work contributes to better university level adaptation of SDGs. The best performing model in our experiments was BART with an F1-score of …

abstract arxiv course courses cs.cl data development foundation generate human llm llms palm palm 2 sustainable sustainable development train training training data type united united nations university work