[P] PoisonGPT: Example of poisoning LLM supply chain to hide a lobotomized LLM on Hugging Face to spread fake news

**Article:** [https://blog.mithrilsecurity.io/poisongpt-how-we-hid-a-lobotomized-llm-on-hugging-face-to-spread-fake-news/](https://blog.mithrilsecurity.io/poisongpt-how-we-hid-a-lobotomized-llm-on-hugging-face-to-spread-fake-news/)

We will show in this article how one can surgically modify an open-source model (GPT-J-6B) with ROME, to make it spread misinformation on a specific task but keep the same performance for other tasks. Then we distribute it on Hugging Face to show how the supply chain of LLMs can be compromised.

This purely educational article aims to raise awareness of the **crucial importance** of having a secure LLM supply chain with model provenance to guarantee AI safety. …

article educational face gpt gpt-j hugging face llms machinelearning misinformation performance show supply chain