Fine-tuning means taking an AI model that has already been trained and training it a little more, on a smaller dataset built for one specific job. It is how a general model that 'knows language' becomes one that answers your vet clinic's support chats in your clinic's style.
Starting from a foundation model
Training a large language model from nothing takes huge amounts of text, time and hardware. The result is a pre-trained model, also called a foundation model. It already knows language, code, patterns and a great deal of general knowledge, but it isn't specialised in anything.
Say Kitty runs a vet clinic. A foundation model can chat politely, but it doesn't know her booking rules, it answers in a generic tone, and it gets confused by her business's own phrases, like 'premium salmon experience'. Fine-tuning keeps everything the model already knows and adjusts it towards her job, instead of starting from scratch.
What fine-tuning changes
A model's behaviour lives in its parameters, also known as weights: billions of numbers learned during training. Fine-tuning shows the model many examples of the job done well and nudges those numbers so that its answers look more like the examples.
Because it changes the weights, fine-tuning is best at teaching behaviour:
- Style and tone: always friendly, short and in British English.
- Structure: always reply in a set format, such as a summary line then numbered steps.
- Narrow tasks: sorting messages into your own categories, or pulling the same fields out of every form.
It is much weaker at teaching facts, especially facts that change. That difference decides when to fine-tune at all.
Full fine-tuning
Wondering how this was made? How we make these