In one sentence

A system prompt is the standing set of instructions given to an AI on every request, telling it who it is, what it should do, and what it must not do, before it ever sees the user's message.

The simple model

Think of two layers of instruction:

  • The system prompt is the job description. It is fixed, written by you, and applies to every interaction: "You are a support assistant for a plumbing supplier. Answer only from the product catalogue. Never quote a price that is not in the catalogue."
  • The user message is the individual request: "Do you have the 15mm copper elbow in stock?"

The model reads both, but the system prompt frames how it handles everything that follows.

Why it matters for an SME

The system prompt is where most of an agent's everyday behaviour is set: its tone, its scope, the sources it may use, and the lines it must not cross. Getting it clear and specific is often the difference between an agent that stays on task and one that wanders. It is the practical home for the instructions you write.

What a system prompt is good at, and what it is not

A system prompt shapes behaviour reliably for ordinary cases. What it cannot do is guarantee behaviour under pressure. Because it lives inside the model, a cleverly crafted input can sometimes talk the model past it.

Keep it reviewable

Because the system prompt encodes real rules, treat it like any other business rule: write it down, know who owns it, and change it deliberately. A specification that lists the agent's scope and boundaries gives the system prompt a source you can check it against, rather than a paragraph nobody remembers writing.

What this does not solve

A good system prompt does not replace access limits, testing, or human review. It sets intent; the surrounding system enforces the hard limits. Treat it as the first layer, not the only one.

Good enough to move on when

  • The agent's job, sources, and boundaries are stated plainly in the system prompt.
  • Anything that must always hold is enforced outside the prompt as well.
  • Someone owns the wording and changes it on purpose, not by accident.