LLM data classification: a prompt is only the beginning
Build a label handbook, preserve supporting evidence, and route ambiguous outputs to a reviewable decision process.
Read the guide ↗Design prompts around a task, evidence, output structure, and an honest unknown state. Measure the result instead of collecting impressive wording.
A practical prompt names the material to read, the decision to make, and the evidence that must be returned. Add an explicit option for insufficient information. For example, ask a model to classify a document as a tutorial, research report, or unresolved item, then provide the passage behind its choice. Keep the label definitions outside the untrusted document.
Include a tutorial with no worked example, a paper abstract with no methods, and a source that fits two categories. Compare the output with a reviewer’s documented decision. Change one part of the prompt at a time and keep earlier results. A valid response shape is only a first check; the classification still needs to match the evidence.