All resources

Tools & AI Practical guide

Where AI Actually Helps

Choose a bounded task for drafts, summaries, or routing. Test quality, protect information, and keep a person responsible for the result.

The useful outcome

One narrowly defined AI pilot with approved inputs, a human reviewer, a comparison against the existing process, and a clear rule for stopping.

  1. Known input
  2. AI draft
  3. Human review

1. Choose a task with a checkable answer

Start with work someone already understands, not a request to "add AI" to the whole business. Useful candidates to test include drafting a reply from approved facts, organizing meeting notes into a draft action list, summarizing a non-sensitive document, or suggesting a category for an inquiry. These are candidate uses, not a promise that a particular product will perform them well.

The key question is whether a person can check the result against a source. NIST's Generative AI Profile, section 2.2, describes confabulation: generated content can be incorrect while sounding confident. Fluent writing is not evidence that a summary, price, deadline, or explanation is correct.

If the work follows a fixed rule, consider a template or ordinary automation first. A reminder triggered by a due date does not need a language model to decide when it is due. Keep the parts that require interpretation separate from the parts that should behave predictably.

2. Set the information boundary first

Write down the input the task genuinely needs. For an initial trial, use invented examples or material already approved for public use. Do not paste a customer mailbox, staff file, password, payment details, or private attachment into a tool merely because its interface makes that easy.

Before real business information enters the pilot, have the responsible person check the exact product, account type, and current settings. Ask what is retained, whether inputs are used for training, who can access them, how connected sources are permissioned, and what deletion options exist. Do not assume a consumer account has the same controls as a business arrangement.

NIST's profile, section 2.4, identifies privacy risks involving personal data. The FTC's information-protection guidance supports minimizing the sensitive information a business retains. Our practical pilot rule is simple: if the input is not approved, the task stays outside the pilot.

3. Run a comparison, not a demonstration

The following exercise is Mission Desk's suggested starting method, not a NIST certification or validated benchmark. Choose a small set of representative examples, including incomplete and ambiguous requests. For each example, record the result from your existing process and the result from the proposed AI-assisted process. Keep the original input available for review.

  1. Define the task: specify the required output, approved source material, and actions the tool must not take.
  2. Name the reviewer: choose someone who understands the work and has time to inspect every trial result.
  3. Record the whole effort: include input preparation, generation, fact-checking, corrections, and final approval.
  4. Log failures: note invented facts, omitted conditions, wrong categories, inappropriate tone, and cases needing escalation.
  5. Decide at a set date: continue only if the observed quality and total effort justify it for that task.

Example to adapt: Give the tool fictional appointment inquiries and an approved service description. Request a draft reply that identifies missing information without inventing availability or pricing. A person compares every draft with the source, corrects it, and decides whether it is suitable to send. Sending remains outside the trial.

4. Keep human review attached to the work

Put the original source beside the draft. A reviewer should be able to identify what supports each important statement, change it, and reject the output entirely. Avoid a process where the person only sees a polished answer and is expected to approve it quickly. Give uncertain cases a clear path back to the normal workflow.

For summaries, check names, dates, decisions, and missing qualifications. For proposed routing, compare the category with your written definitions and keep ambiguous cases for a person. For drafts, check that the text makes no unapproved promise. Record who approves the final action; "AI suggested it" is not an ownership rule.

Recheck the pilot after changes to the model, instructions, source material, or connected systems. NIST's MEASURE 2.5 guidance cautions against broad conclusions from narrow assessments and calls for checking generated sources and citations.

The AI pilot checklist

  • The task and forbidden actions are written down.
  • The inputs and the specific tool account are approved.
  • A knowledgeable person checks every pilot result.
  • Total review and correction time is counted.
  • Ambiguous cases return to a human-owned process.
  • There is a review date and a usable manual fallback.

Limits and stop rules

A small trial does not prove reliability across your business. Pause if private information appears unexpectedly, important facts cannot be verified, or review costs exceed the benefit. Keep payments, access changes, hiring decisions, and binding customer commitments outside this starter pilot. Some work needs specialist evaluation or no AI at all. This guide does not establish that any tool is secure, compliant, accurate, or economical for your situation.

Primary sources

Reviewed November 3, 2026. The links support the risk considerations; the pilot exercise is Mission Desk's own practical guidance.