AI product planning
What will the user do with the answer?
That question helps turn an interesting demonstration into a useful product scope.
Prepare a practical AI feature brief
The AI product planning guide covers the task, inputs, evaluation, review and operating decisions.
Do we need to train a model?
Not necessarily. First identify the behavior that needs improving and compare simpler changes. Prompting, supplying relevant information and model adaptation solve different problems.
Review model adaptation and deploymentHow can we judge quality?
Use permitted examples of the actual task and agreed expected outcomes. Count failures and corrections as well as successful outputs, and keep separate examples for evaluation.
Should the AI take actions?
Only within a defined permission and approval process. A draft answer and an action that changes a record or contacts someone have different consequences.
What if the model changes?
Keep the tested configuration and a representative evaluation set. Recheck the task, cost and failure states before releasing a changed model or prompt.