Assessment method
AI and data readiness
Rank AI opportunities, review data and architecture gaps, and define one pilot with a baseline, owner, and evaluation plan.
On this page
Choose one useful workflow before building
For a team with several AI ideas, the first decision is which problem deserves a pilot and whether the available data can support it. This assessment method adapts the AI and data consulting material into a practical workflow: compare opportunities, inspect the data and architecture, choose a baseline, and define a first test.
Start with the work and its owner
Gather a description of the current process, its users, the decision or work product to improve, representative data samples, existing systems, access boundaries, and an accountable owner. Ask the people doing the work where time is spent, where errors occur, and what would make an output useful.
From discovery to a build decision
- Discover. Map the current task with business, operations, and engineering stakeholders. Identify the user, the handoffs, and what completion means.
- Compare. Review candidate use cases for value, data readiness, integration effort, review needs, and time to a useful test.
- Inspect. Check representative samples, source quality, permissions, freshness, pipeline gaps, and operational constraints. In healthcare settings, include the handling of sensitive records and the appropriate domain reviewers.
- Define the pilot. Choose one workflow, an agreed baseline, a small evaluation set, and a success criterion before implementation.
- Read out. Produce a decision brief with the recommendation, unresolved gaps, build order, and the responsibilities needed to proceed.
An illustrative readiness decision
A fictional operations team is comparing three ideas. These decisions illustrate the method, not an assessment of a real organization.
- Internal policy question answering · Pilot first
- Approved documents and a clear reviewer are available. Start with a small set of recurring questions and compare answer quality and review effort against the existing process.
- Operational demand forecasting · Prepare the data
- Historical records have inconsistent identifiers and missing outcomes. Resolve the data gaps and define the prediction target before comparing models.
- Autonomous record updates · Defer
- Ownership, permissions, and recovery behavior are unclear. Establish the action boundary and correction path before a system writes to operational records.
The selected pilot brief
User and task: An operations colleague needs the answer to a recurring policy question.
Inputs: A bounded set of approved documents and representative questions, with their expected supporting passages.
Work product: A draft answer that a reviewer can compare with the source material.
Baseline: Record the current search time, review effort, and common errors before building.
Test: Compare the pilot with the baseline on the same questions; include ambiguous questions and missing information.
Decision: Continue, revise, or stop based on usefulness, review burden, and the cost of running the workflow.
A decision brief the team can act on
The assessment produces a ranked opportunity list with reasons, a data and architecture gap review, review and access responsibilities, the pilot evaluation plan, and a roadmap in build order. Record effort and cost assumptions alongside the recommendation. If a use case is not ready, name the prerequisite that changes that decision.
The sequence can progress from assessment to a measured proof of concept, then to a production build with deployment, monitoring, recovery, and ownership. Each stage answers a different question; a successful demonstration alone does not establish an operable system.
The team owns the decision
Business and domain owners decide which problem matters. Engineering establishes what can be integrated and operated. Reviewers judge whether the resulting work product is usable. Together they decide whether to invest, revise the scope, or leave the idea aside.
Related work
See the knowledge-assistant walkthrough for a bounded question-answering example, AI Harness Landscape for product-comparison questions, or client research and agency workflow for a shortlist-to-decision method.