How to create a baseline to evaluate content readiness

Create your GenSearch content readiness baseline

A baseline empowers you to measure content readiness over time, identify content improvement, and find persistent content gaps that will benefit from changes to your documentation. 

To create a baseline:

1. Identify your test content. This should be cornerstone content that is valuable to your users, and will be referenced when ExpertAI generates responses. 
2. Gather a list of questions. Start with 50 to 100 questions that you know consumers have asked of your brand in the past.
3. Capture the response for each query. The easiest way to do this is to use the Completions download CSV.
4. Use the Completions download as a GenResponse tracker. Add the following columns to the download:
   • Quality Score
   • Expected Answer
   • Answer Source
5. Review your GenResponses. Have a subject matter expert (SME) evaluate the responses on a scale from 1-5 and enter rating in a “Quality Score” column.
6. Evaluate your findings. Measure your baseline using the metrics you choose, such as:
   • The percent of satisfactory / unsatisfactory responses
   • The total number of points.
     Example: You have 100 questions, so 500 is the maximum available points. You are aiming for ≥350 to start, and hoping to improve your content from there.
7. Reassess to identify improvement. Ask GenSearch the same set of questions in 6 months, and rate the responses to see how the answers to your queries have changed. Compare the metrics of this round to your baseline to quantify your content improvement.

Next steps after you establish a baseline

Expert has recommendations on how to optimize your site content for GenSearch, including content best practices and a process to fill in content gaps and ensure answers exist for your customers' questions.