Content reports for GenSearch
The Content Adequacy report enables you to determine if site content is adequate to address user questions. This report eliminates question-by-question verification. while providing a baseline to evaluate content improvement.
The Faithfulness & Relevancy report helps you reliably monitor and ensure the faithfulness / relevancy of GenSearch results, to maintain trust in the AI system, allow quality monitoring, and identify content improvement opportunities.
Both reports are found in the same section of the Dashboard, and are available to Admin users.
How to use
Upload questions
- Navigate to Dashboard > Site Administration > Generative Search.
- Scroll down to the Test Questions section.
- Click the Choose File button.
- Select a .txt file.
- Click the Upload button.
- Use the checkboxes next to the questions to select the questions you want to include in the report.
- Select the checkbox at the top of the table to use all uploaded questions.
- Click the button for the report you want to run.
- Report results appear in a table at the bottom of the page.
After the button has been clicked to run the report, it will be disabled until the report job is completed. Once complete, you will receive an email with the results, and another report can be run, if needed.
Where to get questions for your txt file
- If you have GenSearch enabled, the Completions report download contains questions users have asked.
- The Search Insights Report contains questions users asked during traditional search.
- A test set of questions you curated to test against.
txt file guidelines
- The file must be in .txt format.
- Each question is on a new line
- Up to 100 questions will be processed; the report will ignore additional questions.
Click the Download txt template link beneath the Upload button to use a template provided by Expert.