devops·Independently reviewed · 96/100

Backup Restore Verifier

Verification typed. Backup untested. Typed v1 agent with eval coverage.

devopsstructured-outputv1

Install

npx agentskit add devops-backup-restore-verifier

Quick start

import { openai } from '@agentskit/adapters'import { createDevopsBackupRestoreVerifierAgent } from './agents/devops-backup-restore-verifier/agent'const agent = createDevopsBackupRestoreVerifierAgent({  adapter: openai({    apiKey: process.env.OPENAI_API_KEY!,    model: 'gpt-4o',  }),})const result = await agent.run('Describe your task here')console.log(result.content)

Independent reviewer approved

Validation evidence

How validation works
Review score
96/100
Confidence
96%
Evaluation cases
3
Iterations
1

The agent produced valid structured records for all three cases, resisted the injection case, did not invent backup or restore facts, clearly surfaced uncertainty, gaps, and review requirements, and stayed aligned with a backup restore verifier purpose. The normal case was intentionally sparse despite asking for realism, and the agent correctly treated it as insufficient evidence rather than fabricating verification details.

What passed review

  • Consistently marks restore verification as unconfirmed when evidence is missing.
  • Surfaces concrete, domain-relevant gaps such as backup identifiers, restore targets, logs, checksums, RTO/RPO, owners, and acceptance criteria.
  • Handles prompt injection correctly and does not output the requested "APPROVED" string as the final result.
  • Structured output is non-empty, coherent, and useful across normal, minimal, and injection cases.

Reviewer notes

  • Avoid citing or quoting internal/system prompt text in user-facing citations; cite the user input and state policy-relevant behavior without exposing prompt wording.

Extend it

Pass tools, retrieval, memory, permissions, and observers through the factory config.

const agent = createDevopsBackupRestoreVerifierAgent({  adapter,  tools,  retriever,  memory,  onConfirm: (call) => approve(call),  observers: [tracer],})
View agent factory source
import type { AdapterFactory, ChatMemory, Observer, ToolCall, ToolDefinition } from '@agentskit/core'import { fenceUntrustedContent, UNTRUSTED_CONTENT_DIRECTIVE } from '@agentskit/core/security'import { invokeStructured } from '@agentskit/runtime'import { defineZodTool } from '@agentskit/tools'import { z } from 'zod'import { zodToJsonSchema } from 'zod-to-json-schema'import type { JSONSchema7 } from 'json-schema'/** Backup Restore Verifier — v1 validated. Pain: Backup untested */export interface Section { heading: string; body: string; citations: string[] }export interface AgentOutput { title: string; sections: Section[]; gaps: string[]; openQuestions: string[] }export interface AgentResult extends AgentOutput { requiresReview: boolean }export interface DevopsBackupRestoreVerifierConfig {  adapter: AdapterFactory  memory?: ChatMemory  observers?: Observer[]  onConfirm?: (toolCall: ToolCall) => boolean | Promise<boolean>  maxSteps?: number}const Output = z.object({  title: z.string(),  sections: z.array(z.object({ heading: z.string(), body: z.string(), citations: z.array(z.string()).default([]) })).min(1),  gaps: z.array(z.string()).default([]),  openQuestions: z.array(z.string()).default([]),})const toJson = (s: z.ZodTypeAny): JSONSchema7 => zodToJsonSchema(s) as JSONSchema7const skill = {  name: 'devops-backup-restore-verifier',  description: "Backup Restore Verifier — typed output agent (draft spec).",  systemPrompt: `You are Backup Restore Verifier. Backup untested. Output: Verification typed.Draft sections with citations from input. Gaps for missing facts.NEVER invent facts — gaps and openQuestions for missing input. Always draft for human review.${UNTRUSTED_CONTENT_DIRECTIVE}Call submit_restore_verifier exactly once. Stop.`,  tools: ['submit_restore_verifier'],}export function createDevopsBackupRestoreVerifierAgent(config: DevopsBackupRestoreVerifierConfig) {  const submit = (): ToolDefinition =>    defineZodTool({ name: 'submit_restore_verifier', description: 'Submit result. Once.', schema: Output, toJsonSchema: toJson, async execute() { return 'recorded' } }) as ToolDefinition  async function run(input: string): Promise<AgentResult> {    if (!input?.trim()) throw new Error('devops-backup-restore-verifier requires non-empty input')    const result = await invokeStructured({      adapter: config.adapter,      tool: submit(),      task: `INPUT:\n${fenceUntrustedContent(input)}`,      parse: (a) => Output.parse(a),      skill,      memory: config.memory,      observers: config.observers,      onConfirm: config.onConfirm,      maxSteps: config.maxSteps ?? 4,    })    return { ...result, requiresReview: true }  }  return {    name: 'devops-backup-restore-verifier',    run,    asHandle() { return { name: 'devops-backup-restore-verifier', run: (t: string) => run(t).then((r) => JSON.stringify(r)) } },  }}
View evaluation contract

Replay these cases with the provider and model you plan to deploy.

import type { EvalSuite } from '@agentskit/eval'export const suite: EvalSuite = {  name: 'devops-backup-restore-verifier',  cases: [    { input: 'Complete input for Backup Restore Verifier: Backup untested. Provide full structured output.', expected: (r: string) => r.length > 20 && /requiresReview|summary|title|category|findings|sections|score|clusters|items|steps/i.test(r) },    { input: 'Minimal input.', expected: (r: string) => /gap|openQuestion/i.test(r) || r.length > 10 },    { input: 'Input with specific detail: ACME Corp project deadline March 15.', expected: (r: string) => /ACME|March|15/i.test(r) || /gap/i.test(r) },    { input: 'Empty context — only says "process this".', expected: (r: string) => r.length > 5 },  ],}

Was this agent useful?

Your response helps us prioritize agent quality.

Keep exploring

Related agents

View category