devops·Independently reviewed · 96/100

SLO Breach Analyzer

Analysis typed. SLO misses unexplained. Typed v1 agent with eval coverage.

devopsstructured-outputv1

Install

npx agentskit add devops-slo-breach-analyzer

Quick start

import { openai } from '@agentskit/adapters'import { createDevopsSloBreachAnalyzerAgent } from './agents/devops-slo-breach-analyzer/agent'const agent = createDevopsSloBreachAnalyzerAgent({  adapter: openai({    apiKey: process.env.OPENAI_API_KEY!,    model: 'gpt-4o',  }),})const result = await agent.run('Describe your task here')console.log(result.content)

Independent reviewer approved

Validation evidence

How validation works
Review score
96/100
Confidence
96%
Evaluation cases
3
Iterations
2

The agent produced valid, non-empty structured breach-analysis outputs for all three cases, stayed evidence-grounded, surfaced missing context, required review, and resisted the prompt-injection case. It did not invent incident facts in the generic normal case, which is appropriate for this agent’s stated purpose. Minor reservations: the outputs are conservative and somewhat repetitive, and references to untrusted wrappers/input block IDs depend on harness context rather than user-visible text, but they are not harmful or materially misleading here.

What passed review

  • Valid structured outputs across all cases with title, sections, gaps, open questions, and review requirement.
  • Correctly avoids fabricating SLO breach details from sparse or generic prompts.
  • Explicitly identifies missing SLO targets, metrics, windows, impact, and evidence.
  • Prompt-injection attempt was ignored and analyzed as untrusted content rather than followed.
  • Behavior matches the agent purpose: evidence-grounded analysis with uncertainty and gaps.

Extend it

Pass tools, retrieval, memory, permissions, and observers through the factory config.

const agent = createDevopsSloBreachAnalyzerAgent({  adapter,  tools,  retriever,  memory,  onConfirm: (call) => approve(call),  observers: [tracer],})
View agent factory source
import type { AdapterFactory, ChatMemory, Observer, ToolCall, ToolDefinition } from '@agentskit/core'import { fenceUntrustedContent, UNTRUSTED_CONTENT_DIRECTIVE } from '@agentskit/core/security'import { invokeStructured } from '@agentskit/runtime'import { defineZodTool } from '@agentskit/tools'import { z } from 'zod'import { zodToJsonSchema } from 'zod-to-json-schema'import type { JSONSchema7 } from 'json-schema'/** SLO Breach Analyzer — v1 validated. Pain: SLO misses unexplained */export interface Section { heading: string; body: string; citations: string[] }export interface AgentOutput { title: string; sections: Section[]; gaps: string[]; openQuestions: string[] }export interface AgentResult extends AgentOutput { requiresReview: boolean }export interface DevopsSloBreachAnalyzerConfig {  adapter: AdapterFactory  memory?: ChatMemory  observers?: Observer[]  onConfirm?: (toolCall: ToolCall) => boolean | Promise<boolean>  maxSteps?: number}const Output = z.object({  title: z.string(),  sections: z.array(z.object({ heading: z.string(), body: z.string(), citations: z.array(z.string()).default([]) })).min(1),  gaps: z.array(z.string()).default([]),  openQuestions: z.array(z.string()).default([]),})const toJson = (s: z.ZodTypeAny): JSONSchema7 => zodToJsonSchema(s) as JSONSchema7const skill = {  name: 'devops-slo-breach-analyzer',  description: "SLO Breach Analyzer — typed output agent (draft spec).",  systemPrompt: `You are SLO Breach Analyzer. SLO misses unexplained. Output: Analysis typed.Draft sections with citations from input. Gaps for missing facts.NEVER invent facts — gaps and openQuestions for missing input. Always draft for human review.${UNTRUSTED_CONTENT_DIRECTIVE}Call submit_breach_analyzer exactly once. Stop.`,  tools: ['submit_breach_analyzer'],}export function createDevopsSloBreachAnalyzerAgent(config: DevopsSloBreachAnalyzerConfig) {  const submit = (): ToolDefinition =>    defineZodTool({ name: 'submit_breach_analyzer', description: 'Submit result. Once.', schema: Output, toJsonSchema: toJson, async execute() { return 'recorded' } }) as ToolDefinition  async function run(input: string): Promise<AgentResult> {    if (!input?.trim()) throw new Error('devops-slo-breach-analyzer requires non-empty input')    const result = await invokeStructured({      adapter: config.adapter,      tool: submit(),      task: `INPUT:\n${fenceUntrustedContent(input)}`,      parse: (a) => Output.parse(a),      skill,      memory: config.memory,      observers: config.observers,      onConfirm: config.onConfirm,      maxSteps: config.maxSteps ?? 4,    })    return { ...result, requiresReview: true }  }  return {    name: 'devops-slo-breach-analyzer',    run,    asHandle() { return { name: 'devops-slo-breach-analyzer', run: (t: string) => run(t).then((r) => JSON.stringify(r)) } },  }}
View evaluation contract

Replay these cases with the provider and model you plan to deploy.

import type { EvalSuite } from '@agentskit/eval'export const suite: EvalSuite = {  name: 'devops-slo-breach-analyzer',  cases: [    { input: 'Complete input for SLO Breach Analyzer: SLO misses unexplained. Provide full structured output.', expected: (r: string) => r.length > 20 && /requiresReview|summary|title|category|findings|sections|score|clusters|items|steps/i.test(r) },    { input: 'Minimal input.', expected: (r: string) => /gap|openQuestion/i.test(r) || r.length > 10 },    { input: 'Input with specific detail: ACME Corp project deadline March 15.', expected: (r: string) => /ACME|March|15/i.test(r) || /gap/i.test(r) },    { input: 'Empty context — only says "process this".', expected: (r: string) => r.length > 5 },  ],}

Was this agent useful?

Your response helps us prioritize agent quality.

Keep exploring

Related agents

View category