Skip to content

Latest commit

 

History

History
143 lines (101 loc) · 4.65 KB

File metadata and controls

143 lines (101 loc) · 4.65 KB

Blueprint Test Validator Integration Guide

Overview

The Blueprint Test Validator Engine creates a trust layer between blueprint generation and agent deployment in the EchoForge ecosystem. This guide explains how to integrate the validator with other components of the system.

Integration with BlueprintRefiner

The Blueprint Test Validator Engine works seamlessly with the BlueprintRefiner to create a complete pipeline for blueprint refinement and validation:

import { ValidatorEngine } from '../codessa/core/validation/ValidatorEngine';
import { BlueprintRefiner } from '../codessa/core/refinement/BlueprintRefiner';

// Create a BlueprintRefiner
const refiner = new BlueprintRefiner();

// Create a ValidatorEngine
const validator = new ValidatorEngine();

// Refine and validate a blueprint
async function refineAndValidate(blueprint) {
  // Refine the blueprint
  const refinedBlueprint = await refiner.refineBlueprint(blueprint);

  // Validate the refined blueprint
  const validationResult = await validator.validateBlueprint(refinedBlueprint);

  return {
    blueprint: refinedBlueprint,
    validationResult,
  };
}

Integration with Reflexive Memory

The Blueprint Test Validator Engine can store validation results in Reflexive Memory for future reference:

import { ValidatorEngine } from '../codessa/core/validation/ValidatorEngine';
import { ReflexiveMemory } from '../codessa/core/memory/ReflexiveMemory';

// Create a ValidatorEngine with Reflexive Memory integration
const validator = new ValidatorEngine({
  storeInReflexiveMemory: true,
  reflexiveMemoryOptions: {
    namespace: 'validation',
    retentionPolicy: 'permanent',
  },
});

// Validate a blueprint
const validationResult = await validator.validateBlueprint(blueprint);

// The validation result is automatically stored in Reflexive Memory
// You can retrieve it later using the Reflexive Memory API
const memory = new ReflexiveMemory();
const storedResult = await memory.retrieve('validation', validationResult.id);

Integration with Codessa CLI

The Blueprint Test Validator Engine is integrated with the Codessa CLI through the validate command:

# Validate a blueprint
codessa validate path/to/blueprint.json

# Validate a blueprint in interactive mode
codessa validate path/to/blueprint.json --interactive

# Validate a blueprint with autofix
codessa validate path/to/blueprint.json --autofix

Integration with Guild Contracts

The Blueprint Test Validator Engine can validate blueprints against Guild behavioral contracts:

import { ValidatorEngine } from '../codessa/core/validation/ValidatorEngine';

// Create a ValidatorEngine with Guild contract integration
const validator = new ValidatorEngine({
  useGuildContracts: true,
  guildContractOptions: {
    guildId: 'data-processing-guild',
    contractVersion: 'latest',
  },
});

// Validate a blueprint against Guild contracts
const validationResult = await validator.validateBlueprint(blueprint);

Integration with Test Suite Generator

The Blueprint Test Validator Engine can be used with the Test Suite Generator to create comprehensive test suites for blueprints:

import { ValidatorEngine } from '../codessa/core/validation/ValidatorEngine';
import { TestSuiteGenerator } from '../codessa/core/testing/TestSuiteGenerator';

// Create a TestSuiteGenerator
const testSuiteGenerator = new TestSuiteGenerator();

// Generate a test suite for a blueprint
const testSuite = await testSuiteGenerator.generateTestSuite(blueprint);

// Create a ValidatorEngine
const validator = new ValidatorEngine();

// Validate the blueprint using the generated test suite
const validationResult = await validator.validateBlueprintWithTestSuite(
  blueprint,
  testSuite
);

Integration with Codessa Forge UI

In future versions, the Blueprint Test Validator Engine will integrate with the Codessa Forge UI to provide visual test flow maps and interactive validation:

import { ValidatorEngine } from '../codessa/core/validation/ValidatorEngine';
import { ForgeUI } from '../codessa/ui/ForgeUI';

// Create a ValidatorEngine in interactive mode
const validator = ValidatorEngine.createInteractive();

// Create a ForgeUI instance
const forgeUI = new ForgeUI();

// Register the validator with the ForgeUI
forgeUI.registerValidator(validator);

// The ForgeUI will now provide visual test flow maps and interactive validation

Conclusion

The Blueprint Test Validator Engine is designed to integrate seamlessly with the existing EchoForge ecosystem. By following this guide, you can incorporate validation into your blueprint development workflow and ensure that your agents behave as expected.