@polyweave/training (1.0.2)
Installation
@polyweave:registry=https://hub.kl1.tenere.ai/api/packages/Polyweave/npm/npm install @polyweave/training@1.0.2"@polyweave/training": "1.0.2"About this package
@polyweave/training
Training and continual learning loops for Polyweave. Provides SIEVE (Self-Improving Example Validation Engine) for example filtering/quality enhancement, SDPO (Self-Directed Preference Optimization) for preference-based training rollouts, and dataset utilities for training data management.
Synopsis
import { createSieveTransform, createSdpoRolloutTransform } from '@polyweave/training';
const sieve = createSieveTransform({ model: myLLM });
inputDuplex.source.pipe(sieve).pipe(outputSink);
Install
npm install @polyweave/training
API
createSieveTransform(config)
Creates a frame transform implementing the SIEVE algorithm. Filters and improves training examples through iterative LLM evaluation. Validates, corrects, and enriches examples to improve training data quality.
createSdpoRolloutTransform(config)
Creates a frame transform implementing SDPO. Generates multiple rollouts per training example, collects feedback/scoring, and produces preference pairs for optimization. Supports configurable rollout count and custom generators.
Datasets
Utilities for creating, merging, splitting, and validating training datasets. Supports multi-source dataset assembly with normalization and deduplication.
Tests
npm test
Requirements
- Node.js >= 18.0.0
@polyweave/core(peer)@polyweave/state(peer)
License
MIT
Dependencies
Development Dependencies
| ID | Version |
|---|---|
| @rigor/core | * |
Peer Dependencies
| ID | Version |
|---|---|
| @polyweave/core | * |
| @polyweave/state | * |