whestbench.

How-to — recipes for specific tasks

Sourced from whest-starterkit @ 96e308c.

How-to — recipes for specific tasks

← Documentation

Task-oriented guides. Each one answers "I want to do X — give me the steps and the common mistakes." Use these alongside the Tutorial for a guided sequence and the Reference for exact APIs.

Writing and iterating

DocWhen to read
write-an-estimator.mdImplementing your custom estimator from scratch: minimal structure, contract checklist, common first failure.
inspect-mlp-structure.mdTraversing the MLP object: fields, weights, shapes.
validate-run-package.mdThe standard local loop: validate → run → package. Includes a "Useful flags" table covering --seed, --n-samples, --profile, --max-threads, --setup-timeout, and other whest run flags.
use-evaluation-datasets.mdPre-creating an evaluation dataset for fast, reproducible iteration.

Optimizing

DocWhen to read
algorithm-ideas.mdSurvey of estimation strategies: Monte Carlo, mean propagation, covariance, and why one fixed strategy outperforms runtime routing at this budget. Plus open directions (low-rank, layer-adaptive, spectral, importance sampling, higher moments).
manage-flop-budget.mdWhere your FLOPs go and how to fit a tighter budget. Includes a line-by-line walkthrough of examples/02_mean_propagation.py.
performance-tips.mdConcrete patterns: matmul placement, free ops, diagonal vs covariance, env-var knobs.

Debugging and shipping

DocWhen to read
debugging-checklist.mdTiered checklist for "estimator runs but something feels wrong": Tier 0 pure-Python loop, Tier 1 sanity, Tier 2 correctness, Tier 3 optimization.
pre-submission-checklist.mdChecks to run before you click "submit" on AIcrowd, including the Phase 2 allowed-code rules and the 10-submissions-per-UTC-day cap.
ship-weights.mdPre-compute offline and load weights in setup() via submission_dir; the boundary between permitted data and prohibited code; the 5 s setup budget; multi-file submissions; 50 MiB / 50 file caps; .whestignore; package preview and --dry-run.

➡️ Where to look next

  • Not sure whether a technique is allowed at all? → Allowed Code.
  • Need the exact contract / report fields? → Reference.
  • Estimator throws an error you don't recognize? → Troubleshooting.
  • Working through the stages in order? → Tutorial.

On this page