whestbench.
API

API Reference

Autogenerated reference for the whestbench public API.

API Reference

Every symbol exported from whestbench (__all__). Generated from source.

  • BaseEstimator — Estimator contract for participant implementations.
  • BudgetExhaustionWarning — Raised when an estimator exhausts its FLOP budget on a single MLP.
  • combine_split_datasets — Combine N complete single-split datasets into a multi-split dataset directory.
  • CombinedBudgetExhaustionWarning — Raised when combined compute C_m = F_m + lambda*R_m exceeds the FLOP budget on a single MLP.
  • create_dataset — Generate MLPs, compute ground-truth, and write a schema-3.0 dataset directory.
  • InvalidDatasetError — Raised when a dataset directory has missing/incompatible metadata.
  • iter_mlps — Iterate the MLPs in a Dataset, constructing MLP objects per row.
  • load_dataset — Load a whestbench dataset from a local directory or HF Hub repo.
  • merge_datasets — Concatenate partial bakes into a single canonical dataset directory.
  • metadata — Return the metadata.json contents attached to a Dataset or DatasetDict.
  • MLP — Validated MLP container with fixed width and layer depth.
  • mlp_at — Return the MLP at index in the Dataset.
  • publish_dataset — Upload a baked dataset directory to HF Hub.
  • relu — Element-wise ReLU activation.
  • ResidualWallTimeExhaustionWarning — Raised when an estimator exhausts its residual wall-time budget on a single MLP.
  • run_mlp — Forward pass returning final-layer activations.
  • run_mlp_all_layers — Forward pass returning activations after each layer.
  • sample_layer_statistics — Estimate per-layer activation statistics via chunked Monte Carlo sampling.
  • sample_mlp — Sample a random MLP with He-initialized weight matrices.
  • SCHEMA_VERSION — value
  • ScoringExhaustionWarning — Base class for budget/time exhaustion warnings raised during scoring.
  • SetupContext — Runtime context passed to BaseEstimator.setup.
  • TimeExhaustionWarning — Raised when an estimator exhausts its wall-clock budget on a single MLP.

On this page