# whestbench

> White-box estimation of MLP output statistics under a FLOP budget

## Participant Guide

- [Tutorial, concepts, how-to, and troubleshooting (from whest-starterkit)](https://aicrowd.github.io/whestbench/docs/participant-guide)

## Guides

- [Working with whestbench datasets](https://aicrowd.github.io/whestbench/docs/guides/datasets)

## How-to

- [Bake datasets in parallel](https://aicrowd.github.io/whestbench/docs/how-to/parallel-bake)
- [Publish a dataset to the Hugging Face Hub](https://aicrowd.github.io/whestbench/docs/how-to/publish-to-hf-hub)

## Reference

- [The estimator contract participants implement](https://aicrowd.github.io/whestbench/docs/reference/estimator-contract)
- [Fields in the score report](https://aicrowd.github.io/whestbench/docs/reference/score-report-fields)
- [On-disk dataset format](https://aicrowd.github.io/whestbench/docs/reference/dataset-format)
- [CLI overview](https://aicrowd.github.io/whestbench/docs/reference/cli-reference)
- [flopscope cheat sheet](https://aicrowd.github.io/whestbench/docs/reference/code-patterns)
- [BudgetContext and FLOP costs](https://aicrowd.github.io/whestbench/docs/reference/flopscope-primer)

## CLI

- [Autogenerated per-command reference for the whest CLI](https://aicrowd.github.io/whestbench/docs/cli)

## API Reference

- [Autogenerated reference for the whestbench public API](https://aicrowd.github.io/whestbench/docs/api)

## Development

- [Release process](https://aicrowd.github.io/whestbench/docs/development/release-process)

## Changelog

- [Release history](https://aicrowd.github.io/whestbench/docs/changelog)