API Reference

BestOfNSampler

__init__(model_name, evalution_metric, **kwargs)

Best-of-N inference sampler.

Generates multiple responses from different models and selects the best candidate using cosine similarity.

Parameters

model_name : list[str] List of model names used for generation.