HelpLogin
© 2022-2025 Spice AI, Inc.
SQL Query ReferenceDocsFAQSupport
PrivacyTerms
Status
Home
Datasets
Models
main
Edit on GitHub
Fork
/evals/examples
lafand-mt.ipynb
[not Eval] Unify expression: pth => path (#700) In the notebooks under `examples` directory, there are variables using either `pth` or `path` for the same purpose. For better readability, I think we should unify the expression.
2 years ago
lambada.ipynb
Add download command for dataset (#23)
2 years ago
mmlu.ipynb
[not Eval] Unify expression: pth => path (#700) In the notebooks under `examples` directory, there are variables using either `pth` or `path` for the same purpose. For better readability, I think we should unify the expression.
2 years ago
retrieval-completionfn.ipynb
Upgrade openai to >=1.0.0 (#1420) Migrates evals to the new version of openai-python. Ran the migration script, and then manually fixed issues with running tests/evals Test Plan: - unit tests - run `python -m evals.cli.oaievalset gpt-3.5-turbo test` - test make_me_pay (uses solvers) - run `python -m evals.cli.oaieval langchain/chains/llm_math bigrams --max_samples 20 --dry-run` - run the retrieval-completionfn example
2 years ago