[not Eval] Unify expression: pth => path (#700)
In the notebooks under `examples` directory, there are variables using
either `pth` or `path` for the same purpose. For better readability, I
think we should unify the expression.
2 years ago
Add download command for dataset (#23)
2 years ago
[not Eval] Unify expression: pth => path (#700)
In the notebooks under `examples` directory, there are variables using
either `pth` or `path` for the same purpose. For better readability, I
think we should unify the expression.
2 years ago
Upgrade openai to >=1.0.0 (#1420)
Migrates evals to the new version of openai-python. Ran the migration
script, and then manually fixed issues with running tests/evals
Test Plan:
- unit tests
- run `python -m evals.cli.oaievalset gpt-3.5-turbo test`
- test make_me_pay (uses solvers)
- run `python -m evals.cli.oaieval langchain/chains/llm_math bigrams
--max_samples 20 --dry-run`
- run the retrieval-completionfn example
a year ago