Skip to content

Commit

Permalink
Update content/blog/codegen-learnings/index.md
Browse files Browse the repository at this point in the history
Co-authored-by: Gavin <[email protected]>
  • Loading branch information
arturl and thtmnisamnstr authored Jan 4, 2025
1 parent 3982830 commit b6681db
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion content/blog/codegen-learnings/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -203,7 +203,7 @@ Our testing strategy combines several approaches:

1. **Systematic experimentation**: We run "what-if" scenarios against various test datasets to understand how the system behaves under different conditions.

2. **Local evaluation pipeline**: While local testing has its limitations, it helps catch obvious issues early in development. We evaluate the performance of code generator, and run the code through the typechecker.
2. **Local evaluation pipeline**: While local testing has its limitations, it helps catch obvious issues early in development. We evaluate the performance of the code generator and run the code through the typechecker.

3. **Deterministic generation**: We set the LLM temperature to 0 to ensure consistent outputs. For code generation, consistency and repeatability matters more than creative variations.

Expand Down

0 comments on commit b6681db

Please sign in to comment.