Do deep eval for doctests

[jneem]

Previously, we weren't doing deep eval of doctests, which would fail to catch some errors.

I think maybe there are use-cases where you don't want full evaluation, but I'm pretty sure it should be the default. (And then we could support a test annotation to make it lazy if anyone actually needs that)

[github-actions]

Bencher Report

Branch	doctest-deep-eq
Testbed	ubuntu-latest

Click to view all benchmark results

Benchmark	Latency	nanoseconds (ns)
fibonacci 10	📈 view plot 🚷 view threshold	490,250.00
foldl arrays 50	📈 view plot 🚷 view threshold	1,705,200.00
foldl arrays 500	📈 view plot 🚷 view threshold	6,737,900.00
foldr strings 50	📈 view plot 🚷 view threshold	7,121,900.00
foldr strings 500	📈 view plot 🚷 view threshold	62,834,000.00
generate normal 250	📈 view plot 🚷 view threshold	47,864,000.00
generate normal 50	📈 view plot 🚷 view threshold	2,211,300.00
generate normal unchecked 1000	📈 view plot 🚷 view threshold	3,449,100.00
generate normal unchecked 200	📈 view plot 🚷 view threshold	773,460.00
pidigits 100	📈 view plot 🚷 view threshold	3,172,100.00
pipe normal 20	📈 view plot 🚷 view threshold	1,503,700.00
pipe normal 200	📈 view plot 🚷 view threshold	10,279,000.00
product 30	📈 view plot 🚷 view threshold	835,100.00
scalar 10	📈 view plot 🚷 view threshold	1,521,000.00
sum 30	📈 view plot 🚷 view threshold	829,960.00

🐰 View full continuous benchmarking report in Bencher

[jneem]

There's still one failing test in the stdlib, which I think is due to the unimplemented record freezing:

std.record.update "bar" 1 {foo = bar + 1, bar | default = 0 }

returns { foo = 1, bar = 1 }, but if I add an Equal contract then:

(std.record.update "bar" 1 {foo = bar + 1, bar | default = 0 }) | std.contract.Equal { foo = 1, bar = 1 }

gives

error: contract broken by a value
  ┌─ <unknown> (generated by evaluation):1:1
  │
1 │ std.contract.Equal { bar = 1, foo = 1, }
  │ ---------------------------------------- expected type
  │
  ┌─ /home/jneeman/tweag/nickel-doctest-deep-eq/core/stdlib/std.ncl:1:34
  │
1 │ std.record.update "bar" 1 {foo = bar + 1, bar | default = 0 }
  │                                  ^^^^^^^ applied to this expression
  │
  ┌─ <unknown> (generated by evaluation):1:1
  │
1 │ 2
  │ - evaluated to this value

[yannham]

Ah. Maybe it's a sign that it's time to implement freezing properly 😅 I can try to take a look at that after the ongoing PR that I have (a simple cleaning of the AstAlloc interface)