Nice interpolation/commenting of testing values (feature)

[exaexa]

Hello!

we recently hit a problem with trying to make the test values as informative as possible by allowing inclusion of values (esp. in autogenerated test), which resulted in:

• Allow supplying custom "Expression" values to @test JuliaLang/julia#49788
• and now a temporary solution https://github.com/LCSB-BioCore/FBCModelTests.jl/blob/master/src/common.jl#L40 that allows us to at least rewrite the expression to humanely understandable stuff, such as https://github.com/LCSB-BioCore/FBCModelTests.jl/blob/master/src/frog/report.jl#L245

Since I guess this might be a topic for TestingUtilities, would you mind us sending (or more like "upstreaming" but not to direct upstream 😅) the @atest ("annotated test") code, and later possibly the thing with proper interpolation of variables as I sketched in the julia PR, to TestingUtilities?

Thanks & best!

and cc @stelmo

[curtd]

Hi there,

Sorry I'm trying to parse out exactly what you're asking for here -- are you suggesting a modification to the @Test macro that allows for the manual (i.e., as indicated by the programmer) collection/handling of certain expressions for failing tests? E.g., something like

@Test f(g($x), $(h(y))) "Test failed because $x isn't correct and $(h(y)) did something weird"

?

Here x and h(y) would be captured from the expression and interpolated into the output message if the test fails. Is that what you're thinking?

[exaexa]

Yeah, something like that. Sorry for confusion :D

I'll try to supply a PR, stay tuned. The main problem is that I'd just pack this code to a few of our packages which would eventually spawn a new package like YetAnotherTestingUtils.jl, but since the purpose of your package is quite similar I think that just submitting it here would be more preferable than flooding out more packages.