In the Jane Street interview (which I think was fantastic), they describe this as the other half of their product - narrowing the search space intelligently, finding the right probability distribution of input/environment sequences to break a piece of software, using genetic algorithms to evolve pathological input.
is this a gate (like a CI process) or a separate continuous process (like fuzzing.)
They're designing for more of a CI process based on my 2am research. Early versions would turnaround results in a day, but whether they are able to generalize their customer base will depend on whether they can shorten it.
it still sounds expensive (in terms of time / compute)
And whether they can get costs under control.
you'll still want to test for the most important regressions in your CI (and are still writing unit and integration tests.)
The CEO states that even when testing their own work, there are some circumstances where a normal test suffices and deterministic/autonomous testing is overkill.
In the Jane Street interview (which I think was fantastic), they describe this as the other half of their product - narrowing the search space intelligently, finding the right probability distribution of input/environment sequences to break a piece of software, using genetic algorithms to evolve pathological input.
They're designing for more of a CI process based on my 2am research. Early versions would turnaround results in a day, but whether they are able to generalize their customer base will depend on whether they can shorten it.
And whether they can get costs under control.
The CEO states that even when testing their own work, there are some circumstances where a normal test suffices and deterministic/autonomous testing is overkill.