[ML]Backtesting and Cross-validation

This article is a memo to me reading https://eng.uber.com/omphalos/

This article is a backtesting tool which used in Uber to validate ML related thing.
I’m not sure some words and I’d like to memorise them in my brain. Thus, I’ve published this article.

• Back testing: https://en.wikipedia.org/wiki/Backtesting

Backtesting is a term used in oceanography, meteorology and the financial industry to refer to testing a predictive model using existing historic data. Backtesting is a kind of retrodiction, and a special type of cross-validation applied to time series data.

I haven’t known the word even I’m in Test/Quality world…
Similar concept is applied in our Kage, which is

• Cross-validation: https://en.wikipedia.org/wiki/Cross-validation_(statistics)

a model validation technique for assessing how the results of a statistical analysis will generalize to an independent data set.

Have a good testing!