TY - JOUR
T1 - Light-touch forecasting
T2 - A novel method to combine human judgment with statistical algorithms
AU - van der Staak, B.B.J.P.J.
AU - Basten, R.J.I.
AU - van de Calseyde, P.P.F.M.
AU - Demerouti, E.
AU - de Kok, A.G.
PY - 2024
Y1 - 2024
N2 - Forecast adjustments are an indispensable component of the forecasting process, but what is the most effective and efficient method to make these adjustments? Understanding how to effectively blend human forecast adjustments with statistical methods is of great importance as, even with the increased possibilities of AI, we can still not include all information available to a human planner. We address this issue by developing a method that builds on literature showing that some adjustments are consistently (in)accurate. More specifically, in two extensive case studies containing more than 3.5 million forecasting decisions, we confirm that planners are accurate in adjusting a statistical forecast in the right direction and determining the magnitude of downward adjustments, and they are inaccurate in determining the magnitude of upward adjustments. Leveraging these results, we introduce a novel method called light-touch forecasting, which attains performance levels similar to those of more traditional forecasting methods while minimizing the involvement of human planners. Furthermore, an online experiment shows an efficiency gain of 38% in terms of time spent on planning compared to traditional judgmental forecasting. We thus optimize the forecasting process by using the strengths of planners while avoiding their weaknesses.
AB - Forecast adjustments are an indispensable component of the forecasting process, but what is the most effective and efficient method to make these adjustments? Understanding how to effectively blend human forecast adjustments with statistical methods is of great importance as, even with the increased possibilities of AI, we can still not include all information available to a human planner. We address this issue by developing a method that builds on literature showing that some adjustments are consistently (in)accurate. More specifically, in two extensive case studies containing more than 3.5 million forecasting decisions, we confirm that planners are accurate in adjusting a statistical forecast in the right direction and determining the magnitude of downward adjustments, and they are inaccurate in determining the magnitude of upward adjustments. Leveraging these results, we introduce a novel method called light-touch forecasting, which attains performance levels similar to those of more traditional forecasting methods while minimizing the involvement of human planners. Furthermore, an online experiment shows an efficiency gain of 38% in terms of time spent on planning compared to traditional judgmental forecasting. We thus optimize the forecasting process by using the strengths of planners while avoiding their weaknesses.
KW - Adjusting forecasts
KW - Behavioral operations
KW - Decision making
KW - Forecasting accuracy
KW - Judgmental forecasting
KW - Multi-method
UR - http://www.scopus.com/inward/record.url?scp=85192691515&partnerID=8YFLogxK
U2 - 10.1016/j.ijforecast.2024.04.003
DO - 10.1016/j.ijforecast.2024.04.003
M3 - Article
AN - SCOPUS:85192691515
SN - 0169-2070
VL - XX
JO - International Journal of Forecasting
JF - International Journal of Forecasting
IS - X
ER -