Bayesian statistical decision theory is a formal approach to making decisions under uncertainty. The big picture looks like this.