A perspective of the optimization taxonomy is as follows: (figure from neos-Guide)

Optimization Tree

Rollout Algorithms

An introduction of rollout algorithms can be found here. This method is said to be “particularly simple to implement, and is often surprisingly effective.”