This is also known as one-step look ahead. \[V^{\pi_i}(s) = \sum_{s ... Another (optional) method to solve for the values is to solve them as a system of equations. By eliminating the \(\max_{a}\), ...