Introduction to the theory and application of large-scale dynamic programming. Markov decision processes. Dynamic programming algorithms. Simulation-based algorithms. Theory and algorithms for value function approximation. Policy search methods. Games. Applications in areas such as dynamic resource allocation, finance and queueing networks, among others.