Markov decision models represent efficient analytical tools for mathematical description and optimization of sequencial decision schemes, as encountered in many economical and industrial environments. In this lecture such models and the corresponding optimization algorithms are treated.