Optimization methods play a central role in many engineering disciplines. In this chapter, we give a broad overview of the optimization settings and algorithms including simultaneous perturbation approaches as well as give a brief summary of later chapters.