Abstract: In this (informal) seminar, I will begin by introducing some optimization problems in computational science and engineering and explaining the challenges associated with computing gradients. Afterward, I will present several fundamental concepts for addressing these optimization problems, which will include stochastic approaches like Bayesian sampling and neural network/operator-based methods.