This tutorial bridges the gap between operations research and management science (OR/MS) and deep learning for sequential decision making under uncertainty. It presents a framework for integrating OR/MS approaches with neural architectures, highlighting the complementary strengths of both fields.