This is an introductory course on modeling probabilistic systems. The emphasis will be on model formulation and probabilistic analysis. Topics to be covered include general stochastic processes, discrete and continuous time Markov chains, the Poisson Process, Non-Stationary Poisson Processes, Markov Decision Processes, Queueing Theory, and other selected topics.