In this paper, the smallest confidence region is obtained for the location and scale parameters of the two-parameter exponential distribution. For this purpose, we use constrained optimization problems. We first provide some suitable pivotal quantities to obtain a balanced confidence region. We then obtain the smallest confidence region by minimizing the area of the confidence region using the Lagrangian method. Two numerical examples are presented to illustrate the proposed methods. Finally, some applications of proposed joint confidence regions in hypothesis testing and the construction of confidence bands are discussed.