We study half-BPS Wilson loops in D = 3 N =4 gauge theories using matrix models obtained from localization techniques. The infrared CFTs of the N=4 theories are subject to 3-dimensional mirror symmetry, which exchanges the Higgs and Coulomb branches of vacua of dual theories. Recently progress have been made in understanding the mapping of BPS Wilson loops under mirror symmetry in abelian theories. Our aim is to understand the operators dual to half-BPS Wilson loops in non-abelian theories. We propose a matrix model for the mirror loops by implementing mirror symmetry directly in the matrix model and we verify the mapping of loop operators by computing explicitly the Wilson loops and mirror loops in non-abelian linear quiver theories. We discuss the possible gauge theory operators that would lead to the matrix model we found. Our results are nicely related to the brane realization of linear quivers in IIB string theory.