In this paper, the authors use the discrete Littlewood-Paley-Stein theory to introduce weighted multi-parameter Triebel-Lizorkin and Besov spaces associated with non-isotropic flag singular integrals under a rather weak weight condition $(w\in A_\infty)$. They also obtain the boundedness of flag singular integrals on these spaces.