A ring $R$ is called {\it quasi-Baer} if the right annihilator of every right ideal of $R$ is generated by an idempotent as a right ideal. We investigate the quasi-Baer property of skew group rings and fixed rings under a finite group action on a semiprime ring and their applications to $C^*$-algebras. Various examples to illustrate and delimit our results are provided.