To cite R/mbmixture in publications use:

  Lobo AK, Traeger LL, Keller MP, Attie AD, Rey FE, Broman KW (2021)
  Identification of sample mix-ups and mixtures in microbiome data in
  Diversity Outbred mice. G3 (Bethesda) 11:jkab308

A BibTeX entry for LaTeX users is

  @Article{Lobo2021,
    title = {Identification of sample mix-ups and mixtures in microbiome data in {D}iversity {O}utbred mice},
    author = {Alexandra K. Lobo and Lindsay L. Traeger and Mark P. Keller and Alan D. Attie and Federico E. Rey and Karl W. Broman},
    journal = {G3 (Bethesda)},
    year = {2021},
    doi = {10.1093/g3journal/jkab308},
    url = {https://doi.org/10.1093/g3journal/jkab308},
    eprint = {https://academic.oup.com/g3journal/article-pdf/11/11/jkab308/40770295/jkab308.pdf},
  }