Most heritable information in eukaryotic cells is encoded in the nuclear genome, with inheritance patterns following classic Mendelian segregation. Genomes residing in the cytoplasm, however, prove to be a peculiar exception to this rule. Cytoplasmic genetic elements are generally maternally inherited, although there are several exceptions where these are paternally, biparentally or doubly-uniparentally inherited. In this review, we examine the diversity and peculiarities of cytoplasmically inherited genomes, and the broad evolutionary consequences that non-Mendelian inheritance brings. We first explore the origins of vertical transmission and uniparental inheritance, before detailing the vast diversity of cytoplasmic inheritance systems across Eukaryota. We then describe the evolution of genomic organisation across lineages, how this process has been shaped by interactions with the nuclear genome and population genetics dynamics. Finally, we discuss how both nuclear and cytoplasmic genomes have evolved to co-inhabit the same host cell via one of the longest symbiotic processes, and all the opportunities for intergenomic conflict that arise due to divergence in inheritance patterns. In sum, we cannot understand the evolution of eukaryotes without understanding hereditary symbiosis.