Knowledge of the mechanisms that lead to reproductive isolation is essential for understanding population structure and speciation. While several models have been advanced to explain post-mating reproductive isolation, experimental data supporting most are indirect. Laboratory investigations of this phenomenon are typically carried out under benign conditions, which result in low rates of genetic change unlikely to initiate reproductive isolation. Previously, we described an experimental system using the yeast Saccharomyces cerevisiae where starvation served as a proxy to any stress that decreases reproduction and/or survivorship. We showed that novel lineages with restructured genomes quickly emerged in starved populations, and that these survivors were more fit than their ancestors when re-starved. Here we show that certain yeast lineages that survive starvation have become reproductively isolated from their ancestor. We further demonstrate that reproductive isolation arises from genomic rearrangements, whose frequency in starving yeast is several orders of magnitude greater than an unstarved control. By contrast, the frequency of point mutations is less than 2-fold greater. In a particular case, we observe that a starved lineage becomes reproductively isolated as a direct result of the stress-related accumulation of a single chromosome. We recapitulate this result by demonstrating that introducing an extra copy of one or several chromosomes into naïve, i.e. unstarved, yeast significantly diminishes their fertility. This type of reproductive barrier, whether arising spontaneously or via genetic manipulation, can be removed by making a lineage euploid for the altered chromosomes. Our model provides direct genetic evidence that reproductive isolation can arise frequently in stressed populations via genome restructuring without the precondition of geographic isolation.