Nowadays, we have a large quantity of different Virtual and Augmented Reality devices with ever-improving technology. Although those devices are mainly still used for entertainment purposes, we also see new applications regarding data analysis, virtual meetings, and many more. We observe that these different applications provide environments, which are vastly different in terms of their target density and occlusion. Many application-specific interaction techniques were proposed over the last decades to solve the challenges coming from diverse environments. Users, who want to use multiple applications, often have to switch between various techniques for interaction and learn entirely new application-specific selection techniques, especially for distant target selection. We propose the need for a design space to classify selection techniques and streamline the development of an all-encompassing selection technique. For this purpose, we present a systematic literature review. We include 146 records using the PRISMA guidelines. Through an investigation of the literature, we extract ten impact factors to classify distant selection techniques. We present a design space with these factors clustered into three categories: input and output devices, the selection process, and the confirmation of the selection. Supported by this design space, the development of new selection techniques can be more effective in creating one technique, able to solve challenges from complex environments while still leading to little user fatigue and high levels of immersion.