diff --git a/docs/course/visual_perception.md b/docs/course/visual_perception.md index fa9509af..893b9dab 100644 --- a/docs/course/visual_perception.md +++ b/docs/course/visual_perception.md @@ -1,35 +1,40 @@ -## Color Science -[Biomimetic Eye Modeling & Deep Neuromuscular Oculomotor Control](https://www.andrew.cmu.edu/user/aslakshm/pdfs/siggraph19_eye.pdf) ## Color Perception -We can establish an understanding on color perception through studying its physical and perceptual meaning, so we can understand motivations behind display, computer graphics and camera technologies. +We can establish an understanding on color perception through studying its physical and perceptual meaning. +This way, we can gather more information on its relation to technologies and devices including displays, cameras, sensors, communication, computing and computer graphics. ### What is Color? -Color can be explained in a physical and perceptual capacity. In the physical sense, color is a quantity typically described using a wavelength of light. Humans can only percieve color within a certain range of the electromagnetic spectrum, from around 400 nanometers to 700 nanometers. For greater details on the electromagnetic spectrum and concept of wavelength, we recommend revisiting [Light, Computation, and Computational Light](computational_light.md) section of our course. Color is also a perceptual phenomenon arising from the human visual system's interaction with light. Color is essentially a "side effect" created by our brain when specific wavelengths of light are emitted, reflected, or transmitted by objects. - - -### Biological Foundations of Perceiving Color +Color, a perceptual phenomenon, can be explained in a physical and visual perception capacity. +In the physical sense, color is a quantity representing the response to wavelength of light. +Humans visual system can percieve colors within a certain range of the electromagnetic spectrum, from around 400 nanometers to 700 nanometers. +For greater details on the electromagnetic spectrum and concept of wavelength, we recommend revisiting [Light, Computation, and Computational Light](computational_light.md) section of our course. +Color is also a perceptual concept arising from the human visual system's interaction with wavelengths of light. +Color is essentially a "side effect" created by our brain when specific wavelengths of light are emitted, reflected, or transmitted by objects. The perception of color originates from the absorption of light by photoreceptors in the eye, converting the light into electrical signals to be interpreted by the brain[^1]. +Here, you can see a close-up photograph of these photoreceptor cells found in the eye.
- ![Image title](media/photoreceptors_rods_and_cones.png){ width="600" } -
Anatomy of an Eye (Designed with BioRender)
-
[^2] + ![Image title](media/rods_and_cones_closeup.jpg){ width="600" } +
Live Capture of Photoreceptor Cells (CC PDM 1.0 by NIH).
+ + +The photoreceptors, where color perception originates, are called [rods and cones](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4763127/)[^3]. +Here, we provide a sketch showing where these rods and cones are located inside the eye. +By closely observing this sketch, you can also understand the basic average geometry of a human eye and its parts that helps redirect light from an actual scene towards retinal cells.
- ![Image title](media/rods_and_cones_closeup.jpg){ width="600" } -
Live Capture of Photoreceptor Cells (CC PDM 1.0 by NIH)
+ ![Image title](media/photoreceptors_rods_and_cones.png){ width="600" } +
Anatomy of an Eye (Designed with BioRender).
+Rods, which are relatively more common in the periphery, help people see in low-light (scotopic) conditions, but can only interpret in a greyscale manner. Cones, which are more dense in the fovea, are pivotal in color perception in brighter (photopic) environments. +We highlight the distribution of these photoreceptor cells, rods and cones with changing eccentricities in the eye.
![Image title](media/retinal_photoreceptor_distribution.png){ width="600" } -
Retinal Photoreceptor Distribution (Image adapted from GOLDSTEIN E. B.: Sensation and Perception, 8th ed. Wadsworth-Thomson Learning, Pacific Grove, 2010.)
+
Retinal Photoreceptor Distribution, adapted from the work by Goldstein et al [3].
-The photoreceptors, where color perception originates, are called [rods and cones](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4763127/)[^3]. Rods, which are relatively more common in the periphery, help people see in low-light (scotopic) conditions, but can only interpret in a greyscale manner. Cones, which are more dense in the fovea, are pivotal in color perception in brighter (photopic) environments. The cones are categorized into three types based on their sensitivity to specific wavelengths of light, corresponding to long (L), medium (M), and short (S) wavelength cones. These [three types of cones](https://opg.optica.org/josaa/fulltext.cfm?uri=josaa-31-4-A195&id=279354)[^4] allow us to better understand the [trichromatic theory](https://www.jstor.org/stable/82365)[^5], suggesting that human color perception stems from combining stimulations of the LMS cones. Scientists have tried to graphically represent how sensitive each type of cone is to different wavelengths of light, which is known as the spectral sensitivity function[^6]. - -??? question end "Would you like to learn more about LMS?" - Check out this paper, we find it insightful: [ B. P. Schmidt, M. Neitz, and J. Neitz, "Neurobiological hypothesis of color appearance and hue perception," J. Opt. Soc. Am. A 31(4), A195–207 (2014)](https://doi.org/10.1364/josaa.31.00a195)! +In the above sketch, we introduced various parts on the retina, including fovea, parafovea, perifovea and peripheral vision.
@@ -37,6 +42,12 @@ The photoreceptors, where color perception originates, are called [rods and cone
Spectral Sensitivities of LMS cones
+The cones are categorized into three types based on their sensitivity to specific wavelengths of light, corresponding to long (L), medium (M), and short (S) wavelength cones. These [three types of cones](https://opg.optica.org/josaa/fulltext.cfm?uri=josaa-31-4-A195&id=279354)[^4] allow us to better understand the [trichromatic theory](https://www.jstor.org/stable/82365)[^5], suggesting that human color perception stems from combining stimulations of the LMS cones. Scientists have tried to graphically represent how sensitive each type of cone is to different wavelengths of light, which is known as the spectral sensitivity function[^6]. +??? question end "Looking for more reading to expand your understanding on human visual system?" + We recommend these papers, which we find it insightful: + - [ B. P. Schmidt, M. Neitz, and J. Neitz, "Neurobiological hypothesis of color appearance and hue perception," J. Opt. Soc. Am. A 31(4), A195–207 (2014)](https://doi.org/10.1364/josaa.31.00a195) + - [Biomimetic Eye Modeling & Deep Neuromuscular Oculomotor Control](https://www.andrew.cmu.edu/user/aslakshm/pdfs/siggraph19_eye.pdf) + The story of color perception only deepens with the concept of [color opponency](http://dx.doi.org/10.1364/JOSAA.34.001099)[^7]. This theory reveals that our perception of color is not just a matter of additive combinations of primary colors but also involves a dynamic interplay of opposing colors: red versus green, blue versus yellow. This phenomenon is rooted in the neural pathways of the eye and brain, where certain cells are excited or inhibited by specific wavelengths, enhancing our ability to distinguish between subtle shades and contrasts. @@ -73,9 +84,10 @@ As we dive deeper into light and color perception, it becomes evident that the t [^1]: [Freeman, J. and Simoncelli, E.P. 2011. Metamers of the ventral stream. Nature Neuroscience 14, 1195–1201. http://dx.doi.org/10.1038/nn.2889.](https://doi.org/10.1038/nn.2889) [^2]: [Cleveland Clinic. 2024. Photoreceptors (Rods and Cones). Cleveland Clinic. Accessed September 27, 2024. https://my.clevelandclinic.org/-/scassets/images/org/health/articles/photoreceptors-rods-and-cones.](https://my.clevelandclinic.org/-/scassets/images/org/health/articles/photoreceptors-rods-and-cones) -[^3]: [Lamb, T.D. 2015. Why rods and cones? Eye 30, 179–185. http://dx.doi.org/10.1038/eye.2015.236.](https://doi.org/10.1038/eye.2015.236) -[^4]: [Schmidt, B.P., Neitz, M., and Neitz, J. 2014. Neurobiological hypothesis of color appearance and hue perception. Journal of the Optical Society of America A 31, A195. http://dx.doi.org/10.1364/JOSAA.31.00A195.](https://doi.org/10.1364/JOSAA.31.00A195) -[^5]: [Some experiments on the trichromatic theory of vision. 1942. Proceedings of the Royal Society of London. Series B - Biological Sciences 131, 27–50. http://dx.doi.org/10.1098/rspb.1942.0016.](https://doi.org/10.1098/rspb.1942.0016) -[^6]: [Stockman, A. and Sharpe, L.T. 2000. The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype. Vision Research 40, 1711–1737. http://dx.doi.org/10.1016/S0042-6989(00)00021-3.](https://doi.org/10.1016/S0042-6989(00)00021-3) -[^7]: [Shevell, S.K. and Martin, P.R. 2017. Color opponency: tutorial. Journal of the Optical Society of America A 34, 1099. http://dx.doi.org/10.1364/JOSAA.34.001099.](http://dx.doi.org/10.1364/JOSAA.34.001099) +[^3]: [GOLDSTEIN E. B.: Sensation and Perception, 8th ed. Wadsworth-Thomson Learning, Pacific Grove, 2010.](https://psycnet.apa.org/record/1988-98693-000) +[^4]: [Lamb, T.D. 2015. Why rods and cones? Eye 30, 179–185. http://dx.doi.org/10.1038/eye.2015.236.](https://doi.org/10.1038/eye.2015.236) +[^5]: [Schmidt, B.P., Neitz, M., and Neitz, J. 2014. Neurobiological hypothesis of color appearance and hue perception. Journal of the Optical Society of America A 31, A195. http://dx.doi.org/10.1364/JOSAA.31.00A195.](https://doi.org/10.1364/JOSAA.31.00A195) +[^6]: [Some experiments on the trichromatic theory of vision. 1942. Proceedings of the Royal Society of London. Series B - Biological Sciences 131, 27–50. http://dx.doi.org/10.1098/rspb.1942.0016.](https://doi.org/10.1098/rspb.1942.0016) +[^7]: [Stockman, A. and Sharpe, L.T. 2000. The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype. Vision Research 40, 1711–1737. http://dx.doi.org/10.1016/S0042-6989(00)00021-3.](https://doi.org/10.1016/S0042-6989(00)00021-3) +[^8]: [Shevell, S.K. and Martin, P.R. 2017. Color opponency: tutorial. Journal of the Optical Society of America A 34, 1099. http://dx.doi.org/10.1364/JOSAA.34.001099.](http://dx.doi.org/10.1364/JOSAA.34.001099)