Visual Computing in the Life Sciences, Introduction.

Jeheonpark
6 min readAug 27, 2020

--

MRI image from Wikipedia

I will post the visual computing basics in Life Science. These posts are based on the lecture in my master's course in B-it (the international Information Technology Center of RWTH Aachen and Bonn University in Germany).

What is Visual Computing?

def. The entire field of acquiring, analyzing, and synthesizing visual data by means of computers is called visual computing.

It has 5 parts:
1. Image Synthesis
2. Image Analysis
3. Visualization
4. Virtual and Augmented Reality
5. Human-Computer Interaction

In life science, most of the visual computing means 2. Image analysis and 3. Visualization. Therefore, we are going to focus on these topics and especially deep learning on the image analysis topic because it is the hottest method now. The first half of this series will cover visualization and the other half will cover the image analysis part.

Visualization

why do we have to visualize the data? It is obvious at some points. It makes people easily understand the data and also we have a lot of problems with explainable deep learning or AI. Many people including me also believe it can be solved by visualization. Life Science also has a lot of problems with visualization, for example, large-scale genomic data sets, fMRI, and RNA-seq, etc.

The Goal of Visualization is:
1. Analysis leading to insight: Extract the new knowledge from data and generate hypotheses.
2. Communication and education: Present findings to others and discuss them teach non-experts
3. Steering: Control the machine with visualized status, parameter changing.

This posting series on visualization part will focus on:
1. Visualization techniques
2. Dimensionality reduction and clustering
3. Trees and general graph structures
4. Design visualization systems
5. Examples from biology

Color and Perception

RGB
YMC

First of all, we need to define what is the color, what is the light, and what our eyes do when we see. There are two ways to represent the colors the first one is RGB and the second one is YMC. It is a really easy topic. You can directly recognize the differences. If you consider the light, then it is RGB. If you consider paints like the printer in your room, then it is YMC. Actually, if you have a chance to replace the ink when you get an internship, then you can get that immediately. In this series, we will only focus on RGB because we only consider the visualization with a computer that uses emitting the light from the monitor.

What is the color?

Physicist’s View

The physicist’s view

The physicist’s view explains the color as a linear range of wavelengths of visible EM radiation. You can see the figure above, it is linear and the x-axis has the wavelength scale.

Color is just the part of the electromagnetic spectrum, it is the visible part for humans, there are some exceptions like color blind. The wavelength is related to the size of the material that we want to visualize. If you use an X-ray, you can visualize the Atoms because its wavelength has the same size as the atoms.

Physical Property of light

Physical Properties of light and Related Perceptions.

Light has three properties, wavelength, amplitude, and purity. You can easily understand the wavelength and wave amplitude. However, purity is somehow unfamiliar to you. Actually, it is a really simple notion. It is just how much the same wavelength light is mixed. If it consists of the same wavelength of light, then the light is highly saturated.

Artist’s View

The Artist’s view

Artist’s view explains the color as the circle of hues, with the mixing of white or black. It is closer than the physicist’s view to the human perception of the color.

Only 8 color names were consistently used by at least 75% of people.

Post and Greene 1986

The edge of the triangle is pure color and the white line the range of people said the same color name. We can see pure red on the monitor is considered as the orange and blue range is large. Yellow has a small range than other colors. I think this will be related to the evolutionary history of human beings, distinguishing foods or response of immediate danger.

Biological process interpreting the light

Anatomy of the Eye

If you graduate from high school, it is really easy to understand. The important part is Retina and Macula. The macula is the part where the retina is denser and retina consists of cones and rods.

Rods and Cones

Rods:
1. Used for night vision
2. Achromatic
3. Peripheral vision
4. Less acuity

Cones:
1. Require strong illumination
2. Chromatic
3. Central Vision
4. Higher acuity

Three types of cones: S, M, L

The proportion of our cones

L(‘Red’) cones are consisting the most of part and the next one is M(‘green’) cones. S(‘Blue’) cones are sparse. We can conclude we have poor sensitivity towards the short cone’s wavelength range.

The light gets through the eyes and reaches the brain.

Dorsal and Ventral Stream

Dorsal Stream(green, ‘where’) is related to guiding behavior and relatively fast. Ventral stream(purple, ‘what’) is related to recognition and visual memory and relatively slow. These streams process visual information. If we want to visualize the data, then we need to quantify this process. Especially, the light we feel and the color we feel. Quantifying is part of physical parts but perception is art parts.

How do we quantify the visual information?

The wavelength each cone is stimulated
The anatomy of Retina

We can quantify the color with this information. The equation for quantifying the color is:

𝑆 = ∫ 𝑠( 𝜆) 𝐼( 𝜆) 𝑑𝜆

S is the result, s is the sensitive curve of the one type of cone and I is the intensity of the light.

Now we are the first part of quantifying the human perception of the light. Next Post will be the difference of Luminance, Brightness, and Lightness.

This is published on 8/27/2020.

--

--

Jeheonpark
Jeheonpark

Written by Jeheonpark

Jeheon Park, Software Engineer at Kakao in South Korea

No responses yet