Algorithm could enable visible-light-based imaging for medical devices, autonomous vehicles

Algorithm could enable visible-light-based imaging for medical devices, autonomous vehicles
13:34 4 Oktyabr 2016
Ölkə mətbuatı
A- A+

MIT researchers have developed a technique for recovering visual information from light that has scattered because of interactions with the environment — such as passing through human tissue.
 
The technique could lead to medical-imaging systems that use visible light, which carries much more information than X-rays or ultrasound waves, or to computer vision systems that work in fog or drizzle. The development of such vision systems has been a major obstacle to self-driving cars.
 
In experiments, the researchers fired a laser beam through a “mask” — a thick sheet of plastic with slits cut through it in a certain configuration, such as the letter A  — and then through a 1.5-centimeter “tissue phantom,” a slab of material designed to mimic the optical properties of human tissue for purposes of calibrating imaging systems. Light scattered by the tissue phantom was then collected by a high-speed camera, which could measure the light’s time of arrival.
 
From that information, the researchers’ algorithms were able to reconstruct an accurate image of the pattern cut into the mask.
 
“The reason our eyes are sensitive only in this narrow part of the spectrum is because this is where light and matter interact most,” says Guy Satat, a graduate student at the MIT Media Lab and first author on the new paper. “This is why X-ray is able to go inside the body, because there is very little interaction. That’s why it can’t distinguish between different types of tissue, or see bleeding, or see oxygenated or deoxygenated blood.”
 
The imaging technique’s potential applications in automotive sensing may be even more compelling than those in medical imaging, however. Many experimental algorithms for guiding autonomous vehicles are highly reliable under good illumination, but they fall apart completely in fog or drizzle; computer vision systems misinterpret the scattered light as having reflected off of objects that don’t exist. The new technique could address that problem.
 
Like many of the Camera Culture group’s projects, the new system relies on a pulsed laser that emits ultrashort bursts of light, and a high-speed camera that can distinguish the arrival times of different groups of photons, or light particles. When a light burst reaches a scattering medium, such as a tissue phantom, some photons pass through unmolested; some are only slightly deflected from a straight path; and some bounce around inside the medium for a comparatively long time. The first photons to arrive at the sensor have thus undergone the least scattering; the last to arrive have undergone the most.
 
Where previous techniques have attempted to reconstruct images using only those first, unscattered photons, the MIT researchers’ technique uses the entire optical signal. Hence its name: all-photons imaging.
 
The data captured by the camera can be thought of as a movie — a two-dimensional image that changes over time. To get a sense of how all-photons imaging works, suppose that light arrives at the camera from only one point in the visual field. The first photons to reach the camera pass through the scattering medium unimpeded: They show up as just a single illuminated pixel in the first frame of the movie.
 
The next photons to arrive have undergone slightly more scattering, so in the second frame of the video, they show up as a small circle centered on the single pixel from the first frame. With each successive frame, the circle expands in diameter, until the final frame just shows a general, hazy light.
The problem, of course, is that in practice the camera is registering light from many points in the visual field, whose expanding circles overlap. The job of the researchers’ algorithm is to sort out which photons illuminating which pixels of the image originated where.
 
The first step is to determine how the overall intensity of the image changes in time. This provides an estimate of how much scattering the light has undergone: If the intensity spikes quickly and tails off quickly, the light hasn’t been scattered much. If the intensity increases slowly and tails off slowly, it has.
 
On the basis of that estimate, the algorithm considers each pixel of each successive frame and calculates the probability that it corresponds to any given point in the visual field. Then it goes back to the first frame of video and, using the probabilistic model it has just constructed, predicts what the next frame of video will look like. With each successive frame, it compares its prediction to the actual camera measurement and adjusts its model accordingly. Finally, using the final version of the model, it deduces the pattern of light most likely to have produced the sequence of measurements the camera made.
 
One limitation of the current version of the system is that the light emitter and the camera are on opposite sides of the scattering medium. That limits its applicability for medical imaging, although Satat believes that it should be possible to use fluorescent particles known as fluorophores, which can be injected into the bloodstream and are already used in medical imaging, as a light source. And fog scatters light much less than human tissue does, so reflected light from laser pulses fired into the environment could be good enough for automotive sensing.
 
“People have been using what is known as time gating, the idea that photons not only have intensity but also time-of-arrival information and that if you gate for a particular time of arrival you get photons with certain specific path lengths and therefore [come] from a certain specific depth in the object,” says Ashok Veeraraghavan, an assistant professor of electrical and computer engineering at Rice University. “This paper is taking that concept one level further and saying that even the photons that arrive at slightly different times contribute some spatial information.”
 
“Looking through scattering media is a problem that’s of large consequence,” he adds. But he cautions that the new paper does not entirely solve it. “There’s maybe one barrier that’s been crossed, but there are maybe three more barriers that need to be crossed before this becomes practical,” he says.




RƏYLƏR

BU KATEQORİYADAN DİGƏR XƏBƏRLƏR

Ölkə mətbuatında bugün »

Bakıda 13 və 14 yaşlı iki qardaş itkin düşüb

26 İyul 2017 12:54

Sərnişin avtobusunda kişinin əxlaqsız hərəlkəti kameraya düşdü - VİDEO

26 İyul 2017 12:52

İntellekt səviyyəsi yüksək olan kişilər qadınlara daha çox... - HEYRATAMİZ FAKT

26 İyul 2017 12:48

Zərrə qədər Fotoşop istifadə olunmamış müxtəlif məkanlardan 15 HEYRANEDİCİ FOTO

26 İyul 2017 12:48

Tanınmış iş adamının keçmiş sevgilisi yeni məşuqu ilə dodaq-dodağa - VİDEO

26 İyul 2017 12:47

Havanın temperaturu yenidən yüksəlir

26 İyul 2017 12:47

Azərbaycanda iribuynuzlu heyvanların bruselyoza qarşı peyvəndləməsinə başlanılıb

26 İyul 2017 12:47

Qüds şəhəri İslam Dünyasının Gənclik paytaxtı elan edildi

26 İyul 2017 12:47

“Lotu Quli”n daha bir qohumu MƏHKƏMƏ QARŞISINDA

26 İyul 2017 12:44

ADU-da Yay məktəbi uğurla davam edir - FOTOLAR

26 İyul 2017 12:43

Ermənistandan daha bir qorxu dolu bəyanat: Azərbaycanın silahları arasında...

26 İyul 2017 12:38

"Neftçi" Bundesliqa klubuna qarşı

26 İyul 2017 12:37

"Qarabağ"ın polşalı futbolçusunun vəziyyəti necədi?

26 İyul 2017 12:37

"Lotu Quli"nin yaxın adamının məhkəməsi başlayıb

26 İyul 2017 12:37

"Neftçi"dən ayrılan futbolçu rəsmən Rusiya klubunda

26 İyul 2017 12:37

Yeni texnologiya məlumatların “SSD” disklərində saxlanma müddətini dəfələrlə artıracaq

26 İyul 2017 12:35

Külək getdikcə güclənir - HAVA PROQNOZU

26 İyul 2017 12:34

DİQQƏT: Pensiya və maaş kartını itirənlər

26 İyul 2017 12:33

Məşhur rəqqasə mədəsini kiçiltdi - FOTO

26 İyul 2017 12:32

Bakının mərkəzində kafedən oğurluq edən şəxs ələ keçdi

26 İyul 2017 12:29

Cənubi Azərbaycanlı ifaçıdan rekord qıran ifa

26 İyul 2017 12:29

Millət vəkili parlamentdə şou göstərdi - FOTOLAR

26 İyul 2017 12:28

Havanın temperaturu yüksələcək

26 İyul 2017 12:27

® Azərbaycan üçün nəzərdə tutulmamış telefonlar əhalini ziyana salır

26 İyul 2017 12:24

"Beynəlxalq Bank işi" ilə bağlı 55 şəxs barəsində materiallar DİN-ə göndərildi

26 İyul 2017 12:19

Təhsil Nazirliyi müəllimlərin işə qəbulu haqda geniş məlumat verdi

26 İyul 2017 12:18

Valideyinləri yeni doğulan körpənin damağına narkotik maddə sürtdü - FOTO

26 İyul 2017 12:17

"Real" əsrin transferini etdi: 222 milyon avro

26 İyul 2017 12:17

Sevgilinizin xasiyyətini ayaqlarından öyrənin

26 İyul 2017 12:17

Burak Özçivitlə Fahriye Evcen toydan sonra

26 İyul 2017 12:14

Əliyar Ağayevin idarə etdiyi oyunda 4 qol vuruldu

26 İyul 2017 12:12

535 minə yaxın mənzil özəlləşdirildi

26 İyul 2017 12:12

Röyanın keçmiş qaynatası HƏBS EDİLDİ

26 İyul 2017 12:10

Nazir qardaşına pul atan şəxsə 9 İL HƏBS TƏLƏBİ

26 İyul 2017 12:09

ABŞ-da Respublikaçıların ilk qanun layihəsi rədd edildi

26 İyul 2017 12:08

DİM jurnalistika ixtisasına qəbul olmaq istəyən abituriyentlər üçün qabiliyyət imtahanı keçirəcək

26 İyul 2017 12:07

"Eurovision-2018" müsabiqəsinin keçirilmə yeri və vaxtı məlum olub

26 İyul 2017 12:07

Müğənni Röyanın keçmiş qaynatası HƏBS EDİLDİ

26 İyul 2017 12:05

Neftçalada çağırışa gedən masajçı uşaq həkimini it dişlədi

26 İyul 2017 12:05

Tətilə əri ilə yox, rəfiqəsi ilə çıxdı - FOTOlar

26 İyul 2017 12:05

AER dondurmalarına yaşıl işıq: “Bu sınaqdan da üzüağ çıxdıq” - REPORTAJ

26 İyul 2017 12:04

Azərbaycanın hələ də işə salmadığı MƏXFİ SİLAHI – Ermənistanın ən böyük QORXUSU

26 İyul 2017 12:03

Prokuror nazirin qardaşına qarşı dələduzluq etməkdə təqsirləndirilən şəxsə iş istəyib

26 İyul 2017 12:02

"Çudo Peçka"nın sahibi həbs edildi

26 İyul 2017 11:59

Çiy əti yuyursunuzsa, mütləq oxuyun!

26 İyul 2017 11:59

Qəhrəman tankçılar terrorçunu əzdilər - VİDEO - FOTO

26 İyul 2017 11:57

Ermənistanda qubernatorun itkin düşmüş müşaviri öldürülüb

26 İyul 2017 11:57

“Çudo Peçka”nın sahibi həbs olunub

26 İyul 2017 11:57

800-dən çox abituriyent yenidən imtahan verəcək

26 İyul 2017 11:53

Dələ 45 mindən çox sakini, məktəb və müəssisələri işıqsız qoydu - Kaliforniyada

26 İyul 2017 11:52