Connect with us

TOP SCEINCE

Study explains why the brain can robustly recognize images, even without color

Published

on

Study explains why the brain can robustly recognize images, even without color


Even though the human visual system has sophisticated machinery for processing color, the brain has no problem recognizing objects in black-and-white images. A new study from MIT offers a possible explanation for how the brain comes to be so adept at identifying both color and color-degraded images.

Using experimental data and computational modeling, the researchers found evidence suggesting the roots of this ability may lie in development. Early in life, when newborns receive strongly limited color information, the brain is forced to learn to distinguish objects based on their luminance, or intensity of light they emit, rather than their color. Later in life, when the retina and cortex are better equipped to process colors, the brain incorporates color information as well but also maintains its previously acquired ability to recognize images without critical reliance on color cues.

The findings are consistent with previous work showing that initially degraded visual and auditory input can actually be beneficial to the early development of perceptual systems.

“This general idea, that there is something important about the initial limitations that we have in our perceptual system, transcends color vision and visual acuity. Some of the work that our lab has done in the context of audition also suggests that there’s something important about placing limits on the richness of information that the neonatal system is initially exposed to,” says Pawan Sinha, a professor of brain and cognitive sciences at MIT and the senior author of the study.

The findings also help to explain why children who are born blind but have their vision restored later in life, through the removal of congenital cataracts, have much more difficulty identifying objects presented in black and white. Those children, who receive rich color input as soon as their sight is restored, may develop an overreliance on color that makes them much less resilient to changes or removal of color information.

MIT postdocs Marin Vogelsang and Lukas Vogelsang, and Project Prakash research scientist Priti Gupta, are the lead authors of the study, which appears today in Science. Sidney Diamond, a retired neurologist who is now an MIT research affiliate, and additional members of the Project Prakash team are also authors of the paper.

Seeing in black and white

The researchers’ exploration of how early experience with color affects later object recognition grew out of a simple observation from a study of children who had their sight restored after being born with congenital cataracts. In 2005, Sinha launched Project Prakash (the Sanskrit word for “light”), an effort in India to identify and treat children with reversible forms of vision loss.

Many of those children suffer from blindness due to dense bilateral cataracts. This condition often goes untreated in India, which has the world’s largest population of blind children, estimated between 200,000 and 700,000.

Children who receive treatment through Project Prakash may also participate in studies of their visual development, many of which have helped scientists learn more about how the brain’s organization changes following restoration of sight, how the brain estimates brightness, and other phenomena related to vision.

In this study, Sinha and his colleagues gave children a simple test of object recognition, presenting both color and black-and-white images. For children born with normal sight, converting color images to grayscale had no effect at all on their ability to recognize the depicted object. However, when children who underwent cataract removal were presented with black-and-white images, their performance dropped significantly.

This led the researchers to hypothesize that the nature of visual inputs children are exposed to early in life may play a crucial role in shaping resilience to color changes and the ability to identify objects presented in black-and-white images. In normally sighted newborns, retinal cone cells are not well-developed at birth, resulting in babies having poor visual acuity and poor color vision. Over the first years of life, their vision improves markedly as the cone system develops.

Because the immature visual system receives significantly reduced color information, the researchers hypothesized that during this time, the baby brain is forced to gain proficiency at recognizing images with reduced color cues. Additionally, they proposed, children who are born with cataracts and have them removed later may learn to rely too much on color cues when identifying objects, because, as they experimentally demonstrated in the paper, with mature retinas, they commence their post-operative journeys with good color vision.

To rigorously test that hypothesis, the researchers used a standard convolutional neural network, AlexNet, as a computational model of vision. They trained the network to recognize objects, giving it different types of input during training. As part of one training regimen, they initially showed the model grayscale images only, then introduced color images later on. This roughly mimics the developmental progression of chromatic enrichment as babies’ eyesight matures over the first years of life.

Another training regimen comprised only color images. This approximates the experience of the Project Prakash children, because they can process full color information as soon as their cataracts are removed.

The researchers found that the developmentally inspired model could accurately recognize objects in either type of image and was also resilient to other color manipulations. However, the Prakash-proxy model trained only on color images did not show good generalization to grayscale or hue-manipulated images.

“What happens is that this Prakash-like model is very good with colored images, but it’s very poor with anything else. When not starting out with initially color-degraded training, these models just don’t generalize, perhaps because of their over-reliance on specific color cues,” Lukas Vogelsang says.

The robust generalization of the developmentally inspired model is not merely a consequence of it having been trained on both color and grayscale images; the temporal ordering of these images makes a big difference. Another object-recognition model that was trained on color images first, followed by grayscale images, did not do as well at identifying black-and-white objects.

“It’s not just the steps of the developmental choreography that are important, but also the order in which they are played out,” Sinha says.

The advantages of limited sensory input

By analyzing the internal organization of the models, the researchers found that those that begin with grayscale inputs learn to rely on luminance to identify objects. Once they begin receiving color input, they don’t change their approach very much, since they’ve already learned a strategy that works well. Models that began with color images did shift their approach once grayscale images were introduced, but could not shift enough to make them as accurate as the models that were given grayscale images first.

A similar phenomenon may occur in the human brain, which has more plasticity early in life, and can easily learn to identify objects based on their luminance alone. Early in life, the paucity of color information may in fact be beneficial to the developing brain, as it learns to identify objects based on sparse information.

“As a newborn, the normally sighted child is deprived, in a certain sense, of color vision. And that turns out to be an advantage,” Diamond says.

Researchers in Sinha’s lab have observed that limitations in early sensory input can also benefit other aspects of vision, as well as the auditory system. In 2022, they used computational models to show that early exposure to only low-frequency sounds, similar to those that babies hear in the womb, improves performance on auditory tasks that require analyzing sounds over a longer period of time, such as recognizing emotions. They now plan to explore whether this phenomenon extends to other aspects of development, such as language acquisition.

The research was funded by the National Eye Institute of NIH and the Intelligence Advanced Research Projects Activity.



Source link

Continue Reading
Click to comment

Leave a Reply

TOP SCEINCE

‘Ice bucket challenge’ reveals that bacteria can anticipate the seasons

Published

on

By

Study explains why the brain can robustly recognize images, even without color


Bacteria use their internal 24-hour clocks to anticipate the arrival of new seasons, according to research carried out with the assistance of an ‘ice bucket challenge.’ 

This discovery may have profound implications for understanding the role that circadian rhythms – a molecular version of a clock – play in adapting species to climate change, from migrating animals to flowering plants.  

The team behind the findings gave populations of blue-green algae (cyanobacteria) different artificial day lengths at a constant warm temperature. Samples on plates received either short days, equinox days (equal light and dark), or long days, for eight days.  

After this treatment, the blue-green algae were plunged into ice for two hours and survival rates monitored.   

Samples that had been exposed to a succession of short days (eight hours light and 16 hours dark) in preparation for the icy challenge achieved survival rates of 75%, up to three times higher than colonies that had not been primed in this way. 

One short day was not enough to increase the bacteria’s resistance to cold. Only after several short days, and optimally six to eight days, did the bacteria’s life chances significantly improve. 

In cyanobacteria which had genes that make up their biological clock removed, survival rates were the same regardless of day lengths. This indicates that photoperiodism (the ability to measure the day-night cycle and change one’s physiology in anticipation of the upcoming season) is critical in preparing bacteria for longer-term environmental changes such as a new season or shifts in climate. 

“The findings indicate that bacteria in nature use their internal clocks to measure day length and when the number of short days reaches a certain point, as they do in autumn/fall, they ‘switch’ to a different physiology in anticipation of the wintry challenges that lie ahead,” explained first author of the study, Dr Luísa Jabbur, who was a researcher at Vanderbilt University, Tennessee, in the laboratory of Prof. Carl Johnson when this study took place, and is now a BBSRC Discovery Fellow at the John Innes Centre.  

The Johnson lab has a long history of studying the circadian clock of cyanobacteria, both from a mechanistic and an ecological perspective. 

Previous studies have shown that bacteria have a version of a biological clock, which could allow them to measure differences in day-night length, offering an evolutionary advantage. 

This study, which appears in Science, is the first time that anyone has shown that photoperiodism in bacteria has evolved to anticipate seasonal cues.  

Based on these findings a whole new horizon of scientific exploration awaits. A key question is: how does an organism with a lifespan of between six and 24 hours evolve a mechanism that enables it not merely to react to, but to anticipate, future conditions? 

“It’s like they are signalling to their daughter cells and their granddaughter cells, passing information that the days are getting short, you need to do something,” said Dr Jabbur. 

Dr Jabbur and colleagues at the John Innes Centre will, as part of her BBSRC Discovery Fellowship, use cyanobacteria as a fast-reproducing model species to understand how photoperiodic responses might evolve in other species during climate change, with hopeful applications to major crops.  

A key part of this work will be to understand more about the molecular memory systems by which information is passed from generation to generation in species. Research will investigate the possibility that an accumulation of compounds during the night on short days acts as a molecular switch that triggers change to a different physiology or phenotype.  

For Dr Jabbur the findings amount to an early-career scientific breakthrough in the face of initial scepticism from her scientific mentor and the corresponding author of the paper, Professor Carl Johnson. 

“As well as being a fascinating person and an inspiration, Carl sings in the Nashville Symphony Chorus, and he has an operatic laugh! It echoed round the department when I first outlined my idea for the icy challenge, to see if photoperiod was a cue for cyanobacteria in their natural element,” said Dr Jabbur. 

“To be fair he told me to go away and try it, and as I went, he showed me a sign on his door with the Frank Westheimer quote: ‘Progress is made by young scientists who carry out experiments that old scientists say would not work.’ 

“It did work, first time. Then I repeated the experiments. There is something very precious about looking at a set of plates with bacteria on them and realizing that in that moment you know something that nobody else knows.” 

Bacteria can anticipate the seasons: Photoperiodism in cyanobacteria appears in Science.  



Source link

Continue Reading

TOP SCEINCE

New filtration material could remove long-lasting chemicals from water

Published

on

By

Study explains why the brain can robustly recognize images, even without color


Water contamination by the chemicals used in today’s technology is a rapidly growing problem globally. A recent studyby the U.S. Centers for Disease Control found that 98 percent of people tested had detectable levels of PFAS, a family of particularly long-lasting compounds, also known as forever chemicals, in their bloodstream.

A new filtration material developed by researchers at MIT might provide a nature-based solution to this stubborn contamination issue. The material, based on natural silk and cellulose, can remove a wide variety of these persistent chemicals as well as heavy metals. And, its antimicrobial properties can help keep the filters from fouling.

The findings are described in the journal ACS Nano, in a paper by MIT postdoc Yilin Zhang, professor of civil and environmental engineering Benedetto Marelli, and four others from MIT.

PFAS chemicals are present in a wide range of products, including cosmetics, food packaging, water-resistant clothing, firefighting foams, and antistick coating for cookware. A recent study identified 57,000 sites contaminated by these chemicals in the U.S. alone. The U.S. Environmental Protection Agency has estimated that PFAS remediation will cost $1.5 billion per year, in order to meet new regulations that call for limiting the compound to less than 7 parts per trillion in drinking water.

Contamination by PFAS and similar compounds “is actually a very big deal, and current solutions may only partially resolve this problem very efficiently or economically,” Zhang says. “That’s why we came up with this protein and cellulose-based, fully natural solution,” he says.

“We came to the project by chance,” Marelli notes. The initial technology that made the filtration material possible was developed by his group for a completely unrelated purpose — as a way to make a labelling system to counter the spread of counterfeit seeds, which are often of inferior quality. His team devised a way of processing silk proteins into uniform nanoscale crystals, or “nanofibrils,” through an environmentally benign, water-based drop-casting method at room temperature.

Zhang suggested that their new nanofibrillar material might be effective at filtering contaminants, but initial attempts with the silk nanofibrils alone didn’t work. The team decided to try adding another material: cellulose, which is abundantly available and can be obtained from agricultural wood pulp waste. The researchers used a self-assembly method in which the silk fibroin protein is suspended in water and then templated into nanofibrils by inserting “seeds” of cellulose nanocrystals. This causes the previously disordered silk molecules to line up together along the seeds, forming the basis of a hybrid material with distinct new properties.

By integrating cellulose into the silk-based fibrils that could be formed into a thin membrane, and then tuning the electrical charge of the cellulose, the researchers produced a material that was highly effective at removing contaminants in lab tests.

The electrical charge of the cellulose, they found, also gave it strong antimicrobial properties. This is a significant advantage, since one of the primary causes of failure in filtration membranes is fouling by bacteria and fungi. The antimicrobial properties of this material should greatly reduce that fouling issue, the researchers say.

“These materials can really compete with the current standard materials in water filtration when it comes to extracting metal ions and these emerging contaminants, and they can also outperform some of them currently,” Marelli says. In lab tests, the materials were able to extract orders of magnitude more of the contaminants from water than the currently used standard materials, activated carbon or granular activated carbon.

While the new work serves as a proof of principle, Marelli says, the team plans to continue working on improving the material, especially in terms of durability and availability of source materials. While the silk proteins used can be available as a byproduct of the silk textile industry, if this material were to be scaled up to address the global needs for water filtration, the supply might be insufficient. Also, alternative protein materials may turn out to perform the same function at lower cost.

Initially, the material would likely be used as a point-of-use filter, something that could be attached to a kitchen faucet, Zhang says. Eventually, it could be scaled up to provide filtration for municipal water supplies, but only after testing demonstrates that this would not pose any risk of introducing any contamination into the water supply. But one big advantage of the material, he says, is that both the silk and the cellulose constituents are considered food-grade substances, so any contamination is unlikely.

“Most of the normal materials available today are focusing on one class of contaminants or solving single problems,” Zhang says. “I think we are among the first to address all of these simultaneously.”

The research team included MIT postdocs Hui Sun and Meng Li, graduate student Maxwell Kalinowski, and recent graduate Yunteng Cao PhD ’22, now a postdoc at Yale. The work was supported by the Office of Naval Research, the National Science Foundation, and the Singapore-MIT Alliance for Research and Technology.



Source link

Continue Reading

TOP SCEINCE

‘Some pterosaurs would flap, others would soar’ — new study further confirms the flight capability of these giants of the skies

Published

on

By

Study explains why the brain can robustly recognize images, even without color


Some species of pterosaurs flew by flapping their wings while others soared like vultures, demonstrates a new study published in the peer-reviewed Journal of Vertebrate Paleontology.

It has long been debated whether the largest pterosaurs could fly at all.

However, “remarkable” and “rare” three-dimensional fossils of two different large-bodied azhdarchoid pterosaur species — including one new-to-science — have enabled scientists to hypothesize that not only could the largest pterosaurs take to the air, but their flight styles could differ too.

The new findings are led by experts from the University of Michigan, in the US, the Natural Resources Authority and Yarmouk University, in Jordan, and the Saudi Geological Survey, in Saudi Arabia.

Their paper details how these fossils — which date back to the latest Cretaceous period (approximately 72 to 66 million years ago) — were remarkably three-dimensionally preserved within the two different sites that preserve a nearshore environment on the margin of Afro-Arabia, an ancient landmass that included both Africa and the Arabian Peninsula. The research team used high-resolution computed tomography (CT) scans to then analyze the internal structure of the wing bones.

“The dig team was extremely surprised to find three-dimensionally preserved pterosaur bones, this is a very rare occurrence,” explains lead author Dr Kierstin Rosenbach, from the Department of Earth and Environmental Sciences of the University of Michigan.

“Since pterosaur bones are hollow, they are very fragile and are more likely to be found flattened like a pancake, if they are preserved at all.

“With 3D preservation being so rare, we do not have a lot of information about what pterosaur bones look like on the inside, so I wanted to CT scan them.

“It was entirely possible that nothing was preserved inside, or that CT scanners were not sensitive enough to differentiate fossil bone tissue from the surrounding matrix.”

Luckily, though, what the team uncovered was “remarkable,” via “exciting internal structures not only preserved, but visible in the CT scanner.”

CT scans reveal one soars; one flaps!

Newly collected specimens of the already-known giant pterosaur, Arambourgiania philadelphiae, confirm its 10-meter wingspan and provide the first details of its bone structure. CT images revealed that the interior of its humerus, which is hollow, contains a series of ridges that spiral up and down the bone.

This resembles structures in the interior of wing bones of vultures. The spiral ridges are hypothesized to resist the torsional loadings associated with soaring (sustained powered flight that requires launch and maintenance flapping).

The other specimen analyzed was the new-to-science Inabtanin alarabia, which had a five-meter wingspan. The team named it after the place where it was excavated — near a large grape-colored hill, called Tal Inab. The generic name combines the Arabic words “inab,” for grape, and “tanin” for dragon. ‘Alarabia’ refers to the Arabian Peninsula.

Inabtanin is one of the most complete pterosaurs ever recovered from Afro-Arabia, and the CT scans revealed the structure of its flight bones was completely different from that of Arambourgiania.

The interior of the flight bones were crisscrossed by arrangement with struts that match those found in the wing bones of modern flapping birds.

This indicates it was adapted to resist bending loads associated with flapping flight, and so it is likely that Inabtanin flew this way — although this does not preclude occasional use of other flight styles too.

“The struts found in Inabtanin were cool to see, though not unusual,” says Dr Rosenbach.

“The ridges in Arambourgiania were completely unexpected, we weren’t sure what we were seeing at first!

“Being able to see the full 3D model of Arambourgiania’s humerus lined with helical ridges was just so exciting.”

What explains this difference?

The discovery of diverse flight styles in differently-sized pterosaurs is “exciting,” the experts state, because it opens a window into how these animals lived. It also poses interesting questions, like to what extent flight style is correlated with body size and which flight style is more common among pterosaurs.

“There is such limited information on the internal bone structure of pterosaurs across time, it is difficult to say with certainty which flight style came first,” Dr Rosenbach adds.

“If we look to other flying vertebrate groups, birds and bats, we can see that flapping is by far the most common flight behavior.

“Even birds that soar or glide require some flapping to get in the air and maintain flight.

“This leads me to believe that flapping flight is the default condition, and that the behavior of soaring would perhaps evolve later if it were advantageous for the pterosaur population in a specific environment; in this case the open ocean.”

Co-author Professor Jeff Wilson Mantilla, Curator at Michigan’s Museum of Paleontology, and Dr Iyad Zalmout, from the Saudi Geological Survey, found these specimens in 2007 at sites in the north and south of Jordan.

Professor Jeff Wilson Mantilla says the “variations likely reflect responses to mechanical forces applied on the pterosaurs’ wings during flight.”

Enabling further study of vertebrate flight

Concluding, Dr Rosenbach states: “Pterosaurs were the earliest and largest vertebrates to evolve powered flight, but they are the only major volant group that has gone extinct.

“Attempts to-date to understand their flight mechanics have relied on aerodynamic principles and analogy with extant birds and bats.

“This study provides a framework for further investigation of the correlation between internal bone structure and flight capacity and behavior, and will hopefully lead to broader sampling of flight bone structure in pterosaur specimens.”



Source link

Continue Reading

Trending