Connect with us

TOP SCEINCE

Animal brain inspired AI game changer for autonomous robots

Published

on

Animal brain inspired AI game changer for autonomous robots


A team of researchers at Delft University of Technology has developed a drone that flies autonomously using neuromorphic image processing and control based on the workings of animal brains. Animal brains use less data and energy compared to current deep neural networks running on GPUs (graphic chips). Neuromorphic processors are therefore very suitable for small drones because they don’t need heavy and large hardware and batteries. The results are extraordinary: during flight the drone’s deep neural network processes data up to 64 times faster and consumes three times less energy than when running on a GPU. Further developments of this technology may enable the leap for drones to become as small, agile, and smart as flying insects or birds. The findings were recently published in Science Robotics.

Learning from animal brains: spiking neural networks

Artificial intelligence holds great potential to provide autonomous robots with the intelligence needed for real-world applications. However, current AI relies on deep neural networks that require substantial computing power. The processors made for running deep neural networks (Graphics Processing Units, GPUs) consume a substantial amount of energy. Especially for small robots like flying drones this is a problem, since they can only carry very limited resources in terms of sensing and computing.

Animal brains process information in a way that is very different from the neural networks running on GPUs. Biological neurons process information asynchronously, and mostly communicate via electrical pulses called spikes. Since sending such spikes costs energy, the brain minimizes spiking, leading to sparse processing.

Inspired by these properties of animal brains, scientists and tech companies are developing new, neuromorphic processors. These new processors allow to run spiking neural networks and promise to be much faster and more energy efficient.

“The calculations performed by spiking neural networks are much simpler than those in standard deep neural networks.,” says Jesse Hagenaars, PhD candidate and one of the authors of the article, “Whereas digital spiking neurons only need to add integers, standard neurons have to multiply and add floating point numbers. This makes spiking neural networks quicker and more energy efficient. To understand why, think of how humans also find it much easier to calculate 5 + 8 than to calculate 6.25 x 3.45 + 4.05 x 3.45.”

This energy efficiency is further boosted if neuromorphic processors are used in combination with neuromorphic sensors, like neuromorphic cameras. Such cameras do not make images at a fixed time interval. Instead, each pixel only sends a signal when it becomes brighter or darker. The advantages of such cameras are that they can perceive motion much more quickly, are more energy efficient, and function well both in dark and bright environments. Moreover, the signals from neuromorphic cameras can feed directly into spiking neural networks running on neuromorphic processors. Together, they can form a huge enabler for autonomous robots, especially small, agile robots like flying drones.

First neuromorphic vision and control of a flying drone

In an article published in Science Robotics on May 15, 2024, researchers from Delft University of Technology, the Netherlands, demonstrate for the first time a drone that uses neuromorphic vision and control for autonomous flight. Specifically, they developed a spiking neural network that processes the signals from a neuromorphic camera and outputs control commands that determine the drone’s pose and thrust. They deployed this network on a neuromorphic processor, Intel’s Loihi neuromorphic research chip, on board of a drone. Thanks to the network, the drone can perceive and control its own motion in all directions.

“We faced many challenges,” says Federico Paredes-Vallés, one of the researchers that worked on the study, “but the hardest one was to imagine how we could train a spiking neural network so that training would be both sufficiently fast and the trained network would function well on the real robot. In the end, we designed a network consisting of two modules. The first module learns to visually perceive motion from the signals of a moving neuromorphic camera. It does so completely by itself, in a self-supervised way, based only on the data from the camera. This is similar to how also animals learn to perceive the world by themselves. The second module learns to map the estimated motion to control commands, in a simulator. This learning relied on an artificial evolution in simulation, in which networks that were better in controlling the drone had a higher chance of producing offspring. Over the generations of the artificial evolution, the spiking neural networks got increasingly good at control, and were finally able to fly in any direction at different speeds. We trained both modules and developed a way with which we could merge them together. We were happy to see that the merged network immediately worked well on the real robot.”

With its neuromorphic vision and control, the drone is able to fly at different speeds under varying light conditions, from dark to bright. It can even fly with flickering lights, which make the pixels in the neuromorphic camera send great numbers of signals to the network that are unrelated to motion.

Improved energy efficiency and speed by neuromorphic AI

“Importantly, our measurements confirm the potential of neuromorphic AI. The network runs on average between 274 and 1600 times per second. If we run the same network on a small, embedded GPU, it runs on average only 25 times per second, a difference of a factor ~10-64! Moreover, when running the network, , Intel’s Loihi neuromorphic research chip consumes 1.007 watts, of which 1 watt is the idle power that the processor spends just when turning on the chip. Running the network itself only costs 7 milliwatts. In comparison, when running the same network, the embedded GPU consumes 3 watts, of which 1 watt is idle power and 2 watts are spent for running the network. The neuromorphic approach results in AI that runs faster and more efficiently, allowing deployment on much smaller autonomous robots.,” says Stein Stroobants, PhD candidate in the field of neuromorphic drones.

Future applications of neuromorphic AI for tiny robots

“Neuromorphic AI will enable all autonomous robots to be more intelligent,” says Guido de Croon, Professor in bio-inspired drones, “but it is an absolute enabler for tiny autonomous robots. At Delft University of Technology’s Faculty of Aerospace Engineering, we work on tiny autonomous drones which can be used for applications ranging from monitoring crop in greenhouses to keeping track of stock in warehouses. The advantages of tiny drones are that they are very safe and can navigate in narrow environments like in between ranges of tomato plants. Moreover, they can be very cheap, so that they can be deployed in swarms. This is useful for more quickly covering an area, as we have shown in exploration and gas source localization settings.”

“The current work is a great step in this direction. However, the realization of these applications will depend on further scaling down the neuromorphic hardware and expanding the capabilities towards more complex tasks such as navigation.”



Source link

Continue Reading
Click to comment

Leave a Reply

TOP SCEINCE

New understanding of fly behavior has potential application in robotics, public safety

Published

on

By

Animal brain inspired AI game changer for autonomous robots


Why do flies buzz around in circles when the air is still? And why does it matter?

In a paper published online July 26, 2024 by the scientific journal Current Biology, University of Nevada, Reno Assistant Professor Floris van Breugel and Postdoctoral Researcher S. David Stupski respond to this up-until-now unanswered question. And that answer could hold a key to public safety — specifically, how to better train robotic systems to track chemical leaks.

“We don’t currently have robotic systems to track odor or chemical plumes,” van Breugel said. “We don’t know how to efficiently find the source of a wind-borne chemical. But insects are remarkably good at tracking chemical plumes, and if we really understood how they do it, maybe we could train inexpensive drones to use a similar process to find the source of chemicals and chemical leaks.”

A fundamental challenge in understanding how insects track chemical plumes — basically, how does the fly find the banana in your kitchen? — is that wind and odors can’t be independently manipulated.

To address this challenge, van Breugel and Stupski used a new approach that makes it possible to remotely control neurons — specifically the “smell” neurons — on the antennae of flying fruit flies by genetically introducing light-sensitive proteins, an approach called optogenetics. These experiments, part of a $450,000 project funded through the Air Force Office of Scientific Research, made it possible to give flies identical virtual smell experiences in different wind conditions.

What van Breugel and Stupski wanted to know: how do flies find an odor when there’s no wind to carry it? This is, after all, likely the wind experience of a fly looking for a banana in your kitchen. The answer is in the Current Biology article, “Wind Gates Olfaction Driven Search States in Free Flight.” The print version will appear in the Sept. 9 issue.

Flies use environmental cues to detect and respond to air currents and wind direction to find their food sources, according to van Breugel. In the presence of wind, those cues trigger an automatic “cast and surge” behavior, in which the fly surges into the wind after encountering a chemical plume (indicating food) and then casts — moves side to side — when it loses the scent. Cast-and-surge behavior long has been understood by scientists but, according to van Breugel, it was fundamentally unknown how insects searched for a scent in still air.

Through their work, van Breugel and Stupski uncovered another automatic behavior, sink and circle, which involves lowering altitude and repetitive, rapid turns in a consistent direction. Flies perform this innate movement consistently and repetitively, even more so than cast-and-surge behavior.

According to van Breugel, the most exciting aspect of this discovery is that it shows flying flies are clearly able to assess the conditions of the wind — its presence, and direction — before deploying a strategy that works well under these conditions. The fact that they can do this is actually quite surprising — can you tell if there is a gentle breeze if you stick your head out of the window of a moving car? Flies aren’t just reacting to an odor with the same preprogrammed response every time like a simple robot, they are responding in context-appropriate manner. This knowledge potentially could be applied to train more sophisticated algorithms for scent-detecting drones to find the source of chemical leaks.

So, the next time you try to swat a fly in your home, consider the fact that flies might actually be a little more aware of some of their natural surroundings than you are. And maybe just open a window to let it out.



Source link

Continue Reading

TOP SCEINCE

New drug shows promise in clearing HIV from brain

Published

on

By

Animal brain inspired AI game changer for autonomous robots


An experimental drug originally developed to treat cancer may help clear HIV from infected cells in the brain, according to a new Tulane University study.

For the first time, researchers at Tulane National Primate Research Center found that a cancer drug significantly reduced levels of SIV, the nonhuman primate equivalent of HIV, in the brain by targeting and depleting certain immune cells that harbor the virus.

Published in the journal Brain, this discovery marks a significant step toward eliminating HIV from hard-to-reach reservoirs where the virus evades otherwise effective treatment.

“This research is an important step in tackling brain-related issues caused by HIV, which still affect people even when they are on effective HIV medication,” said lead study author Woong-Ki Kim, PhD, associate director for research at Tulane National Primate Research Center. “By specifically targeting the infected cells in the brain, we may be able to clear the virus from these hidden areas, which has been a major challenge in HIV treatment.”

Antiretroviral therapy (ART) is an essential component of successful HIV treatment, maintaining the virus at undetectable levels in the blood and transforming HIV from a terminal illness into a manageable condition. However, ART does not completely eradicate HIV, necessitating lifelong treatment. The virus persists in “viral reservoirs” in the brain, liver, and lymph nodes, where it remains out of reach of ART.

The brain has been a particularly challenging area for treatment due to the blood-brain barrier — a protective membrane that shields it from harmful substances but also blocks treatments, allowing the virus to persist. In addition, cells in the brain known as macrophages are extremely long-lived, making them difficult to eradicate once they become infected.

Infection of macrophages is thought to contribute to neurocognitive dysfunction, experienced by nearly half of those living with HIV. Eradicating the virus from the brain is critical for comprehensive HIV treatment and could significantly improve the quality of life for those with HIV-related neurocognitive problems.

Researchers focused on macrophages, a type of white blood cell that harbors HIV in the brain. By using a small molecule inhibitor to block a receptor that increases in HIV-infected macrophages, the team successfully reduced the viral load in the brain. This approach essentially cleared the virus from brain tissue, providing a potential new treatment avenue for HIV.

The small molecule inhibitor used, BLZ945, has previously been studied for therapeutic use in amyotrophic lateral sclerosis (ALS) and brain cancer, but never before in the context of clearing HIV from the brain.

The study, which took place at the Tulane National Primate Research Center, utilized three groups to model human HIV infection and treatment: an untreated control group, and two groups treated with either a low or high dose of the small molecule inhibitor for 30 days. The high-dose treatment lead to a notable reduction in cells expressing HIV receptor sites, as well as a 95-99% decrease in viral DNA loads in the brain .

In addition to reducing viral loads, the treatment did not significantly impact microglia, the brain’s resident immune cells, which are essential for maintaining a healthy neuroimmune environment. It also did not show signs of liver toxicity at the doses tested.

The next step for the research team is to test this therapy in conjunction with ART to assess its efficacy in a combined treatment approach. This could pave the way for more comprehensive strategies to eradicate HIV from the body entirely.

This research was funded by the National Institutes of Health, including grants from the National Institute of Mental Health and the National Institute of Neurological Disorders and Stroke, and was supported with resources from the Tulane National Primate Research Center base grant of the National Institutes of Health, P51 OD011104.



Source link

Continue Reading

TOP SCEINCE

Chemical analyses find hidden elements from renaissance astronomer Tycho Brahe’s alchemy laboratory

Published

on

By

Animal brain inspired AI game changer for autonomous robots


In the Middle Ages, alchemists were notoriously secretive and didn’t share their knowledge with others. Danish Tycho Brahe was no exception. Consequently, we don’t know precisely what he did in the alchemical laboratory located beneath his combined residence and observatory, Uraniborg, on the now Swedish island of Ven.

Only a few of his alchemical recipes have survived, and today, there are very few remnants of his laboratory. Uraniborg was demolished after his death in 1601, and the building materials were scattered for reuse.

However, during an excavation in 1988-1990, some pottery and glass shards were found in Uraniborg’s old garden. These shards were believed to originate from the basement’s alchemical laboratory. Five of these shards — four glass and one ceramic — have now undergone chemical analyses to determine which elements the original glass and ceramic containers came into contact with.

The chemical analyses were conducted by Professor Emeritus and expert in archaeometry, Kaare Lund Rasmussen from the Department of Physics, Chemistry, and Pharmacy, University of Southern Denmark. Senior researcher and museum curator Poul Grinder-Hansen from the National Museum of Denmark oversaw the insertion of the analyses into historical context.

Enriched levels of trace elements were found on four of them, while one glass shard showed no specific enrichments. The study has been published in the journal Heritage Science.

“Most intriguing are the elements found in higher concentrations than expected — indicating enrichment and providing insight into the substances used in Tycho Brahe’s alchemical laboratory,” said Kaare Lund Rasmussen.

The enriched elements are nickel, copper, zinc, tin, antimony, tungsten, gold, mercury, and lead, and they have been found on either the inside or outside of the shards.

Most of them are not surprising for an alchemist’s laboratory. Gold and mercury were — at least among the upper echelons of society — commonly known and used against a wide range of diseases.

“But tungsten is very mysterious. Tungsten had not even been described at that time, so what should we infer from its presence on a shard from Tycho Brahe’s alchemy workshop?,” said Kaare Lund Rasmussen.

Tungsten was first described and produced in pure form more than 180 years later by the Swedish chemist Carl Wilhelm Scheele. Tungsten occurs naturally in certain minerals, and perhaps the element found its way to Tycho Brahe’s laboratory through one of these minerals. In the laboratory, the mineral might have undergone some processing that separated the tungsten, without Tycho Brahe ever realizing it.

However, there is also another possibility that Professor Kaare Lund Rasmussen emphasizes has no evidence whatsoever — but which could be plausible.

Already in the first half of the 1500s, the German mineralogist Georgius Agricola described something strange in tin ore from Saxony, which caused problems when he tried to smelt tin. Agricola called this strange substance in the tin ore “Wolfram” (German for Wolf’s froth, later renamed to tungsten in English).

“Maybe Tycho Brahe had heard about this and thus knew of tungsten’s existence. But this is not something we know or can say based on the analyses I have done. It is merely a possible theoretical explanation for why we find tungsten in the samples,” said Kaare Lund Rasmussen.

Tycho Brahe belonged to the branch of alchemists who, inspired by the German physician Paracelsus, tried to develop medicine for various diseases of the time: plague, syphilis, leprosy, fever, stomach aches, etc. But he distanced himself from the branch that tried to create gold from less valuable minerals and metals.

In line with the other medical alchemists of the time, he kept his recipes close to his chest and shared them only with a few selected individuals, such as his patron, Emperor Rudolph II, who allegedly received Tycho Brahe’s prescriptions for plague medicine.

We know that Tycho Brahe’s plague medicine was complicated to produce. It contained theriac, which was one of the standard remedies for almost everything at the time and could have up to 60 ingredients, including snake flesh and opium. It also contained copper or iron vitriol (sulphates), various oils, and herbs.

After various filtrations and distillations, the first of Brahe’s three recipes against plague was obtained. This could be made even more potent by adding tinctures of, for example, coral, sapphires, hyacinths, or potable gold.

“It may seem strange that Tycho Brahe was involved in both astronomy and alchemy, but when one understands his worldview, it makes sense. He believed that there were obvious connections between the heavenly bodies, earthly substances, and the body’s organs. Thus, the Sun, gold, and the heart were connected, and the same applied to the Moon, silver, and the brain; Jupiter, tin, and the liver; Venus, copper, and the kidneys; Saturn, lead, and the spleen; Mars, iron, and the gallbladder; and Mercury, mercury, and the lungs. Minerals and gemstones could also be linked to this system, so emeralds, for example, belonged to Mercury,” explained Poul Grinder-Hansen.

Kaare Lund Rasmussen has previously analyzed hair and bones from Tycho Brahe and found, among other elements, gold. This could indicate that Tycho Brahe himself had taken medicine that contained potable gold.



Source link

Continue Reading

Trending