Nanotechnology Now

Our NanoNews Digest Sponsors
Heifer International



Home > Press > CEA-Leti Reports Machine-Learning Breakthrough That Opens Way to Edge Learning: Article in Nature Electronics Details Method that Takes Advantage of RRAM Non-Idealities To Create Intelligent Systems that Have Potential Medical-Diagnostic Applications

Abstract:
CEA-Leti scientists have demonstrated a machine-learning technique exploiting what have been previously considered as “non-ideal” traits of resistive-RAM (RRAM) devices, overcoming barriers to developing RRAM-based edge-learning systems.

CEA-Leti Reports Machine-Learning Breakthrough That Opens Way to Edge Learning: Article in Nature Electronics Details Method that Takes Advantage of RRAM Non-Idealities To Create Intelligent Systems that Have Potential Medical-Diagnostic Applications

Grenoble, France | Posted on January 20th, 2021

Reported in a paper published in the January issue of Nature Electronics titled, “In-situ learning using intrinsic memristor variability via Markov chain Monte Carlo sampling”, the research team demonstrated how RRAM, or memristor, technology can be used to create intelligent systems that learn locally at the edge, independent of the cloud. The learning algorithms used in current RRAM-based edge approaches cannot be reconciled with device programming randomness, or variability, as well as other intrinsic non-idealities of the technology.



To get around that problem, the team developed a method that actively exploits that memristor randomness, implementing a Markov Chain Monte Carlo (MCMC) sampling learning algorithm in a fabricated chip that acts as a Bayesian machine-learning model.



The article notes that while machine learning provides the enabling models and algorithms for edge-learning systems, increased attention concerning how these algorithms map onto hardware is required to bring machine learning to the edge. Machine-learning models are normally trained using general purpose hardware based on a von Neumann architecture, which is unsuited for edge learning because of the energy required to continuously move information between separated processing and memory centers on-chip.



Intensive research in the microelectronics industry is currently focused on using RRAM as non-volatile analog devices in hardware-based artificial neural networks that can allow computation to be carried out in-memory, to drastically reduce these energy requirements. RRAM has been applied to in-memory implementations of backpropagation algorithms to implement in-situ learning on edge systems. However, because backpropogation requires high-precision memory elements, previous work has largely focused on how RRAM randomness can be mitigated – often necessitating energy-intensive techniques.



The CEA-Leti-based team’s breakthrough was an approach capable of leveraging this randomness, instead of trying to prevent it, and allowing in-situ learning to be realized in a highly efficient fashion through the application of nanosecond voltage pulses to nanoscale memory devices. This culminated in an extremely low-energy solution. The team explained that, relative to a CMOS implementation of its algorithm, the approach requires five orders of magnitude less energy. That is the rough equivalence of the difference in height between the tallest building in the world and a coin lying on the ground.



As a result, this approach is capable of bringing learning to edge-computing systems, which is impossible using existing commercial approaches. Such an application could be an implanted medical system that locally updates its operation based on the evolving state of a patient. To run a representative test of learning at the edge in such an environment, the team experimentally applied RRAM-based MCMC to train a multilayer Bayesian neural network to detect heart arrhythmias from electrocardiogram recordings – reporting a better detection rate than a standard neural network based on a von Neumann computing system.



“This highlights that, beyond being RRAM-compatible, Bayesian machine learning offers an alternative modelling method that appears well suited to the characteristics of edge learning,” the article says.

The team also applied their experimental system to solve further classification tasks including the diagnosis of malignant breast-tissue samples.



“Our system could be used as the foundation for the design and fabrication of a standalone and fully integrated RRAM-based MCMC sampling chip, for applications outside the laboratory,” the authors of the article conclude. That achievement will finally open the door to edge learning and an entirely new set of applications.

####

About CEA Leti
Leti, a technology research institute at CEA, is a global leader in miniaturization technologies enabling smart, energy-efficient and secure solutions for industry. Founded in 1967, CEA-Leti pioneers micro-& nanotechnologies, tailoring differentiating applicative solutions for global companies, SMEs and startups. CEA-Leti tackles critical challenges in healthcare, energy and digital migration. From sensors to data processing and computing solutions, CEA-Leti’s multidisciplinary teams deliver solid expertise, leveraging world-class pre-industrialization facilities. With a staff of more than 1,900, a portfolio of 3,100 patents, 10,000 sq. meters of cleanroom space and a clear IP policy, the institute is based in Grenoble, France, and has offices in Silicon Valley and Tokyo. CEA-Leti has launched 65 startups and is a

member of the Carnot Institutes network. Follow us on www.leti-cea.com and @CEA_Leti.



Technological expertise

CEA has a key role in transferring scientific knowledge and innovation from research to industry. This high-level technological research is carried out in particular in electronic and integrated systems, from microscale to nanoscale. It has a wide range of industrial applications in the fields of transport, health, safety and telecommunications, contributing to the creation of high-quality and competitive products.



For more information: www.cea.fr/english

For more information, please click here

Contacts:
Press Contact

Agency

+33 6 74 93 23 47

Copyright © CEA Leti

If you have a comment, please Contact us.

Issuers of news releases, not 7th Wave, Inc. or Nanotechnology Now, are solely responsible for the accuracy of the content.

Bookmark:
Delicious Digg Newsvine Google Yahoo Reddit Magnoliacom Furl Facebook

Related News Press

News and information

HKUST researchers develop a novel integration scheme for efficient coupling between III-V and silicon November 18th, 2022

Researchers at Purdue unlock light-matter interactions on sub-nanometer scales, leading to ‘picophotonics’ November 18th, 2022

Rice turns asphaltene into graphene for composites: ‘Flashed’ byproduct of crude oil could bolster materials, polymer inks November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Memristors

Photoinduced large polaron transport and dynamics in organic-inorganic hybrid lead halide perovskite with terahertz probes July 8th, 2022

Artificial neurons go quantum with photonic circuits: Quantum memristor as missing link between artificial intelligence and quantum computing March 25th, 2022

New brain-like computing device simulates human learning: Researchers conditioned device to learn by association, like Pavlov's dog April 30th, 2021

New insights into memristive devices by combining incipient ferroelectrics and graphene November 27th, 2020

Possible Futures

HKUST researchers develop a novel integration scheme for efficient coupling between III-V and silicon November 18th, 2022

NIST’s grid of quantum islands could reveal secrets for powerful technologies November 18th, 2022

A new experiment pushes the boundaries of our understanding of topological quantum matter: The behavior of bosonic particles observed in a magnetic insulator fabricated from ruthenium chloride can be explained by a relatively new and little-studied physics phenomenon called the B November 18th, 2022

Trial by wind: Testing the heat resistance of carbon fiber-reinforced ultra-high-temperature ceramic matrix composites: Researchers use an arc-wind tunnel to test the heat resistance of carbon fiber reinforced ultra-high-temperature ceramic matrix composites November 18th, 2022

Chip Technology

NIST’s grid of quantum islands could reveal secrets for powerful technologies November 18th, 2022

An on-chip time-lens generates ultrafast pulses: New device opens the doors to applications in communication, quantum computing, astronomy November 18th, 2022

Researchers at Purdue unlock light-matter interactions on sub-nanometer scales, leading to ‘picophotonics’ November 18th, 2022

Semi-nonlinear etchless lithium niobate waveguide with bound states in the continuum November 4th, 2022

Discoveries

An on-chip time-lens generates ultrafast pulses: New device opens the doors to applications in communication, quantum computing, astronomy November 18th, 2022

Researchers at Purdue unlock light-matter interactions on sub-nanometer scales, leading to ‘picophotonics’ November 18th, 2022

Rice turns asphaltene into graphene for composites: ‘Flashed’ byproduct of crude oil could bolster materials, polymer inks November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Announcements

HKUST researchers develop a novel integration scheme for efficient coupling between III-V and silicon November 18th, 2022

NIST’s grid of quantum islands could reveal secrets for powerful technologies November 18th, 2022

A new experiment pushes the boundaries of our understanding of topological quantum matter: The behavior of bosonic particles observed in a magnetic insulator fabricated from ruthenium chloride can be explained by a relatively new and little-studied physics phenomenon called the B November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Artificial Intelligence

New chip ramps up AI computing efficiency August 19th, 2022

Artificial Intelligence Centered Cancer Nanomedicine: Diagnostics, Therapeutics and Bioethics June 3rd, 2022

‘Nanomagnetic’ computing can provide low-energy AI, researchers show May 6th, 2022

Development of low-power and high-efficiency artificial sensory neurons: 3T-OTS device to simulate the efficient information processing method of the human brain. A green light for the development of sensor-AI combined next-generation artificial intelligence “to be used in life a April 8th, 2022

NanoNews-Digest
The latest news from around the world, FREE




  Premium Products
NanoNews-Custom
Only the news you want to read!
 Learn More
NanoStrategies
Full-service, expert consulting
 Learn More











ASP
Nanotechnology Now Featured Books




NNN

The Hunger Project