Home > Press > Teaching physics to neural networks removes 'chaos blindness'
The Hamiltonian flow represented as a donut-like torus; rainbow colors code a fourth dimension. |
Abstract:
Researchers from North Carolina State University have discovered that teaching physics to neural networks enables those networks to better adapt to chaos within their environment. The work has implications for improved artificial intelligence (AI) applications ranging from medical diagnostics to automated drone piloting.
Neural networks are an advanced type of AI loosely based on the way that our brains work. Our natural neurons exchange electrical impulses according to the strengths of their connections. Artificial neural networks mimic this behavior by adjusting numerical weights and biases during training sessions to minimize the difference between their actual and desired outputs. For example, a neural network can be trained to identify photos of dogs by sifting through a large number of photos, making a guess about whether the photo is of a dog, seeing how far off it is and then adjusting its weights and biases until they are closer to reality.
The drawback to this neural network training is something called "chaos blindness" - an inability to predict or respond to chaos in a system. Conventional AI is chaos blind. But researchers from NC State's Nonlinear Artificial Intelligence Laboratory (NAIL) have found that incorporating a Hamiltonian function into neural networks better enables them to "see" chaos within a system and adapt accordingly.
Simply put, the Hamiltonian embodies the complete information about a dynamic physical system - the total amount of all the energies present, kinetic and potential. Picture a swinging pendulum, moving back and forth in space over time. Now look at a snapshot of that pendulum. The snapshot cannot tell you where that pendulum is in its arc or where it is going next. Conventional neural networks operate from a snapshot of the pendulum. Neural networks familiar with the Hamiltonian flow understand the entirety of the pendulum's movement - where it is, where it will or could be, and the energies involved in its movement.
In a proof-of-concept project, the NAIL team incorporated Hamiltonian structure into neural networks, then applied them to a known model of stellar and molecular dynamics called the Hénon-Heiles model. The Hamiltonian neural network accurately predicted the dynamics of the system, even as it moved between order and chaos.
"The Hamiltonian is really the 'special sauce' that gives neural networks the ability to learn order and chaos," says John Lindner, visiting researcher at NAIL, professor of physics at The College of Wooster and corresponding author of a paper describing the work. "With the Hamiltonian, the neural network understands underlying dynamics in a way that a conventional network cannot. This is a first step toward physics-savvy neural networks that could help us solve hard problems."
The work appears in Physical Review E and is supported in part by the Office of Naval Research (grant N00014-16-1-3066). NC State postdoctoral researcher Anshul Choudhary is first author. Bill Ditto, professor of physics at NC State, is director of NAIL. Visiting researcher Scott Miller; Sudeshna Sinha, from the Indian Institute of Science Education and Research Mohali; and NC State graduate student Elliott Holliday also contributed to the work.
####
For more information, please click here
Contacts:
Tracey Peake
919-515-6142
@NCStateNews
Copyright © North Carolina State University
If you have a comment, please Contact us.Issuers of news releases, not 7th Wave, Inc. or Nanotechnology Now, are solely responsible for the accuracy of the content.
Related Links |
"Physics enhanced neural networks predict order and chaos"
Related News Press |
Physics
Simulating magnetization in a Heisenberg quantum spin chain April 5th, 2024
News and information
Simulating magnetization in a Heisenberg quantum spin chain April 5th, 2024
NRL charters Navy’s quantum inertial navigation path to reduce drift April 5th, 2024
Discovery points path to flash-like memory for storing qubits: Rice find could hasten development of nonvolatile quantum memory April 5th, 2024
Govt.-Legislation/Regulation/Funding/Policy
NRL charters Navy’s quantum inertial navigation path to reduce drift April 5th, 2024
Discovery points path to flash-like memory for storing qubits: Rice find could hasten development of nonvolatile quantum memory April 5th, 2024
Chemical reactions can scramble quantum information as well as black holes April 5th, 2024
Possible Futures
Discovery points path to flash-like memory for storing qubits: Rice find could hasten development of nonvolatile quantum memory April 5th, 2024
With VECSELs towards the quantum internet Fraunhofer: IAF achieves record output power with VECSEL for quantum frequency converters April 5th, 2024
Discoveries
Chemical reactions can scramble quantum information as well as black holes April 5th, 2024
New micromaterial releases nanoparticles that selectively destroy cancer cells April 5th, 2024
Utilizing palladium for addressing contact issues of buried oxide thin film transistors April 5th, 2024
Announcements
NRL charters Navy’s quantum inertial navigation path to reduce drift April 5th, 2024
Discovery points path to flash-like memory for storing qubits: Rice find could hasten development of nonvolatile quantum memory April 5th, 2024
Interviews/Book Reviews/Essays/Reports/Podcasts/Journals/White papers/Posters
Simulating magnetization in a Heisenberg quantum spin chain April 5th, 2024
Discovery points path to flash-like memory for storing qubits: Rice find could hasten development of nonvolatile quantum memory April 5th, 2024
Military
NRL charters Navy’s quantum inertial navigation path to reduce drift April 5th, 2024
What heat can tell us about battery chemistry: using the Peltier effect to study lithium-ion cells March 8th, 2024
New chip opens door to AI computing at light speed February 16th, 2024
Artificial Intelligence
Simulating magnetization in a Heisenberg quantum spin chain April 5th, 2024
Researchers’ approach may protect quantum computers from attacks March 8th, 2024
New chip opens door to AI computing at light speed February 16th, 2024
HKUST researchers develop new integration technique for efficient coupling of III-V and silicon February 16th, 2024
The latest news from around the world, FREE | ||
Premium Products | ||
Only the news you want to read!
Learn More |
||
Full-service, expert consulting
Learn More |
||