Nanotechnology Now

Our NanoNews Digest Sponsors
Heifer International



Home > Press > Teaching physics to neural networks removes 'chaos blindness'

The Hamiltonian flow represented as a donut-like torus; rainbow colors code a fourth dimension.
The Hamiltonian flow represented as a donut-like torus; rainbow colors code a fourth dimension.

Abstract:
Researchers from North Carolina State University have discovered that teaching physics to neural networks enables those networks to better adapt to chaos within their environment. The work has implications for improved artificial intelligence (AI) applications ranging from medical diagnostics to automated drone piloting.

Teaching physics to neural networks removes 'chaos blindness'

Raleigh, NC | Posted on June 19th, 2020

Neural networks are an advanced type of AI loosely based on the way that our brains work. Our natural neurons exchange electrical impulses according to the strengths of their connections. Artificial neural networks mimic this behavior by adjusting numerical weights and biases during training sessions to minimize the difference between their actual and desired outputs. For example, a neural network can be trained to identify photos of dogs by sifting through a large number of photos, making a guess about whether the photo is of a dog, seeing how far off it is and then adjusting its weights and biases until they are closer to reality.

The drawback to this neural network training is something called "chaos blindness" - an inability to predict or respond to chaos in a system. Conventional AI is chaos blind. But researchers from NC State's Nonlinear Artificial Intelligence Laboratory (NAIL) have found that incorporating a Hamiltonian function into neural networks better enables them to "see" chaos within a system and adapt accordingly.

Simply put, the Hamiltonian embodies the complete information about a dynamic physical system - the total amount of all the energies present, kinetic and potential. Picture a swinging pendulum, moving back and forth in space over time. Now look at a snapshot of that pendulum. The snapshot cannot tell you where that pendulum is in its arc or where it is going next. Conventional neural networks operate from a snapshot of the pendulum. Neural networks familiar with the Hamiltonian flow understand the entirety of the pendulum's movement - where it is, where it will or could be, and the energies involved in its movement.

In a proof-of-concept project, the NAIL team incorporated Hamiltonian structure into neural networks, then applied them to a known model of stellar and molecular dynamics called the Hénon-Heiles model. The Hamiltonian neural network accurately predicted the dynamics of the system, even as it moved between order and chaos.

"The Hamiltonian is really the 'special sauce' that gives neural networks the ability to learn order and chaos," says John Lindner, visiting researcher at NAIL, professor of physics at The College of Wooster and corresponding author of a paper describing the work. "With the Hamiltonian, the neural network understands underlying dynamics in a way that a conventional network cannot. This is a first step toward physics-savvy neural networks that could help us solve hard problems."

The work appears in Physical Review E and is supported in part by the Office of Naval Research (grant N00014-16-1-3066). NC State postdoctoral researcher Anshul Choudhary is first author. Bill Ditto, professor of physics at NC State, is director of NAIL. Visiting researcher Scott Miller; Sudeshna Sinha, from the Indian Institute of Science Education and Research Mohali; and NC State graduate student Elliott Holliday also contributed to the work.

####

For more information, please click here

Contacts:
Tracey Peake

919-515-6142

@NCStateNews

Copyright © North Carolina State University

If you have a comment, please Contact us.

Issuers of news releases, not 7th Wave, Inc. or Nanotechnology Now, are solely responsible for the accuracy of the content.

Bookmark:
Delicious Digg Newsvine Google Yahoo Reddit Magnoliacom Furl Facebook

Related Links

"Physics enhanced neural networks predict order and chaos"

Related News Press

News and information

HKUST researchers develop a novel integration scheme for efficient coupling between III-V and silicon November 18th, 2022

Researchers at Purdue unlock light-matter interactions on sub-nanometer scales, leading to ‘picophotonics’ November 18th, 2022

Rice turns asphaltene into graphene for composites: ‘Flashed’ byproduct of crude oil could bolster materials, polymer inks November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Physics

A new experiment pushes the boundaries of our understanding of topological quantum matter: The behavior of bosonic particles observed in a magnetic insulator fabricated from ruthenium chloride can be explained by a relatively new and little-studied physics phenomenon called the B November 18th, 2022

Govt.-Legislation/Regulation/Funding/Policy

NIST’s grid of quantum islands could reveal secrets for powerful technologies November 18th, 2022

A new experiment pushes the boundaries of our understanding of topological quantum matter: The behavior of bosonic particles observed in a magnetic insulator fabricated from ruthenium chloride can be explained by a relatively new and little-studied physics phenomenon called the B November 18th, 2022

Trial by wind: Testing the heat resistance of carbon fiber-reinforced ultra-high-temperature ceramic matrix composites: Researchers use an arc-wind tunnel to test the heat resistance of carbon fiber reinforced ultra-high-temperature ceramic matrix composites November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Possible Futures

HKUST researchers develop a novel integration scheme for efficient coupling between III-V and silicon November 18th, 2022

NIST’s grid of quantum islands could reveal secrets for powerful technologies November 18th, 2022

A new experiment pushes the boundaries of our understanding of topological quantum matter: The behavior of bosonic particles observed in a magnetic insulator fabricated from ruthenium chloride can be explained by a relatively new and little-studied physics phenomenon called the B November 18th, 2022

Trial by wind: Testing the heat resistance of carbon fiber-reinforced ultra-high-temperature ceramic matrix composites: Researchers use an arc-wind tunnel to test the heat resistance of carbon fiber reinforced ultra-high-temperature ceramic matrix composites November 18th, 2022

Discoveries

An on-chip time-lens generates ultrafast pulses: New device opens the doors to applications in communication, quantum computing, astronomy November 18th, 2022

Researchers at Purdue unlock light-matter interactions on sub-nanometer scales, leading to ‘picophotonics’ November 18th, 2022

Rice turns asphaltene into graphene for composites: ‘Flashed’ byproduct of crude oil could bolster materials, polymer inks November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Announcements

HKUST researchers develop a novel integration scheme for efficient coupling between III-V and silicon November 18th, 2022

NIST’s grid of quantum islands could reveal secrets for powerful technologies November 18th, 2022

A new experiment pushes the boundaries of our understanding of topological quantum matter: The behavior of bosonic particles observed in a magnetic insulator fabricated from ruthenium chloride can be explained by a relatively new and little-studied physics phenomenon called the B November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Interviews/Book Reviews/Essays/Reports/Podcasts/Journals/White papers/Posters

An on-chip time-lens generates ultrafast pulses: New device opens the doors to applications in communication, quantum computing, astronomy November 18th, 2022

Researchers at Purdue unlock light-matter interactions on sub-nanometer scales, leading to ‘picophotonics’ November 18th, 2022

Rice turns asphaltene into graphene for composites: ‘Flashed’ byproduct of crude oil could bolster materials, polymer inks November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Military

An on-chip time-lens generates ultrafast pulses: New device opens the doors to applications in communication, quantum computing, astronomy November 18th, 2022

Researchers at Purdue unlock light-matter interactions on sub-nanometer scales, leading to ‘picophotonics’ November 18th, 2022

Rice turns asphaltene into graphene for composites: ‘Flashed’ byproduct of crude oil could bolster materials, polymer inks November 18th, 2022

How “2D” materials expand: New technique that accurately measures how atom-thin materials expand when heated could help engineers develop faster, more powerful electronic devices November 18th, 2022

Artificial Intelligence

New chip ramps up AI computing efficiency August 19th, 2022

Artificial Intelligence Centered Cancer Nanomedicine: Diagnostics, Therapeutics and Bioethics June 3rd, 2022

‘Nanomagnetic’ computing can provide low-energy AI, researchers show May 6th, 2022

Development of low-power and high-efficiency artificial sensory neurons: 3T-OTS device to simulate the efficient information processing method of the human brain. A green light for the development of sensor-AI combined next-generation artificial intelligence “to be used in life a April 8th, 2022

NanoNews-Digest
The latest news from around the world, FREE




  Premium Products
NanoNews-Custom
Only the news you want to read!
 Learn More
NanoStrategies
Full-service, expert consulting
 Learn More











ASP
Nanotechnology Now Featured Books




NNN

The Hunger Project