Nanotechnology Now

Our NanoNews Digest Sponsors

Heifer International

Wikipedia Affiliate Button

Home > Press > Learning with light: New system allows optical “deep learning”: Neural networks could be implemented more quickly using new photonic technology

This futuristic drawing shows programmable nanophotonic processors integrated on a printed circuit board and carrying out deep learning computing.

Image: RedCube Inc., and courtesy of the researchers
This futuristic drawing shows programmable nanophotonic processors integrated on a printed circuit board and carrying out deep learning computing. Image: RedCube Inc., and courtesy of the researchers

Abstract:
“Deep Learning” computer systems, based on artificial neural networks that mimic the way the brain learns from an accumulation of examples, have become a hot topic in computer science. In addition to enabling technologies such as face- and voice-recognition software, these systems could scour vast amounts of medical data to find patterns that could be useful diagnostically, or scan chemical formulas for possible new pharmaceuticals.

Learning with light: New system allows optical “deep learning”: Neural networks could be implemented more quickly using new photonic technology

Cambridge, MA | Posted on June 12th, 2017

But the computations these systems must carry out are highly complex and demanding, even for the most powerful computers.

Now, a team of researchers at MIT and elsewhere has developed a new approach to such computations, using light instead of electricity, which they say could vastly improve the speed and efficiency of certain deep learning computations. Their results appear today in the journal Nature Photonics in a paper by MIT postdoc Yichen Shen, graduate student Nicholas Harris, professors Marin Soljačić and Dirk Englund, and eight others.

Soljačić says that many researchers over the years have made claims about optics-based computers, but that “people dramatically over-promised, and it backfired.” While many proposed uses of such photonic computers turned out not to be practical, a light-based neural-network system developed by this team “may be applicable for deep-learning for some applications,” he says.

Traditional computer architectures are not very efficient when it comes to the kinds of calculations needed for certain important neural-network tasks. Such tasks typically involve repeated multiplications of matrices, which can be very computationally intensive in conventional CPU or GPU chips.

After years of research, the MIT team has come up with a way of performing these operations optically instead. “This chip, once you tune it, can carry out matrix multiplication with, in principle, zero energy, almost instantly,” Soljačić says. “We’ve demonstrated the crucial building blocks but not yet the full system.”

By way of analogy, Soljačić points out that even an ordinary eyeglass lens carries out a complex calculation (the so-called Fourier transform) on the light waves that pass through it. The way light beams carry out computations in the new photonic chips is far more general but has a similar underlying principle. The new approach uses multiple light beams directed in such a way that their waves interact with each other, producing interference patterns that convey the result of the intended operation. The resulting device is something the researchers call a programmable nanophotonic processor.

The result, Shen says, is that the optical chips using this architecture could, in principle, carry out calculations performed in typical artificial intelligence algorithms much faster and using less than one-thousandth as much energy per operation as conventional electronic chips. “The natural advantage of using light to do matrix multiplication plays a big part in the speed up and power savings, because dense matrix multiplications are the most power hungry and time consuming part in AI algorithms” he says.

The new programmable nanophotonic processor, which was developed in the Englund lab by Harris and collaborators, uses an array of waveguides that are interconnected in a way that can be modified as needed, programming that set of beams for a specific computation. “You can program in any matrix operation,” Harris says. The processor guides light through a series of coupled photonic waveguides. The team’s full proposal calls for interleaved layers of devices that apply an operation called a nonlinear activation function, in analogy with the operation of neurons in the brain.

To demonstrate the concept, the team set the programmable nanophotonic processor to implement a neural network that recognizes four basic vowel sounds. Even with this rudimentary system, they were able to achieve a 77 percent accuracy level, compared to about 90 percent for conventional systems. There are “no substantial obstacles” to scaling up the system for greater accuracy, Soljačić says.

Englund adds that the programmable nanophotonic processor could have other applications as well, including signal processing for data transmission. “High-speed analog signal processing is something this could manage” faster than other approaches that first convert the signal to digital form, since light is an inherently analog medium. “This approach could do processing directly in the analog domain,” he says.

The team says it will still take a lot more effort and time to make this system useful; however, once the system is scaled up and fully functioning, it can find many user cases, such as data centers or security systems. The system could also be a boon for self-driving cars or drones, says Harris, or “whenever you need to do a lot of computation but you don’t have a lot of power or time.”

The research team also included MIT graduate students Scott Skirlo and Mihika Prabhu in the Research Laboratory of Electronics, Xin Sun in mathematics, and Shijie Zhao in biology, Tom Baehr-Jones and Michael Hochberg at Elenion Technologies, in New York, and Hugo Larochelle at Université de Sherbrooke, in Quebec. The work was supported by the U.S. Army Research Office through the Institute for Soldier Nanotechnologies, the National Science Foundation, and the Air Force Office of Scientific Research.

###

Written by David L. Chandler, MIT News Office

####

For more information, please click here

Copyright © Massachusetts Institute of Technology

If you have a comment, please Contact us.

Issuers of news releases, not 7th Wave, Inc. or Nanotechnology Now, are solely responsible for the accuracy of the content.

Bookmark:
Delicious Digg Newsvine Google Yahoo Reddit Magnoliacom Furl Facebook

Related Links

Paper: “Deep learning with coherent nanophotonic circuits.”:

Related News Press

News and information

Leti to Demo Wristband with Embedded Sensors to Diagnose Sleep Apnea: APNEAband, Which Will Be Demonstrated at CES 2018, Also Monitors Mountain Sickness, Dehydration, Dialysis Treatment Response and Epileptic Seizures December 12th, 2017

Leti Develops World’s First Micro-Coolers for CERN Particle Detectors: Leti Design, Fabrication and Packaging Expertise Extends to Very Large Scientific Instruments December 11th, 2017

Untangling DNA: Researchers filter the entropy out of nanopore measurements December 8th, 2017

Device makes power conversion more efficient: New design could dramatically cut energy waste in electric vehicles, data centers, and the power grid December 8th, 2017

JPK Instruments announce partnership with Swiss company, Cytosurge AG. The partnership makes Cytosurge’s FluidFM® technology available on the JPK NanoWizard® AFM platform December 8th, 2017

Chemistry

UCLA chemists synthesize narrow ribbons of graphene using only light and heat: Tiny structures could be next-generation solution for smaller electronic devices December 8th, 2017

Dendritic fibrous nanosilica: all-in-one nanomaterial for energy, environment and health November 4th, 2017

Researchers greenlight gas detection at room temperature October 26th, 2017

Creation of coherent states in molecules by incoherent electrons October 21st, 2017

Software

EC Project Aims at Creating and Commercializing Cyber-Physical-System Solutions November 14th, 2017

Govt.-Legislation/Regulation/Funding/Policy

Wheat gets boost from purified nanotubes: Rice University toxicity study shows plant growth enhanced by -- but only by -- purified nanotubes December 6th, 2017

Arrowhead Presents New Clinical Data Demonstrating a Sustained Host Response in Hepatitis B Patients Following RNAi Therapy — Up to 5.0 log10 reduction in HBsAg observed; data presented at HEP DART 2017 — December 6th, 2017

Chinese market opens up for Carbodeon nanodiamonds: Carbodeon granted Chinese Patent for Nanodiamond-containing Thermoplastic Thermal Compounds December 4th, 2017

Researchers advance technique to detect ovarian cancer: Rice, MD Anderson use fluorescent carbon nanotube probes to achieve first in vivo success November 30th, 2017

Possible Futures

UCLA chemists synthesize narrow ribbons of graphene using only light and heat: Tiny structures could be next-generation solution for smaller electronic devices December 8th, 2017

Untangling DNA: Researchers filter the entropy out of nanopore measurements December 8th, 2017

Device makes power conversion more efficient: New design could dramatically cut energy waste in electric vehicles, data centers, and the power grid December 8th, 2017

Creating a new kind of metallic glass December 7th, 2017

Chip Technology

UCLA chemists synthesize narrow ribbons of graphene using only light and heat: Tiny structures could be next-generation solution for smaller electronic devices December 8th, 2017

Device makes power conversion more efficient: New design could dramatically cut energy waste in electric vehicles, data centers, and the power grid December 8th, 2017

Leti Integrates Hybrid III-V Silicon Lasers on 200mm Wafers with Standard CMOS Process December 6th, 2017

Leti Breakthroughs Point Way to Significant Improvements in SoC Memories December 6th, 2017

Nanomedicine

Leti to Demo Wristband with Embedded Sensors to Diagnose Sleep Apnea: APNEAband, Which Will Be Demonstrated at CES 2018, Also Monitors Mountain Sickness, Dehydration, Dialysis Treatment Response and Epileptic Seizures December 12th, 2017

Untangling DNA: Researchers filter the entropy out of nanopore measurements December 8th, 2017

Arrowhead Presents New Clinical Data Demonstrating a Sustained Host Response in Hepatitis B Patients Following RNAi Therapy — Up to 5.0 log10 reduction in HBsAg observed; data presented at HEP DART 2017 — December 6th, 2017

Copper will replace toxic palladium and expensive platinum in the synthesis of medications: The effectiveness of copper nanoparticles as a catalyst has been proven December 5th, 2017

Optical computing/Photonic computing

Scientists make transparent materials absorb light December 1st, 2017

Going swimmingly: Biotemplates breakthrough paves way for cheaper nanobots: By using bacterial flagella as a template for silica, researchers have demonstrated an easier way to make propulsion systems for nanoscale swimming robots November 30th, 2017

Fast flowing heat in graphene heterostructures: Surprisingly fast heat flow from graphene to its surrounding November 29th, 2017

Quantum optics allows us to abandon expensive lasers in spectroscopy: Lomonosov Moscow State University scientists have invented a new method of spectroscopy November 21st, 2017

Discoveries

UCLA chemists synthesize narrow ribbons of graphene using only light and heat: Tiny structures could be next-generation solution for smaller electronic devices December 8th, 2017

Untangling DNA: Researchers filter the entropy out of nanopore measurements December 8th, 2017

Device makes power conversion more efficient: New design could dramatically cut energy waste in electric vehicles, data centers, and the power grid December 8th, 2017

Wheat gets boost from purified nanotubes: Rice University toxicity study shows plant growth enhanced by -- but only by -- purified nanotubes December 6th, 2017

Announcements

Leti to Demo Wristband with Embedded Sensors to Diagnose Sleep Apnea: APNEAband, Which Will Be Demonstrated at CES 2018, Also Monitors Mountain Sickness, Dehydration, Dialysis Treatment Response and Epileptic Seizures December 12th, 2017

Leti Develops World’s First Micro-Coolers for CERN Particle Detectors: Leti Design, Fabrication and Packaging Expertise Extends to Very Large Scientific Instruments December 11th, 2017

Untangling DNA: Researchers filter the entropy out of nanopore measurements December 8th, 2017

Device makes power conversion more efficient: New design could dramatically cut energy waste in electric vehicles, data centers, and the power grid December 8th, 2017

Interviews/Book Reviews/Essays/Reports/Podcasts/Journals/White papers

UCLA chemists synthesize narrow ribbons of graphene using only light and heat: Tiny structures could be next-generation solution for smaller electronic devices December 8th, 2017

Device makes power conversion more efficient: New design could dramatically cut energy waste in electric vehicles, data centers, and the power grid December 8th, 2017

Creating a new kind of metallic glass December 7th, 2017

Copper will replace toxic palladium and expensive platinum in the synthesis of medications: The effectiveness of copper nanoparticles as a catalyst has been proven December 5th, 2017

Photonics/Optics/Lasers

Leti Integrates Hybrid III-V Silicon Lasers on 200mm Wafers with Standard CMOS Process December 6th, 2017

Scientists make transparent materials absorb light December 1st, 2017

Going swimmingly: Biotemplates breakthrough paves way for cheaper nanobots: By using bacterial flagella as a template for silica, researchers have demonstrated an easier way to make propulsion systems for nanoscale swimming robots November 30th, 2017

Fast flowing heat in graphene heterostructures: Surprisingly fast heat flow from graphene to its surrounding November 29th, 2017

Research partnerships

Wheat gets boost from purified nanotubes: Rice University toxicity study shows plant growth enhanced by -- but only by -- purified nanotubes December 6th, 2017

Copper will replace toxic palladium and expensive platinum in the synthesis of medications: The effectiveness of copper nanoparticles as a catalyst has been proven December 5th, 2017

Researchers advance technique to detect ovarian cancer: Rice, MD Anderson use fluorescent carbon nanotube probes to achieve first in vivo success November 30th, 2017

Tiny robots step closer to treating hard-to-reach parts of the body November 25th, 2017

NanoNews-Digest
The latest news from around the world, FREE



  Premium Products
NanoNews-Custom
Only the news you want to read!
 Learn More
NanoTech-Transfer
University Technology Transfer & Patents
 Learn More
NanoStrategies
Full-service, expert consulting
 Learn More











ASP
Nanotechnology Now Featured Books




NNN

The Hunger Project