Deep Learning for Electron Microscopy

Artificial intelligence on Summit to discover atomic-scale structures.

Four Electron Microscopy images

Image courtesy of Oak Ridge National Laboratory

The same image shown using different analysis methods. a) Raw electron microscopy image. b) Defects (white) as labelled by a human expert. c) Defects (white) as labelled by a Fourier transform method. d) Defects (white) as labelled by the optimal neural network. Defects that don’t exist are shown in purple, and defects that weren’t identified are orange. In mere hours, researchers created a neural network that performed as well as a human expert, demonstrating MENNDL’s ability to significantly reduce the time to analyze electron microscopy images.

The Science

Finding defects in electron microscopy images takes months. Now, there’s a faster way. It’s called MENNDL, the Multinode Evolutionary Neural Networks for Deep Learning. It creates artificial neural networks—computational systems that loosely mimic the human brain—that tease defects out of dynamic data. It runs on all available nodes of the Summit supercomputer, performing 152 thousand million million calculations a second.

The Impact

In mere hours, scientists using MENNDL created a neural network that performed as well as a human expert. It reduces the time to analyze electron microscopy images by months. MENNDL is the first known approach to automatically identify atomic-level structural information in scanning transmission electron microscopy data. In 2018, MENNDL received an R&D 100 award, considered the Oscars of innovation. It’s also a finalist for the Gordon Bell award.

Summary

MENNDL, an artificial intelligence system, automatically designed an optimal deep learning network to extract structural information from raw atomic-resolution microscopy data. To design the network, MENNDL used 18,000 GPUs on all of the available 3000 nodes of the Summit supercomputer. In a few hours, MENNDL creates and evaluates millions of networks using a scalable, parallel, asynchronous genetic algorithm augmented with a support vector machine to automatically find a superior deep learning network topology and hyper-parameter set. This work is far faster than could be done by a human expert. For the application of electron microscopy, the system furthers the goal of better  understanding the electron-beam-matter interactions and real-time image-based feedback, which enables a huge step beyond human capacity toward nanofabricating materials automatically.

Contact

Thomas E. Potok         
Oak Ridge National Laboratory
[email protected]; (865) 574-0834  

Funding

This material is based upon work supported by the Department of Energy (DOE), Office of Science, Office of Advanced Scientific Computing Research. This research used resources of the Oak Ridge Leadership Computing Facility, which is a DOE Office of Science user facility.

Publications

R.M. Patton, J.T. Johnston, S.R. Young, et al., “167-PFlops deep learning for electron microscopy: From learning physics to atomic manipulation.” SC’18: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, Dallas, TX (2018).

Related Links

 

Highlight Categories

Program: ASCR

Performer: DOE Laboratory , SC User Facilities , ASCR User Facilities