• Latest
  • Trending
  • All
  • Capacitors
  • Resistors
  • Inductors
  • Filters
  • Fuses
  • Non-linear Passives
  • Applications
  • Integrated Passives
  • Oscillators
  • Passive Sensors
  • New Technologies
  • Aerospace & Defence
  • Automotive
  • Industrial
  • Market & Supply Chain
  • Medical
  • RF & Microwave
  • Telecommunication

Researches Developed Three-Dimensional Human Brain Like Neural Networks Using Multilayer Memristor

11.4.2022

4th PCNS Call for Abstracts Extended !

31.3.2023

KEMET SMD Tantalum Polymer Capacitors Meets Newly Released Military Performance Specification MIL-PRF-32700/1 and /2

31.3.2023

Practical LLC Transformer Design Methodology

31.3.2023

Practical Measurement of Crystal Circuits

31.3.2023

March 2023 ECIA NA Electronic Components Sales Misses Expectations

31.3.2023

Würth Elektronik Presents New Series of DC-Link Film Capacitors

30.3.2023
  • Home
  • Privacy Policy
  • EPCI Membership & Advertisement
  • About
No Result
View All Result
NEWSLETTER
Passive Components Blog
  • Home
  • NewsFilter
    • All
    • Aerospace & Defence
    • Antenna
    • Applications
    • Automotive
    • Capacitors
    • Circuit Protection Devices
    • Filters
    • Fuses
    • Inductors
    • Industrial
    • Integrated Passives
    • Market & Supply Chain
    • Medical
    • New Materials & Supply
    • New Technologies
    • Non-linear Passives
    • Oscillators
    • Passive Sensors
    • Resistors
    • RF & Microwave
    • Telecommunication

    4th PCNS Call for Abstracts Extended !

    KEMET SMD Tantalum Polymer Capacitors Meets Newly Released Military Performance Specification MIL-PRF-32700/1 and /2

    Practical LLC Transformer Design Methodology

    Practical Measurement of Crystal Circuits

    March 2023 ECIA NA Electronic Components Sales Misses Expectations

    Würth Elektronik Presents New Series of DC-Link Film Capacitors

    Vishay Increases Anti-Surge Thick Film 0805 Power Resistor Performance with 0.5 W Power Rating

    Q&A Update on Aluminum Capacitor Technology with Industry Highest Energy Density >5J/cc Available for Acquisition

    Designing with High Voltage Resistors: 10 Top Tips for Success

    Trending Tags

    • Ripple Current
    • RF
    • Leakage Current
    • Tantalum vs Ceramic
    • Snubber
    • Low ESR
    • Feedthrough
    • Derating
    • Dielectric Constant
    • New Products
    • Market Reports
  • VideoFilter
    • All
    • Antenna videos
    • Capacitor videos
    • Filter videos
    • Fuse videos
    • Inductor videos
    • Non-linear passives videos
    • Oscillator videos
    • Passive sensors videos
    • Resistor videos
    • Sensors

    Practical LLC Transformer Design Methodology

    Practical Measurement of Crystal Circuits

    Investigating Modeling Techniques of Class II Ceramic Capacitors Losses for High Voltage and Current Applications

    Understanding Basics of Current Sense Resistors

    What Decoupling Capacitor Value To Use And Where To Place Them

    How to Measure Rated Current on Power Inductors

    LTspice Simulation of a Spark-Gap Circuit Protection Surge Arrester

    Approximate Inductor Design Using Two Alternative Cores

    1kW Phase Shift Full Bridge Converter Design and Simulation

    Trending Tags

    • Capacitors explained
    • Inductors explained
    • Resistors explained
    • Filters explained
    • Application Video Guidelines
    • EMC
    • New Products
    • Ripple Current
    • Simulation
    • Tantalum vs Ceramic
  • Knowledge Blog
  • Suppliers
    • Preferred Suppliers
    • Who is Who
  • Events
  • Home
  • NewsFilter
    • All
    • Aerospace & Defence
    • Antenna
    • Applications
    • Automotive
    • Capacitors
    • Circuit Protection Devices
    • Filters
    • Fuses
    • Inductors
    • Industrial
    • Integrated Passives
    • Market & Supply Chain
    • Medical
    • New Materials & Supply
    • New Technologies
    • Non-linear Passives
    • Oscillators
    • Passive Sensors
    • Resistors
    • RF & Microwave
    • Telecommunication

    4th PCNS Call for Abstracts Extended !

    KEMET SMD Tantalum Polymer Capacitors Meets Newly Released Military Performance Specification MIL-PRF-32700/1 and /2

    Practical LLC Transformer Design Methodology

    Practical Measurement of Crystal Circuits

    March 2023 ECIA NA Electronic Components Sales Misses Expectations

    Würth Elektronik Presents New Series of DC-Link Film Capacitors

    Vishay Increases Anti-Surge Thick Film 0805 Power Resistor Performance with 0.5 W Power Rating

    Q&A Update on Aluminum Capacitor Technology with Industry Highest Energy Density >5J/cc Available for Acquisition

    Designing with High Voltage Resistors: 10 Top Tips for Success

    Trending Tags

    • Ripple Current
    • RF
    • Leakage Current
    • Tantalum vs Ceramic
    • Snubber
    • Low ESR
    • Feedthrough
    • Derating
    • Dielectric Constant
    • New Products
    • Market Reports
  • VideoFilter
    • All
    • Antenna videos
    • Capacitor videos
    • Filter videos
    • Fuse videos
    • Inductor videos
    • Non-linear passives videos
    • Oscillator videos
    • Passive sensors videos
    • Resistor videos
    • Sensors

    Practical LLC Transformer Design Methodology

    Practical Measurement of Crystal Circuits

    Investigating Modeling Techniques of Class II Ceramic Capacitors Losses for High Voltage and Current Applications

    Understanding Basics of Current Sense Resistors

    What Decoupling Capacitor Value To Use And Where To Place Them

    How to Measure Rated Current on Power Inductors

    LTspice Simulation of a Spark-Gap Circuit Protection Surge Arrester

    Approximate Inductor Design Using Two Alternative Cores

    1kW Phase Shift Full Bridge Converter Design and Simulation

    Trending Tags

    • Capacitors explained
    • Inductors explained
    • Resistors explained
    • Filters explained
    • Application Video Guidelines
    • EMC
    • New Products
    • Ripple Current
    • Simulation
    • Tantalum vs Ceramic
  • Knowledge Blog
  • Suppliers
    • Preferred Suppliers
    • Who is Who
  • Events
No Result
View All Result
Passive Components Blog
No Result
View All Result

Researches Developed Three-Dimensional Human Brain Like Neural Networks Using Multilayer Memristor

11.4.2022
Reading Time: 5 mins read
0 0
0
SHARES
257
VIEWS

Researchers at the University of Massachusetts and the Air Force Research Laboratory Information Directorate have recently created a 3-D computing circuit that could be used to map and implement complex machine learning algorithms, such convolutional neural networks (CNNs). This 3-D circuit, presented in a paper published in Nature Electronics, comprises eight layers of memristors; electrical components that regulate the electrical current flowing in a circuit and directly implement neural network weights in hardware.

Professors Qiangfei Xia and Jianhua (Joshua) Yang of the electrical and computer engineering (ECE) department have published yet another in a long series of papers in the family of “Nature” academic journals, this one in the latest issue of “Nature Electronics.” In this paper, the two ECE researchers and their research team described their construction and operation of a three-dimensional (3D) circuit composed of eight layers of integrated memristive devices in which the novel structure makes it possible to directly map and implement complex neural networks.

RelatedPosts

Researchers Demonstrated Quantum Memristor as a Link between AI and Quantum Computing

Graphene-based Memristors Show Promise for Brain-Based Computing

Nanometers-thin Niobium Oxide (NbO2) Memristor Can Bring Breakthrough to Neuromorphic AI Hardware Designs

“Previously, we developed a very reliable memristive device that meets most requirements of in-memory computing for artificial neural networks, integrated the devices into large 2-D arrays and demonstrated a wide variety of machine intelligence applications,” Prof. Qiangfei Xia, one of the researchers who carried out the study, told TechXplore. “In our recent study, we decided to extend it to the third dimension, exploring the benefit of a rich connectivity in a 3-D neural network.”

Constructing a computing circuit in three dimensions (3D) is a necessary step to enable the massive connections and efficient communications required in complex neural networks. 3D circuits based on conventional complementary metal–oxide–semiconductor transistors are, however, difficult to build because of challenges involved in growing or stacking multilayer single-crystalline silicon channels.

Here we report a 3D circuit composed of eight layers of monolithically integrated memristive devices. The vertically aligned input and output electrodes in our 3D structure make it possible to directly map and implement complex neural networks. As a proof-of-concept demonstration, we programmed parallelly operated kernels into the 3D array, implemented a convolutional neural network and achieved software-comparable accuracy in recognizing handwritten digits from the Modified National Institute of Standard and Technology database. We also demonstrated the edge detection of moving objects in videos by applying groups of Prewitt filters in the 3D array to process pixels in parallel.

An image of part of the memristor array is highlighted on the cover of “Nature Electronics.” This is the second time that the same group of researchers landed on the cover of this journal (the first time was on the cover of this journal in Jan. 2018).

According to the website memristor.org, “Memristors are basically a fourth class of electrical circuit, joining the resistor, the capacitor, and the inductor, that exhibit their unique properties primarily at the nanoscale.” Among other advancements, this new research by Xia, Yang and their team represents a major step forward in using memristors for complex computing processes that closely imitate the connectivity of the human nervous system and brain.

As Xia and Yang said about their new paper, “It is about a 3D memristor neural network that was used for parallel image and video processing, moving one step closer to mimicking the complex connectivity in the brain.”

Building integrated circuits into the third dimension is a straightforward approach to address challenges in further shrinking down the device size – an essential way to improve the chip performance. With 3D integration, one can simply pack more devices without the need of aggressive scaling However, the key message from their Nature Electronics paper, according to the Xia and Yang, is to show that constructing a computing circuit in 3D is a necessary step to enable the massive connections and efficient communications required in complex neural networks. Furthermore, a 3D neural network would be able to take 2D inputs, a paradigm-shift and less resource-demanding approach than most current neural network topographies in which the inputs data have to be one dimensional vectors.

Nevertheless, “making a 3D chip is an extremely challenging task”, said Xia and Yang. “Putting one layer on top of the other, and to carry out the stacking process many times, requires delicate chip design and rigorous process control”.

Indeed, it took the first author of the paper, Mr. Peng Lin a few years to build this 3D circuit that is a major part of his Ph.D. work. Dr. Lin graduated from UMass ECE department in September 2017. He is now a postdoctoral associate at the Massachusetts Institute of Technology, leading the neuromorphic computing efforts in a research group.

As background to this feat, Xia and Yang explained that deep neural networks are computationally heavy models with a huge number of functional and complex connections. Data flows in such networks are translated into massive physical instructions that run in digital computers, a process which consumes tremendous computing resources and imposes a performance ceiling due to the need to shuttle data between the processing and memory units.

However, according to Xia and Yang, emerging non-volatile devices, such as memristors, can directly implement synaptic weights and efficiently carry out resource-hungry matrix operations inside ensemble arrays.

“Moreover,” said Xia and Yang, “neural networks could be fully placed in memristor-based systems and executed on site, transforming the computing paradigms from high-demand, sequential, digital operations into an activation-driven, parallel, analogue-computing network.”

But there’s still a crucial problem with memristors used in this context. Existing memristor-based systems are built on regular, two-dimensional (2D), crossbar arrays. Their simplified connections cannot efficiently implement the full topology of often more complex structures in deep neural networks.

Ultimately, it is the connections between neurons (which generate the emergent functional properties and states) that define the capability of a neural network. Therefore, a fundamental shift in architecture design to emphasize the functional connectivity of device arrays is required to unleash the full potential of neuromorphic computing.

“In this article,” as Xia and Yang wrote, “we show that extending the array design into 3D enables a large number of functional connections, allowing a complex, memristor, neural network to be built. Using the convolutional neural network as an example, we built an eight-layer, prototype, 3D array with purposely-designed connections that are able to perform parallel convolutional kernel operations in the convolutional neural network.

Xia and Yang added that “The 3D design provides a high degree of functional complexity, which goes beyond the purpose of increasing packing density in conventional 3D architectures and opens a critical avenue to using memristors for neuromorphic computing.”

In this case, neuromorphic computing means computing that mimics the neuro-biological architectures present in the human nervous system.

As an example of the continuing success of Xia and Yang publishing in the prestigious scientific journals, they published around 30 papers in “Nature” and “Science” research journals in the last few years.

Memristors Support Brain-Like Computing System
Source: University of Massachusetts

Related Posts

Non-linear Passives

Variohm Announced Rapid Response NTC thermistor

3.3.2023
22
Biodegradable polymers in supercapacitors and the recycling process (Source: DICP; Image by WU Lu)
Capacitors

Biodegradable Polymers Are Promising for Supercapacitors

2.3.2023
33
Polysulfates with excellent thermal properties are casted into flexible free-standing films. High-temperature, high-voltage capacitors based on such films show state-of-the-art energy storage properties at 150 degrees Celsius. Such power capacitors are promising for improving the energy efficiency and reliability of integrated power systems in demanding applications such as electrified transportation. (Credit: Yi Liu and He (Henry) Li/Berkeley Lab)
Capacitors

Polysulfate Film Capacitors Pose to Extend Temperature and Energy Density of Film Capacitors

22.2.2023
99

Upcoming Events

Apr 3
April 3 @ 12:00 - April 4 @ 14:00 CEST

Microelectronic Packaging Failure Modes and Analysis

Apr 5
11:00 - 12:00 CEST

Plugging – Filling – Tenting; WE PCB Webinar

Apr 6
April 6 @ 12:00 - April 7 @ 14:00 EDT

Space and Military Standards for Hybrids and RF Microwave Modules

View Calendar

Popular Posts

  • Why Low ESR Matters in Capacitor Design

    0 shares
    Share 0 Tweet 0
  • Capacitor Selection for Coupling and Decoupling Applications

    28 shares
    Share 28 Tweet 0
  • How to Choose the Right Inductor for DC-DC Buck Applications

    0 shares
    Share 0 Tweet 0
  • What is a Dielectric Constant of Plastic Materials ?

    4 shares
    Share 4 Tweet 0
  • Ripple Current and its Effects on the Performance of Capacitors

    3 shares
    Share 3 Tweet 0
  • Dielectric Constant and its Effects on the Properties of a Capacitor

    7 shares
    Share 7 Tweet 0
  • Understanding High-Precision Resistor Temperature Coefficient of Resistance

    0 shares
    Share 0 Tweet 0
  • Modular AC line EMI filters explained

    0 shares
    Share 0 Tweet 0

Newsletter Subscription

 

PCNS Call for Papers !

Archive

2022
2021
2020
2019
2018
2017

Symposium

Passive Components Networking Symposium

Passives e-Learning

Knowledge Blog

  • Home
  • Privacy Policy
  • EPCI Membership & Advertisement
  • About

© EPCI - Premium Passive Components Educational and Information Site

No Result
View All Result
  • Home
  • News
  • Video
  • Knowledge Blog
  • Preferred Suppliers
  • Events

© EPCI - Premium Passive Components Educational and Information Site

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
This website uses cookies. By continuing to use this website you are giving consent to cookies being used. Visit our Privacy and Cookie Policy.