Header menu link for other important links
X
Efficient mapping of backpropagation algorithm onto a network of workstations
Published in
1998
Volume: 28
   
Issue: 6
Pages: 841 - 848
Abstract
In this paper, we present an efficient technique for mapping a backpropagation (BP) learning algorithm for multilayered neural networks onto a network of workstations (NOW's). We adopt a vertical partitioning scheme, where each layer in the neural network is divided into p disjoint partitions, and map each partition onto an independent workstation in a network of p workstations. We present a fully distributed version of the BP algorithm and also its speedup analysis. We compare the performance of our algorithm with a recent work involving the vertical partitioning approach for mapping the BP algorithm onto a distributed memory multiprocessor. Our results on SUN 3/50 NOW's show that we are able to achieve better speedups by using only two communication sets and also by avoiding some redundancy in the weights computation for one training cycle of the algorithm. © 1998 IEEE.
About the journal
JournalIEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
ISSN10834419
Open AccessYes
Concepts (11)
  •  related image
    Backpropagation
  •  related image
    Computer networks
  •  related image
    Computer workstations
  •  related image
    Data communication systems
  •  related image
    Data storage equipment
  •  related image
    Learning algorithms
  •  related image
    Multiprocessing systems
  •  related image
    Response time (computer systems)
  •  related image
    NETWORK OF WORKSTATIONS (NOW)
  •  related image
    VERTICAL PARTITIONING SCHEMES
  •  related image
    Multilayer neural networks