Abstract: The algorithms for supervised learning in artificial neural networks (ANN) require time and high computational power. As these algorithms gain popularity in a variety of domains, it is critical for them to run fast. Following a brief survey of the different dimensions of parallelism in ANN this paper analyses the performance comparison between different parallelization techniques to show the advantages and disadvantages of these strategies.