Search Results

Documents authored by Tan, Wilson M.


Document
Blurring the Computation-Communication Divide: Extraneous Memory Accesses and their Effects on MPI Intranode Communications

Authors: Wilson M. Tan and Stephen A. Jarvis

Published in: OASIcs, Volume 28, 2012 Imperial College Computing Student Workshop


Abstract
Modern MPI simulator frameworks assume the existence of a Computation-Communication Divide: thus, they model and simulate the computation and communication sections of an MPI Program separately. The assumption is actually sound for MPI processes that are situated in different nodes and communicate through a network medium such as Ethernet or Infiniband. For processes that are within a node however, the validity of the assumption is limited since the processes communicate using shared memory, which also figures in computation by storing the application and its associated data structures. In this work, the limits of the said assumption's validity were tested, and it is shown that Extraneous Memory Accesses(EMAs) by a compute section could significantly slow down the communication operations following it. Two general observations were made in the course of this work: first, more EMAs cause greater slowdown; and second, EMAs coming from the compute section of the processes containing the MPI_Recv are more detrimental to communication performance than those coming from processes containing MPI_Send.

Cite as

Wilson M. Tan and Stephen A. Jarvis. Blurring the Computation-Communication Divide: Extraneous Memory Accesses and their Effects on MPI Intranode Communications. In 2012 Imperial College Computing Student Workshop. Open Access Series in Informatics (OASIcs), Volume 28, pp. 135-141, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2012)


Copy BibTex To Clipboard

@InProceedings{tan_et_al:OASIcs.ICCSW.2012.135,
  author =	{Tan, Wilson M. and Jarvis, Stephen A.},
  title =	{{Blurring the Computation-Communication Divide: Extraneous Memory Accesses and their Effects on MPI Intranode Communications}},
  booktitle =	{2012 Imperial College Computing Student Workshop},
  pages =	{135--141},
  series =	{Open Access Series in Informatics (OASIcs)},
  ISBN =	{978-3-939897-48-4},
  ISSN =	{2190-6807},
  year =	{2012},
  volume =	{28},
  editor =	{Jones, Andrew V.},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/OASIcs.ICCSW.2012.135},
  URN =		{urn:nbn:de:0030-drops-37771},
  doi =		{10.4230/OASIcs.ICCSW.2012.135},
  annote =	{Keywords: High performance computing, Message passing, Multicore processing, Computer simulation, Computer networks, Parallel programming, Parallel processing}
}
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail