Blurring the Computation-Communication Divide: Extraneous Memory Accesses and their Effects on MPI Intranode Communications

Authors Wilson M. Tan, Stephen A. Jarvis



PDF
Thumbnail PDF

File

OASIcs.ICCSW.2012.135.pdf
  • Filesize: 0.92 MB
  • 7 pages

Document Identifiers

Author Details

Wilson M. Tan
Stephen A. Jarvis

Cite AsGet BibTex

Wilson M. Tan and Stephen A. Jarvis. Blurring the Computation-Communication Divide: Extraneous Memory Accesses and their Effects on MPI Intranode Communications. In 2012 Imperial College Computing Student Workshop. Open Access Series in Informatics (OASIcs), Volume 28, pp. 135-141, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2012)
https://doi.org/10.4230/OASIcs.ICCSW.2012.135

Abstract

Modern MPI simulator frameworks assume the existence of a Computation-Communication Divide: thus, they model and simulate the computation and communication sections of an MPI Program separately. The assumption is actually sound for MPI processes that are situated in different nodes and communicate through a network medium such as Ethernet or Infiniband. For processes that are within a node however, the validity of the assumption is limited since the processes communicate using shared memory, which also figures in computation by storing the application and its associated data structures. In this work, the limits of the said assumption's validity were tested, and it is shown that Extraneous Memory Accesses(EMAs) by a compute section could significantly slow down the communication operations following it. Two general observations were made in the course of this work: first, more EMAs cause greater slowdown; and second, EMAs coming from the compute section of the processes containing the MPI_Recv are more detrimental to communication performance than those coming from processes containing MPI_Send.
Keywords
  • High performance computing
  • Message passing
  • Multicore processing
  • Computer simulation
  • Computer networks
  • Parallel programming
  • Parallel processing

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail