Repeat Problem 2-5 for broadcast and other collective routines as available on your system. Problem 2-5 Measure the time to send a message in a parallel programming system by using code segments of...

Repeat Problem 2-5 for broadcast and other collective routines as available on your system.

Problem 2-5

Measure the time to send a message in a parallel programming system by using code segments of the form

Repeat with the ping-pong method described in Section 2.4.4. Experiment with sending groups of multiple messages and messages of different sizes to obtain a good estimate for the time of message transfers. Plot the time for sending a message against the size of the message, and fit a line to the results. Estimate the startup time, tstartup (latency), and the time to send one data item, tdata.