Content deleted Content added
this is term from MPP/HPC computing +Category:Massively_parallel_computers |
m removing orphan template as not a valid orphan |
||
Line 1:
A [[massively parallel]], [[high-performance computing]] (HPC) system is particularly sensitive to [[operating system]] overhead. Traditional, multi-purpose, operating systems are designed to support a wide range of usage models and requirements. To support the range of needs, a large number of system processes are provided and are often inter-dependent on each other. The computing overhead of these processes leads to an unpredictable amount of processor time available to a parallel application. A very common [[parallel programming model]] is referred to as the [[bulk synchronous parallel]] model which often employs [[MPI]] for communication. The synchronization events are made at specific points in the application code. If one processor takes longer to reach that point than all the other processors, everyone must wait. The overall finish time is increased. Unpredictable operating system overhead is one significant reason a processor might take longer to reach the synchronization point than the others.
| |||