<Tr> <Td> <Ul> <Li> SIMD </Li> <Li> MIMD </Li> <Li> SPMD </Li> <Li> MPMD </Li> </Ul> </Td> </Tr> <Ul> <Li> SIMD </Li> <Li> MIMD </Li> <Li> SPMD </Li> <Li> MPMD </Li> </Ul> <P> In SPMD, multiple autonomous processors simultaneously execute the same program at independent points, rather than in the lockstep that SIMD imposes on different data . With SPMD, tasks can be executed on general purpose CPUs; SIMD requires vector processors to manipulate data streams . Note that the two are not mutually exclusive . </P> <P> SPMD usually refers to message passing programming on distributed memory computer architectures . A distributed memory computer consists of a collection of independent computers, called nodes . Each node starts its own program and communicates with other nodes by sending and receiving messages, calling send / receive routines for that purpose . Barrier synchronization may also be implemented by messages . The messages can be sent by a number of communication mechanisms, such as TCP / IP over Ethernet, or specialized high - speed interconnects such as Myrinet and Supercomputer Interconnect . Serial sections of the program are implemented by identical computation on all nodes rather than computing the result on one node and sending it to the others . </P>

Difference between simd and spmd in parallel computing
find me the text answering this question