Parallel programming. Parallel programming serves for creating programs which effectively use computational resources by simultaneously executing the code on several computational nodes. For creating parallel applications parallel programming languages and special systems of parallel programming support such as MPI and OpenMP are used. Parallel programming is more difficult in comparison to sequential programming both in writing the code and debugging it. To simplify the process of parallel programming there are specialized tools, for example, TotalView debugger and VivaMP static code analyzer.
- Wikipedia. "Parallel computing"
- Andrey Karpov. "Introduction into the problems of developing parallel programs"