Creating of an individual modeling environment in a hybrid high-performance computing system

The article is devoted to the problem of solving scientific problems in the field of high-performance computing systems. An approach to solving a certain kind of problems in materials science is the use of mathematical modeling technologies implemented by specialized modeling systems. The greatest efficiency of the modeling system is shown when deployed in hybrid high-performance computing systems (HHPC), which have high performance and allow solving problems in an acceptable time with sufficient accuracy. However, there are a number of limitations that affect the work of the research team with modeling systems in the HHPC computing environment: the need to access graphics accelerators at the stage of development and debugging of algorithms in the modeling system, the need to use several modeling systems in order to obtain the most optimal solution, the need to dynamically change settings modeling systems for solving problems. The solution to the problem of the above limitations is assigned to an individual modeling environment functioning in the HHPC computing environment. The optimal solution for creating an individual modeling environment is the technology of virtual containerization. An algorithm for the formation of an individual modeling environment in a hybrid high-performance computing complex based on the «docker» virtual containerization system is proposed. An individual modeling environment is created by installing the necessary software in the base container, setting environment variables, installing custom software and licenses. A feature of the algorithm is the ability to form a library image from a base container with a customized individual modeling environment. In conclusion, the direction for further research work is indicated. The algorithm presented in the article is independent of the implementation of the job management system and can be used for any high-performance computing system.

algorithm, basic image, high-performance computing system, hybrid architecture, graphics accelerator, individual modeling environment, container

1. Sechenykh P. A., Abgaryan K. K. Mathematical modeling of the crystal structure of metal oxides. In: Mathematical modeling in materials science of electronic components. Materials of the I international conference. Moscow, 2019, pp. 74—76. (In Russ.)

2. Abgaryan K. K. Multiscale modeling of multilevel memory elements used to create neuromorphic networks. In: Mathematical modeling in materials science of electronic components. Materials of the I international conference. Moscow, 2019, pp. 53—56. (In Russ.)

3. Supercomputer technology in science, education and industry. Moscow: Izdatel’stvo Moskovskogo gosudarstvennogo universiteta, 2012, pp. 42—49. (In Russ.)

4. Gorchakov A. Yu., Malkova V. U. Comparison of Intel Core-i7, Intel Xeon, Intel Xeon Phi and IBM Power 8 processors using the example of initial data recovery. International Journal of Open Information Technologies, 2018, vol. 6, no. 4, pp. 12—17. (In Russ.)

5. Gorchakov A. Yu., Posypkin M. A. Comparison of variants of multithreaded realization of method of branches and borders for multi-core systems. Modern Information Technology and IT-education, 2018, vol. 14, no. 1, pp. 138—148. DOI: 10.25559/SITITO.14.201801.138-148

6. Abramov S. M. Analysis of supercomputer cyber infrastructures of the leading countries of the world. Supercomputer technologies (SKT-2018). Materials of the 5th All-Russian Scientific and Technical Conference. Rostov-on-Don, 2018, pp. 11—18. (In Russ.)

7. Sobolev S., Antonov A, Shvets P., Nikitenko D., Stefanov K., Voevodin V., Voevodin Vl., Zhumatiy, S. Evaluation of the octotron system on the Lomonosov-2 supercomputer. Conference materials parallel computing technologies. Rostov-on-Don, 2018. (In Russ.)

8. Parfenov A. V., Chudinov S. M. Trends in the development of computer technology. Scientific Bulletin of the Belgorod State University. Series: Economics. Informatics, 2016, vol. 39, no. 16, pp. 98—106. (In Russ.)

9. Telegin P. N., Shabanov B. M. Communication models of programming and architecture of parallel computing systems. Software products and systems, 2007, no. 2, pp. 5—8. (In Russ.)

10. Volovich K. I. Some system-technical issues of providing computing resources for scientific research in a hybrid high-performance cloud environment. Systems and means of informatics, 2018, vol. 28, no. 4, pp. 97—108. (In Russ.)

11. Zatsarinny A. A., Gorshenin A. K., Kondrashev V. A., Volovich K. I., Denisov S. A. Toward high performance solutions as services of research digital platform. Procedia Computer Science, 2019, vol. 150, pp. 622—627. DOI: 10.1016/j.procs.2019.02.078

12. Kondrashev V. A., Volovich K. I. Service management of a digital platform on the example of high-performance computing services. Materials of the International scientific conference. Voronezh, 2018. (In Russ.)

13. Savin G. I., Telegin P. N., Baranov A. V., Shitik A. S. Methods and means of representing custom supercomputer tasks in the form of Docker containers. Transactions of the Research Institute for System Research of the Russian Academy of Sciences, 2018, vol. 8, no. 6, pp. 84—93. (In Russ.). DOI: 10.25682/niisi.2018.6.0012

14. Afanasyev I., Voevodin V. The comparison of large-scale graph processing algorithms implementation methods for Intel KNL and NVIDIA GPU. In: Communications in Computer and Information Science, 2017, vol. 793, pp. 80—94. DOI: 10.1007/978-3-319-71255-0_7

15. Gorchakov A. Yu. Using OPENMP to implement the multithreaded method of uneven coatings // Advanced Information Technologies (PIT 2018). Proceedings of the International Scientific and Technical Conference. Samara: Izdatel’stvo Samarskogo nauchnogo tsentra RAN, 2018. 613—616. (In Russ.)

16. Kartsev A., Malkovsky S. I., Volovich K. I., Sorokin A. A. Research of the performance and scalability of the Quantum ESPRESSO package in the study of low-dimensional systems on hybrid computing systems. In: Proc. of the I Intern. Conf. “Mathematical Modeling in Materials Science of Electronic Components. MMMEK-2019”. Moscow: MAKS-Press, 2019, pp. 18—21. (In Russ.)

17. Nikitenko D. A., Voevodin Vl. V., Teplov A. M., Zhumatiy S. A., Voevodin V. V., Stefanov K. S., Shvets P. A.: Supercomputer application integral characteristics analysis for the whole queued job collection of large-scale hpc systems. Parallel computing technologies (PaVT’2016): Proceedings of the international scientific conference. Chelyabinsk, 2016, pp. 20—30.

18. Regulations on the of the Center for Shared Use “Informatics”. URL: http://www.frccsc.ru/ckp (accessed: 02.12.2019). (In Russ.)

19. Zatsarinny A. A., Abgaryan K. K. Factors determining the relevance of creating a research infrastructure for the synthesis of new materials in the framework of the implementation of the priorities of scientific and technological development of Russia. In: Mathematical modeling in materials science of electronic components. Materials of the I international conference. Moscow, 2019, pp. 8—11. (In Russ.)

20. IBM Spectrum LSF Suites. URL: https://www.ibm.com/ru-ru/marketplace/hpc-workload-management