Извините, этот техт доступен только в “Американский Английский”. For the sake of viewer convenience, the content is shown below in the alternative language. You may click the link to switch the active language.
INTEGRATION OF LEGACY APPLICATIONS INTO «ENI» SCIENTIFIC RESEARCH ECOSYSTEM
DOI: 10.36724/2072-8735-2020-14-8-33-41
Artem S. Trunov, Moscow Technical University of Communication and Informatics, Moscow, Russia, greek17@yandex.ru
Vyacheslav I. Voronov, Moscow Technical University of Communication and Informatics, Moscow, Russia, Vorvi@mail.ru
Lilia I. Voronova, Moscow Technical University of Communication and Informatics, Moscow, Russia, Voronova.lilia@ya.ru
Abstract
The article describes the development of a digital platform for the Eni research ecosystem, based on a microservice approach that automatically scales the computing resources of the system when working with big data. A brief description of the structure of the digital platform, its main components and the functionality of the basic subsystems is provided. Two types of digital platform consumers are presented — legacy and platform applications. Their capabilities and limitations are shown. The subsystem of distributed computing is described, which provides continuous management and monitoring of the microservice architecture of the platform, in particular, it is responsible for: load balancing, service discovery, system recovery after failures, end-to-end authentication, «canary rollouts», access control. The high-performance computing subsystem is presented. It includes models and methods for organizing parallel calculations on various hardware devices, such as a multiprocessor system, a cluster of computing devices connected by a local network, and a graphics processor. As software solutions for organizing parallel computing, multithreaded data processing technologies, MPI messaging interface, and CUDA technology are used. Also described is a data mining subsystem designed to deploy different types of neural networks with different architectures, including direct distribution, convolutional, recurrent and generative neural networks. The integration of the legacy application MD-SLAG-MELT v13.0 into the ecosystem of scientific research using platform integration adapters is presented. The architectures and the main components of the original software package and the integrated software package MD-SLAG-MELT v14.0 are presented. The results of load testing with the analysis of performance metrics and response time of an inherited application, when processing big data, are presented.
Keywords: ecosystem, high performance computing, distributed computing, microservice architecture.
References
1. Azure API for FHIR and our expanding ecosystem of partners — https://azure.microsoft.com/ru-ru/updates/azure-api-for-fhir-and-our-growing-ecosystem-of-partners.
2. Sberbank Annual Report 2019 https://www.sberbank.com/common/img/uploaded/files/pdf/yrep/sberbank-ar19-rus.pdf.
3. Report of the President of Russia at the SPIEF 2017 http://kremlin.ru/events/president/news/54667.
4. Decree of the President of the Russian Federation of 05.09.2017 No. 203 On the Strategy for the Development of the Information Society in the Russian Federation for 2017-2030.
5. Program «Digital Economy of the Russian Federation» http://static.government.ru/media/files/ 9gFM4FHj4PsB79I5v7yLVuPgu4bvR7M0.pdf.
6. X5RetailGroup creates its ecosystem. https://retail-life.ru/x5-sozdast-cifrovuju-jekosistemu-ritejla-v-odnoj-knopke-za-15-let.
7. David P. Anderson, Carl Christensen, Bruce Allen. Designing a Runtime System for Volunteer Computing.
8. Trunov A.S., Voronova L.I., Voronov V.I., Sukhachev D.I., Strelnikov V.G. (2018). Legacy applications model integration to support scientific experiment. 2018 Systems of Signals Generating and Processing in the Field of on Board Communications. P. 8350641.
9. Voronova L.I., Grigoryeva M.A., Voronov V.I., Trunov A.S. The software package «MD SLAG-MELT» Information Research System «Slag Melts» version 10.0. Deposited manuscript No. 29-В2012 01/26/2012.
10. Bezumnov D.N., Voronova L.I., Varganova E.E. A program for automating the process of prototyping distributed systems for collecting and processing information. Certificate of registration of a computer program RU 2019610043, 09/09/2019. Application No. 2018664390 dated 12/13/2018.
11. Pilipchak P.E., Voronova L.I., Trunov A.S. (2014). Load balancing model for parallel calculation of an n-particle system on a heterogeneous cluster system. Modern high technology. No. 5-2. P. 218-219.
12. Trunov A.S., Sukhachev D.I., Voronova L.I., Strelnikov V.G. Legacy application integration program to support high-performance computing. Certificate of registration of a computer program RU 2019610042, 09/09/2019. Application No. 2018664391 dated 12/13/2018.
13. Trunov A.S., Filatov A.M., Voronova L.I., Usachev V.A. The program of intelligent automatic distribution of computing load in the hardware-software complex for high-performance computing. Certificate of registration of a computer program RU 2018666858, 12/21/2018. Application No. 2018664407 dated 12/13/2018.
14. Voronova L.I., Trunov A.S. (2011). Optimization of the parallel algorithm of the subsystem of distributed molecular dynamics modeling. Intersectoral information service. No. 3. P. 3-11.
15. Voronova L.I., Trunov A.S., Voronov V.I. (2013). Development of parallel calculation methods for a correlated multiparticle system on a graphics processor. Bulletin of the Russian State Humanitarian University. Series: Documentation and Archival Studies. Computer science. Information protection and information security. No. 14 (115). P. 236-247.
16. Voronov V.I., Voronova L.I., Genchel K.V. (2018). The use of parallel algorithms in a neural network for recognition of sign language. Actual problems of information and telecommunications in science and education (APINO 2018) VII International Scientific-Technical and Scientific-Methodological Conference. Collection of scientific articles. In 4 volumes. Edited by S.V. Bachevsky. P. 207-212.
17. Usachev V.A., Voronova L.I., Voronov V.I., Zharov I.A., Strelnikov V.G. (2019). Neural network using to analyze the results of environmental monitoring of water. 2019 Systems of Signals Generating and Processing in the Field of on Board Communications, SOSG 2019. P. 8706733.
18. Voronov V.I., Zharov I.A., Bykov A.D., Trunov A.S., Voronova L.I. (2020). Designing a neural network identification subsystem in the hardware-software complex of face recognition. T-Comm. Vol.14. No. 5, ISSN 2072-8743
19. Zharov I.A., Voronov V.I., Voronova L.I., Bykov A.D., Vovik A.G., Usachev V.A. A program for identifying images in the neural network face recognition software package. Certificate of registration of a computer program RU 2020612466, 02.25.2020. Application No. 2020611422 of 02/11/2020.
20. Ezhov A.A., Voronova L.I., Voronov V.I., Goncharenko A.A., Artemov M.D. A program for supporting non-verbal communication using machine learning based on a convolutional neural network. Certificate of registration of a computer program RU 2019610179, 01/09/2019. Application No. 2018664377 dated 12/13/2018.
21. Goncharenko A., Voronova L., Artemov M., Voronov V., Bezumnov D. (2019). Sign language recognition information system development using wireless technologies for people with hearing impairments. Conference of Open Innovations Association, FRUCT. No. 24. P. 104-109.
22. Brus V.R., Voronova L.I., Voronov V.I. (2020). Neural network classification of cardiac activity based on cardiogram data. 2020 Systems of signals generating and processing in the field of on board communications» (IEEE Conference # 48371) 19-20 March 2020.
23. Van Yue., Voronova L.I. (2019). Classification of the type of spinal disease using a neural network. TECHNOLOGIES OF THE INFORMATION SOCIETY Materials of the XIII International Industrial Scientific and Technical Conference. P. 407-410.
24. Bashirov A.N., Voronov V.I. (2019). Predicting the likelihood of bronchial asthma in children using the random forest algorithm. Modern high technology. No 12-2. P. 249-255.
25. Introducing Istio Service Mesh for Microservices by Christian Posta and Burr Sutter.
26. Voronova L.I., Grigoryeva M.A., Voronov V.I., Trunov A.S. (2013). The md-slag-melt software package for modeling the nanostructure and properties of multicomponent melts. Melts. No. 4. P. 36-49.
27. Bykov A.D., Voronov V.I., Voronova L.I., Zharov I.A., Fadeev M.A., Usachev V.A. A program for detecting and tracking faces in a video stream in a hardware-software complex of biometric identification based on neural network recognition of faces. Certificate of registration of a computer program RU 2020612484, 02.25.2020. Application No. 2020610985 dated 03.02.2020.
28. Voronov V.I., Bykov A.D., Voronova L.I. (2020). Designing a face detection subsystem and a database interface in a hardware-software complex of biometric identification based on neural network face recognition. T-Comm. Vol. 14. No. 4, ISSN 2072-8743
29. Goncharenko A.A., Voronova L.I., Voronov V.I., Ezhov A.A., Artemov M.D. Software package for data management in the information and communication system of social accessibility for people with hearing impairments. Certificate of registration of a computer program RU 2019610962, 01/18/2019. Application No. 2018665275 dated 12/26/2018
30. Achkasov E.E., Polukarov N.V., Lazareva I.A., Zhukova E.V. (2019). A personalized approach to the comprehensive rehabilitation of the combined deformity of the feet of twins with cerebral palsy using insoles with 3D computer modeling. Issues of Practical Pediatrics. Vol. 14, No. 5. P. 119-124.
31. Polukarov N.V. «Insole and method for its production», Patent RU (11) 2 718 262 (13) C1.
32. Rathee, S., Kashyap A. (2018). Adaptive Miner: an efficient distributed association rule mining algorithm on Spark. Journal of Big Data 5. P. 6.
33. Vinutha, D.C., Raju, G.T. (2018). An Accurate and Efficient Scheduler for Hadoop MapReduce Framework. Indonesian Journal of Electrical Engineering and Computer Science. No. 12. P. 1132-1142.
Information about authors:
Artem S. Trunov, Moscow Technical University of Communication and Informatics, senior teacher, Moscow, Russia
Vyacheslav I. Voronov, Moscow Technical University of Communication and Informatics, Associate Professor of the department «Intelligent systems in control and automation», PhD in engineering, Moscow, Russia
Lilia I. Voronova, Moscow Technical University of Communication and Informatics, head of the department «Intelligent systems in control and automation», D.Sc. in Physical and Mathematical Sciences, Moscow, Russia