Creation of a strategy for the innovative development of industry in the regions of Russia using machine learning

Machine learning technology is a powerful tool for analyzing big data, and thus they can be applied to create a strategy for innovative development of industry in the regions of Russia. To compare the results of the quality of forecasting and to choose the most optimal method on the example of radio-electronic industry (REI), the authors applied the method of “k-nearest neighbor machine learning”, neural networks “multilayer perceptron” and adaptive neuro-fuzzy inference system which includes a particle swarm algorithm as well as multidimensional adaptive regression splines. The following functions were studied as the target ones: 1) the volume of innovative goods; 2) developed advanced production technologies; 3) net financial result (informatization and communication). The suggested model was trained on the basis of a sample package of nine inputs and three targets in 2010-2022 in 83 regions of Russia. For further verification of the trained model the year of 2023 was chosen as a sample package. It was stated that the highest quality forecast was made with the k-nearest neighbors machine learning algorithm. During the assessment, it was established that the prospects for innovative development in the industry can be found in the regions where the values of the predicted target functions fall into the planned segments in 2023. The assessment was conducted only in those regions whose forecast was regarded as the highest quality (with the average absolute percentage error < 0,5). These regions include the Krasnodar and the Perm territories, and Nizhny Novgorod, Sverdlovsk, Chelyabinsk and Novosibirsk regions. When performing similar analysis for algorithms of multidimensional adaptive regression splines (for target 3), particle swarm (for target 2), multilayer perceptrons (for target 1), the authors established that Nizhny Novgorod and Sverdlovsk region can be regarded as leaders in the REI industry, and this partially confirms the conclusions obtained by the machine learning method.

1. Grinev S.A., Kvint V.L. Formation of strategic priorities of industrial development of the Russian Federation as an innovative factor in overcoming crisis periods. Russian Journal of Industrial Economics. 2023;16(3):275–283. (In Russ.). https://doi.org/10.17073/2072-1633-2023-3-275-283

2. Yashin S.N., Koshelev E.V., Sukhanov D.A. Evolutionary neural network modeling of import substitution in the electronics industry of regions. Finance and Credit. 2024;30(4):765–787. (In Russ.). https://doi.org/10.24891/fc.30.4.765

3. Yoosefzadeh-Najafabadi M., Earl Hugh J., Tulpan D., Sulik J., Eskandari M. Application of machine learning algorithms in plant breeding: Predicting yield from hyperspectral reflectance in soybean. Frontiers in Plant Science. 2021;11:2169. https://doi.org/10.3389/fpls.2020.624273

4. Ramezanpour A., Beam A.L., Chen J.H., Mashaghi A. Statistical physics for medical diagnostics: Lear ning, inference, and optimization algorithms. Diagnostics. 2020;10(11):972. https://doi.org/10.3390/diagnostics10110972

5. Okolie J.A., Savage Sh., Ogbaga C.C., Gunes B. Assessing the potential of machine learning me thods to study the removal of pharmaceuticals from wastewater using biochar or activated carbon. Total Environment Research Themes. 2022;1-2:100001. https://doi.org/10.1016/j.totert.2022.100001

6. Jaiswal A., Babu A.R., Zadeh M.Z., Banerjee D., Makedon F. A survey on contrastive self-supervised learning. Technologies. 2021;9(1):2. https://doi.org/10.3390/technologies9010002

7. Fleer S., Moringen A., Klatzky R.L., Ritter H. Correction: Learning efficient haptic shape exploration with a rigid tactile sensor array. PLoS One. 2020;15(2):e0230054 https://doi.org/10.1371/journal.pone.0230054

8. Piryonesi S.M., El-Diraby T.E. Role of data analytics in infrastructure asset management: Overcoming data size and quality problems. Journal of Transportation Engineering, Part B: Pavements. 2020;146(2):04020022.

9. Uddin S., Haque I., Lu H., Moni M.A., Gide E. Comparative performance analysis of K-nearest neighbour (KNN) algorithm and its different variants for disease prediction. Scientific Reports. 2022;12:6256. https://doi.org/10.1038/s41598-022-10358-x

10. Halder R.K., Uddin M.N., Uddin M.A., Aryal S., Khraisat A. Enhancing K-nearest neighbor algorithm: A comprehensive review and performance analysis of modifications. Journal of Big Data. 2024;11:113. https://doi.org/10.1186/s40537-024-00973-y

11. Xiong L., Yao Y. Study on an adaptive thermal comfort model with K-nearest-neighbors (KNN) algorithm. Building and Environment. 2021;202:108026. https://doi.org/10.1016/j.buildenv.2021.108026

12. Patchanok S., Korn S. Random kernel k-nearest neighbors regression. Frontiers in Big Data. 2024;7:1402384. https://doi.org/10.3389/fdata.2024.1402384

13. Zardini E., Blanzieri E., Pastorello D. A quantum k-nearest neighbors algorithm based on the Eucli dean distance estimation. Quantum Machine Intelligence. 2024;6:23. https://doi.org/10.1007/s42484-024-00155-2

14. Boateng E., Otoo J., Abaye D. Basic tenets of classification algorithms K-nearest-neighbor, support vector machine, random forest and neural network: A review. Journal of Data Analysis and Information Processing. 2020;08(04):341–357. https://doi.org/10.4236/jdaip.2020.84020

15. Isabona J., Imoize A.L., Ojo S., Karunwi O., Kim Y., Lee C.-C., Li C.-T. Development of a multilayer perceptron neural network for optimal predictive mo deling in urban microcellular radio environments. Applied Sciences. 2022;12(11):5713. https://doi.org/10.3390/app12115713

16. Rashedi K.A., Ismail M.T., Al Wadi S., Serroukh A., Alshammari T.S., Jaber J.J. Multi-layer perceptronbased classification with application to outlier detection in Saudi Arabia stock returns. Journal of Risk and Financial Management. 2024;17(2):69. https://doi.org/10.3390/jrfm17020069

17. Sagias V.D., Zacharia P., Tempeloudis A., Stergiou C. Adaptive neuro-fuzzy inference system-based predictive modeling of mechanical properties in additive manufacturing. Machines. 2024;12(8):523. https://doi.org/10.3390/machines12080523

18. Putra V.G.V., Mohamad J.N. Adaptive neuro-fuzzy inference systems (ANFIS) and artificial neural networks (ANNs) for optimizing electrospun PVA/ TiO2 fiber diameter. The Journal of The Textile Institute. 2022;114(10):1898–1908. https://doi.org/10.1080/00405000.2022.2150954

19. Qiao J., Wang G., Yang Z., Luo X., Chen J., Li K., Liu P. A hybrid particle swarm optimization algorithm for solving engineering problem. Scientific Reports. 2024;14:8357. https://doi.org/10.1038/s41598-024-59034-2

20. Tang K., Meng C. Particle swarm optimization algorithm using velocity pausing and adaptive strategy. Symmetry. 2024;16(6):61. https://doi.org/10.3390/sym16060661

21. Adnan R.M., Liang Z., Heddam S., Zounemat-Kermani M., Kisi O., Li B. Least square support vector machine and multivariate adaptive regression splines for streamflow prediction in mountainous basin using hydro-meteorological data as inputs. Journal of Hydrology. 2020;586:124371. https://doi.org/10.1016/j.jhydrol.2019.124371

22. Hwaidi A., Badr A., Henedy S., Ostrowski K., Imran H. Application of multivariate adaptive regression splines (MARS) approach in prediction of compressive strength of eco-friendly concrete. Case Studies in Construction Materials. 2022;17:e01262. https://doi.org/10.1016/j.cscm.2022.e01262