With the advancement of biological sciences and modern technologies, high-dimensional data, in which the number of independent variables exceeds the number of observations, have become increasingly prevalent in various fields. Gene expression data associated with riboflavin or vitamin $B_2$ production represent an important example of such datasets. Riboflavin, as an essential micronutrient, plays a crucial role in metabolic reactions and vital biological processes through its coenzyme forms, $mathit{FAD}$ and $mathit{FMN}$. Therefore, the biological production of this vitamin using microorganisms as a sustainable and economical approach has gained considerable importance in the food, pharmaceutical, and animal feed industries. The presence of a large number of variables and multicollinearity among them presents major obstacles to classical regression methods. Consequently, regularisation and dimensionality reduction approaches, including Ridge regression, Lasso, Elastic Net and Partial Least Squares (PLS), have been developed to improve model stability and predictive performance. Moreover, machine learning methods such as Support Vector Machines (SVM) and Support Vector Regression (SVR) have been widely applied in high-dimensional data analysis due to their ability to capture complex and nonlinear relationships. In this study, regression and machine learning methods, including Ridge, Lasso, Elastic Net, PLS, SVM, and SVR, are implemented and compared using real riboflavin production data and simulated datasets to evaluate their performance in handling multicollinearity, dimensionality reduction, and prediction of production levels.}
1. امامی، ه. (١٣٩٧)، روش های تشخیصی در مدلهای خطی ریج نیمهپارامتری با خطا در اندازهگیری، مجله مدلسازی پیشرفته ریاضی،8، 19-48.
2. روحی، آ،. جهادی، ف،. روزبه، م. و زالزاده، س. (١۴٠٢)، تحلیل دادههای با بعد بالا با استفاده از رگرسیون بردار پشتیبان تعمیم یافته، رگرسیون تابعی، رگرسیون ستیغی و لاسو، مجله علوم آماری،17 (1)، 6-26.
3. Arashi, M. and Valizadeh, T. (2015), Performance of Kibria's methods in partial linear ridge regression model, Statistical Papers, 56, 231-246. [DOI:10.1007/s00362-014-0578-6]
4. Awad, M. and Khanna, R. (2015), Efficient learning machines: theories, concepts, and applications for engineers and system designers, First Edition. Apress Media. [DOI:10.1007/978-1-4302-5990-9]
5. Bargam, B., Boudhar, A., Kinnard, C., Bouamri, H., Nifa, K. and Chehbouni, A. (2024), Evaluation of the Support Vector Regression (SVR) and the Random Forest (RF) Models Accuracy for Streamflow Prediction under a Data-Scarce Basin in Morocco, Discover Applied Sciences, 6, 322. [DOI:10.1007/s42452-024-05994-z]
6. Coates, P. M., Betz, J. M., Blackman, M. R., Cragg, G. M., Levine, M., Moss, J. and White, J. D. (2010), Encyclopedia of Dietary Supplements, Second Edition, Informa Healthcare. [DOI:10.1201/b14669]
7. Cook, R. D. and Forzani, L. (2024), Partial Least Squares Regression and Related Dimension Reduction Methods, 1st ed., Chapman and Hall/CRC, New York. [DOI:10.1201/9781003482475-1]
8. Emami, H. (2018), Diagnostic methods in semi-parametric ridge linear models with measurement error, Journal of Advanced Mathematical Modeling, 8, 19-48.
9. Hastie, T., Tibshirani, R. and Wainwright, M. (2015), Statistical Learning with Sparsity: The Lasso and Generalizations, CRC Press, Taylor and Francis Group, Boca Raton, FL, USA. [DOI:10.1201/b18401]
10. Herawati, N., Wijayanti, A., Sutrisno, A., Nusyirwan and Misgiyati (2024), The Performance of Ridge Regression, LASSO, and Elastic-Net in Controlling Mul-ticollinearity: A Simulation and Application, Journal of Modern Applied Statistical Methods, 23(2). [DOI:10.56801/Jmasm.V23.i2.4]
11. James, G., Witten, D., Hastie, T. and Tibshirani, R. (2023), An Introduction to Statistical Learning with Applications in R, Second Edition, Springer Science and Business Media.
12. Lauer, F. and Bloch, G. (2008), Incorporating Prior Knowledge in Support Vector Regression, Machine Learning, 70, 89-118. [DOI:10.1007/s10994-007-5035-5]
13. Roohi, A., Jahadi, F., Roozbeh, M. and Zalzadeh, S. (2023), High-dimensional data analysis using generalized support vector regression, functional regression, ridge regression and lasso, Journal of Statistical Sciences, {17}(1), 6-26. [DOI:10.61186/jss.17.1.1]
14. Roozbeh, M., Babaie-Kafaki, S. and Aminifard, Z. (2022), Improved High Dimensional Regression Models with Matrix Approximations Applied to the Comparative Case Studies with Support Vector Machines, Optimization Methods and Software, 37(6), 1912-1929. [DOI:10.1080/10556788.2021.2022144]
15. Roozbeh, M. and Maanavi, M. (2022), Mammalian Eye Gene Expression Using Support Vector Regression to Evaluate a Strategy for Detecting Human Eye Disease, Iranian Journal of Health Sciences, 10(2), 14-28. [DOI:10.18502/jhs.v10i2.9763]
16. Roozbeh, M., Rouhi, A., Mohamed, N. A. and Jahadi, F. (2023), Generalized Support Vector Regression and Symmetry Functional Regression Approaches to Model the High-Dimensional Data, Symmetry, 15(6), 1262. [DOI:10.3390/sym15061262]