Modeling of the Vacuum Distillation Unit of a Refinery Using Attention-Based and Conventional Neural Network Approaches
Modeling of the Vacuum Distillation Unit of a Refinery Using Attention-Based and Conventional Neural Network Approaches is an open-access, peer-reviewed research paper by AKPAN Nseabasi M. and EGEMBA Kingsley C., published in Volume 15, Issue 8 of the International Journal of Advanced Research in Science and Technology (IJARST), a UGC-approved journal (Print ISSN 2319-1783, Online ISSN 2320-1126).
Author
AKPAN Nseabasi M. and EGEMBA Kingsley C.
Abstract
The vacuum distillation unit (VDU) of a West African refinery was modeled using conventional Feedforward Artificial Neural Network (FF-ANN) and Attention-Based Artificial Neural Network (Attention-ANN) approaches, and the effectiveness of the models in predicting critical product variables were evaluated. Using preprocessed plant data, the models were trained with 14 input process variables and six process outputs. The performance of the models was evaluated using the coefficient of determination (R²), root mean square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and Pearson's correlation coefficient (R), while paired samples t-test was performed over 20 repeated runs. Both models achieved high predictive accuracy, with the Attention-ANN demonstrating superior overall performance (R² = 0.9970, RMSE = 6.3080, MAE = 4.5341, and MAPE = 4.27%) compared with the FF-ANN (R² = 0.9853, RMSE = 14.0252, MAE = 5.2037, and MAPE = 7.92%), while also achieving a slightly better performance in predicting five of the six individual output variables. The observed differences between the predictions of the models were not statistically significant, though the attention mechanism enhanced model interpretability by identifying the column bottom pressure as the most influential process variable. The predictive performance achieved compared favorably with reported refinery modelling studies for VDU modeling. These findings indicate that attention-based neural networks represent an effective and interpretable framework for multi-output VDU modelling.
Keywords: Vacuum Distillation Unit, Neural Network Modeling, Attention-Based Mechanism, Vacuum Distillation Product Prediction, Model Interpretability
Chandler, B. (2022). Addressing Africa’s Energy Deficit: Gas, Renewables. Mo Ibrahim Foundation. https://mo.ibrahim.foundation/sites/default/files/2022-09/energy-transition.pdf. (Retreieved 9th August 2015)
Davies, D., A. Cobbinah, C. Sithole, and S. Williams. (2024) “60% of Africa’s Energy Will Be Fossil Fuel-Based by 2040”. Africa Briefing, October 2024. https://africabriefing.com/60-of-africas-energy-will-be-fossil-fuel-based-by-2040/. (Retrieved 9th August 2025).
Holechek, J. L., H. M. Geli,M. N. Sawalhah, and R. Valdez. (2022). “A Global Assessment: Can Renewable Energy Replace Fossil Fuels by 2050?” Sustainability 14(8): 4792.
H’ng, S., L. Ng, D. Ng, and V. Andiappan. (2024). “Optimisation of Vacuum Distillation Units in Oil Refineries Using Surrogate Models”. Process Integration and Optimization for Sustainability. 8: 1–23.
Elayane, J., R. Bchitou, and A. Bouhaouss. (2017)” Study of the Thermal Cracking during the Vacuum Distillation of Atmospheric Residue of Crude Oil”. Scientific Study and Research: Chemistry and Chemical Engineering, Biotechnology, Food Industry. 18: 61–71.
Jin, Q., Z. Li, Z. Yan, B. Wang, and Z. Wang. (2022). “Optimization Study on Enhancing Deep-Cut Effect of the Vacuum Distillation Unit (VDU)”. Processes. 10(2): 359.
Atta, M., Khan, H., Ali, M., Tariq, R., Yasir, A., Iqbal, M., Din, S., and Krzywanski, J. (2024). “Simulation of Vacuum Distillation Unit in Oil Refinery: Operational Strategies for Optimal Yield Efficiency”. Energies. 17, 3806.
Okwonna, O., and A. Obuebite. (2021). “Artificial Intelligence Approach in Crude Distillation Unit Operation”. Global Journal of Engineering and Technology Advances 09(02): 075–082.
Egemba, K., and Igbokwe P. (2024). Artificial Neural Network Model for the Prediction of the Products of a Crude Distillation Column. Journal of Engineering Research and Reports. 26(8): 1–9.
Oster, K., Güttel, S., Chen, L., Shapiro, J. L., and Jobson, M. (2021). “Machine learning-based soft sensors for vacuum distillation unit”. arXiv. https://arxiv.org/abs/2111.11251
Buitinck, L., Louppe, G., Blondel, M., Pedregosa, F., Mueller, A., Grisel, O., Niculae, V., Prettenhofer, P.,Gramfort, A., Grobler, J., Layton, R., Vanderplas, J., Joly, A., Holt, B., and Varoquaux, G. (2013). “API Design for Machine Learning Software: Experiences from the Scikit-learn Project”. (arXiv:1309.0238). arXiv. https://arxiv.org/abs/1309.0238.
Goodfellow, I., Y. Bengio, and A. Courville. (2016). Deep Learning. MIT Press.
Bergstra, J., and Bengio, Y. (2012). “Random search for hyper-parameter optimization”. Journal of Machine Learning Research, 13(2): 281-305.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I. (2017). “Attention is all you need”. In I. Guyon, U. von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. V. N.Vishwanathan, and R. Garnett (Editors), Advances in Neural Information Processing Systems. Volume 30. 7102p : 5998–6008
Masters, D. and Luschi, C., (2018). “Revisiting small batch training for deep neural networks”. arXiv. arXiv:1804.07612
Prechelt, L. (1998). “Early Stopping - But When?”. In G. B. Orr & K.-R. Müller (Editors.), Neural Networks: Tricks of the Trade. Springer. 55-69
Feurer, M. and Hutter, F. (2019). “Hyperparameter Optimization”. In: Hutter, F., Kotthoff, L., Vanschoren, J. (Editors). Automated Machine Learning. The Springer Series on Challenges in Machine Learning. Springer, Cham. https://doi.org/10.1007/978-3-030-05318-5_1
Chicco, D., Tötsch, N., and Jurman, G. (2021). “The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE, and RMSE in regression analysis evaluation”. PeerJ Computer Science, 7, Article e623. https://doi.org/10.7717/peerj-cs.623
Willard, J., Jia, X., Xu, S., Steinbach, M., and Kumar, V. (2023). Integrating scientific knowledge with machine learning for engineering and environmental systems. ACM Computing Surveys, 55(4): 1 – 37
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I. and Salakhutdinov, R., (2014). “Dropout: a simple way to prevent neural networks from overfitting”. The Journal of Machine Learning Research, 15(1): 1929–1958
Kleinberg, B., Li, Y. and Yuan, Y., (2018). “An alternative view: When does SGD Escape Local Minima?”.International Conference on Machine Learning (ICML). 2698–2707
Kister, H. Z. Distillation Design. McGraw-Hill, 1992
Halsey, L. G. (2025). “The reign of the p-value is over: What alternative analyses could we employ to fill the power vacuum?” Nature Human Behaviour. 9(2): 141-152
DOI
10.62226/ijarst20262765
PAGES : 2516-2525 | 7 VIEWS | 2 DOWNLOADS
How do you cite this paper?
AKPAN Nseabasi M. and EGEMBA Kingsley C. — “Modeling of the Vacuum Distillation Unit of a Refinery Using Attention-Based and Conventional Neural Network Approaches.” International Journal of Advanced Research in Science and Technology (IJARST), Volume 15, Issue 8. DOI: 10.62226/ijarst20262765.
AKPAN Nseabasi M. and EGEMBA Kingsley C. | Modeling of the Vacuum Distillation Unit of a Refinery Using Attention-Based and Conventional Neural Network Approaches | DOI : 10.62226/ijarst20262765
Journal Frequency:
ISSN 2320-1126, Monthly
Paper Submission:
Throughout the month
Acceptance Notification:
Within 6 days
Subject Areas:
Engineering, Science & Technology
Publishing Model:
Open Access
Publication Fee:
USD 60 USD 50
Publication Impact Factor:
6.76
Certificate Delivery:
Digital
Publish your research with IJARST and engage with global scientific minds