A Mathematical Framework for Integrating Neural Networks into Stochastic DEA Models to Reduce Variance and Improve Prediction Stability

Authors

  • Hengki Tamando Sihotang Sains Data, Universitas Pembangunan Nasional Veteran Jakarta, Indonesia
  • Roma Sinta Simbolon Institute of Computer Science, Indonesia

DOI:

https://doi.org/10.35335/cit.Vol17.2025.1394.pp196-206

Keywords:

Stochastic Data Envelopment Analysis (SDEA), Neural Network Integration, Efficiency Measurement Stability, Variance Reduction, Nonlinear Frontier Estimation

Abstract

This study proposes a novel mathematical framework that integrates neural networks into Stochastic Data Envelopment Analysis (SDEA) to reduce variance and enhance the stability of efficiency prediction under uncertainty. Traditional DEA models rely on linear or piecewise-linear frontiers and are highly sensitive to noise, resulting in unstable efficiency scores and unreliable rankings. The proposed hybrid framework addresses these limitations by combining stochastic frontier modeling, noise-distribution assumptions, and neural network function approximation to construct a smooth, flexible, and noise-resilient efficiency frontier. Neural components capture nonlinear relationships among inputs and outputs, while regularization and bootstrapping techniques stabilize estimation and mitigate variance inflation. Empirical experiments demonstrate that the integrated model outperforms classical DEA, stochastic DEA, and bootstrap-corrected DEA in terms of variance reduction, robustness to noise, and stability across repeated sampling. Efficiency scores exhibit narrower confidence intervals, more consistent DMU rankings, and improved frontier curvature representation. Sensitivity analyses further show that the model remains robust under different noise structures and hyperparameter settings. The findings highlight the potential of combining machine learning with stochastic optimization to advance the methodological foundation of DEA. By enhancing frontier flexibility and reducing noise-induced bias, the proposed framework provides a more reliable tool for efficiency evaluation in complex and uncertain production environments. Future work should focus on enhancing interpretability, reducing computational cost, and relaxing distributional assumptions to further extend the applicability of this hybrid approach.

Downloads

Download data is not yet available.

References

R. Lahdelma and P. Salminen, “Stochastic multicriteria acceptability analysis using the data envelopment model,” Eur. J. Oper. Res., vol. 170, no. 1, pp. 241–252, 2006.

W. H. Guss and R. Salakhutdinov, “On universal approximation by neural networks with uniform guarantees on approximation of infinite dimensional maps,” arXiv Prepr. arXiv1910.01545, 2019.

T. Kuosmanen and M. Kortelainen, “Stochastic non-smooth envelopment of data: semi-parametric frontier estimation subject to shape constraints,” J. Product. Anal., vol. 38, no. 1, pp. 11–28, 2012.

S. Guillaume, “Designing fuzzy inference systems from data: An interpretability-oriented review,” IEEE Trans. fuzzy Syst., vol. 9, no. 3, pp. 426–443, 2002.

C. Daraio and L. Simar, Advanced robust and nonparametric methods in efficiency analysis: Methodology and applications. Springer, 2007.

S. Kornilov, “Assessing organizational efficiency under macroeconomic uncertainty in decision support systems: Ensemble methods in machine learning with two-stage nonparametric efficiency models.” Mykolo Romerio universitetas., 2020.

D. Khezrimotlagh, S. Salleh, and Z. Mohsenpour, “A new method for evaluating decision making units in DEA,” J. Oper. Res. Soc., vol. 65, no. 5, pp. 694–707, 2014.

Z. Huang and S. X. Li, “Stochastic DEA models with different types of input-output disturbances,” J. Product. Anal., vol. 15, no. 2, pp. 95–113, 2001.

I. E. Tsolas, “Assessing power stations performance using a DEA?bootstrap approach,” Int. J. energy Sect. Manag., vol. 4, no. 3, pp. 337–355, 2010.

O. I. Abiodun, A. Jantan, A. E. Omolara, K. V. Dada, N. A. Mohamed, and H. Arshad, “State-of-the-art in artificial neural network applications: A survey,” Heliyon, vol. 4, no. 11, 2018.

K. Karydis, I. Poulakakis, J. Sun, and H. G. Tanner, “Probabilistically valid stochastic extensions of deterministic models for systems with uncertainty,” Int. J. Rob. Res., vol. 34, no. 10, pp. 1278–1295, 2015.

H.-B. Kwon and J. Lee, “Two-stage production modeling of large US banks: A DEA-neural network approach,” Expert Syst. Appl., vol. 42, no. 19, pp. 6758–6766, 2015.

C. F. Parmeter and V. Zelenyuk, “Combining the virtues of stochastic frontier and data envelopment analysis,” Oper. Res., vol. 67, no. 6, pp. 1628–1658, 2019.

V. M. A. Souza, D. M. dos Reis, A. G. Maletzke, and G. E. Batista, “Challenges in benchmarking stream learning algorithms with real-world data,” Data Min. Knowl. Discov., vol. 34, no. 6, pp. 1805–1858, 2020.

I. Sabuncuoglu, M. M. Fadiloglu, and S. Çelik, “Variance reduction techniques: Experimental comparison and analysis for single systems,” IIE Trans., vol. 40, no. 5, pp. 538–551, 2008.

D. S. Yeung, I. Cloete, D. Shi, and W. wY Ng, Sensitivity analysis for neural networks. Springer, 2010.

Y. Chen, W. D. Cook, C. Kao, and J. Zhu, “Network DEA pitfalls: Divisional efficiency and frontier projection,” in Data Envelopment Analysis: A Handbook on the Modeling of Internal Structures and Networks, Springer, 2014, pp. 31–54.

B. Reagen et al., “Ares: A framework for quantifying the resilience of deep neural networks,” in Proceedings of the 55th Annual Design Automation Conference, 2018, pp. 1–6.

S. Zheng, Y. Song, T. Leung, and I. Goodfellow, “Improving the robustness of deep neural networks via stability training,” in Proceedings of the ieee conference on computer vision and pattern recognition, 2016, pp. 4480–4488.

L. Simar and V. Zelenyuk, “Stochastic FDH/DEA estimators for frontier analysis,” J. Product. Anal., vol. 36, no. 1, pp. 1–20, 2011.

F. Bianconi, C. Antonini, L. Tomassoni, and P. Valigi, “Robust calibration of high dimension nonlinear dynamical models for omics data: An application in cancer systems biology,” IEEE Trans. Control Syst. Technol., vol. 28, no. 1, pp. 196–207, 2018.

M. B. Lyons, D. A. Keith, S. R. Phinn, T. J. Mason, and J. Elith, “A comparison of resampling methods for remote sensing classification and accuracy assessment,” Remote Sens. Environ., vol. 208, pp. 145–153, 2018.

S. Pantelidakis, “Robust estimation of statistical temporal networks for financial time series modeling: theoretical formulation and temporal patterns typology.” Goldsmiths, University of London, 2020.

J. A. K. Suykens, J. P. L. Vandewalle, and B. L. De Moor, Artificial neural networks for modelling and control of non-linear systems. Springer Science & Business Media, 2012.

V. T. Lee, A. Alaghi, J. P. Hayes, V. Sathe, and L. Ceze, “Energy-efficient hybrid stochastic-binary neural networks for near-sensor computing,” in Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017, IEEE, 2017, pp. 13–18.

D. Russo and J. Zou, “How much does your data exploration overfit? Controlling bias via information usage,” IEEE Trans. Inf. Theory, vol. 66, no. 1, pp. 302–323, 2019.

J. Lampinen and A. Vehtari, “Bayesian approach for neural networks—review and case studies,” Neural networks, vol. 14, no. 3, pp. 257–274, 2001.

Downloads

Published

2025-10-01

How to Cite

Sihotang, H. T., & Simbolon, R. S. (2025). A Mathematical Framework for Integrating Neural Networks into Stochastic DEA Models to Reduce Variance and Improve Prediction Stability. Jurnal Teknik Informatika C.I.T Medicom, 17(4), 196–206. https://doi.org/10.35335/cit.Vol17.2025.1394.pp196-206