FEB-Stacking and FEB-DNN Models for Stock Trend Prediction: A Performance Analysis for Pre and Post Covid-19 Periods

Indranil Ghosh; Tamal Datta Chaudhuri

doi:10.31181/dmame2104051g

Authors

Indranil Ghosh Calcutta Business School, West Bengal, India
Tamal Datta Chaudhuri Calcutta Business School, West Bengal, India

DOI:

https://doi.org/10.31181/dmame2104051g

Keywords:

Binary Classification, Kernel Principal Component (KPCA), Bootstrapping, Stacking, Deep Neural Network

Abstract

In this paper, stock price prediction is perceived as a binary classification problem where the goal is to predict whether an increase or decrease in closing prices is going to be observed the next day. The framework will be of use for both investors and traders. In the aftermath of the Covid-19 pandemic, global financial markets have seen growing uncertainty and volatility and as a consequence, precise prediction of stock price trend has emerged to be extremely challenging. In this background, we propose two integrated frameworks wherein rigorous feature engineering, methodology to sort out class imbalance, and predictive modeling are clubbed together to perform stock trend prediction during normal and new normal times. A number of technical and macroeconomic indicators are chosen as explanatory variables, which are further refined through dedicated feature engineering process by applying Kernel Principal Component (KPCA) analysis. Bootstrapping procedure has been used to deal with class imbalance. Finally, two separate Artificial Intelligence models namely, Stacking and Deep Neural Network models are deployed separately on feature engineered and bootstrapped samples for estimating trends in prices of underlying stocks during pre and post Covid-19 periods. Rigorous performance analysis and comparative evaluation with other well-known models justify the effectiveness and superiority of proposed frameworks.

Downloads

Download data is not yet available.

References

Ahmar, A. S. & Val, E. B. D. (2020). SutteARIMA: Short-term forecasting method, a case: Covid-19 and stock market in Spain. Science of The Total Environment, 729, 138883.

Atsalakis, G. S. & Valavanis, K. P. (2009). Forecasting stock market short-term trends using a neuro-fuzzy based methodology. Expert Systems With Applications, 36, 10696-10707.

Babu, C. N. & Reddy, B. E. (2015). Prediction of selected Indian stock using a partitioning–interpolation based ARIMA–GARCH model. Applied Computing and Informatics, 11, 130-143.

Basu, S. (1977). Investment Performance of Common Stocks in Relation to Their Price Earnings Ratios: A Test of the Efficient Market Hypothesis. Journal of Finance, 32, 663-682.

Basu, S. (1983). The Relationship between Earnings Yield, Market Value and Return for NYSE Common Stocks: Further Evidence. Journal of Financial Economics, 12, 129-156.

Bisoi, R., Dash, P. K. & Parida, A. K. (2019). Hybrid Variational Mode Decomposition and evolutionary robust kernel extreme learning machine for stock price and movement prediction on daily basis. Applied Soft Computing, 74, 652-678.

Breiman, L. (2001). Random forests. Machine Learning, 45, 5–32.

Bria, A., Marrocco, C. & Tortorella, F. (2020). Addressing class imbalance in deep learning for small lesion detection on medical images. Computers in Biology and Medicine, 120, 103735.

Carta, S., Ferreira, A., Podda, A. S., Recupero, D. R. & Sanna, A. (2021). Multi-DQN: An ensemble of Deep Q-learning agents for stock market forecasting. Expert Systems with Applications, 164, 113820.

Chatzis, S. P., Siakoulis, V., Petropoulos, A., Stavroulakis, E. & Vlachogiannakis, N. (2018). Forecasting stock market crisis events using deep and statistical machine learning techniques. Expert Systems With Applications, 112, 353-371.

Chen, A. S., Leung, M. T. & Daouk, H. (2003). Application of Neural Networks to an Emerging Financial Market: Forecasting and Trading the Taiwan Stock Index. Operations Research in Emerging Economics, 30, 901– 923.

Chen, Y. & Hao, Y. (2018). Integrating principle component analysis and weighted support vector machine for stock trading signals prediction. Neurocomputing, 321, 381-402.

Das, S. R., Mishra, D. & Rout, M. (2019). Stock market prediction using Firefly algorithm with evolutionary framework optimized feature reduction for OSELM method. Expert Systems with Applications: X, 4, 100016.

Datta Chaudhuri, T., Ghosh, I. & Eram, S. (2016). Application of Unsupervised Feature Selection, Machine Learning and Evolutionary Algorithm in Predicting Stock Returns: A Study of Indian Firms. IUP Journal of Financial Risk Management, 13, 20-46.

Datta Chaudhuri, T., Ghosh, I. & Singh, P. (2017). Application of Machine Learning Tools in Predictive Modeling of Pairs Trade in Indian Stock Market. IUP Journal of Applied Finance, 23, 5-25.

Dutta, G., Jha, P., Laha, A. & Mohan, N. (2006). Artificial Neural Network Models for Forecasting Stock Price Index in the Bombay Stock Exchange. Journal of Emerging Market Finance, 5, 283-295.

Fama, E. F. & French, K. R. (1988). Dividend Yields and Expected Stock Returns. Journal of Financial Economics, 1, 3-25.

Fama, E. F. & French, K. R. (1992). The Cross-Section of Expected Stock Returns. Journal of Finance, 47, 427-465.

Fama, E. F. & French, K. R. (1995). Size and Book-to-Market Factors in Earnings and Returns. Journal of Finance, 50, 131-155.

Ghosh, I. & Datta Chaudhuri, T. (2018). Stock Market Portfolio Construction: A Four-stage Model Based on Fractal Analysis. South Asian Journal of Management, 25, 117-149.

Ghosh, I., Jana, R. K., & Sanyal, M. K. (2019). Analysis of temporal pattern, causal interaction and predictive modeling of financial markets using nonlinear dynamics, econometric models and machine learning algorithms. Applied Soft Computing, 82, 105553.

Ghosh, I., Sanyal, M. K. & Jana, R. K. (2018). Fractal inspection and machine learning-based predictive modelling framework for financial markets. Arabian Journal for Science and Engineering, 43, 4273-4287.

Graham, B. & Dodd, D. (1934). Security Analysis. 1st Edition, Mcgraw Hill, New York.

Ibbotson, R. & Idzorek, T. (2014). Dimensions of Popularity. Journal of Portfolio Management, 40, 68-74.

Ismail, M. S., Noorani, M. S. M., Ismail, M., Razak, F. A. & Alias, M. A. (2020). Predicting next day direction of stock price movement using machine learning methods with persistent homology: Evidence from Kuala Lumpur Stock Exchange. Applied Soft Computing, 93, 106422.

Jaffe, J., Keim, D. B. & Westerfield, R. (1989). Earnings Yields, Market Values, and Stock Returns. Journal of Finance, 44, 135-148.

Jiang, W. (2020). Applications of deep learning in stock market prediction: recent progress. arXiv preprint arXiv:2003.01859.

Kingma, D. P. & Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv:1412.6980.

Lariviere, B. & Van den Poel, D. (2005). Predicting customer retention and profitability by random forests and regression forests techniques. Expert Systems with Applications, 29, 472–484.

Lei, L. (2018). Wavelet Neural Network Prediction Method of Stock Price Trend Based on Rough Set Attribute Reduction. Applied Soft Computing, 62, 923-932.

Lemmens, A. & Croux, C. (2006). Bagging and Boosting Classification Trees to Predict Churn. Journal of Marketing Research, 43, 276-286.

Liu, H. & Long, Z. (2020). An improved deep learning model for predicting stock market price time series. Digital Signal Processing, 102, 102741.

Liu, M., Wang, M., Wang, J. & Li, D. (2013). Comparison of random forest, support vector machine and back propagation neural network for electronic tongue data classification: Application to the recognition of orange beverage and Chinese vinegar. Sensors and Actuators B: Chemical, 177, 970–980.

Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y. & Alsaadi, F. E. (2017). A survey of deep neural network architectures and their applications. Neurocomputing, 234, 11-26.

Mostafa, M. (2010). Forecasting Stock Exchange Movements using Neural Networks: Empirical evidence from Kuwait. Expert Systems with Application, 37, 6302-6309.

Perez-Rodriguez, J. V., Torra, S. & Andrada-Felix, J. (2005). Star and ANN models: Forecasting performance on the Spanish Ibex-35 stock index. Journal of Empirical Finance, 12, 490–509.

Pirizadeh, M., Alemohammad, N., Manthouri, M. & Pirizadeh, M. (2020). A new machine learning ensemble model for class imbalance problem of screening enhanced oil recovery methods. Journal of Petroleum Science and Engineering, https://doi.org/10.1016/j.petrol.2020.108214.

Qureshi, A. S., Khan, A., Zameer, A. & Usman, A. (2017). Wind Power Prediction using Deep Neural Network based Meta Regression and Transfer Learning. Applied Soft Computing, 58, 742-755.

Rundo, F., Trenta, F., di Stallo, A. L. & Battiato, S. (2019). Machine learning for quantitative finance applications: A survey. Applied Sciences, 9, 5574.

Schapire, R. E. and Singer, Y. (1999). Improved boosting algorithms using confidence-rated predictions. Machine Learning, 37, 297-336.

Scholkopf, B., Smola, A. & Muller, K. R. (1999). Kernel principal component analysis. Advances in Kernel Methods – Support Vector Learning. MIT Press, Massachusetts. (Chapter 2)

Sezer, O, B., Gudelek, M. U. & Ozbayoglu, A. M. (2020). Financial time series forecasting with deep learning: A systematic literature review: 2005–2019. Applied Soft Computing, 90, 106181.

Shen, J., Fan, H. & Chang, S. (2007). Stock Index Prediction Based on Adaptive Training and Pruning Algorithm. Advances in Neural Networks, 4492, 457–464.

Shin, J., Yoon, S., Kim, Y. W., Kim, T., Go, B. G. & Cha, Y. K. (2021). Effects of class imbalance on resampling and ensemble learning for improved prediction of cyanobacteria blooms. Ecological Informatics, 61, 101202.

Simidjievski, N., Todorovski, L. & Dzeroski S (2015). Predicting long-term population dynamics with bagging and boosting of process-based models. Expert Systems with Applications, 42, 8484-8496.

Srinivasan, P. & Prakasam, K. (2014). Gold Price, Stock Price and Exchange Rate Nexus: The Case of India. IUP Journal of Financial Risk Management, 11, 52-62.

Strong, N. & Xu, X. G. (1997). Explaining the Cross-Section of UK Expected Stock Returns. The British Accounting Review, 29, 1-23.

Zhang, X. D., Li, A. & Pan, R. (2016). Stock trend prediction based on a new status box method and AdaBoost probabilistic support vector machine. Applied Soft Computing, 49, 385-398.

Zheng, Y., Caixin, S., Jian, L., Qing, Y. & Weigen, C. (2011). Entropy-Based Bagging for Fault Prediction of Transformers Using Oil-Dissolved Gas Data. Energies, 4, 1138-1147.

Zhou, F., Zhou, H. M., Yang, Z. & Yang, L. (2019). EMD2FNN: A strategy combining empirical mode decomposition and factorization machine based neural network for stock market trend prediction. Expert Systems with Applications, 115, 136-151.