Deep learning with small and big data of symmetric volatility information for predicting daily accuracy improvement of JKII prices

Mohammed Ayoub Ledhem (Department of Economics, University Centre of Maghnia, Maghnia, Algeria)

Journal of Capital Markets Studies

ISSN: 2514-4774

Article publication date: 6 May 2022

Issue publication date: 20 September 2022

1354

Abstract

Purpose

The purpose of this paper is to predict the daily accuracy improvement for the Jakarta Islamic Index (JKII) prices using deep learning (DL) with small and big data of symmetric volatility information.

Design/methodology/approach

This paper uses the nonlinear autoregressive exogenous (NARX) neural network as the optimal DL approach for predicting daily accuracy improvement through small and big data of symmetric volatility information of the JKII based on the criteria of the highest accuracy score of testing and training. To train the neural network, this paper employs the three DL techniques, namely Levenberg–Marquardt (LM), Bayesian regularization (BR) and scaled conjugate gradient (SCG).

Findings

The experimental results show that the optimal DL technique for predicting daily accuracy improvement of the JKII prices is the LM training algorithm based on using small data which provide superior prediction accuracy to big data of symmetric volatility information. The LM technique develops the optimal network solution for the prediction process with 24 neurons in the hidden layer across a delay parameter equal to 20, which affords the best predicting accuracy based on the criteria of mean squared error (MSE) and correlation coefficient.

Practical implications

This research would fill a literature gap by offering new operative techniques of DL to predict daily accuracy improvement and reduce the trading risk for the JKII prices based on symmetric volatility information.

Originality/value

This research is the first that predicts the daily accuracy improvement for JKII prices using DL with symmetric volatility information.

Keywords

Citation

Ledhem, M.A. (2022), "Deep learning with small and big data of symmetric volatility information for predicting daily accuracy improvement of JKII prices", Journal of Capital Markets Studies, Vol. 6 No. 2, pp. 130-147. https://doi.org/10.1108/JCMS-12-2021-0041

Publisher

:

Emerald Publishing Limited

Copyright © 2022, Mohammed Ayoub Ledhem

License

Published in Journal of Capital Markets Studies. Published by Emerald Publishing Limited. This article is published under the Creative Commons Attribution (CC BY 4.0) license. Anyone may reproduce, distribute, translate and create derivative works of this article (for both commercial and non-commercial purposes), subject to full attribution to the original publication and authors. The full terms of this license may be seen at http://creativecommons.org/licences/by/4.0/legalcode


1. Introduction

The predicting of the movement of the stock market index is termed to be a rather critical goal in the financial world, given that a reasonably precise forecast has the potential to gain profit in the stock market, deliver higher financial benefits and hedge against market risks (Livieris et al., 2019). The stock market is notorious for its intense uncertainty and instability, and investors are still looking for an efficient and accurate way to direct stock investing (Wang et al., 2020). Certainly, the area of financial analysis has changed radically from a more qualitative science to a more quantitative science, which is also based on the extraction of knowledge from databases. Over the last few years, machine learning, artificial intelligence and deep learning (DL) have become effective analytical methods for the forecasting process through evaluating and leveraging the information gained from financial data (Jannes, 2018; Livieris et al., 2019).

According to Aslam et al. (2020) and Jannes (2018), the use of artificial intelligence, machine learning and DL in predicting the stock index movements of Islamic capital markets became essential for making the right trading decisions by investors, particularly for the Jakarta Islamic Index (JKII) in the Indonesian Islamic stock market which witnessed deep volatilities and unstable movements as stated by Irsalinda et al. (2020).

In the last decade, the Indonesian Islamic stock market became one of the most global developed Islamic stock markets that offer great profit opportunities (Ledhem, 2020; Qizam et al., 2020). According to Subekti et al. (2020), the structure of Islamic capital markets in Indonesia became large, investments in the Islamic capital markets were introduced first in 1997; then in 2000, the JKII has appeared to encourage investors who want to gain profits from the financial opportunities in Islamic capital markets (JKII is the first Islamic stock index established on July 3rd, 2000, which included 30 liquid stocks from the Indonesian capital market). There are similarities between the Islamic capital markets and the conventional ones in the practice of Islamic capital investment, the difference is that the mechanism and effect of trading do not violate the Islamic law principle which prohibits the interest rates (Subekti et al., 2020). The JKII has its own characteristics as any other Islamic stock index that differ from the conventional one in terms of risk, profit and loss sharing, and informational efficiency. Regarding risk, on one hand, Islamic stock indexes are seen to be riskier than their conventional equivalents owing to the deficiency of diversification (Albaity and Ahmad, 2008). On the other hand, Al-Zoubi and Maghyereh (2007) demonstrated that the Islamic stock index is less risky than the standard because of the profit and loss sharing concept in Islamic finance. In addition, Ben Rejeb and Arfaoui (2019) demonstrated that Islamic stock indices are more efficient than conventional ones in terms of informational efficiency. However, Ben Rejeb and Arfaoui (2019) proved that Islamic stock indices are more volatile than their conventional equivalents in terms of volatility. Since this research is focussing on the factor of volatility in the JKII, Irsalinda et al. (2020) showed that the JKII is highly volatile and witnessed unstable movements.

According to Irsalinda et al. (2020) and Ledhem (2021), there is a lack of using modern statistical techniques in the Indonesian Islamic capital markets and particularly in predicting the JKII price movements, and since the JKII was witnessing volatilities and unbalanced movements, investors were obliged to employ the modern methods like artificial intelligence, machine learning and DL in predicting the JKII prices.

Therefore, the objective of this paper is to provide an effective DL model among artificial neural networks (ANNs) to predict daily accuracy improvement for JKII daily prices and support both the individual and the institutional investors in the Islamic capital markets to achieve their investment goals and make the accurate investment decision.

According to Floros (2009), Caporin et al. (2013), and Moon and Yu (2010), the appropriate technique for understanding the behaviour of the capital stock volatility structure is to identify it in terms of its information distribution function over a conditional variance examination. In fact, information is the ultimate driver of asset pricing volatility in the capital stock market (Caporin et al., 2013; Floros, 2009; Moon and Yu, 2010). This information can reach the market in a linear or non-linear form, and it is supposed to be either negative or positive information with serious impacts on the asset price volatility (Caporin et al., 2013; Floros, 2009; Moon and Yu, 2010). According to Moon and Yu (2010), volatility of the stock market is symmetric information with the capability to be maintained in the future. As well, symmetric volatility is considered to be more sensitive to its previous (lagged) values relative to the current market value shock (Floros, 2009; Moon and Yu, 2010; Caporin et al., 2013; Othman et al., 2020). Thus, in this study, the symmetric volatility structure of the JKII is used for predicting its daily price future movement based on symmetric information (that illustrates the information of supply and demand) which can be calculated through four input price features such as open price (OP), high price (HP), low price (LP) and close price (CP).

Hence, the objective of the current study is to provide an accurate and ethnic method, such as the ANNs to predict the JKII daily prices as an accuracy improvement to support both institutional and individual investors to achieve their investment objectives by reducing trading risk and to make the precise investment decision. As reported by Peng and Tang (2020), one of the modern ANNs that employed exogenous factors of the symmetric volatility as inputs to predict daily stock prices is the nonlinear autoregressive exogenous (NARX) neural network. As well, Wibowo et al. (2017) determined that the NARX neural network provided high accuracy in predicting the capital market movements in Indonesia. Therefore, this study is using the NARX neural model to predict JKII prices based on symmetric volatility information.

As well, big data which has brought notable attention among financial researchers and investors are also effective in the prediction process of economic and stock market indicators because big data hold large information about volatilities (Kapetanios and Papailias, 2018; Bok et al., 2018; Sigo et al., 2018). Conversely, Yudelson et al. (2014) and Faraway and Augustin (2018) demonstrated that small data outperforms big data in prediction accuracy because the high-quality small sample can generate superior inferences than the low-quality large sample. Therefore, for these reasons, this paper is using both small and big data of symmetric volatility factors as exogenous inputs within the NARX neural network for the prediction process to obtain a robust daily accuracy improvement for JKII prices.

Unlike the previous studies, the contribution of this current study is to predict the JKII prices using small and big data of symmetric volatility information as exogenous inputs inside the NARX neural network for improving the daily accuracy of the JKII. Since the prediction process under an ANN is built on the training algorithms within DL, it is suitable to choose the optimal DL training algorithm to get the best accuracy predicting score, this process is achieved by testing the optimum task for training based on the criteria of the lowest values in mean squared error (MSE) and correlation coefficient. Thus, this paper answers the following question, “What is the optimal training task of DL for predicting daily accuracy improvement for the JKII?”

The rest of this paper is framed as follows: the literature review and the research gap are addressed in the second section “Literature review”. Data collection and DL tasks of analysis using NARX neural network are presented in the third section “Research methodology”. Whereas the empirical outputs and discussion are then deliberated in the fourth section “Empirical outputs and discussion”. To end with a conclusion and some practical implications are given in the fifth section “Conclusion”.

2. Literature review

In the last few years, the use of ANNs in predicting prices and volatilities of capital markets has been emerged in many studies because of its significant efficiency (Livieris et al., 2019; Wang et al., 2020; Yu and Yan, 2020). By reviewing the literature, one of the most effective methods of neural networks in predicting stock market prices is the NARX neural network. Gandhmal and Kumar (2020) predicted the daily stock prices of two companies (Relaxo Footwear and Reliance Communications) using NARX neural networks with chronological penguin Levenberg–Marquardt (CPLM) technique. Their findings indicated that the forecasting using the NARX model provides high-performance accuracy in terms of root mean squared error (RMSE) and mean absolute error. In another study, Peng and Tang (2020) predicted the quantitative stock investments of the Shanghai composite index using the NARX neural network. Their results showed that the NARX neural network provided an accurate predictive ability for the security market. Likewise, Alkhoshi and Belkasim (2018) predicted the Dow Jones stock market index using the NARX neural network based on a training algorithm of LM, their results showed that the predicted model using NARX neural network provides high prediction accuracy based on the MSE score. Also, Wibowo et al. (2017) predicted the price movement of the Indonesia composite index using the NARX neural network, their results showed that NARX neural network can be an alternative prediction model for investors and traders concerning the movements and dynamic variations of Indonesia composite index.

Correspondingly, Das et al. (2017) predicted the Dhaka stock price in the Malaysian stock market using the NARX neural model based on hybrid clustering, their results indicated that the NARX neural network was very efficient in predicting the Dhaka stock price by improving the error rate. Also, Indera et al. (2017) predicted the bitcoin prices using the NARX neural network based on the daily open, low, high and close prices by focussing on the closing price as the output target for forecasting. Their results indicated that the NARX neural network model provides high forecasting accuracy across the training and testing process. Consistently, Yassin et al. (2017) predicted the Apple Inc prices using NARX neural network based on weekly stock prices. Correlation tests and the one-step ahead method were used for validating the predictive model. Their results indicated that the predictive model offers high predictive ability while using generating the Gaussian residuals. Also, Ercan (2017) predicted the OMX Baltic Benchmark stock market prices using the NARX neural network. The predicted model used employed the EUR/USD exchange rate and the index value as exogenous variables. The results showed that the NARX neural network predicted efficiently the Baltic stock market index prices. As well, Shahbazi et al. (2016) predicted the Forex market movements using the NARX neural network, their results indicated that the NARX neural network is efficient in predicting the Forex market movements of the hourly foreign exchange rates (EUR/USD and GBP/USD).

Above and beyond, predicting the stock market prices and volatilities is gaining notable importance nowadays in capital markets around the world. For this purpose, in the last decade, ANNs have been widely used to predict stock market volatility. However, in the Islamic capital markets, the ANNs are not commonly used in predicting the prices and volatilities of Islamic financial indexes. To the best of the author's knowledge, there are limited studies that employed the ANNs for predicting price movements in the Islamic capital markets. One of the newest studies that applied ANNs in Islamic capital markets, a study by Aslam et al. (2020), predicted that daily closing prices of the Islamic securities (KMI-30) index using ANNs, their results showed that ANNs provided high accuracy in the prediction process. Correspondingly, Irsalinda et al. (2020) predicted the JKII using the neural networks based on the fuzzy feed-forward method, their results showed that the predicted model produced high prediction ability in reducing the error rate in the training and testing process.

Yet, generally, other traditional econometric techniques were employed in the Islamic capital markets for the forecasting processes, Rizwan and Khursheed (2018) predicted the volatility of the Islamic stock market index KSE-100 in Pakistan using the ARIMA and GARCH models. Besides, Nasr et al. (2016) predicted the Dow Jones Islamic stock market index volatility using the GARCH with a long memory and a short memory. Consequently, the forecasting in the Islamic capital markets is witnessing a lack of using ANNs which makes this is a gap in the literature. Therefore, to fill this gap and to enrich the literature, this paper employed one of the most effective ANNs models that use the exogenous inputs in forecasting price movements in capital markets which is the NARX neural network. Thus, this is the first study that uses the NARX neural networks in Islamic capital markets for predicting the daily accuracy improvement of the JKII prices.

Since the NARX neural network is based on exogenous inputs for targeting the output, this paper is following Othman et al. (2020), Floros (2009), and Moon and Yu (2010) when they employed the symmetric volatility information of prices as exogenous factors to improve the accuracy of predicting. Thus, this is the first study that uses the NARX neural networks based on symmetric volatility structure in forecasting the daily accuracy improvement for JKII prices.

One of the revolutionary data technologies in improving the prediction accuracy is the use of big data time series (Faloutsos et al., 2019; Galicia et al., 2019; Pérez-Chacón et al., 2020; Singh, 2015; Singh and Yassine, 2018; Talavera-Llames et al., 2018, 2019; Torres et al., 2018a, b). As well, Sigo et al. (2018) predicted the stock price movements in India using ANNs based on big data time series for the best prediction accuracy. Conversely, Yudelson et al. (2014) and Faraway and Augustin (2018) demonstrated that small data outperforms big data in prediction accuracy because the high-quality small sample can generate superior inferences than the low-quality large sample. Therefore, to empower the prediction accuracy of the JKII in the Islamic capital market, this paper has used two samples of small and big data of the JKII symmetric volatility information. Consequently, to the best of the authors' knowledge, this research is the first that uses small and big data samples of symmetric volatility for the prediction of the daily accuracy improvement of JKII prices in the Islamic capital markets.

In conclusion, many researchers have applied artificial intelligence and machine learning in the capital markets especially predicting stock market volatility to make the right trading decisions. As well, all of them had determined the usefulness of these modern methods. However, to the best of the authors' knowledge, there is a lack of applying those modern methods in the Islamic capital markets, in which DL within neural networks methods was missed to be used in the Islamic capital markets. Thus, this research is filling this literature gap by employing neural networks using DL for predicting the daily prices of the JKII prices which is one the most common index in the Islamic capital market in Indonesia, this prediction process is conducted through using small and big data of symmetric volatility information as exogenous inputs within the NARX neural network. Additionally, following Othman et al. (2020), Floros (2009), and Moon and Yu (2010), this paper is using the symmetric volatility approach to predict the accuracy improvement information for the JKII prices, therefore, this paper is one of the limited studies that is using symmetric volatility information in the Islamic capital markets as exogenous factors within the NARX neural network model to predict the accuracy improvement for the JKII prices. Consequently, it is believed that this paper is making a substantial contribution to the related literature.

3. Research methodology

3.1 Data collection and pre-processing

Indonesia is the prime country in Islamic Fintech (financial technology) that uses big data trials with 31 Islamic fintech firms, one of the biggest organizations which afford big data analytics under Islamic Fintech in the ASEAN is the Indonesian Financial Services Authority (OJK) (ISLAMIC FINTECH REPORT 2018, 2019; Ledhem, 2021). Therefore, big data became very important in the Islamic financial sector in Indonesia. By following the study of Singh and Yassine (2018) that used a big data sample for predicting the capital markets movements since big data are highly informative about the index volatilities, the current study used a big data sample of the daily basic symmetric volatility information for the JKII which contains the OP, HP, LP and CP spanning from the 6 October 2000 to 1 July 2021. Additionally, although small data of symmetric volatility information data can be more uniform with fewer volatilities (less extraordinary shocks), the small data sample can provide better inference than a big data sample due to the high quality as stated by Yudelson et al. (2014) and Faraway and Augustin (2018). Therefore, this study employs a small data sample of the daily basic symmetric volatility information for the JKII spanning from 04 January 2021 to 01 July 2021. Both small and big data samples of symmetric volatility information were collected from the respected financial platform database of “Investing.com” which affords financial investments analysis, portfolio and stock market quotes. From this basic information, four attributes are taken into account as input layers, which are the JKII daily OP, HP, LP and CP. The output layer comprises a single feature of the daily price index of the JKII. As well, for training the network, the data of each sample are divided into three subgroups, 70% for training, 15% in the validation process and the rest 15% in the testing process.

3.2 The ANN framework of the current study

This paper aims to predict the daily accuracy improvement for the JKII prices by using the volatility pattern of symmetric information of JKII using DL over the ANN which can model any connection amongst the data without statistical distribution assumptions (Othman et al., 2020). In this study, the ANN framework consists of three main elements, including input layer (IL), hidden layer (HL) and output layer (OL), each with multiple neurons.

Following the study of Indera et al. (2017) that predicted the bitcoin prices using the NARX neural network based on the daily open, low, high and close prices, the IL in this study consists of four attributes as exogenous variables that construct basic symmetric volatility information for the JKII. Additionally, although stock volatility is affected by various parameters, the OP, HP, LP and CP which construct the symmetric volatility structure are the best parameters that illustrate the information of supply and demand for optimal informational efficiency (Othman et al., 2020). Therefore, these four attributes of the JKII are used as exogenous variables in the IL. While the OL includes the target variable (daily JKII price) which is the close price of the JKII that reflects the standard benchmark for all trading activities of the JKII (Indera et al., 2017), the HL in an ANN is a layer in-between the IL and OL. The typical ANN structure of the proposed model is therefore presented in Figure 1.

3.3 NARX neural network within deep learning methodology

According to Lin et al. (1996), the nonlinear autoregressive with exogenous inputs (NARX) model is defined by the following equation:

(1)Y(t)=F(Y(t1), ,Y(td),x(t),s(t1),,x(td))+ε(t)

The neural network predicts the time series' true value Y(t), based on the prior d values of the exogenous series, where d,d1 signifies the delay parameter, Y(t1), ,Y(td) signify the feedback delays. The prediction aims to estimate the unknown nonlinear function F as accurately as possible, using various approaches of the neural network. The last term of Eq (1), ε(t), signifies the actual time series value approximation error (Lin et al., 1996).

The optimization could be achieved by adjusting the weights and bias of the network, as well as testing with various numbers of neurons per layer and hidden layers. Through checking various parameters, one can achieve the optimal predictive accuracy of the neural network but, using this method, one must be aware that reducing too many neurons could decrease the computing capacity of the neural network, limiting generalization whereas increasing much more neurons increases the difficulty in the system. Therefore, this study employed three efficient DL techniques for the optimal testing and training process of the neural network as stated by Houssein et al. (2021), namely LM, Bayesian regularization (BR) and scaled conjugate gradient (SCG).

To develop several ANNs, this paper uses the LM as the first training algorithm based on the NARX model which is one of the utmost common ANNs algorithms with comprehensive applications in computing and mathematical fields (Levenberg, 1944). The LM method includes two optimization procedures, namely the Gauss–Newton and the gradient descent one (Marquardt, 1963). Provided that the LM algorithm incorporates the efficiency and functionality of its two component elements, it provides processors with various undeniable advantages. According to Beale et al. (2010), the LM algorithm has the advantage of taking less time for the training process, which automatically stops when generalization stops improving the MSE of the validation samples. However, the LM algorithm needs a larger memory capacity. Therefore, using the LM algorithm, this experimental study trains 15 predicting ANNs based on various architectures to get an optimal mix between the number of neurons from the hidden layer and the delay parameter. In this way, one neuron for the input data corresponding to the symmetric volatility information of JKII, n neurons in the hidden layer, where n{6,12,24}, the delay parameter d{2,5,10,15,20}, one neuron for the output layer and one neuron for the output data (the predicted JKII daily price).

As well, this paper uses the BR training algorithm to construct various ANNs based on the NARX model. The BR algorithm uses a linear combination of squared errors and squared weights as an objective function, which is adjusted after the network's training process is completed to obtain a network with better generalization properties (MacKay, 1992; Foresee and Hagan, 1997). According to Beale et al. (2010), the BR algorithm has the advantage of providing good generalization for complex, small or noisy datasets in the training process, which automatically stops when based on adaptive weight minimization for the MSE in the validation samples. However, the BR algorithm needs more time for the training process. Using the BR algorithm, this research trains 15 predicting ANNs using the same procedure as in the LM algorithm case.

The third employed training algorithm in this paper is the SCG, a supervised learning algorithm that was implemented in 1993 and is valuable in the development of ANNs. It is built on the conjugate gradient process which incorporates the modelling and trust area solution of LM and the conjugate gradient one (Møller, 1993). According to Beale et al. (2010), the advantage of the SCG algorithm needs less memory capacity for the training process, which automatically stops when generalization stops improving the MSE in the validation samples. However, it requires more time for the training process.

Considering the benefits of the SCG method, this study aimed to evaluate how well-suited it is in predicting the JKII prices for achieving daily improvement accuracy based on symmetric volatility information. This research trains 15 predicting ANNs using the same procedure of testing and training as in the case of the LM algorithm and BR algorithm to achieve an optimal combination between the neurons number from the hidden layer and the delay parameter, therefore, the total developed ANNs is 45 for each data sample.

4. Empirical outputs and discussion

In this experiment research, the main process before the predicting is choosing the optimal developed ANN under the NARX model that affords the highest predicting accuracy score using the LM, BR and SCG algorithms for each data sample, this process within DL is called the training and testing process which generate the best solution for predicting the daily improvement accuracy of JKII prices. To execute DL procedures, this study implements the NARX neural network model using DL in the MATLAB NARX toolbox, because as stated by Paluszek and Thomas (2020), MATLAB is an advanced piece of software for DL. It includes deep belief networks, convolutional neural networks, and other neural net functions and provides DL tools for deep belief networks.

4.1 Training and testing the NARX neural network model using deep learning in MATLAB software

In this process of training and testing, this study contrasts the best prediction accuracy among 45 developed ANNs within the LM, BR and SCG algorithms for each data sample as is shown in Tables 1 and 2, built according to the NARX model with different delays and neurons for choosing the optimal developed ANN that delivers the best accuracy results based on the criteria of MSE and the coefficient of correlation (R) between the targets and outputs networks where 70% of data are used for training, 15% in the validation process and the rest 15% in the testing process.

Analysing the outcomes in Tables 1 and 2, this research notices that the optimal daily prediction accuracy refers to the developed ANN using the LM training algorithm for both small and big data samples, however, the small data sample provides the best predicting accuracy which refers to a developed ANN based on the architecture of n = 24 neurons in the hidden layer and the delay parameter of d = 20 (20 days = 4 working weeks in the Islamic capital market), this optimal developed ANN delivers the lowest value of the MSE (MSE = 1.7247e−08, closer to 0) and the highest value of the correlation coefficient calculated for the entire dataset (R = 0.999999 1) (Table 3), this optimal ANN architecture is entitled NARX_LM_JKII (Figure 2). Additionally, the BR algorithm provides good accuracy results for the prediction in the case of using the small data sample as shown in Table 2 (the developed ANN with the architecture of n = 12 neurons in the hidden layer and the delay parameter of d = 20 that offers an MSE = 1.79139 and R = 0.999071), while the worst prediction accuracy refers to the SCG algorithm for both small and big data samples.

To analyse the training performance for predicting daily accuracy improvement for the JKII prices using the developed NARX model from the LM algorithm based on the small data sample, this study first plots the curves of the training, testing and validation process as is shown in Figure 3. In this case, this study has recorded the best training, testing and validation performance at the 2nd epoch, when the MSE has a value of 1.7247e−08 for the best training, 0.7053 for the best testing and 3.6151 for the best validation. By analysing the plot, the devised predicting solution (70% of data: training process, 15%: validation process and 15%: the testing process) is stable and provides good outcomes for the training process, therefore, the overfitting process does not occur, and the NARX_LM_JKII neural network delivers a high degree of performance and accuracy (Figure 3).

Afterwards, this study signifies the error histogram, when predicting daily accuracy improvement for the JKII prices for July 2021 (2 July 2021 until 12 July 2021) using the optimal developed ANN of the NARX_LM_JKII network (Figure 4).

Analysing the plot, this study notes that errors fall in 0.007845, a very small value. All the errors training points are close to this point. As a consequence, the error histogram in this context emphasizes extremely good outcomes.

Afterwards, to analyse the prediction accuracy, this study calculates and represents one more important plot for the goodness of fit, the regressions between the outputs and network targets. This plot in Figure 5 shows that the correlation coefficient values are very close to 1, all of them is greater than 0.998. Thus, this experimental research attains very good fit outputs.

This study uses the error autocorrelation function to examine how the predicting errors are interconnected in time to verify the network's performance. Apart from the zero-lag correlation, most of the predicting errors fit inside the confidence limit around zero, confirming the efficiency of the predicting approach (Figure 6).

4.2 Outputs discussion and visualization

Finally, this experimental study compares the obtained predicted JKII prices (7 anticipated days starting from 2 July 2021 until 12 July 2021) with the corresponding real values provided by the respected website database of Investing.com as is shown in Table 4.

As well, this study plots the real daily prices of JKII and the predicted ones on the same graph for this purpose. Analysing the graph, this study notices that the two curves are very close to each other as Table 4 shows low absolute values of the differences (Δ = Real JKII prices – Predicted JKII prices) in most predicted days (2 July 2021, 6 July 2021, 7 July 2021, 8 July 2021, 9 July 2021 and 12 July 2021), a fact that demonstrates the high level of accuracy under the developed predicting solution for a whole five-day weak in the Indonesian Islamic capital markets (Figure 7).

5. Conclusion

In this paper, the experimental research aims to predict daily accuracy improvement of JKII prices based on small and big data of symmetric volatility information that consist of the OP, HP, LP and CP. The predicting solution has been developed using DL with small and big data over the LM, BR, SCG training algorithms within the NARX ANNs.

By testing various training algorithms of DL, choosing the optimal amount of hidden layer’s neurons, the delay parameter and the network's weights, and comparing the outcomes, this study attains in each data sample (small and big data) the neural network that affords the best prediction accuracy. Subsequently, by evaluating the predicting performance of the chosen network (NARX_LM_JKII) which was emphasized by the MSE, correlation coefficient, the error histogram, the regression, the error autocorrelation chart, this study has determined that the best daily prediction accuracy for JKII prices under the NARX model is provided by the developed ANN using the Levenberg–Marquardt algorithm (NARX_LM_JKII) in the case of using the small data sample, in which this developed ANN is built from exogenous variables of the OP, HP, LP and CP, with n = 24 neurons in the hidden layer and a delay parameter of d = 20 (NARX_LM_JKII).

To validate the predicting accuracy of the developed solution, this study has performed the final verification based on the real-world predicting scenario, through predicting the daily JKII prices using the developed ANN of NARX_LM_JKII provided by small data of symmetric volatility information and compared the obtained findings with the corresponding real values. Consequently, the daily JKII prices solution developed within this paper offers a high level of accuracy, having the potential of being useful tools for both the financial decision-makers and investors, offering them the means to attain appropriate management of portfolios, reduce the trading risk and make the right financial decisions in the Islamic capital markets.

Above and beyond, this study is enriching the literature by providing a new effective technique for predicting the JKII prices in the Islamic capital markets of Indonesia. It applied the DL techniques through the NARX neural network and chose the best training task based on the optimal accuracy score after learning processes. Consequently, to answer the main research question about the optimal training task of DL for predicting daily accuracy improvement for the JKII prices, the experimental results demonstrate that the LM algorithm is the most appropriate training task for predicting daily accuracy improvement for the JKII in Indonesia due to the optimal predicting accuracy according to the criteria of the lowest MSE and the highest correlation coefficient (R). In addition, this study accomplishes that using small data of symmetric volatility information is better than using big data sample, this result indicates that small data of symmetric volatility information is full of high-quality information for better prediction accuracy, therefore, this result is consistent with Yudelson et al. (2014) and Faraway and Augustin (2018) when they demonstrated that small data outperforms big data in prediction accuracy when small data generate superior inferences than the low-quality large sample. In conclusion, this paper supports the findings of Das et al. (2017), Wibowo et al. (2017), Alkhoshi and Belkasim (2018), Livieris et al. (2019), Aslam et al. (2020), Peng and Tang (2020), Wang et al. (2020), Irsalinda et al. (2020), Yu and Yan (2020), Gandhmal and Kumar (2020), and Peng and Tang (2020), in which modern techniques like machine learning, artificial intelligence and DL are effective tools in the capital markets by affording advanced knowledge to the financial investors for the well-organized managing of portfolios, to reduce trading risk and to make right financial decisions, which leads to the inevitability of using new technological techniques in Islamic capital markets due to the effectiveness of those modern techniques in the predicting process than other classical statistical tools which remained paralyzed to evaluate big data time series, this inevitability of updating the classical statistical tools obliges the financial investors and decision-makers to employ new techniques which only machine learning, artificial intelligence and DL can offer.

5.1 Practical implications for research and practice

This paper has some implications for research and practice as the following:

  1. This study aims to apply DL for predicting daily accuracy improvement for the JKII prices using the NARX neural network model based on small and big data of symmetric volatility information. Therefore, this paper would fill the literature gap by providing a new efficient tool for predicting prices and volatilities in the Islamic capital markets.

  2. Due to the age of big data, DL is one of the effective techniques for financial analysers and decision-makers to evaluate and predict the volatilities in both Islamic and conventional capital markets. Consequently, although this paper is limited to an Islamic stock index which is JKII, in terms of practical implication, this paper provides important evidence for researchers, financial investors and decision-makers across countries in the Islamic capital markets to the necessity of adopting DL due to high volatilities and unstable movements in Islamic stock indices, artificial intelligence, and machine learning as major tools in the age of big data technology and the emerging of Islamic fintech across the world. Thus, modern technological techniques can be beneficial in Islamic capital markets by ranking investments, assessing stock volatilities, reducing trading risk, managing portfolios strategies in Islamic financial environments and managing wise financial decisions to maximize financial investment profits.

Figures

The ANN structure for predicting the daily accuracy improvement for the JKII prices

Figure. 1

The ANN structure for predicting the daily accuracy improvement for the JKII prices

The NARX_LM_JKII's architecture

Figure. 2

The NARX_LM_JKII's architecture

The best performance of training, testing and validation using the NARX_LM_JKII network

Figure. 3

The best performance of training, testing and validation using the NARX_LM_JKII network

The error histogram while predicting the daily accuracy improvement for JKII prices using the NARX_LM_JKII network

Figure. 4

The error histogram while predicting the daily accuracy improvement for JKII prices using the NARX_LM_JKII network

The regression between the network outputs and targets while predicting the daily accuracy improvement for JKII price using the NARX_LM_JKII network

Figure. 5

The regression between the network outputs and targets while predicting the daily accuracy improvement for JKII price using the NARX_LM_JKII network

The error autocorrelation function while predicting the daily accuracy improvement for JKII price using the NARX_LM_JKII network

Figure. 6

The error autocorrelation function while predicting the daily accuracy improvement for JKII price using the NARX_LM_JKII network

Comparison between the predicted JKII prices with the corresponding real values

Figure. 7

Comparison between the predicted JKII prices with the corresponding real values

The formulation of the experimental results when developing the ANNs predicting solution based on the NARX model using big data of symmetric volatility information

nd25101520
The LevenbergMarquardt training algorithm
6MSE43.5049841.6775941.9832139.8042536.83621
R0.999,6040.999,6240.9996190.9996370.999668
12MSE42.5055940.3289136.3008836.0182532.17813
R0.9996199.9996359.9996750.9996780.999707
24MSE39.3552938.6186834.4819330.4102330.69891*
R0.9996470.9996490.9996890.9997230.999730*
The Bayesian regularization training algorithm
6MSE44.4423841.0278439.8273443.0789741.43801
R0.9996010.9996300.9996370.9996040.999624
12MSE43.5341642.5692043.1114241.5318840.93640
R0.9996070.9996140.9996100.9996240.999629
24MSE42.5179943.3605942.6518441.9548740.88045
R0.9996140.9996080.9996120.9996200.999626
The scaled conjugate gradient training algorithm
6MSE45.94484*47.8314351.9216348.7010553.78498
R0.999579*0.9995620.9995230.9995570.999511
12MSE46.7212847.1379552.7448549.9248849.21687
R0.9995820.9995810.9995240.9995470.999550
24MSE47.1611752.7817647.9230752.1302458.59782
R0.9995730.9995250.9995670.9995300.999473

Note(s): * Refers to the optimal daily prediction accuracy

Source(s): Executed by authors using MATLAB DL toolbox

The formulation of the experimental results when developing the ANNs predicting solution based on the NARX model using small data of symmetric volatility information

nd25101520
The LevenbergMarquardt training algorithm
6MSE31.2875525.369370.01768560.001718280.0246743
R0.9879040.9910120.9999940.9999990.999992
12MSE22.321430.6756990.009864360.001154370.00106328
R0.9909350.9997310.9999960.9999990.999999
24MSE11.677700.03529850.01871230.003729261.7247e−08*
R0.9957640.9999970.9999920.9999990.999999*
The Bayesian regularization training algorithm
6MSE41.0202326.285719.069678.443097.87300
R0.9850630.9895860.9960320.9956290.996075
12MSE40.6949426.4324718.442094.331481.79139
R0.9845550.9897820.9918300.9977700.999071
24MSE38.0680923.9758818.2259710.670972.62832
R0.9854650.9906840.9919950.9949470.998584
The scaled conjugate gradient training algorithm
6MSE45.7939438.3110237.4376622.4595819.59446
R0.9806050.9839470.983710.9892670.990695
12MSE39.5819333.9373427.5754621.4159215.81079
R0.9838230.9862190.9864590.9893640.992591
24MSE37.7613531.9075024.6675610.676725.84013
R0.9844850.9878270.9892770.9940580.996971

Note(s): * Refers to the optimal daily prediction accuracy

Source(s): Executed by authors using MATLAB DL toolbox

The optimal accuracies of DL techniques for small and big data samples

Deep learning techniquesLM training algorithmBR training algorithmSCG training algorithm
SamplesMSERMSERMSER
Big data30.698910.99973040.880450.99962645.944840.999579
Small data1.7247e−08*0.999999*1.791390.9990715.840130.996971

Note(s): * Refers to the optimal daily prediction accuracy

Source(s): Organized by authors

Comparison between real daily JKII prices and predicted daily JKII prices

Days02 July05 July06 July07 July08 July09 July12 July
Real JKII prices (IDR)547.52539.43549.42548.81543.8549.97553.22
Predicted JKII prices (IDR)548.210555.768550.061544.215548.933555.770554.700
Δ = |Real – NARX_LM_JKII|0.69016.3380.6414.5955.1335.8001.480

Source(s): Organized by authors

References

Al-Zoubi, H.A. and Maghyereh, A.I. (2007), “The relative risk performance of Islamic finance: a new guide to less risky investments”, International Journal of Theoretical and Applied Finance, World Scientific Publishing, Vol. 10 No. 2, pp. 235-249.

Albaity, M. and Ahmad, R. (2008), “Performance of Syariah and composite indices: evidence from Bursa Malaysia”, Asian Academy of Management Journal of Accounting and Finance, Citeseer, Vol. 4 No. 1, pp. 23-43.

Alkhoshi, E. and Belkasim, S. (2018), “Stable stock market prediction using NARX algorithm”, Proceedings of the 2018 International Conference on Computing and Big Data, Charleston, SC, USA, Association for Computing Machinery, pp. 62-66.

Aslam, F., Mughal, K.S., Ali, A. and Mohmand, Y.T. (2020), “Forecasting Islamic securities index using artificial neural networks: performance evaluation of technical indicators”, Journal of Economic and Administrative Sciences. doi: 10.1108/JEAS-04-2020-0038.

Beale, M.H., Hagan, M.T. and Demuth, H.B. (2010), “Neural network toolbox”, User’s Guide, MathWorks, Vol. 2, pp. 77-81.

Ben Rejeb, A. and Arfaoui, M. (2019), “Do Islamic stock indexes outperform conventional stock indexes? A state space modeling approach”, European Journal of Management and Business Economics, Emerald Publishing, Vol. 28 No. 3, pp. 301-322.

Bok, B., Caratelli, D., Giannone, D., Sbordone, A.M. and Tambalotti, A. (2018), “Macroeconomic nowcasting and forecasting with big data”, Annual Review of Economics, Annual Reviews, Vol. 10, pp. 615-643.

Caporin, M., Ranaldo, A. and Santucci de Magistris, P. (2013), “On the predictability of stock prices: a case for high and low prices”, Journal of Banking and Finance, Vol. 37 No. 12, pp. 5132-5146.

Das, D., Sadiq, A.S., Mirjalili, S. and Noraziah, A. (2017), “Hybrid Clustering-GWO-NARX neural network technique in predicting stock price”, Journal of Physics: Conference Series, IOP Publishing, Vol. 892, p. 012018.

Ercan, H. (2017), “Baltic stock market prediction by using NARX”, in Presented at the 2017 12th International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT), Vol. 1, pp. 464-467.

Faloutsos, C., Flunkert, V., Gasthaus, J., Januschowski, T. and Wang, Y. (2019), “Forecasting big time series: theory and practice”, in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 3209-3210.

Faraway, J.J. and Augustin, N.H. (2018), “When small data beats big data”, Statistics and Probability Letters, Vol. 136, pp. 142-145.

Floros, C. (2009), “Modelling volatility using high, low, open and closing prices: evidence from four S&P indices”, International Research Journal of Finance and Economics, EuroJournals, Vol. 28, pp. 198-206.

Foresee, F.D. and Hagan, M.T. (1997), “Gauss–Newton approximation to Bayesian learning”, in Presented at the Proceedings of International Conference on Neural Networks (ICNN’97), Vol. 3, pp. 1930-1935.

Galicia, A., Talavera-Llames, R., Troncoso, A., Koprinska, I. and Martínez-Álvarez, F. (2019), “Multi-step forecasting for big data time series based on ensemble learning”, Knowledge-Based Systems, Elsevier, Vol. 163, pp. 830-841.

Gandhmal, D.P. and Kumar, K. (2020), “Wrapper-enabled feature selection and CPLM-based NARX model for stock market prediction”, The Computer Journal, Vol. 64 No. 2, pp. 169-184, doi: 10.1093/comjnl/bxaa099.

Houssein, E.H., Dirar, M., Hussain, K. and Mohamed, W.M. (2021), “Assess deep learning models for Egyptian exchange prediction using nonlinear artificial neural networks”, Neural Computing and Applications, Vol. 33 No. 11, pp. 5965-5987.

Indera, N.I., Yassin, I.M., Zabidi, A. and Rizman, Z.I. (2017), “Non-linear autoregressive with exogeneous input (NARX) Bitcoin price prediction model using PSO-optimized parameters and moving average technical indicators”, Journal of Fundamental and Applied Sciences, University of El Oued, Vol. 9 No. 3S, pp. 791-808.

Irsalinda, N., Astuti, Y.S. and Sugiyarto (2020), “Fuzzy feed forward neural network (FFFNN) model for the Jakarta Islamic index (JII) forecasting”, IOP Conference Series: Materials Science and Engineering, IOP Publishing, Vol. 821, p. 012004.

ISLAMIC FINTECH REPORT 2018 (2019), “DinarStandard”, available at: https://www.dinarstandard.com/wp-content/uploads/2018/12/Islamic-Fintech-Report-2018.pdf.

Jannes, K. (2018), Machine Learning for Finance: Data Algorithms for the Markets and Deep Learning from the Ground up for Financial Experts and Economics, Packt Publishing, Birmingham (accessed 22 May 2021).

Kapetanios, G. and Papailias, F. (2018), “Big data & macroeconomic nowcasting: methodological review”, Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2018-12, Economic Statistics Centre of Excellence (ESCoE).

Ledhem, M.A. (2020), “Does Sukuk financing boost economic growth? Empirical evidence from Southeast Asia”, PSU Research Review. doi: 10.1108/PRR-09-2020-0028.

Ledhem, M.A. (2021), “Data mining techniques for predicting the financial performance of Islamic banking in Indonesia”, Journal of Modelling in Management. doi: 10.1108/JM2-10-2020-0286.

Levenberg, K. (1944), “A method for the solution of certain non-linear problems in least squares”, Quarterly of Applied Mathematics, Vol. 2 No. 2, pp. 164-168.

Lin, T., Horne, B.G., Tino, P. and Giles, C.L. (1996), “Learning long-term dependencies in NARX recurrent neural networks”, IEEE Transactions on Neural Networks, Vol. 7 No. 6, pp. 1329-1338.

Livieris, I.E., Kotsilieris, T., Stavroyiannis, S. and Pintelas, P. (2019), “Forecasting stock price index movement using a constrained deep neural network training algorithm”, Intelligent Decision Technologies, IOS Press, Vol. 14 No. 3, pp. 313-323.

MacKay, D.J.C. (1992), “Bayesian interpolation”, Neural Computation, MIT Press, Vol. 4 No. 3, pp. 415-447.

Marquardt, D.W. (1963), “An algorithm for least-squares estimation of nonlinear parameters”, Journal of the Society for Industrial and Applied Mathematics, Vol. 11 No. 2, pp. 431-441.

Møller, M.F. (1993), “A scaled conjugate gradient algorithm for fast supervised learning”, Neural Networks, Vol. 6 No. 4, pp. 525-533.

Moon, G.-H. and Yu, W.-C. (2010), “Volatility spillovers between the US and China stock markets: structural break test with symmetric and asymmetric GARCH approaches”, Global Economic Review, Routledge, Vol. 39 No. 2, pp. 129-149.

Nasr, A.B., Lux, T., Ajmi, A.N. and Gupta, R. (2016), “Forecasting the volatility of the Dow Jones Islamic Stock Market Index: long memory vs. regime switching”, International Review of Economics and Finance, Vol. 45, pp. 559-571.

Othman, A.H.A., Kassim, S., Rosman, R.B. and Redzuan, N.H.B. (2020), “Prediction accuracy improvement for Bitcoin market prices based on symmetric volatility information using artificial neural network approach”, Journal of Revenue and Pricing Management, Vol. 19 No. 5, pp. 314-330.

Paluszek, M. and Thomas, S. (2020), Practical MATLAB Deep Learning: A Project-Based Approach, Apress, New York.

Peng, J. and Tang, Q. (2020), “Application of NARX dynamic neural network in quantitative investment forecasting system”, in Li, K., Li, W., Wang, H. and Liu, Y. (Eds), Artificial Intelligence Algorithms and Applications, Springer, Singapore, pp. 628-635.

Pérez-Chacón, R., Asencio-Cortés, G., Martínez-Álvarez, F. and Troncoso, A. (2020), “Big data time series forecasting based on pattern sequence similarity and its application to the electricity demand”, Information Sciences, Vol. 540, pp. 160-174.

Qizam, I., Ardiansyah, M. and Qoyum, A. (2020), “Integration of Islamic capital market in ASEAN-5 countries: preliminary evidence for broader benefits from the post-global financial crisis”, Journal of Islamic Accounting and Business Research, Emerald Publishing Limited, Vol. 11, No. 3, pp. 811-825.

Rizwan, A. and Khursheed, A. (2018), “Forecasting islamic stock market volatility: an empirical evidence from Pakistan economy”, UCP Management Review (UCPMR), Vol. 2 No. 1, pp. 17-38.

Shahbazi, N., Memarzadeh, M. and Gryz, J. (2016), “Forex market prediction using NARX neural network with bagging”, MATEC Web of Conferences, EDP Sciences, Vol. 68, p. 19001.

Sigo, M.O., Selvam, M., Maniam, B., Kannaiah, D., Kathiravan, C. and Vadivel, T. (2018), “Big data analytics-application of artificial neural network in forecasting stock price trends in India”, Academy of Accounting and Financial Studies, Vol. 22 No. 3, available at: https://papers.ssrn.com/abstract=3665321.

Singh, P. (2015), “Big data time series forecasting model: a fuzzy-neuro hybridize approach”, in Acharjya, D.P., Dehuri, S. and Sanyal, S. (Eds), Computational Intelligence for Big Data Analysis: Frontier Advances and Applications, Springer International Publishing, Cham, pp. 55-72.

Singh, S. and Yassine, A. (2018), “Big data mining of energy time series for behavioral analytics and energy consumption forecasting”, Energies, Multidisciplinary Digital Publishing Institute, Vol. 11 No. 2, p. 452.

Subekti, R., Abdurakhman and Rosadi, D. (2020), “Modified capital asset pricing model (CAPM) into Sharia framework”, Journal of Physics: Conference Series, IOP Publishing, Vol. 1581, p. 012021.

Talavera-Llames, R., Pérez-Chacón, R., Troncoso, A. and Martínez-Álvarez, F. (2018), “Big data time series forecasting based on nearest neighbours distributed computing with Spark”, Knowledge-Based Systems, Elsevier, Vol. 161, pp. 12-25.

Talavera-Llames, R., Pérez-Chacón, R., Troncoso, A. and Martínez-Álvarez, F. (2019), “MV-kWNN: a novel multivariate and multi-output weighted nearest neighbours algorithm for big data time series forecasting”, Neurocomputing, Vol. 353, pp. 56-73.

Torres, J.F., Galicia, A., Troncoso, A. and Martínez-Álvarez, F. (2018a), “A scalable approach based on deep learning for big data time series forecasting”, Integrated Computer-Aided Engineering, IOS Press, Vol. 25 No. 4, pp. 335-348.

Torres, J.F., Troncoso, A., Koprinska, I., Wang, Z. and Martínez-Álvarez, F. (2018b), “Deep learning for big data time series forecasting applied to solar power”, in The 13th International Conference on Soft Computing Models in Industrial and Environmental Applications, Springer, pp. 123-133.

Wang, Y., Wang, L., Yang, F., Di, W. and Chang, Q. (2020), “Advantages of direct input-to-output connections in neural networks: the Elman network for stock index forecasting”, Information Sciences, Vol. 547, pp. 1066-1079.

Wibowo, A., Pujianto, H. and Saputro, D.R.S. (2017), “Nonlinear autoregressive exogenous model (NARX) in stock price index's prediction”, in 2017 2nd International Conferences on Information Technology, Information Systems and Electrical Engineering (ICITISEE), presented at the 2017 2nd International conferences on Information Technology, Information Systems and Electrical Engineering (ICITISEE), pp. 26-29.

Yassin, I.M., Khalid, M.A., Herman, S.H., Pasya, I., Wahab, N.A. and Awang, Z. (2017), “Multi-layer perceptron (MLP)-Based nonlinear auto-regressive with exogenous inputs (NARX) stock forecasting model”, International Journal on Advanced Science, Engineering and Information Technology, Vol. 7 No. 3, pp. 1098-1103.

Yu, P. and Yan, X. (2020), “Stock price prediction based on deep neural networks”, Neural Computing and Applications, Vol. 32 No. 6, pp. 1609-1628.

Yudelson, M., Fancsali, S., Ritter, S., Berman, S., Nixon, T. and Joshi, A. (2014), “Better data beats big data”, Educational Data Mining 2014, Presented at the Proceedings of the 7th International Conference on Educational Data Mining, London, UK, Institute of Education, pp. 205-208, Citeseer.

Acknowledgements

The author would like to thank the Laboratory for Money and Financial Institutions in the Arab Maghreb “MIFMA Laboratory” (Algeria) for the continuous support of research. The author would also like to thank the General Directorate of Scientific Research and Technological Development “La Direction Générale de la Recherche Scientifique et du Développement Technologique (DGRSDT)” under the the Algerian Ministry of Higher Education and Scientific Research “le Ministère de l'Enseignement Supérieur et la Recherche Scientifique” for supporting this research. The author is also thankful to TAMARA LBALA-WA-LFASS for providing the necessary high-performance computer hardware to implement this study. Humbly, without forgetting Prof. Dr. Mohammed Mekidiche (Jazak-Allahu-Khayran Estadi-Elkarim) for the continuous encouragement.

Corresponding author

Mohammed Ayoub Ledhem can be contacted at: ledhem.edu@gmail.com

Related articles