diff --git a/README.md b/README.md index c4c307d..4799a4c 100644 --- a/README.md +++ b/README.md @@ -1,5 +1,16 @@ # Loss convergence in a causal Bayesian neural network of retail firm performance -Code accompanying arXiv:2008.13038 +Most causal relationships in machine learning are direct, i.e. all the features predict with no relationship to each other. But what about more complicated causal relationships, such as this? - + + +Structural equation modeling provides a means of estimating such relationships. In the example of my [research](https://www.koreascience.or.kr/article/JAKO201816357066272.page), co-authored with Professors Youngjin Bahng and Doris Kincaid, the model from that diagram was estimated as an SEM model: + + +In arXiv 2008.13038, I take this structural model and turn it into the following causal Bayesian neural network: + + + +Why? The processing of tuning such a neural network can reveal much about the relationship between the features and firm performance. If hyperparameter tuning chooses neural network layer densities that are wider than the number of features in a particular node, then that indicates greater aleotoric uncertainty, and that prediction might improve with the addition of other features. In domains such as alternative data for investments, that can indicate causal indicators that could use additional research. + +It can also provide estimates of the uncertainty in prediction. This research shows that removing the SEM node with the weakest causal connection to firm performance speeds up the time to finding those estimates when uncertainty is added to the neural network with the Kullback-Leibler divergence. The code uses version 0.7.0 of Tensorflow-probability.