Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
tr7200 authored Sep 1, 2020
1 parent 4b8f1da commit eaf3ff9
Showing 1 changed file with 13 additions and 2 deletions.
15 changes: 13 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,16 @@
# Loss convergence in a causal Bayesian neural network of retail firm performance

Code accompanying arXiv:2008.13038
Most causal relationships in machine learning are direct, i.e. all the features predict with no relationship to each other. But what about more complicated causal relationships, such as this?

<img src="https://upload.wikimedia.org/wikipedia/commons/thumb/2/2b/Causal-formative_measurement.png/1600px-Causal-formative_measurement.png">


Structural equation modeling provides a means of estimating such relationships. In the example of my [research](https://www.koreascience.or.kr/article/JAKO201816357066272.page), co-authored with Professors Youngjin Bahng and Doris Kincaid, the model from that diagram was estimated as an SEM model:


In arXiv 2008.13038, I take this structural model and turn it into the following causal Bayesian neural network:



Why? The processing of tuning such a neural network can reveal much about the relationship between the features and firm performance. If hyperparameter tuning chooses neural network layer densities that are wider than the number of features in a particular node, then that indicates greater aleotoric uncertainty, and that prediction might improve with the addition of other features. In domains such as alternative data for investments, that can indicate causal indicators that could use additional research.

It can also provide estimates of the uncertainty in prediction. This research shows that removing the SEM node with the weakest causal connection to firm performance speeds up the time to finding those estimates when uncertainty is added to the neural network with the Kullback-Leibler divergence. The code uses version 0.7.0 of Tensorflow-probability.

0 comments on commit eaf3ff9

Please sign in to comment.