-
Notifications
You must be signed in to change notification settings - Fork 2
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
1 changed file
with
13 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,5 +1,16 @@ | ||
# Loss convergence in a causal Bayesian neural network of retail firm performance | ||
|
||
Code accompanying arXiv:2008.13038 | ||
Most causal relationships in machine learning are direct, i.e. all the features predict with no relationship to each other. But what about more complicated causal relationships, such as this? | ||
|
||
<img src="https://upload.wikimedia.org/wikipedia/commons/thumb/2/2b/Causal-formative_measurement.png/1600px-Causal-formative_measurement.png"> | ||
|
||
|
||
Structural equation modeling provides a means of estimating such relationships. In the example of my [research](https://www.koreascience.or.kr/article/JAKO201816357066272.page), co-authored with Professors Youngjin Bahng and Doris Kincaid, the model from that diagram was estimated as an SEM model: | ||
|
||
|
||
In arXiv 2008.13038, I take this structural model and turn it into the following causal Bayesian neural network: | ||
|
||
|
||
|
||
Why? The processing of tuning such a neural network can reveal much about the relationship between the features and firm performance. If hyperparameter tuning chooses neural network layer densities that are wider than the number of features in a particular node, then that indicates greater aleotoric uncertainty, and that prediction might improve with the addition of other features. In domains such as alternative data for investments, that can indicate causal indicators that could use additional research. | ||
|
||
It can also provide estimates of the uncertainty in prediction. This research shows that removing the SEM node with the weakest causal connection to firm performance speeds up the time to finding those estimates when uncertainty is added to the neural network with the Kullback-Leibler divergence. The code uses version 0.7.0 of Tensorflow-probability. |