Releases: ziatdinovmax/NeuroBayes
Releases · ziatdinovmax/NeuroBayes
v0.0.10
Key updates:
- Classification Support for Full and Partial BNNs: While the initial focus was on regression with (P)BNNs - since most tasks in physical sciences deal with (quasi-)continuous variables - it was brought to my attention that some research domains can benefit from classification capabilities. So, the new update introduces classification support. To help you get started, I've provided two toy data examples, which can easily be generalized to real-world problems.
- Expanded SWA Options in JAX/Flax: This update enhances the Stochastic Weight Averaging options, providing more robust priors for both Full and Partial BNNs.
- Automatic Restart for HMC/NUTS: Now, HMC/NUTS for (P)BNNs can automatically restart in case of bad initializations, which helps during the autonomous exploration of parameter spaces in experiments and simulations.
- Additional Metrics for Active Learning and UQ: New metrics have been added to enhance the active learning and uncertainty quantification evaluation processes.
- Minor bug fixes, improved documentation, and more examples!
Looking ahead, the next major step will be expanding Partial BNNs beyond the current MLP and ConvNet architectures to include RNNs, GNNs, and Transformers.
v0.0.9
What's Changed
Add an option to specify which layers in the provided architecture will be treated as probabilistic. For example,
# Initialize NN architecture
architecture = nb.FlaxMLP(hidden_dims = [64, 32, 16, 8], target_dim=1)
# Make the first and output layers probabilistic and the rest deterministic
probabilistic_layer_names = ['Dense0', 'Dense4']
# Intitalize and train a PBNN model
model = nb.PartialBNN(architecture, probabilistic_layer_names=probabilistic_layer_names)
model.fit(X_measured, y_measured, num_warmup=1000, num_samples=1000)
Full Changelog: 0.0.7...0.0.9
v0.0.7
What's Changed
- Add ConvNets by @ziatdinovmax in #10
- Add option to set a custom prior over pre-trained priors by @ziatdinovmax in #13
- Add example with heteroskedastic BNN and PBNN by @ziatdinovmax in #17
Full Changelog: 0.0.5...0.0.7
v0.0.5
What's Changed
- Flax nets by @ziatdinovmax in #2
- Trained priors by @ziatdinovmax in #4
- Jax version by @ziatdinovmax in #5
Full Changelog: 0.0.2...0.0.5
v0.0.2
Merge pull request #1 from ziatdinovmax/hsk Add heteroskedastic and uncertain input BNN