Skip to content

Commit

Permalink
Minor edit
Browse files Browse the repository at this point in the history
  • Loading branch information
krasserm committed Aug 19, 2020
1 parent da123da commit dfd965f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion bayesian_neural_networks_pymc4.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -1843,7 +1843,7 @@
"\n",
"### Model definition\n",
"\n",
"To model the non-linear relationship between `x` and `y` in the dataset we use a ReLU neural network with two hidden layers, 5 neurons each. The weights of the neural network are random variables instead of deterministic variables. This is what makes a neural network a Bayesian neural network. Here, we assume that the weights follow a normal distribution and are independent. \n",
"To model the non-linear relationship between `x` and `y` in the dataset we use a ReLU neural network with two hidden layers, 5 neurons each. The weights of the neural network are random variables instead of deterministic variables. This is what makes a neural network a Bayesian neural network. Here, we assume that the weights are independent random variables. \n",
"\n",
"The neural network defines a prior over the mean `loc` of the data likelihood `obs` which is represented by a normal distribution. For simplicity, the aleatoric uncertainty (`noise`) in the data is assumed to be known. Thanks to PyMC4's model composition support, priors can be defined layer-wise using the `layer` generator function and composed to a neural network as shown in function `model`. During inference, a posterior distribution over the neural network weights is obtained. "
]
Expand Down

0 comments on commit dfd965f

Please sign in to comment.