Skip to content
Shi Jin edited this page Jan 28, 2018 · 10 revisions

Welcome to the learn2deeplearn wiki!

Learning of Tensor Flow

Terminologies Explained

  • softmax: exponentiating its inputs and then normalizing them
    • It can be viewed as a "softened" version of the maximum function.
  • cross-entropy: measures the difference between two distributions. 0 when they are identical.
  • marginal probability: The name “marginal probability” comes from the process of computing marginal probabilities on paper. When the values of P(x, y) are written in a grid with different values of x in rows and different values of y in columns, it is natural to sum across a row of the grid, then write P(x) in the margin of the paper just to the right of the row.
Clone this wiki locally