Machine Learning and Deep Learning in Network Security

This blog will provide you with the technical knowledge of the benchmark techniques related to Machine Learning and Deep Learning, to apply them in the field of network security because network security is a very critical field which is concerned with each and every person now-a-days. As artificial intelligence has changed the paradigm of the world and have automated most of the manual world, it is the need of the hour to apply artificial intelligence in this field.

Sunday, 10 November 2019

Why Softmax Cost Function?

First lets consider other cost functions like mean squared error. For instance the actual output is 1 billionth and desired is 1 , it is conspicuous that there is almost no gradient for a logistic unit to fix up. Secondly, in scenarios where we are dealing with mutually exclusive classes the sum of probabilities is not guaranteed to be 1.

In short to force the probabilities to sum up to 1 we use Softmax Activation function.

reference : https://www.youtube.com/watch?v=PHP8beSz5o4