Biological Neurons

In this article, we will look into how Biological Neurons work and how it is different from Artificial Neurons

When we observe a single neuron, some dendrites will be of more thickness than other dendrites. This allows to pass more impulses to nucleus than other dendrites. Once we have enough impulses from dendrites then neurons sends the output to axioms, else neurons will not be activated.

Also, if we observe the scans of kids from newborn to 6 years, we see the connections between neurons is increasing and becoming dense upto 2 years. After 2 years connections are pruning.

Kids start learning about language , shapes, objects etc., durning early age and build the neurons. After some age, these neurons starts pruning as few of the neurons (experience) will be redundant or random connections. Also, when we observe the dendrites, we can see that few dendrites are more think than others. Dendrites with more thickness will give more impulses than the less thick ones.

Durning the initial years, kids consume lots of data like visual data, audio, sensory data etc., Since child consumes lots of data, our biological algorithm creates new connections based on the data that child has consumed. Kids born on different countries, conditions or circumstances will have different neuron connections. For example, a kid born in India and Canada will have different connections established because of their language / culture / parents etc.,

How thickness of connections are formed?

When a kid touches a hot object, it gives child a pain and forms a strong neural connection, so that when there is a hot object near to kid, it gives a strong signal that dont touch the object. Similarly, when a kid is born in Canada, he knows how snow looks and feels but kid born in India dont have that connection available.

We can write activation function as,

This function is similar to Logistic Regression

When there is no connection between neurons, then weight of that connection is 0

Bottomline:

When we learn a new thing, a new connection will be formed between set of neurons and weights / thickness will be established.

Hope you like this article and please share your feedback.