This module does not implement any operations, but setves as the basis for local response normalization modules.
There are two types of local normalization layers:
- inter-channel normalization;
- intra-channel normalization.
The only difference between them is the area of normalization. In the intra-channel LRN, a 2D neighborhood is determined within one channel, whereas in the inter-channel LRN, the spatial neighborhood is limited to one element, while normalization occurs along a certain neighborhood of the channels.
This normalization technique in general practically does not affect the final result, therefore it is considered obsolete.
def __init__(self, N=5, alpha=1e-4, beta=0.75, K=2.0, name=None):
|N||int||Number of elements to normalize||5|
See descendant classes.