Grad-CAM

$A_{ij}^k$

Average over all gradients for class $c$ and ${\alpha }_k^c=\frac{1}{Z}{\sum }_i{\sum }_j\frac{\delta y^c}{\delta A_{ij}^k}$