Grad-CAM

AijkA_{ij}^k

Average over all gradients for class cc and

αkc=1Z∑i∑jδycδAijk\alpha_k^c=\frac{1}{Z} \sum_i \sum_j \quad \frac{\delta y^c}{\delta A_{i j}^k}