Yama 山

Visualize loss surface in random directions (1st & 2nd picture) or between model checkpoints (3rd picture).

Visualize path that optimizer took during training (4th picture).

References

• Hao Li et.al. "Visualizing the Loss Landscape of Neural Nets"
• Original code in Python