You can find git here. To make your life easier, you may want to also download a gui.
The "official" website is a great resource. However, if you really want to learn (and have 15 minutes of spare time), play with this. It's free. :-)
Also, great cheat-sheet.
To use git from Matlab, first install git from the links above. Then, download this and add it to matlab's path.