When you select a map in 'My Maps' there should be a 'View in Google Earth' link in upper right that you can click. Recently Google has removed the 'View in Google Earth' link from the Google Maps...
The difference is simple - Google maps is designed to help you find places and get directions. Google map maker is like a wiki for Google maps - it lets you edit Google maps to make the data on it...