Google knows where you've been, where you are, and probably where you'll be. It keeps a history of your past locations and even shows you on the Google Map. This features is called Google Location History and you can easily disable/turn it off from your Android device, by doing as follows:
1. Open Google Settings application
2. Go to Location and then tap Location History (If you are running Android 4.4 KitKat, you need to follow this path: Location > Location services > Google Location Reporting > Location History)
3. Now make sure Location History is turned off
Note that, disabling Location History doesn't mean Removing Location History in the past, but from now on, Google doesn't save and keep track of your locations.