Can police locate me if the battery is out of my phone?

Yes they can, but not by your phone location. Cell towers will not communicate with your phone if the battery is removed.

However, there are security cameras array in many places and if you use a credit card or other ID yo may be tracked.