Will I get notified when the batteries are low on the sensor?

Yes!

After you connect the sensor to your gateway and to your UpKeep account, you’ll be able to see the battery level within the UpKeep Sensors application