Enabling on-device learning at scale