On device learning could dramatically improve user experience, says Qualcomm Research.
Much hope for on-device training has been pinned on a hybrid approach, pooling edge devices to aggregate model perturbations in the cloud and then distributing updated models back to the devices. Each device must adapt the model based on local data, then aggregate updates across multiple users globally for improved model performance across a broader range of observed data.
Another approach is to reduce memory requirements. Instead of storing every layer’s activations to calculate the gradient of the loss function, Qualcomm AI Research is investigating using “invertible layers” to reduce memory for training significantly. For example, MobileNet-V2 training was accomplished with an 11x reduction in activation memory, from 43MB to 3.7 MB, without a meaningful reduction in prediction accuracy or change to the number of inference FLOPS or model parameters.
Argentina Últimas Noticias, Argentina Titulares
Similar News:También puedes leer noticias similares a ésta que hemos recopilado de otras fuentes de noticias.
New Research on Financial Infidelity in Romantic RelationshipsHow to better understand a partner's money decisions and not get blindsided by a financial betrayal, writes ArashEmamzadeh
Leer más »
NASA launches rocket from Poker Flats Research Range to study auroraNASA launched a research rocket from the Poker Flats Research Range to study an anomaly in the aurora.
Leer más »
California allows school children to enter classroom without masksAt Las Positas Elementary School in Livermore, some students will experience a day of learning without a mask for the first time in their learning career.
Leer más »
BMW, Qualcomm And Arriver To Collaborate On New Driver Assist And AutomationIn November 2021, Qualcomm announced that its new Snapdragon Ride compute platform for advanced driver assist systems (ADS) and partially automated driving (ADS) had been selected for future BMW vehicles.
Leer más »
Is Emotional Neglect From Childhood Holding You Back?People who grew up feeling like their thoughts and emotions didn't count often have trouble expressing themselves as adults. Here's how they can take back their voice.
Leer más »
CBDCs Are A Very Bad Idea | HackerNoonLearn the risks that Central bank digital currencies (CBDCs) pose to your monetary freedom and privacy.
Leer más »