About this product

Product Identifiers

PublisherNow Publishers

ISBN-101680837001

ISBN-139781680837001

eBay Product ID (ePID)2321453325

Product Key Features

Number of Pages108 Pages

LanguageEnglish

Publication NameDistributed Learning Systems with First-Order Methods

Publication Year2020

SubjectComputer Science, Databases / Servers

TypeTextbook

Subject AreaComputers

AuthorCE Zhang, Ji Liu

SeriesFoundations and Trends in Databases Ser.

FormatTrade Paperback

Dimensions

Item Weight5.8 Oz

Item Length9.2 in

Item Width6.1 in

Additional Product Features

Intended AudienceScholarly & Professional

Table Of Content1. Introduction2. Distributed Stochastic Gradient Descent3. System Relaxation 1: Lossy Communication Compression4. System Relaxation 2: Asynchronous Training5. System Relaxation 3: Decentralized Communication6. Further ReadingReferences

SynopsisScalable and efficient distributed learning is one of the main driving forces behind the recent rapid advancement of machine learning and artificial intelligence. One prominent feature of this development is that recent progress has been made by researchers in two communities: (1) the system community such as database, data management, and distributed systems, and (2) the machine learning and mathematical optimization community. The interaction and knowledge sharing between these two communities has led to the rapid development of new distributed learning systems and theory.This monograph provides a brief introduction to three distributed learning techniques that have recently been developed: lossy communication compression, asynchronous communication, and decentralized communication. These have significant impact on the work in both the system and machine learning and mathematical optimization communities but to fully realize the potential, it is essential they understand the whole picture. This monograph provides the bridge between the two communities. The simplified introduction to the essential aspects of each community enables researchers to gain insights into the factors influencing both.The monograph provides students and researchers the groundwork for developing faster and better research results in this dynamic area of research., Scalable and efficient distributed learning is one of the main driving forces behind the recent rapid advancement of machine learning and artificial intelligence. One prominent feature of this development is that recent progress has been made by researchers in two communities: (1) the system community such as database, data management, and distributed systems, and (2) the machine learning and mathematical optimization community. The interaction and knowledge sharing between these two communities has led to the rapid development of new distributed learning systems and theory. This monograph provides a brief introduction to three distributed learning techniques that have recently been developed: lossy communication compression, asynchronous communication, and decentralized communication. These have significant impact on the work in both the system and machine learning and mathematical optimization communities but to fully realize the potential, it is essential they understand the whole picture. This monograph provides the bridge between the two communities. The simplified introduction to the essential aspects of each community enables researchers to gain insights into the factors influencing both. The monograph provides students and researchers the groundwork for developing faster and better research results in this dynamic area of research., This monograph provides students and researchers the groundwork for developing faster and better research results in this dynamic area of research.