Schedule and Reading List

Date	Readings	Presenter
Jan 21	Introduction + Systems Research	Marco
Jan 25	Reading/Reviewing Papers	Suhaib (joint with CS356)
Jan 29	Research Patterns	Suhaib (joint with CS356)
Feb 1	How to Innovate + Clear/Creative Thinking	Suhaib (joint with CS356)
Feb 4	Giving a Talk	Marco (joint with CS356)
Feb 7	Tech Trends in the Datacenter	Marco (joint with CS356)
	DC Topics
Feb 11	Arrakis: The Operating System is the Control Plane (Companion) IX: A Protected Dataplane Operating System for High Throughput and Low Latency
Feb 14	FaRM: Fast Remote Memory (Companion) Empowering Azure Storage with RDMA	Qusai
Feb 18	Datacenter RPCs can be General and Fast (Companion) StRoM: Smart Remote Memory
Feb 21	No class - holiday
Feb 25	Homa: A Receiver-Driven Low-Latency Transport Protocol Using Network Priorities (Companion) Swift: Delay is Simple and Effective for Congestion Control in the Datacenter
Feb 29	Time Management + People Skills	Suhaib (joint with CS356)
Mar 3	Shenango: Achieving High CPU Efficiency for Latency-sensitive Datacenter Workloads (Companion) Shinjuku: Preemptive Scheduling for µsecond-scale Tail Latency	Ali
Mar 6	How to diagnose nanosecond network latencies in rich end-host stacks (Companion) Collie: Finding Performance Anomalies in RDMA Subsystems	Amandio
Mar 10	Offloading distributed applications onto smartNICs using iPipe (Companion) RDMA is Turing complete, we just did not know it yet!	Ziwu
Mar 13	Ensō: A Streaming Interface for NIC-Application Communication (Companion) PRISM: Rethinking the RDMA Interface for Distributed Systems	Vlad
Mar 17	Visualization and Plotting	Marco (joint with CS356)
	ML systems
Mar 20	Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learning (Companion) MLaaS in the Wild: Workload Analysis and Scheduling in Large-Scale Heterogeneous GPU Clusters	Mustafa
Mar 24	Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training (Companion) EnvPipe: Performance-preserving DNN Training Framework for Saving Energy	Juyi
Mar 27	Mid-Semester Presentations
Mar 31	No class
Apr 3	No class
Apr 7	Eid break
Apr 10	Eid break
Apr 14	Efficient Sparse Collective Communication and its application to Accelerate Distributed Deep Learning (Companion) Towards Domain-Specific Network Transport for Distributed DNN Training
Apr 17	Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism (Companion) Efficient large-scale language model training on GPU clusters using megatron-LM	Boris
Apr 21	ZeRO: Memory Optimizations Toward Training Trillion Parameter Models (Companion) MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs	Mubarak
Apr 24	Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning (Companion) Aceso: Efficient Parallel DNN Training through Iterative Bottleneck Alleviation	Tongzhou
Apr 28	ARK: GPU-driven Code Execution for Distributed Deep Learning (Companion) Orion: Interference-aware, Fine-grained GPU Sharing for ML Applications	Chen
May 1	Tutel: Adaptive Mixture-of-Experts At Scale (Companion) ScheMoE: An Extensible Mixture-of-Experts Distributed Training System with Tasks Scheduling
May 5	Efficient Memory Management for Large Language Model Serving with Paged Attention (Companion) SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification	Mohammed
May 8	Final Presentations