Scribe: Transporting petabytes per hour - Engineering at Meta

Our hardware infrastructure comprises millions of machines, all of which generate logs that we need to process, store, and serve. The total size of these logs is several petabytes every hour. The o…

How Uber Delivers Big Data in Less Than an Hour, by Roy Telles

Manos Karpathiotakis on LinkedIn: Scribe: Transporting petabytes per hour via a distributed, buffered…

Critical analysis of Big Data challenges and analytical methods - ScienceDirect

Adrien CONRATH on LinkedIn: Incredibly proud to see my team present their journey of improving the…

Asynchronous computing at Meta: Overview and learnings

Uber's Big Data Platform: 100+ Petabytes with Minute Latency

A survey on the Distributed Computing stack - ScienceDirect

Seagate Is the First Company to Ship 3 Zettabytes of Hard Drive Storage

PDF) RecD: Deduplication for End-to-End Deep Learning Recommendation Model Training Infrastructure

Understanding data storage and ingestion for large-scale deep recommendation model training