Large-Scale Architecture: The Unreasonable Effectiveness of Simplicity • Randy Shoup • YOW! 2022
This presentation was recorded at YOW! 2022. #GOTOcon #YOW
Randy Shoup - VP Engineering & Chief Architect at eBay @randyshoup46
RESOURCES
@randyshoup
ABSTRACT
Building distributed systems that work is quite challenging. But systems that provide customer value will grow and evolve, and scaling those systems by multiple orders of magnitude is even harder. Citing specific failures and successes from internet-scale consumer properties like Google and eBay, and measuring customer value through the architecturalilities, this session deep-dives into the often counterintuitive architectural principles of simplicity, orthogonality, asynchrony, and feedback.
Simplicity helps us turn seemingly intractable problems into discrete and solvable ones. We will discuss component responsibilities, single-threaded straight-line processing, and making changes in small steps.
Orthogonality allows us to compose separate concerns and bound the complexity of each dimension of the problem. We will discuss processing abstractions like mixins and addons, as well as communication abstractions like channels and pipes.
Asynchrony and eventual consistency further reduce complexity and lead us to drive the system design directly from what really matters – what is actually changing in our core business domain. We will explore events, caching, and dataflow.
Finally, fast and consistent feedback help us continually maintain and improve a complex system. We will discuss quality feedback in the small, as well as systems feedback in the large.
You will take away some interesting anecdotes, as well as actionable insights you can put into practice in scaling your own systems. [...]
TIMECODES
00:00 Intro
01:38 eBay architecture
03:55 Amazon architecture
06:00 Large-scale architecture
06:43 Simple components
14:12 Simple interactions
20:30 Simple changes
30:04 Putting it all together
44:54 Outro
45:35 Q&A
Read the full abstract here:
RECOMMENDED BOOKS
Mary & Tom Poppendieck • Lean Software Development •
Ron Kohavi, Ya Xu, Diane Tang • Trustworthy Online Controlled Experiments •
Simon Brown • Software Architecture for Developers Vol. 2 •
David Farley • Modern Software Engineering •
Dave Farley & Jez Humble • Continuous Delivery •
Woods, Erder & Pureur • Continuous Architecture in Practice •
George Fairbanks • Just Enough Software Architecture •
#SoftwareArchitecture #MinimumViableArchitecture #ModularMonolith #Monolith #Microservices #FeatureFlags #ContinuousDelivery #RandyShoup #SoftwareEngineering #Programming #TDD #SoftwareDevelopment #EventDrivenArchitecture #NetflixArchitecture AmazonArchitecture #FeatureFlag #Sharding #YOWcon
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at
Sign up for updates and specials at
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
1 view
225
76
1 month ago 00:10:08 1
How Weird Would Modern English Sound To A Medieval English Person?
1 month ago 00:01:18 1
Installation artist Tolia Astakhishvili, a winner of the 2024 CHANEL Next Prize
2 months ago 00:23:43 1
Bains et thermes dans la Rome antique | L’Histoire nous le dira #58
2 months ago 01:05:57 1
Spyros Papapetros: World Ornament - Adornment on a Global Scale
2 months ago 00:09:02 1
4000 Tons Heavy & 10 Stories Tall! China Stunning Germany by Unveils World’s Largest Crane.
2 months ago 00:36:30 1
What Putin’s Re-election Means for NATO’s War Hawks
2 months ago 01:12:59 1
18. Hometown Boy: Honoring an Emperor’s Roots in Roman North Africa
2 months ago 01:11:33 1
14. The Mother of All Forums: Civic Architecture in Rome under Trajan
2 months ago 00:11:33 1
The Line, a smart city, 9 million people,170 km long, living modules of 5 minutes neighborhoods
2 months ago 00:08:57 28
Still one of the most realistic British model railway layouts: Knaresborough - The Worlds End
2 months ago 00:05:00 1
Luxury Modern Mega Mansion in Marbella, La Zagaleta | Drumelia Real Estate
3 months ago 00:13:44 2
Angela Cavalieri: large scale linocut printmaking process
3 months ago 00:30:39 1
Liszt: Sonata in B Minor (Zimerman)
3 months ago 00:18:19 1
The Greatest Crypto Explanation Ever? Understand Bitcoin and Crypto Like Never Before (from 2017)
3 months ago 00:01:49 4
Single-View Hair Reconstruction using Convolutional Neural Networks (ECCV 2018)
3 months ago 01:09:06 1
𝐂𝐡𝐞𝐧𝐠𝐝𝐮, 𝐒𝐢𝐜𝐡𝐮𝐚𝐧🇨🇳 China’s New First Tier City of 20 Million People (4K UHD)
3 months ago 00:00:31 1
There are only 10 days left until the 7th edition of the Golden Trezzini Awards begins!
3 months ago 00:05:51 1
Everything You NEED to Know About Client Architecture Patterns
4 months ago 00:08:50 1
Sanctuary Shattered Sun new gameplay in 2024 | Grand Scale Sci-fi RTS like Supreme Commander
4 months ago 00:47:59 1
🇨🇳 4K | Virtual Harbin : Discover the Magic of China’s “Ice & Snow“ City | 云
4 months ago 00:04:28 4
Dr Tikov - Night Breaks
4 months ago 00:00:59 1
Nice 5052 Aluminum Foil To Meet Your Needs
4 months ago 00:00:26 1
Japanese Teahouse - Origamic Architecture
4 months ago 00:05:22 1
Inside Celebrated Designer John Pawson’s Cotswolds Home Farm