169 lines
12 KiB
Markdown
169 lines
12 KiB
Markdown
<p align="center">
|
||
<img src="diagrams/system-design-github-logo.png" width="350" height="200">
|
||
</p>
|
||
|
||
This repository contains free resources to learn System Design concepts and prepare for interviews.
|
||
|
||
Join my free [AlgoMaster Newsletter](https://bit.ly/amghsd) and get a **FREE System Design Interview Handbook** in your inbox.
|
||
|
||
## 📌 System Design Key Concepts
|
||
- [Scalability](https://blog.algomaster.io/p/scalability)
|
||
- [Availability](https://blog.algomaster.io/p/system-design-what-is-availability)
|
||
- [CAP Theorem](https://blog.algomaster.io/p/cap-theorem-explained)
|
||
- [ACID Transactions](https://blog.algomaster.io/p/ecae03ba-1930-42ef-8796-83e2fa818989)
|
||
- [Consistent Hashing](https://highscalability.com/consistent-hashing-algorithm/)
|
||
- [Rate Limiting](https://blog.algomaster.io/p/rate-limiting-algorithms-explained-with-code)
|
||
- [SPOF](https://blog.algomaster.io/p/system-design-how-to-avoid-single-point-of-failures)
|
||
- [Fault Tolerance](https://www.cockroachlabs.com/blog/what-is-fault-tolerance/)
|
||
- [Consensus Algorithms](https://medium.com/@sourabhatta1819/consensus-in-distributed-system-ac79f8ba2b8c)
|
||
- [Gossip Protocol](http://highscalability.com/blog/2023/7/16/gossip-protocol-explained.html)
|
||
- [Service Discovery](https://blog.algomaster.io/p/service-discovery-in-distributed-systems)
|
||
- [API Design](https://abdulrwahab.medium.com/api-architecture-best-practices-for-designing-rest-apis-bf907025f5f)
|
||
- [Disaster Recovery](https://cloud.google.com/learn/what-is-disaster-recovery)
|
||
- [Distributed Tracing](https://www.dynatrace.com/news/blog/what-is-distributed-tracing/)
|
||
|
||
## 🛠️ System Design Building Blocks
|
||
- [Content Delivery Network (CDN)](https://blog.algomaster.io/p/27c62e07-f25b-40ac-a397-101cc54f1f0a)
|
||
- [Proxy vs Reverse Proxy](https://blog.algomaster.io/p/proxy-vs-reverse-proxy-explained)
|
||
- [Domain Name System (DNS)](https://www.cloudflare.com/learning/dns/what-is-dns/)
|
||
- [Caching](https://blog.algomaster.io/p/4d7d6f8a-6803-4c7b-85ca-864c87c2cbf2)
|
||
- [Caching Strategies](https://blog.algomaster.io/p/top-5-caching-strategies-explained)
|
||
- [Distributed Caching](https://blog.algomaster.io/p/distributed-caching)
|
||
- [Load Balancing](https://blog.algomaster.io/p/load-balancing-algorithms-explained-with-code)
|
||
- [Databases Types](https://blog.algomaster.io/p/15-types-of-databases)
|
||
- [SQL vs NoSQL](https://blog.algomaster.io/p/sql-vs-nosql-7-key-differences)
|
||
- [Database Indexes](https://blog.algomaster.io/p/a-detailed-guide-on-database-indexes)
|
||
- [Consistency Patterns](https://systemdesign.one/consistency-patterns/)
|
||
- [HeartBeats](https://blog.algomaster.io/p/heartbeats-in-distributed-systems)
|
||
- [Circuit Breaker](https://medium.com/geekculture/design-patterns-for-microservices-circuit-breaker-pattern-276249ffab33)
|
||
- [Idempotency](https://blog.algomaster.io/p/idempotency-in-distributed-systems)
|
||
- [Database Scaling](https://blog.algomaster.io/p/system-design-how-to-scale-a-database)
|
||
- [Data Replication](https://redis.com/blog/what-is-data-replication/)
|
||
- [Data Redundancy](https://blog.algomaster.io/p/489440f1-9c80-4241-9ec8-de156964c3b9)
|
||
- [Database Sharding](https://blog.algomaster.io/p/what-is-database-sharding)
|
||
- [Database Architectures](https://www.mongodb.com/developer/products/mongodb/active-active-application-architectures/)
|
||
- [Failover](https://www.druva.com/glossary/what-is-a-failover-definition-and-related-faqs)
|
||
- [Bloom Filters](https://blog.algomaster.io/p/bloom-filters)
|
||
- [Message Queues](https://blog.algomaster.io/p/message-queues)
|
||
- [WebSockets](https://blog.algomaster.io/p/websockets)
|
||
- [Checksums](https://blog.algomaster.io/p/what-are-checksums)
|
||
- [API Gateway](https://www.nginx.com/learn/api-gateway/)
|
||
- [Microservices Guidelines](https://newsletter.systemdesign.one/p/netflix-microservices)
|
||
- [Distributed Locking](https://martin.kleppmann.com/2016/02/08/how-to-do-distributed-locking.html)
|
||
|
||
## ⚖️ System Design Tradeoffs
|
||
- [Top 15 Tradeoffs](https://blog.algomaster.io/p/system-design-top-15-trade-offs)
|
||
- [Vertical vs Horizontal Scaling](https://blog.algomaster.io/p/system-design-vertical-vs-horizontal-scaling)
|
||
- [Stateful vs Stateless Design](https://blog.algomaster.io/p/741dff8e-10ea-413e-8dd2-be57434917d2)
|
||
- [Batch vs Stream Processing](https://blog.algomaster.io/p/batch-processing-vs-stream-processing)
|
||
- [Strong vs Eventual Consistency](https://blog.algomaster.io/p/7d9da525-fe25-4e16-94e8-8056e7c57934)
|
||
- [Read-Through vs Write-Through Cache](https://blog.algomaster.io/p/59cae60d-9717-4e20-a59e-759e370db4e5)
|
||
- [Push vs Pull Architecture](https://blog.algomaster.io/p/af5fe2fe-9a4f-4708-af43-184945a243af)
|
||
- [Long-polling vs WebSockets](https://blog.algomaster.io/p/60bfcee4-8ac5-4500-a557-a04c8cbcaf48)
|
||
- [REST vs RPC](https://blog.algomaster.io/p/106604fb-b746-41de-88fb-60e932b2ff68)
|
||
- [Synchronous vs. asynchronous communications](https://blog.algomaster.io/p/aec1cebf-6060-45a7-8e00-47364ca70761)
|
||
- [Latency vs Throughput](https://aws.amazon.com/compare/the-difference-between-throughput-and-latency/)
|
||
|
||
## 🖇️ System Design Architectural Patterns
|
||
- [Client-Server Architecture](https://blog.algomaster.io/p/4585cf8e-30a4-4295-936f-308a25cb716c)
|
||
- [Microservices Architecture](https://medium.com/hashmapinc/the-what-why-and-how-of-a-microservices-architecture-4179579423a9)
|
||
- [Serverless Architecture](https://blog.algomaster.io/p/2edeb23b-cfa5-4b24-845e-3f6f7a39d162)
|
||
- [Event-Driven Architecture](https://www.confluent.io/learn/event-driven-architecture/)
|
||
- [Peer-to-Peer (P2P) Architecture](https://www.spiceworks.com/tech/networking/articles/what-is-peer-to-peer/)
|
||
|
||
## ✅ How to Answer a System Design Interview Problem
|
||
<img src="diagrams/interview-template.png" width="400" height="250">
|
||
|
||
### [Read the Full Article](https://blog.algomaster.io/p/how-to-answer-a-system-design-interview-problem)
|
||
|
||
## 💻 System Design Interview Problems
|
||
### Easy
|
||
- [Design URL Shortener like TinyURL](https://blog.algomaster.io/p/design-a-url-shortener)
|
||
- [Design Text Storage Service like Pastebin](https://www.youtube.com/watch?v=josjRSBqEBI)
|
||
- [Design Leaderboard](https://systemdesign.one/leaderboard-system-design/)
|
||
- [Design Content Delivery Network (CDN)](https://www.youtube.com/watch?v=8zX0rue2Hic)
|
||
- [Design Parking Garage](https://www.youtube.com/watch?v=NtMvNh0WFVM)
|
||
- [Design Vending Machine](https://www.youtube.com/watch?v=D0kDMUgo27c)
|
||
- [Design Distributed Key-Value Store](https://www.youtube.com/watch?v=rnZmdmlR-2M)
|
||
- [Design Distributed Cache](https://www.youtube.com/watch?v=iuqZvajTOyA)
|
||
- [Design Authentication System](https://www.youtube.com/watch?v=uj_4vxm9u90)
|
||
- [Design Unified Payments Interface (UPI)](https://www.youtube.com/watch?v=QpLy0_c_RXk)
|
||
### Medium
|
||
- [Design WhatsApp](https://blog.algomaster.io/p/design-a-chat-application-like-whatsapp)
|
||
- [Design Spotify](https://blog.algomaster.io/p/design-spotify-system-design-interview)
|
||
- [Design Distributed Job Scheduler](https://blog.algomaster.io/p/design-a-distributed-job-scheduler)
|
||
- [Design a Scalable Notification Service](https://blog.algomaster.io/p/design-a-scalable-notification-service)
|
||
- [Design Instagram](https://www.youtube.com/watch?v=VJpfO6KdyWE)
|
||
- [Design Tinder](https://www.youtube.com/watch?v=tndzLznxq40)
|
||
- [Design Facebook](https://www.youtube.com/watch?v=9-hjBGxuiEs)
|
||
- [Design Twitter](https://www.youtube.com/watch?v=wYk0xPP_P_8)
|
||
- [Design Reddit](https://www.youtube.com/watch?v=KYExYE_9nIY)
|
||
- [Design Netflix](https://www.youtube.com/watch?v=psQzyFfsUGU)
|
||
- [Design Youtube](https://www.youtube.com/watch?v=jPKTo1iGQiE)
|
||
- [Design Google Search](https://www.youtube.com/watch?v=CeGtqouT8eA)
|
||
- [Design E-commerce Store like Amazon](https://www.youtube.com/watch?v=EpASu_1dUdE)
|
||
- [Design TikTok](https://www.youtube.com/watch?v=Z-0g_aJL5Fw)
|
||
- [Design Shopify](https://www.youtube.com/watch?v=lEL4F_0J3l8)
|
||
- [Design Airbnb](https://www.youtube.com/watch?v=YyOXt2MEkv4)
|
||
- [Design Autocomplete for Search Engines](https://www.youtube.com/watch?v=us0qySiUsGU)
|
||
- [Design Rate Limiter](https://www.youtube.com/watch?v=mhUQe4BKZXs)
|
||
- [Design Distributed Message Queue like Kafka](https://www.youtube.com/watch?v=iJLL-KPqBpM)
|
||
- [Design Flight Booking System](https://www.youtube.com/watch?v=qsGcfVGvFSs)
|
||
- [Design Online Code Editor](https://www.youtube.com/watch?v=07jkn4jUtso)
|
||
- [Design Stock Exchange System](https://www.youtube.com/watch?v=dUMWMZmMsVE)
|
||
- [Design an Analytics Platform (Metrics & Logging)](https://www.youtube.com/watch?v=kIcq1_pBQSY)
|
||
- [Design Payment System](https://www.youtube.com/watch?v=olfaBgJrUBI)
|
||
- [Design a Digital Wallet](https://www.youtube.com/watch?v=4ijjIUeq6hE)
|
||
### Hard
|
||
- [Design Location Based Service like Yelp](https://www.youtube.com/watch?v=M4lR_Va97cQ)
|
||
- [Design Uber](https://www.youtube.com/watch?v=umWABit-wbk)
|
||
- [Design Food Delivery App like Doordash](https://www.youtube.com/watch?v=iRhSAR3ldTw)
|
||
- [Design Google Docs](https://www.youtube.com/watch?v=2auwirNBvGg)
|
||
- [Design Google Maps](https://www.youtube.com/watch?v=jk3yvVfNvds)
|
||
- [Design Zoom](https://www.youtube.com/watch?v=G32ThJakeHk)
|
||
- [Design Distributed Counter](https://systemdesign.one/distributed-counter-system-design/)
|
||
- [Design File Sharing System like Dropbox](https://www.youtube.com/watch?v=U0xTu6E2CT8)
|
||
- [Design Ticket Booking System like BookMyShow](https://www.youtube.com/watch?v=lBAwJgoO3Ek)
|
||
- [Design Distributed Web Crawler](https://www.youtube.com/watch?v=BKZxZwUgL3Y)
|
||
- [Design Code Deployment System](https://www.youtube.com/watch?v=q0KGYwNbf-0)
|
||
- [Design Distributed Cloud Storage like S3](https://www.youtube.com/watch?v=UmWtcgC96X8)
|
||
- [Design Distributed Locking Service](https://www.youtube.com/watch?v=v7x75aN9liM)
|
||
- [Design Slack](https://systemdesign.one/slack-architecture/)
|
||
- [Design Live Comments](https://systemdesign.one/live-comment-system-design/)
|
||
|
||
## 📚 Books
|
||
- [Designing Data-Intensive Applications](https://www.amazon.in/dp/9352135245)
|
||
|
||
## 📩 Newsletters
|
||
- [AlgoMaster Newsletter](https://blog.algomaster.io/)
|
||
- [ByteByteGo Newsletter](https://blog.bytebytego.com?r=1drwaf)
|
||
|
||
## 📺 YouTube Channels
|
||
- [Tech Dummies Narendra L](https://www.youtube.com/@TechDummiesNarendraL)
|
||
- [Gaurav Sen](https://www.youtube.com/@gkcs)
|
||
- [codeKarle](https://www.youtube.com/@codeKarle)
|
||
- [ByteByteGo](https://www.youtube.com/@ByteByteGo)
|
||
- [System Design Interview](https://www.youtube.com/@SystemDesignInterview)
|
||
- [sudoCODE](https://www.youtube.com/@sudocode)
|
||
- [Success in Tech](https://www.youtube.com/@SuccessinTech/videos)
|
||
|
||
## 📜 Must-Read Engineering Articles
|
||
- [How Discord stores trillions of messages](https://discord.com/blog/how-discord-stores-trillions-of-messages)
|
||
- [Building In-Video Search at Netflix](https://netflixtechblog.com/building-in-video-search-936766f0017c)
|
||
- [How Canva scaled Media uploads from Zero to 50 Million per Day](https://www.canva.dev/blog/engineering/from-zero-to-50-million-uploads-per-day-scaling-media-at-canva/)
|
||
- [How Airbnb avoids double payments in a Distributed Payments System](https://medium.com/airbnb-engineering/avoiding-double-payments-in-a-distributed-payments-system-2981f6b070bb)
|
||
- [Stripe’s payments APIs - The first 10 years](https://stripe.com/blog/payment-api-design)
|
||
- [Real time messaging at Slack](https://slack.engineering/real-time-messaging/)
|
||
|
||
## 🗞️ Must-Read Distributed Systems Papers
|
||
- [Paxos: The Part-Time Parliament](https://lamport.azurewebsites.net/pubs/lamport-paxos.pdf)
|
||
- [MapReduce: Simplified Data Processing on Large Clusters](https://research.google.com/archive/mapreduce-osdi04.pdf)
|
||
- [The Google File System](https://static.googleusercontent.com/media/research.google.com/en//archive/gfs-sosp2003.pdf)
|
||
- [Dynamo: Amazon’s Highly Available Key-value Store](https://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf)
|
||
- [Kafka: a Distributed Messaging System for Log Processing](https://notes.stephenholiday.com/Kafka.pdf)
|
||
- [Spanner: Google’s Globally-Distributed Database](https://static.googleusercontent.com/media/research.google.com/en//archive/spanner-osdi2012.pdf)
|
||
- [Bigtable: A Distributed Storage System for Structured Data](https://static.googleusercontent.com/media/research.google.com/en//archive/bigtable-osdi06.pdf)
|
||
- [ZooKeeper: Wait-free coordination for Internet-scale systems](https://www.usenix.org/legacy/event/usenix10/tech/full_papers/Hunt.pdf)
|
||
- [The Log-Structured Merge-Tree (LSM-Tree)](https://www.cs.umb.edu/~poneil/lsmtree.pdf)
|
||
- [The Chubby lock service for loosely-coupled distributed systems](https://static.googleusercontent.com/media/research.google.com/en//archive/chubby-osdi06.pdf)
|