▷LESSON VIDEOOverview: ScalabilityVideo coming soon. Start with the reading below.COMING SOON
- 04.01Overview: Scalability▷LESSON VIDEOOverview: ScalabilityVideo coming soon. Start with the reading below.COMING SOON
- 04.02HTTP caching▷LESSON VIDEOHTTP cachingVideo coming soon. Start with the reading below.COMING SOON
- 04.03Content delivery networks▷LESSON VIDEOContent delivery networksVideo coming soon. Start with the reading below.COMING SOON
- 04.04Partitioning▷LESSON VIDEOPartitioningVideo coming soon. Start with the reading below.COMING SOON
- 04.05File storage▷LESSON VIDEOFile storageVideo coming soon. Start with the reading below.COMING SOON
- 04.06Network load balancing▷LESSON VIDEONetwork load balancingVideo coming soon. Start with the reading below.COMING SOON
- 04.07Data storage▷LESSON VIDEOData storageVideo coming soon. Start with the reading below.COMING SOON
- 04.08Caching▷LESSON VIDEOCachingVideo coming soon. Start with the reading below.COMING SOON
- 04.09Microservices▷LESSON VIDEOMicroservicesVideo coming soon. Start with the reading below.COMING SOON
- 04.10Control planes and data planes▷LESSON VIDEOControl planes and data planesVideo coming soon. Start with the reading below.COMING SOON
- 04.11Messaging▷LESSON VIDEOMessagingVideo coming soon. Start with the reading below.COMING SOON
References
Overview: Scalability
- “Amazon Route 53,” https://aws.amazon.com/route53/
HTTP caching
- This is an example of the replication pattern in action.
- “HTTP caching,” https://developer.mozilla.org/en-US/docs/Web/HTTP/Caching
- “CQRS,” https://martinfowler.com/bliki/CQRS.html
- This is another instance of functional decomposition.
- “NGINX,” https://www.nginx.com/
- “HAProxy,” https://www.haproxy.com/
Content delivery networks
- “Amazon CloudFront,” https://aws.amazon.com/cloudfront/
- “Akamai,” https://www.akamai.com/
- “The Akamai Network: A Platform for HighPerformance Internet Applications,” https://groups.cs.umass.edu/ramesh/wp-content/uploads/sites/3/2019/12/The-akamai-network-a-platform-for-high-performance-internet-applications.pdf
- “Load Balancing at the Frontend,” https://landing.google.com/sre/sre-book/chapters/load-balancing-frontend/
- “Denial-of-service attack,” https://en.wikipedia.org/wiki/Denial-of-service_attack
- A cache hit occurs when the requested data can be found in the cache, while a cache miss occurs when it cannot.
Partitioning
- “Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web,” https://www.cs.princeton.edu/courses/archive/fall09/cos518/papers/chash.pdf
File storage
- “Amazon Simple Storage Service,” https://aws.amazon.com/s3/
- “Azure Blob Storage,” https://azure.microsoft.com/en-us/services/storage/blobs/#overview
- “Windows Azure Storage: A Highly Available Cloud Storage Service with Strong Consistency,” https://sigops.org/s/conferences/sosp/2011/current/2011-Cascais/printable/11-calder.pdf
- we discussed chain replication in Chain replication in Replication
- “Diving Deep on S3 Consistency,” https://www.allthingsdistributed.com/2021/04/s3-strong-consistency.html
Network load balancing
- “AWS Well-Architected Framework, Availability,” https://docs.aws.amazon.com/wellarchitected/latest/reliability-pillar/availability.html
- Another way to think about it is that by increasing the number of servers linearly, we increase the availability exponentially.
- “The power of two random choices,” https://brooker.co.za/blog/2012/01/17/two-random.html
- “Autoscaling,” https://docs.microsoft.com/en-us/azure/architecture/best-practices/auto-scaling
- “Implementing health checks,” https://aws.amazon.com/builders-library/implementing-health-checks/
- “Round-robin DNS,” https://en.wikipedia.org/wiki/Round-robin_DNS
- layer 4 is the transport layer in the OSI model
- “SREcon19 Americas - Keeping the Balance: Internet-Scale Loadbalancing Demystified,” https://www.youtube.com/watch?v=woaGu3kJ-xk
- “Network address translation,” https://en.wikipedia.org/wiki/Network_address_translation
- “Introduction to modern network load balancing and proxying,” https://blog.envoyproxy.io/introduction-to-modern-network-load-balancing-and-proxying-a57f6ff80236
- “Anycast,” https://en.wikipedia.org/wiki/Anycast
- “Equal-cost multi-path routing,” https://en.wikipedia.org/wiki/Equal-cost_multi-path_routing
- “Network Load Balancer,” https://aws.amazon.com/elasticloadbalancing/network-load-balancer/
- “Azure Load Balancer,” https://azure.microsoft.com/en-us/services/load-balancer/
- layer 7 is the application layer in the OSI model
- A SYN flood is a form of denial-of-service attack in which an attacker rapidly initiates a TCP connection to a server without finalizing the connection.
- “Service mesh data plane vs. control plane,” https://blog.envoyproxy.io/service-mesh-data-plane-vs-control-plane-2774e720f7fc
- “Service Mesh Wars, Goodbye Istio,” https://blog.polymatic.systems/service-mesh-wars-goodbye-istio-b047d9e533c7
Data storage
- “PostgreSQL Server Configuration, Replication,” https://www.postgresql.org/docs/14/runtime-config-replication.html
- “Amazon RDS Read Replicas,” https://aws.amazon.com/rds/features/read-replicas/
- “Multi-AZ deployments for high availability,” https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Concepts.MultiAZ.html
- That said, reducing storage costs isn’t the only benefit of normalization: it also helps maintain data integrity. If a piece of data is duplicated in multiple places, then to update it, we have to make sure it gets updated everywhere. In contrast, if the data is normalized, we only need to update it in one place.
- “Bigtable: A Distributed Storage System for Structured Data,” https://static.googleusercontent.com/media/research.google.com/en//archive/bigtable-osdi06.pdf
- we talked about Dynamo in Dynamo-style data stores in Coordination avoidance
- “AWS re:Invent 2018: Amazon DynamoDB Deep Dive: Advanced Design Patterns for DynamoDB (DAT401),” https://www.youtube.com/watch?v=HaEPXoXVf2k
- On the other hand, while we certainly can find ways to scale a relational database, what works on day 1 might not work on day 10 or 100.
- “Amazon DynamoDB,” https://aws.amazon.com/dynamodb/
- “AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321),” https://www.youtube.com/watch?v=yvBR71D0nAQ
- “The DynamoDB Book,” https://www.dynamodbbook.com/
- “Andy Pavlo — The official ten-year retrospective of NewSQL databases,” https://www.youtube.com/watch?v=LwkS82zs65g
- “NewSQL database systems are failing to guarantee consistency, and I blame Spanner,” https://dbmsmusings.blogspot.com/2018/09/newsql-database-systems-are-failing-to.html
- “CockroachDB,” https://github.com/cockroachdb/cockroach 15we talked about Spanner in NewSQL in Transactions
Caching
- “Cache coherence,” https://en.wikipedia.org/wiki/Cache_coherence
- “RocksDB,” http://rocksdb.org/
- “Redis,” https://redis.io/
- “Memcached,” https://memcached.org/
- “Redis cluster tutorial,” https://redis.io/topics/cluster-tutorial
Microservices
- “The Mythical Man-Month,” https://en.wikipedia.org/wiki/The_Mythical_Man-Month
- A more appropriate name for the microservices architecture is service-oriented architecture, but unfortunately, that name comes with some baggage as well.
- This idea is described well in John Ousterhout’s A Philosophy of Software Design, which I highly recommend.
- “MicroservicePremium,” https://martinfowler.com/bliki/MicroservicePremium.html
- “GraphQL,” https://graphql.org/
- “Introduction to JSON Web Tokens,” https://jwt.io/introduction
- “Microservices Security in Action,” https://www.manning.com/books/microservices-security-in-action
- “Azure API Management,” https://azure.microsoft.com/en-gb/services/api-management/
- “Amazon API Gateway,” https://aws.amazon.com/api-gateway/
Control planes and data planes
- “Control Planes vs Data Planes,” https://brooker.co.za/blog/2019/03/17/control.html
- “Avoiding overload in distributed systems by putting the smaller service in control,” https://aws.amazon.com/builders-library/avoiding-overload-in-distributed-systems-by-putting-the-smaller-service-in-control/
- This is another example of the CQRS pattern applied in practice.
- That said, there is still the potential to overload the control plane if it needs to juggle too many connections.
- “AWS re:Invent 2018: Close Loops & Opening Minds: How to Take Control of Systems, Big & Small ARC337,” https://www.youtube.com/watch?v=O8xLxNje30M
- That said, having a closed loop doesn’t guarantee that either, it’s merely a pre-requisite.
- “Designing Distributed Control Systems,” https://www.amazon.com/gp/product/1118694155
Messaging
- “Amazon Simple Queue Service,” https://aws.amazon.com/sqs/
- “Amazon SQS Standard queues,” https://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSDeveloperGuide/standard-queues.html
- This is also referred to as the competing consumer pattern, which is implemented using leader election.
- “Advanced Message Queuing Protocol,” https://en.wikipedia.org/wiki/Advanced_Message_Queuing_Protocol
- “Azure Queue Storage,” https://azure.microsoft.com/en-us/services/storage/queues/
- “You Cannot Have Exactly-Once Delivery Redux,” https://bravenewgeek.com/you-cannot-have-exactly-once-delivery-redux/
- As we will discuss in Maintainability (module 6), maintaining a service is no small feat.