If you are working on data systems in an enterprise, you are likely to encounter several different types of people who work with data. The first type are backend engineers who…
- 02.01Operational Versus Analytical SystemsIf you are working on data systems in an enterprise, you are likely to encounter several different types of people who work with data. The first type are backend engineers who…
- 02.02Characterizing Transaction Processing and AnalyticsIn the early days of business data processing, a write to the database typically corresponded to a commercial transaction taking place: making a sale, placing an order with a…
- 02.03Data WarehousingAt first, the same databases were used for both transaction processing and analytical queries. SQL turned out to be quite flexible in this regard; it works well for both types…
- 02.04Systems of Record and Derived DataRelated to the distinction between operational and analytical systems, these notes also distinguishes between systems of record and derived data systems. These terms are useful…
- 02.05Cloud Versus Self-HostingWith anything that an organization needs to do, one of the first questions is whether it should be done in-house or outsourced. That is, should you build or should you buy?
- 02.06Pros and Cons of Cloud ServicesUsing a cloud service, rather than running comparable software yourself, essentially outsources the operation of that software to the cloud provider. There are good arguments…
- 02.07Cloud Native System ArchitectureBesides having a different economic model (subscribing to a service instead of buying hardware and licensing software to run on it), the rise of the cloud has also had a…
- 02.08Operations in the Cloud EraTraditionally, the people managing an organization’s server-side data infrastructure were known as database administrators (DBAs) or system administrators (sysadmins). More…
- 02.09Distributed Versus Single-Node SystemsA system that involves several machines communicating via a network is called a distributed system. Each of the processes participating in a distributed system is called a…
- 02.10Data Systems, Law, and SocietyAs you’ve seen in this topic, the architecture of data systems is influenced not only by technical goals and requirements, but also by the human needs of the organizations that…
- 02.11Recap: Trade-Offs in Data Systems ArchitectureThe theme of this topic has been to understand trade-offs—that is, to recognize that many questions do not have one right answer, but several possibilities that each have pros…