Figure 1. Schematic overview of the data pipeline. Raw data are acquired from various sources and ingested (in batches from files, via streaming of cloud databases) into the data pipeline where it undergoes systematic processing (such as noise cleaning) to prepare it for analysis (machine learning, statistical modelling, signal analytics, dashboarding). This is a simplified overview; there may be more details to the data pipeline (eg, aggregation of preprocessed data) or feedback loops (eg, following analysis, preprocessing is enhanced).