Data planning & storage
1 – Integration of data sources
The data that builds-up our dashboard comes from different data sources. Therefore, the TMaaS team built integrators, taking into account the specifications of the individual sources. The integration of different data is very relevant as it facilitates the understanding of information coming from different data sources.
The data platform also needs to be well organised. Consequently, the data gathering and structure is flexible and data-sources can be added, removed or even modified when necessary.
2 – Normalisation and storage
Data from different systems and sources come together in the data platform. The data we use are transformed into EU/pragmatic standards used in the market, in order to ensure data interoperability.
In the platform, data are cleaned, harmonized and made consistent with each other. Data are brought together to a unique temporal and spatial framework and normalised.
The data will be stored so it can at least be real-time compared to the preferences of users and be displayed in real-time dashboards. The storage will also include user feedback, linked to the initial events or values that triggered the feedback.
