|Client:||Distribution system operator / Energy provider|
|Task:||Implementation of ETL processes to transform PostgreSQL/PostGIS data into an ArangoDB, creation of tools (e.g. visualisation, validation and anonymisation) and dashboards with Python.|
|Time period:||07/2021 to 06/2022|
|Technologies:||Python, Pandas, Numpy, Matplotlib, Networkx, Plotly, Bokeh, SQL, PostgreSQL, PostGIS, Jupyter Lab, VS Code, DBeaver, Gitlab, Microsoft Azure Cloud|
For a distribution system operator / energy provider, I analysed geospatial and structured datasets within a PostgreSQL database. I also implemented ETL processes to transform, validate and store Postgres/PostGIS datasets into a graph database (ArangoDB).
Furthermore, I developed recursive CTE queries with SQL and a corresponding dashboard with Python, which is used to visualise and validate power grids by user input. I have also implemented tools for validating and anonymising mapping datasets with SQL and Python.
Finally, all results/tools were uploaded to an internal Gitlab-Repo and supplemented with corresponding readme files (Markdown). Organizationally, the coding was structured by a Scrum process.