Contract type: | Freelancer |
Client: | Distribution system operator / Energy provider |
Task: | Implementation of ETL processes to transform PostgreSQL/PostGIS data into an ArangoDB, creation of tools (e.g. visualisation, validation and anonymisation) and dashboards with Python. |
Time period: | 07/2021 to 06/2022 |
Technologies: | Python, Pandas, Numpy, Matplotlib, Networkx, Plotly, Bokeh, SQL, PostgreSQL, PostGIS, Jupyter Lab, VS Code, DBeaver, Gitlab, Microsoft Azure Cloud |
For a distribution system operator / energy provider, I analysed geospatial and structured datasets within a PostgreSQL database. I also implemented ETL processes to transform, validate and store Postgres/PostGIS datasets into a graph database (ArangoDB).
Furthermore, I developed recursive CTE queries with SQL and a corresponding dashboard with Python, which is used to visualise and validate power grids by user input. I have also implemented tools for validating and anonymising mapping datasets with SQL and Python.
Finally, all results/tools were uploaded to an internal Gitlab-Repo and supplemented with corresponding readme files (Markdown). Organizationally, the coding was structured by a Scrum process.