Creation of data products within the Data Mesh organization.
● Created ELT flux: integrated new data sources in Data Warehouse
● GCP services: Cloud Storage (Data Lake), BigQuery (Data Warehouse)
● Analytics engineering : Building models with DB
● Code versioning : CI/CD, pair programming, PR reviewing
CDI
Designing and implementing a BI platform.
● Created ELT flux: integrated new data sources in Data Warehouse and
created new KPIs (Python, Airflow, BigQuery and Tableau)
● GCP services: Cloud Storage (Data Lake), BigQuery (Data Warehouse)
● Dashboarding : Creating dashboard for all departments
● Data Platform Supervision : Monitoring and smart alerting
● Analysis AD-Hoc : Provide several analysis for all department
Administration of a BI platform.
● Created ELT flux: integrated new data sources in Data Warehouse and
created new KPIs (Python, Airflow, BigQuery and Tableau)
● GCP services: Cloud Storage (Data Lake), BigQuery (Data Warehouse)
Compute Engine, Kubernetes Engine
● DevOps: created Docker images for BI team, used Airflow Helm chart for
Dev environment
● Data load monitoring to detect anomalies: StatsD, Telegraf, InfluxDB,
Grafana, Kapacitor
● Code versioning with GitHub: Agile PR with Jira ticketing, code review
● Engineering Productivity: BI team tasks automation with shell scripts and
Alfred features and workflows
Administration of a Data Science platform.
Implementation of a monitoring solution for a Big Data platform