Data Engineer

Open to full-time

Bio

Sadiq U is a proficient Data Engineer with extensive experience in designing and implementing robust data solutions within the education sector. At the Universal Basic Education Commission, he has excelled in developing ETL pipelines using AWS Glue and Apache Airflow, achieving a significant reduction in data processing times while handling over a million records daily. Sadiq has architected optimized data models in PostgreSQL, enhancing query performance and supporting real-time analytics for executive decision-making. His technical repertoire includes Python, SQL, Apache Spark, and various data warehousing technologies such as Snowflake and Amazon Redshift. Additionally, Sadiq has contributed to the development of MediBook, a hospital appointment management system, where he implemented domain-driven design principles and integrated services using Spring Boot and React. His work ensures high data accuracy and availability through automated quality checks and real-time monitoring, leveraging tools like Docker, Kubernetes, and CI/CD practices. With a BSc in Software Engineering from Cyprus International University, Sadiq combines strong technical skills with a strategic approach to data architecture and system integration.

Video Intro

Assessments

General Coding and Video Assessment

Great score on Find Indices of Two Numbers That Add Up to Target, Difficulty Easy · Great score on Design a Scalable and Compliant SaaS Platform Architecture, Difficulty Medium · Great score on Enhance Kubernetes Security on GCP, Difficulty Easy

Projects

Medibook

MediBook is a hospital appointment management system designed to be operated by a regional hospital network. It enables patients to register, search for doctors by clinical specialisation, view real-time availability, and book or cancel appointments. Doctors use the same platform to manage their daily schedule, mark consultations as completed or cancelled, and record clinical notes. Administrators oversee the network: they onboard doctors, organise departments, monitor appointment activity by department, and produce daily capacity reports. The system is built on a layered Spring Boot 3 backend backed by PostgreSQL, with React powering the user interface. Domain events — specifically appointment booking and cancellation are published to Apache Kafka and consumed asynchronously to produce notifications. Authentication uses JSON Web Tokens; authorisation is role-based with three roles: PATIENT, DOCTOR, and ADMIN/

Experience

Data Engineer
Universal Basic Education Commission· EdTechJan 2025 — Present
- Designed and implemented ETL pipelines using AWS Glue and Apache Airflow, reducing data processing time by 40% and reliably handling 1M+ records daily across education funding datasets.
- Architected optimized Star Schema data models in PostgreSQL with partitioning and indexing strategies, reducing query latency by 30% and providing executive leadership with real-time funding analytics.
- Implemented automated data quality checks, validation rules, and pipeline monitoring (CloudWatch + Airflow alerting), ensuring accuracy of disbursement, budget utilization, and state-level compliance metrics consumed by 20+ senior decision-makers via an internal analytics dashboard.
PythonSQLApache SparkApache AirflowApache KafkadbtPostgreSQLSnowflakeAmazon RedshiftGoogle BigQueryAmazon S3AWS GlueDockerKubernetesGit & CI/CDData Modeling (Snowflake Schema)ETL/ELTBatch ProcessingStream ProcessingData WarehousingData LakesCloud Platforms (GCP)