03 / Data Platform
Customer Data Platform
A unified customer data platform combining HBase, Elasticsearch and Spark to merge identities and ad-spend telemetry at scale.
- Client
- VCCorp
- Role
- Data Engineer
- Year
- 2022
- Category
- Data Platform
[ The project ]
Designed HBase and Elasticsearch schemas to store and query enriched user profiles across multiple product surfaces.
Built Spring Boot APIs and a Kafka-backed queue to expose user data to downstream consumers in near real-time.
Wrote Scala Spark jobs that performed mass identity merging, deduplication and aggregations across billions of rows.
Integrated the Google Ads and Facebook Ads APIs to sync daily campaign statistics into the platform.