Project: DMP module enrichment
Problem: The client had a strong expertise in online advertising and planned to extend their data integration providers pool to enrich their DMP. We were contracted to integrate multiple data providers and plug them into existing reporting and modeling infrastructure.
Solution: It was a challenge of building data pullers across different APIs and integrate the data into the existing client’s RTB/Advertising ecosystem smoothly. We developed infrastructure which allows our client to batch and stream data from providers and fork it into different intra-systems in a near real-time manner.
- Integrates with 10+ data providers
- Processes terabytes data monthly
- Scalable architecture
- Data usage reporting
Technological stack: J2SE, Servlet API, REST API, Apache Kafka, HDFS, Hadoop Hive, PostgreSQL.