Optimizing a Massive Consumer Data and Analytics Factory

Palomar Group has rebuilt and optimized data and analytics factories for leading performance marketing agencies.

Industry Sector

Performance Marketing

The Challenge

A leading performance marketing agency struggled to manage and optimize one of the largest U.S. consumer databases, leading to complex and slow Extract, Transform, Load (ETL) processes that hindered daily operations.

Palomar's Solution

Palomar augmented and led the client’s tech team, acting as the CIO Office. We streamlined complex ETL processes, onboarded new data sources, and rebuilt their entire data factory to achieve a remarkable 10x performance improvement. The solution integrated massive data sets, including daily store visit data (13 billion visits/month) and mobile ad IDs (750 million mobile devices).

Key Results

The new system manages massive daily data refreshes, including shopper visits from over 1 million locations. It delivers powerful self-service insights tools, new customer segmentations, and attribution models.

Technology Stack

Snowflake, AWS (S3, Glue, Redshift), Python, Amazon SageMaker, SQL.

Start Your Project!

[calendly type=4 url=https://calendar.app.google/9YCx57rwCftLtKnR615min_intro text="Book us now" button_color=#444444 text_color=#000000 branding=false hide_details=false style_class=custom_form_style]