Skip to content
NewNeenOpal Earns ISO 42001 Certification for AI GovernanceKnow More

Unified Cross-Platform Intelligence Across 20+ Data Sources

Talk to a Data Expert

Talk to our team

Tell us what you’re working on. A senior consultant will follow up with next steps.

Overview

A leading dental industry media company partnered with NeenOpal to build a centralized marketing intelligence infrastructure from the ground up. With audience data, campaign performance, CRM activity, webinar engagement, and learning platform metrics scattered across more than a dozen disconnected systems, the client lacked a unified view of marketing performance and customer engagement. NeenOpal designed and delivered a fully automated, cloud-native data platform that ingests data from 20+ marketing, CRM, and engagement platforms into Google BigQuery enabling reliable, weekly-refreshed reporting and cross-platform analytics from a single source of truth.

20+
Disconnected Platforms Unified into a Centralized Intelligence Layer
100%
Weekly Pipeline Automation Coverage Across Integrated Platforms

Customer Challenges

The client operated across a wide range of marketing and CRM platforms, each generating valuable data in isolation. Without a unified data layer, cross-platform analysis was impossible, and reporting relied heavily on manual exports and disconnected spreadsheets.

  • Fragmented Data Across 20+ Platforms

    Campaign performance, CRM records, email engagement, webinar registrations, LMS completions, and form submissions lived across separate platforms including Facebook Ads, HubSpot, Mailchimp, Dotdigital, Zoom, YouTube, Google Ads, LinkedIn, Jotform, SurveyMonkey, SendGrid, and a Moodle-based LMS - making unified reporting and attribution extremely difficult.

  • No Centralized Reporting Infrastructure

    The client had no centralized warehouse, no ETL pipelines, and no staging architecture. Every report required manual effort, and cross-platform metrics could not be reliably combined or compared.

  • API Complexity and Platform Limitations

    Each platform exposed data differently, some through native connectors, others through undocumented or inconsistent HTTP APIs. Several platforms introduced additional complexity through API limits, OAuth issues, and unreliable pagination behavior.

  • CRM Scale and Data Integrity

    The HubSpot environment contained over hundreds of thousands of activity records across calls, emails, meetings, tasks, notes, and SMS requiring carefully designed backfills, date-range splits, and deduplication logic to ensure accurate ingestion at scale.

  • Nested LMS API Workloads

    The Moodle-based LMS required deeply nested API execution patterns (courses → enrolled users → completion status per user). This workload exceeded practical limits of low-code orchestration alone and required a cloud-native compute approach.

Unified Marketing Intelligence Platform Infrastructure

A cloud-native pipeline that pulls data from 20+ disconnected platforms into one weekly-refreshed BigQuery warehouse for cross-platform reporting.

Solutions

NeenOpal designed a layered, cloud-native marketing intelligence architecture using Make.com for orchestration, Google Cloud Run for complex workloads, and Google BigQuery as the centralized warehouse with a consistent raw → staging → mart architecture applied across all platforms.

  1. Make.com Orchestration Across 20+ Platforms

    For the majority of platforms, NeenOpal implemented Make.com scenarios using native and HTTP modules to orchestrate automated weekly ingestion. Raw JSON payloads are stored directly in BigQuery, while staging views handle parsing, type casting, deduplication, and business transformations.

  2. Cloud Run for Complex Nested APIs

    For the LMS integration, NeenOpal implemented a Python-based Google Cloud Run service to manage nested API execution, pagination, progressive inserts, BigQuery deduplication checks, and timeout handling. This eliminated excessive Make.com credit consumption while maintaining scalability and reliability.

  3. HubSpot CRM

    NeenOpal built end-to-end ingestion pipelines across all major HubSpot objects including Contacts, Companies, Deals, Calls, Emails, Meetings, Tasks, Notes, and SMS along with association tables linking CRM entities together for downstream analytics.

  4. SCD Type 2 for Deal Stage Tracking

    To preserve historical CRM state changes, NeenOpal implemented Slowly Changing Dimension Type 2 (SCD2) logic for deal stage tracking. This maintained a complete audit history of every deal movement using valid_from, valid_to, and is_current logic.

  5. Consistent Raw → Staging → Mart Architecture

    Every platform follows the same three-layer design: Raw tables retain immutable JSON payloads Staging views standardize, deduplicate, and transform source data Mart views combine platforms into reporting-ready business datasets

  6. Platform-Specific Engineering Solutions

    Several complex engineering challenges had to be addressed across the platform ecosystem, including: HubSpot 10k record API limitations Zoom Events broken pagination behavior YouTube Analytics OAuth account mismatches Deeply nested Moodle LMS API execution patterns LinkedIn Ads native analytics limitations Multi-account Google Ads ingestion complexity Inconsistent JSON payload structures across platforms

Services

  • Google BigQuery
  • HubSpot
  • Google Analytics 4

Benefits

  • Unified marketing intelligence across 20+ platforms

    Consolidated data from more than 20 marketing, CRM, webinar, and engagement platforms into a single source of truth. This enabled teams to analyze performance and customer interactions holistically instead of working with isolated datasets.

  • Fully automated reporting workflows

    Eliminated manual exports and repetitive reporting activities through automated ingestion and transformation pipelines. Weekly data refreshes ensured stakeholders always had access to timely and reliable insights.

  • Centralized BigQuery Warehouse Replacing Fragmented Spreadsheets

    Replaced scattered spreadsheets and disconnected reports with a centralized Google BigQuery warehouse. This provided a scalable foundation for consistent data management and simplified access to business metrics.

  • Scalable Raw → Staging → Mart Architecture for Reliable Analytics

    Implemented a structured multi-layer architecture that separates raw ingestion, transformations, and reporting datasets. This improved data quality, maintainability, and ensured analytics remained reliable as data volumes grew.

  • Complete CRM History with SCD Type 2 Deal Tracking

    Introduced SCD Type 2 logic to preserve every change in deal stages and maintain a full historical record. This enabled accurate trend analysis and complete visibility into the customer lifecycle.

  • Cross-Platform Attribution and Engagement Visibility

    Connected campaign, CRM, webinar, email, and learning platform data to provide end-to-end visibility into customer engagement. Teams could better understand how interactions across channels contributed to marketing outcomes.

  • Foundation Established for Future Expansion and Advanced Analytics

    Built a cloud-native and extensible data platform capable of supporting additional integrations and evolving business requirements. The architecture provides a strong foundation for advanced analytics, attribution models, and AI-driven insights.

Conclusion

With NeenOpal’s support, the client successfully transformed a fragmented, manual reporting ecosystem into a centralized, automated marketing intelligence platform. By combining Make.com orchestration, Google Cloud Run, and BigQuery into a unified architecture, NeenOpal delivered a scalable, production-grade analytics foundation that enables reliable cross-platform reporting and data-driven marketing decisions.

Authors

  • Urwah FarooqiData Analystin
  • Hashim IlyasSEO Specialistin

Case studies

Related case studies