Case Study

Building a Data Pipeline & BI Dashboard for a Non-Profit Organisation

EdTech
Industry
Non-Profit - Education & Skills Training (Social Impact / EdTech)
Services
Business Intelligence, Data Analytics, Architecture Design, Backend Development, Frontend Development, Quality Assurance
Company Size & Location
Mission-Driven Non-Profit Organisation & India
Technology Stack
Talend · MySQL · Apache Superset · Firebase / BigQuery
Team
Data Architect · Backend / ETL Engineer · BI Developer · QA Engineer
Timeline
Phased Engagement
01

Client Vision

The Quality Education and Skills Training (QUEST) Alliance is a not-for-profit organisation focused on research-led innovation and advocacy in teaching and learning, helping young learners and facilitators build real-world, 21st-century skills through modern technology. Engaging multiple stakeholders to enable scalable solutions in education and vocational training using Information and Communication Technology (ICT), QUEST wanted a well-structured analytics system capable of handling large volumes of data built, by preference, on open-source tools that a lean non-profit could sustainably afford. They also needed a future-proof, multi-organisation architecture that could accommodate changes to existing applications, absorb new ones, and mirror their wider organisational structure as they scaled their reach.

02

Challenge

QUEST had already attempted reporting and dashboards across several commercial tools including Zoho Reports, Tableau, and Power BI - but none delivered the expected results. Without an integrated workflow or data pipeline behind them, the tools left data fragmented, and the team needed the underlying foundation fixed before any reporting layer could succeed.

Data Trapped in Silos  

Reporting had been tried across multiple tools, but with no integrated workflow or data pipeline the data remained fragmented and siloed - a significant obstacle for the team.

Poor-Performing, Direct-Query Reporting  

The existing Power BI implementation was rudimentary, consuming database views directly, which resulted in consistently poor performance.

Not Designed for Scale  

Dashboards were not designed properly and the system as a whole was never built to handle scale; a non-modular approach further slowed performance.

High-Volume Mobile Data Logs  

Loading the large, unstructured data logs streaming from mobile devices was a major technical challenge the existing setup could not handle.

03

Solution

Focaloid designed and implemented an integrated, open-source data pipeline and BI layer replacing direct database queries with a warehouse-backed, modular architecture built to scale with the organisation.

Warehouse + ETL Pipeline

Introduced a data warehouse and an ETL tool to aggregate data from QUEST’s various sources and applications into a single, integrated pipeline.

Open-Source BI Stack  

Researched and introduced open-source tools without compromising performance or usability, aligning with the non-profit’s preference for a cost-effective, sustainable solution.

Layered, Scalable Architecture  

Proposed a layered architecture that is scalable, more efficient, and easily maintainable replacing the non-modular, direct-query setup that had been throttling performance.

Multi-Organisation Data Modeling  

Mapped data to different use cases and defined ETL flows that support multiple organisations, in line with QUEST’s multi-company structure.

04

Our Approach

Focaloid began with stakeholder discovery and a review of the existing system, then built and rolled out the solution in four structured phases.

Phase 1: Discovery & Requirements  

Held discussions with business stakeholders to understand their needs and translate them into concrete data requirements.

Phase 2: Architecture Review & Tool Evaluation  

Reviewed the existing implementation to surface bottlenecks, then evaluated open-source BI tools — running proof-of-concept builds on Metabase and Apache Superset, and selecting Superset for its fit and the data team’s familiarity with it.

Phase 3: Pipeline & Warehouse Build  

Implemented the solution using Talend as the ETL layer, MySQL as the data warehouse, and Superset as the BI layer — integrating multiple data sources and embedding custom business logic into the ETL layer.

Phase 4: Dashboards, Testing & QA  

Built reports and dashboards in Apache Superset and validated the full pipeline end to end through testing and QA.

05

Result / Impact

For the Client

  • ~70% faster dashboard and query performance after replacing direct database-view queries with a warehouse-backed model (estimated)
  • 100% open-source BI stack, eliminating commercial reporting-tool licensing costs
  • Unified data pipeline consolidating previously siloed sources into a single data warehouse
  • Multi-organisation architecture supporting QUEST’s full organisational structure

For the Data & Analytics Team

  • ~60% reduction in manual reporting effort through automated ETL pipelines (estimated)
  • Scalable handling of large, unstructured mobile-device data logs that the prior setup could not load
  • Modular maintainable architecture replacing the previous non-modular approach
  • Self-serve reports and dashboards delivered through Apache Superset

For the Mission & Beneficiaries

  • Reliable, data-driven visibility into learning and skilling programs across the organisation
  • A future-proof analytics foundation able to absorb new applications and growing data volumes
  • More of a lean non-profit’s resources directed to its mission rather than reporting-tool licences

06

Why It Matters

For a non-profit working to equip young learners with real-world skills, data is how impact gets measured - but only if the team can actually see it. Scattered tools and siloed data meant QUEST’s reporting told a fragmented story, slowly. By rebuilding the foundation - a warehouse-backed, open-source pipeline feeding well-designed Superset dashboards - Focaloid turned fragmented data into reliable, scalable intelligence the organisation can sustain on a non-profit budget. That’s data infrastructure working in service of the mission, not competing with it for funds.

Let's build

Struggling with siloed data and dashboards that don’t scale?

We design integrated, open-source data pipelines and BI platforms - warehouse-backed, modular, and built to grow with your organisation, so your reporting becomes a reliable foundation rather than a bottleneck.