An Automated Analytics Platform for a Company Serving Multiple Healthcare Providers
About the Client
The Client is a North American analytics company.
The Need for an Automated Data Analytics Platform
The Client provides analytics services to multiple healthcare providers, including the preparation of providers' diverse data for BI querying and reporting. In the past, the Client had to develop dedicated data-processing pipelines for each new provider. The company decided to build an analytics platform that would enable automated data preparation and delivery according to each provider's unique rules.
Building a Common Model for Disparate Data
INNERLUXES appointed a data analytics team consisting of a project manager, a business analyst, a solution architect, data engineers, and a DevOps engineer. To ensure HIPAA compliance, INNERLUXES signed a Business Associate Agreement (BAA) with the Client before the team gained access to any protected information.
The Client's IT team provided a high-level idea of the common data model that would form the basis for a centralized data management framework. The model needed to accommodate various data — such as patient care and treatment history, insurance- and pharmacy-related data, and more — in different file formats (for example, CSV, JSON, XML, ZIP).
INNERLUXES analyzed diverse data samples to identify the standard data fields and design universal data transformation rules for all healthcare providers. To optimize the process, the team worked with a limited number of files that reflected the diversity of the available formats and data structures. During data model creation, INNERLUXES held regular meetings with the Client to report progress, gather stakeholder feedback, and adjust the data model accordingly.
Healthcare Analytics Platform Development
The analytics platform supports the following elements:
- Data ingestion from the Client's databases and data lakes.
- Raw data storage. All files land in the raw data storage in their initial format and are enriched with metadata (for example, file owner and upload date).
- Data transformation. The data passes through ETL and ELT pipelines and lands in the staging area. During transformation, the data is validated, deduplicated, cross-checked, and otherwise adjusted to fit the common data model.
- Data aggregation in a data warehouse storing highly structured, cleaned data.
- Data integration. An external integration source stores data objects prepared according to each provider's requirements. The Client uses BI tools to query the data integration layer, prepare analytics reports, and deliver them to its customers.
- Event recording. The platform gathers and stores information about all performed actions (for example, data entry, transformation, and delivery).
- HIPAA-compliant data governance. The solution uses an identity and access management service to enable user authentication, authorization, and data access control for the Client's staff.
After the platform was ready, INNERLUXES held webinars and workshops with the Client's team to enable smooth user adoption.
An Automated Healthcare Analytics Platform With a Unified Data Model
The Client received a scalable, HIPAA-compliant data analytics platform that can be used to prepare BI reports for multiple healthcare providers. Since data extraction, cleansing, and warehousing are now automated and performed following a unified data model, the Client can significantly reduce the time spent preparing unique reports for each of its customers.
The Client also received exhaustive software documentation, including a data governance framework, a data strategy roadmap, and platform user guidelines.
Technologies and Tools
Azure.