July 26, 2023, 8 a.m. | Rafal Gancarz

InfoQ - AI, ML & Data Engineering www.infoq.com

Pfizer upgraded the serverless architecture for processing digital biomarker data at scale to make it more flexible and configurable. They created a framework that uses a file processing pipeline built with AWS Step Functions and other serverless services, as well as a custom Python package for data ingestion and processing.

By Rafal Gancarz

ai architecture architecture & design aws aws lambda aws step functions batch processing biotech case study data data analysis data ingestion data pipelines development digital docker dynamo db framework functions ml & data engineering package pfizer pipeline processing python s3 scale science serverless services

More from www.infoq.com / InfoQ - AI, ML & Data Engineering

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Consultant Senior Power BI & Azure - CDI - H/F

@ Talan | Lyon, France