The Secret Serverless Computing Service in Azure

Lessons learned from designing a cost-effective containerized data processing solution on Azure

As a small team of data engineers and data scientists, we often work on projects that involve designing and implementing data processing solutions for various customers. Recently, we had an interesting challenge: one of our customers had developed an optimisation algorithm that they wanted to run on a container-based platform in the cloud. The algorithm was designed to solve a complex optimisation problem that required some …

algorithm azure challenge computing cost customers data databricks data engineering data engineers data processing data scientists engineers hands-on-tutorials lessons learned optimisation processing projects scientists secret serverless serverless computing service small solution solutions team work