How to move your ML system from local to production - 2024-03-15

•

0 gostou•4 visualizações

Incontro DevOps Italia 2024 When a Cloud Engineer has to do a review the code of its colleague Data Scientist for production environment, it is always important to understand where it is best to put the focus. Often, the best approach is to promote the resources awareness to be used and to find a framework to split the work together. https://2024.incontrodevops.it/talks_speakers/

Dados e análise

DevOps & MLOps - IDI 2024
Come portare in
produzione un sistema di
ML che ora gira solo nel
locale del nostro data
scientist ?

DevOps & MLOps - IDI 2024
Alessandra Bilardi
Data & Automation Specialist @ Corley Cloud
alessandra.bilardi@corley.it
corley.it

DevOps & MLOps - IDI 2024
SUMMARY
DevOps methods & actors
MLOps methods & actors
Use case
AWS services
What we take home

DevOps & MLOps - IDI 2024
DevOps methods & actors

DevOps & MLOps - IDI 2024
MLOps methods & actors

DevOps & MLOps - IDI 2024
ML system & actors

DevOps & MLOps - IDI 2024
AWS Step Functions

DevOps & MLOps - IDI 2024
AWS Step Functions
https://github.com/aws/aws-step-functions-data-science-sdk-python

DevOps & MLOps - IDI 2024
Amazon SageMaker Pipeline

DevOps & MLOps - IDI 2024
Amazon SageMaker Pipeline
https://github.com/aws/amazon-sagemaker-examples/tree/main/sagemaker-pipeline-parameterization

DevOps & MLOps - IDI 2024
What we take home

DevOps & MLOps - IDI 2024
Data Scientist & Cloud Engineer
1
How to survive with colleagues with diﬀerent skills, without hindering the table football
game during the lunch break.
2 Versioning of conﬁguration,
training and inference data
statistics, models, ..
3
Deﬁne tools and services:
libraries, images, storages, ..
4 Deﬁne guidelines for who does
what: review, support,
deploying the model, ..
Promoting resources
awareness to be used

DevOps & MLOps - IDI 2024
Step Functions vs SageMaker Pipeline

DevOps & MLOps - IDI 2024
AWS services
Which AWS services for which role, when we want to automate a solution from local to
production: depends on the life cycle of the model but above all by the actors involved.
Data Scientists (DS) Cloud Engineer (CE) DS AWS Services CE AWS Services
many one AWS Step Functions AWS CloudFormation
one many Amazon SageMaker
Pipeline
AWS CloudFormation
& Step Functions

DevOps & MLOps - IDI 2024
AWS services
Which AWS services for which model, when we have a small model, we can also use
something like AWS Lambda, but when we need GPU, we must to use an Endpoint.
AWS Service Provisioning type Resources Cost per hour
Endpoint Provisioned 2 CPU + 4GB RAM $0.056
Endpoint Serverless 4096MB $0.288
AWS Lambda Serverless 4096MB $0.00024012 +GBsec

DevOps & MLOps - IDI 2024
Thanks
for listening!

Mais conteúdo relacionado

Semelhante a How to move your ML system from local to production - 2024-03-15

Introducing power bi in your company - andrea martorana tusaAndrea Martorana Tusa

App Development Evolution: What has changed? Paula Peña (She, Her, Hers)

CGI-IgniteChicagoMNaveedAnjum1

The App Evolution Dev_Events

Launching your Application the Amazon Way - AWS Startup Day Boston 2018.pdfAmazon Web Services

The Future of Integration | Webinar of the 24th of April 2020Codit

Using PaaS to run APIs and Microservices in ProductionApigee | Google Cloud

Neo4j_Anurag Tandon_Product Vision and Roadmap.Benelux.pptx.pdfNeo4j

AWS Enterprise Summit London 2015 | Adobe Creative Cloud and AWSAmazon Web Services

C sharp annual conference 15-apr-18 - delhiAlbert Anthony

3 Steps to Accelerate to CloudRightScale

Making the move from iaa s to iaas+Chip Childers

DevOps on AWS: Accelerating Software Delivery with AWS Developer Tools | AWS ...Amazon Web Services

The Need for SpeedCapgemini

WSO2Con EU 2016: Planning Your Cloud StrategyWSO2

EWUG 2018 February the journey continues.....Peter Selch Dahl

Serverless Computing no Microsoft AzureIgor Abade

Feature Store as a Data Foundation for Machine LearningProvectus

The Big Connection: Integrating Cloud with Enterprise SystemsInside Analysis

The Future of DevOps.pdfPetaBytz Technologies

Semelhante a How to move your ML system from local to production - 2024-03-15 (20)

Introducing power bi in your company - andrea martorana tusa

App Development Evolution: What has changed?

CGI-IgniteChicago

The App Evolution

Launching your Application the Amazon Way - AWS Startup Day Boston 2018.pdf

The Future of Integration | Webinar of the 24th of April 2020

Using PaaS to run APIs and Microservices in Production

Neo4j_Anurag Tandon_Product Vision and Roadmap.Benelux.pptx.pdf

AWS Enterprise Summit London 2015 | Adobe Creative Cloud and AWS

C sharp annual conference 15-apr-18 - delhi

3 Steps to Accelerate to Cloud

Making the move from iaa s to iaas+

DevOps on AWS: Accelerating Software Delivery with AWS Developer Tools | AWS ...

The Need for Speed

WSO2Con EU 2016: Planning Your Cloud Strategy

EWUG 2018 February the journey continues.....

Serverless Computing no Microsoft Azure

Feature Store as a Data Foundation for Machine Learning

The Big Connection: Integrating Cloud with Enterprise Systems

The Future of DevOps.pdf

Mais de Alessandra Bilardi

Overview of the OpenCV library and some use cases - 2024-04-19Alessandra Bilardi

Overview of the Kaggle platform and its competitionsAlessandra Bilardi

Forecasting in AWS - 2024-02-01Alessandra Bilardi

From your laptop to all resource that you need - 2023-12-09Alessandra Bilardi

Parallelize data processing - 2023-10-24Alessandra Bilardi

The Fourier transformation - 2023-07-23Alessandra Bilardi

Anomaly Detection and IP Insights - 2023-06-10Alessandra Bilardi

Forecasting in AWS - 2023-05-16Alessandra Bilardi

Natural conversation - 2023-05-06Alessandra Bilardi

Classification - 2023-03-25Alessandra Bilardi

Data transformation on AWS - 2022-10-11Alessandra Bilardi

Anomaly Detection Overview - 2022-05-26Alessandra Bilardi

Automation: from local test to production deploy - 2020-11-05Alessandra Bilardi

Minetest - 2020-06-27Alessandra Bilardi

Line follower - 2020-02-01Alessandra Bilardi

Rubik's cube - 2019-04-06Alessandra Bilardi

AWS database solutions and open sources - 2019-03-28Alessandra Bilardi

Evolving our Datastore - 2018-03-27Alessandra Bilardi

Find the matches - 2018-02-24Alessandra Bilardi

Arduino - 2017-06-26Alessandra Bilardi

Mais de Alessandra Bilardi (20)

Overview of the OpenCV library and some use cases - 2024-04-19

Overview of the Kaggle platform and its competitions

Forecasting in AWS - 2024-02-01

From your laptop to all resource that you need - 2023-12-09

Parallelize data processing - 2023-10-24

The Fourier transformation - 2023-07-23

Anomaly Detection and IP Insights - 2023-06-10

Forecasting in AWS - 2023-05-16

Natural conversation - 2023-05-06

Classification - 2023-03-25

Data transformation on AWS - 2022-10-11

Anomaly Detection Overview - 2022-05-26

Automation: from local test to production deploy - 2020-11-05

Minetest - 2020-06-27

Line follower - 2020-02-01

Rubik's cube - 2019-04-06

AWS database solutions and open sources - 2019-03-28

Evolving our Datastore - 2018-03-27

Find the matches - 2018-02-24

Arduino - 2017-06-26

Último

MATERI MANAJEMEN OF PENYAKIT TETANUS.pptRachmaGhifari

一比一原版麦考瑞大学毕业证成绩单如何办理cyebo

Seven tools of quality control.slideshareraiaryan448

Bios of leading Astrologers & Researchersdarmandersingh4580

NO1 Best Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialist I...Amil baba

edited gordis ebook sixth edition david d.pdfgreat91

Data Visualization Exploring and Explaining with Data 1st Edition by Camm sol...ssuserf63bd7

Identify Rules that Predict Patient’s Heart Disease - An Application of Decis...ThinkInnovation

Data Analytics for Digital Marketing Lecture for Advanced Digital & Social Me...Valters Lauzums

Statistics Informed Decisions Using Data 5th edition by Michael Sullivan solu...ssuserf63bd7

The Significance of Transliteration Enhancingmohamed Elzalabany

Abortion Clinic in Randfontein +27791653574 Randfontein WhatsApp Abortion Cli...mikehavy0

Abortion pills in Riyadh Saudi Arabia (+966572737505 buy cytotecAbortion pills in Riyadh +966572737505 get cytotec

一比一原版纽卡斯尔大学毕业证成绩单如何办理cyebo

1:1原版定制伦敦政治经济学院毕业证(LSE毕业证）成绩单学位证书留信学历认证dq9vz1isj

一比一原版西悉尼大学毕业证成绩单如何办理pyhepag

Audience Researchndfhcvnfgvgbhujhgfv.pptxStephen266013

NOAM AAUG Adobe Summit 2024: Summit Slam Dunksgmuir1066

Formulas dax para power bI de microsoft.pdfRobertoOcampo24

Digital Marketing Demystified: Expert Tips from Samantha Rae CoolbethSamantha Rae Coolbeth

How to move your ML system from local to production - 2024-03-15

1. DevOps & MLOps - IDI 2024 Come portare in produzione un sistema di ML che ora gira solo nel locale del nostro data scientist ?

2. DevOps & MLOps - IDI 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it

3. DevOps & MLOps - IDI 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it

4. DevOps & MLOps - IDI 2024 Alessandra Bilardi Data & Automation Specialist @ Corley Cloud alessandra.bilardi@corley.it corley.it

5. DevOps & MLOps - IDI 2024 SUMMARY DevOps methods & actors MLOps methods & actors Use case AWS services What we take home

6. DevOps & MLOps - IDI 2024 reference

7. DevOps & MLOps - IDI 2024 DevOps methods & actors

8. DevOps & MLOps - IDI 2024 DevOps methods & actors

9. DevOps & MLOps - IDI 2024 DevOps methods & actors

10. DevOps & MLOps - IDI 2024 MLOps methods & actors

11. DevOps & MLOps - IDI 2024 ML system & actors

12. DevOps & MLOps - IDI 2024 reference

13. DevOps & MLOps - IDI 2024 reference

14. DevOps & MLOps - IDI 2024 ML system & actors

15. DevOps & MLOps - IDI 2024 MLOps methods & actors

16. DevOps & MLOps - IDI 2024 MLOps methods & actors

17. DevOps & MLOps - IDI 2024 reference

18. DevOps & MLOps - IDI 2024 Use case

19. DevOps & MLOps - IDI 2024 Use case

20. DevOps & MLOps - IDI 2024 Use case

21. DevOps & MLOps - IDI 2024 reference

22. DevOps & MLOps - IDI 2024

23. DevOps & MLOps - IDI 2024 AWS services

24. DevOps & MLOps - IDI 2024 AWS services

25. DevOps & MLOps - IDI 2024 AWS Step Functions

26. DevOps & MLOps - IDI 2024 AWS Step Functions https://github.com/aws/aws-step-functions-data-science-sdk-python

27. DevOps & MLOps - IDI 2024 AWS services

28. DevOps & MLOps - IDI 2024 AWS services

29. DevOps & MLOps - IDI 2024 Amazon SageMaker Pipeline

30. DevOps & MLOps - IDI 2024 Amazon SageMaker Pipeline https://github.com/aws/amazon-sagemaker-examples/tree/main/sagemaker-pipeline-parameterization

31. DevOps & MLOps - IDI 2024 reference

32. DevOps & MLOps - IDI 2024 What we take home

33. DevOps & MLOps - IDI 2024 Data Scientist & Cloud Engineer 1 How to survive with colleagues with different skills, without hindering the table football game during the lunch break. 2 Versioning of configuration, training and inference data statistics, models, .. 3 Define tools and services: libraries, images, storages, .. 4 Define guidelines for who does what: review, support, deploying the model, .. Promoting resources awareness to be used

34. DevOps & MLOps - IDI 2024 AWS services

35. DevOps & MLOps - IDI 2024 Step Functions vs SageMaker Pipeline

36. DevOps & MLOps - IDI 2024 AWS services Which AWS services for which role, when we want to automate a solution from local to production: depends on the life cycle of the model but above all by the actors involved. Data Scientists (DS) Cloud Engineer (CE) DS AWS Services CE AWS Services many one AWS Step Functions AWS CloudFormation one many Amazon SageMaker Pipeline AWS CloudFormation & Step Functions

37. DevOps & MLOps - IDI 2024 AWS services Which AWS services for which model, when we have a small model, we can also use something like AWS Lambda, but when we need GPU, we must to use an Endpoint. AWS Service Provisioning type Resources Cost per hour Endpoint Provisioned 2 CPU + 4GB RAM $0.056 Endpoint Serverless 4096MB $0.288 AWS Lambda Serverless 4096MB $0.00024012 +GBsec

38. DevOps & MLOps - IDI 2024 Thanks for listening!

How to move your ML system from local to production - 2024-03-15

Recomendados

Recomendados

Mais conteúdo relacionado

Semelhante a How to move your ML system from local to production - 2024-03-15

Semelhante a How to move your ML system from local to production - 2024-03-15 (20)

Mais de Alessandra Bilardi

Mais de Alessandra Bilardi (20)

Último

Último (20)

How to move your ML system from local to production - 2024-03-15