Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Introduction to Apache Airflow for Machine Learning
- Overview of Apache Airflow and its relevance to data science.
- Key features for automating machine learning workflows.
- Setting up Airflow for data science projects.
Building Machine Learning Pipelines with Airflow
- Designing DAGs for end-to-end ML workflows.
- Utilizing operators for data ingestion, preprocessing, and feature engineering.
- Scheduling and managing pipeline dependencies.
Model Training and Validation
- Automating model training tasks with Airflow.
- Integrating Airflow with ML frameworks (e.g., TensorFlow, PyTorch).
- Validating models and storing evaluation metrics.
Model Deployment and Monitoring
- Deploying machine learning models via automated pipelines.
- Monitoring deployed models using Airflow tasks.
- Managing retraining processes and model updates.
Advanced Customization and Integration
- Developing custom operators for ML-specific tasks.
- Integrating Airflow with cloud platforms and ML services.
- Extending Airflow workflows with plugins and sensors.
Optimizing and Scaling ML Pipelines
- Enhancing workflow performance for large-scale data.
- Scaling Airflow deployments using Celery and Kubernetes.
- Best practices for production-grade ML workflows.
Case Studies and Practical Applications
- Real-world examples of ML automation using Airflow.
- Hands-on exercise: Constructing an end-to-end ML pipeline.
- Discussion of challenges and solutions in ML workflow management.
Summary and Next Steps
Requirements
- Familiarity with the concepts and workflows of machine learning.
- Basic understanding of Apache Airflow, specifically DAGs and operators.
- Proficiency in Python programming.
Target Audience
- Data scientists.
- Machine learning engineers.
- AI developers.
Testimonials (2)
Getting people that never used AI some repetition in prompting and people that do use AI to consider different methods to using it.
Matthew Gay - Tarsus Pharmaceuticals
Course - Artificial Intelligence (AI) Overview
Working from first principles in a focused way, and moving to applying case studies within the same day
