Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architecture frameworks
- Creating modular and reusable components
- Hybrid integration approaches across various systems
Advanced Performance Engineering
- Step-level performance optimization
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Implementing scripting within transformations
- Developing custom plugins
- Enhancing PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integrations
- Interfacing with big data platforms
- Advanced file and API processing techniques
Data Governance, Security, and Compliance
- Securing transformations and credential management
- Tracking data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Managing extensive job networks
- Designing error recovery and failover mechanisms
- Orchestration at the environment level
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories
- Integrating PDI with Git
- Continuous deployment patterns and practices
Deployment, Monitoring, and Production Operations
- Promoting solutions across different environments
- Utilizing operational tooling and dashboards
- Achieving end-to-end production readiness
Summary and Next Steps
Requirements
- A solid grasp of ETL pipelines and data modeling concepts
- Hands-on experience with intermediate-level PDI transformations
- Strong proficiency in SQL and scripting
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration workloads
Testimonials (1)
It's a hands-on session.
