Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architectural patterns.
- Creating modular and reusable components.
- Implementing hybrid approaches across various systems.
Advanced Performance Engineering
- Optimizing at the step level.
- Strategies for parallelism and threading.
- Monitoring pipelines under high load.
Automation, Scripting, and Custom Extensions
- Using scripting within transformations.
- Building custom plugins.
- Expanding PDI capabilities using Java and JavaScript.
Complex Data Processing and Integrations
- Real-time and streaming data integration.
- Interacting with big data platforms.
- Advanced handling of files and APIs.
Data Governance, Security, and Compliance
- Securing transformations and managing credentials.
- Ensuring data lineage and traceability.
- Addressing regulatory and compliance requirements.
Enterprise Orchestration and Scheduling
- Managing extensive job networks.
- Designing for error recovery and failover.
- Orchestration at the environment level.
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories.
- Integrating PDI with Git.
- Adopting continuous deployment patterns.
Deployment, Monitoring, and Production Operations
- Promoting solutions across different environments.
- Utilizing operational tooling and dashboards.
- Achieving end-to-end production readiness.
Summary and Next Steps
Requirements
- A solid grasp of ETL pipelines and data modeling concepts.
- Proficiency in intermediate-level PDI transformations.
- Strong skills in SQL and scripting languages.
Target Audience
- Senior data engineers.
- ETL architects.
- Professionals overseeing complex data integration workloads.
21 Hours
Testimonials (1)
It's a hands-on session.
