Get in Touch

Course Outline

Enterprise Architecture and Pipeline Design

  • Multi-layer ETL architectures
  • Creating modular and reusable components
  • Hybrid integration approaches across systems

Advanced Performance Engineering

  • Step-level optimization techniques
  • Strategies for parallelism and threading
  • Monitoring high-load pipelines

Automation, Scripting, and Custom Extensions

  • Scripting within transformations
  • Developing custom plugins
  • Extending PDI capabilities using Java and JavaScript

Complex Data Processing and Integrations

  • Real-time and streaming integrations
  • Working with big data platforms
  • Advanced processing of files and APIs

Data Governance, Security, and Compliance

  • Securing transformations and managing credentials
  • Ensuring data lineage and traceability
  • Addressing regulatory and compliance requirements

Enterprise Orchestration and Scheduling

  • Managing large job networks
  • Designing error recovery and failover mechanisms
  • Environment-level orchestration

Repository, Version Control, and CI/CD

  • Strategies for enterprise repositories
  • Integrating PDI with Git
  • Continuous deployment patterns

Deployment, Monitoring, and Production Operations

  • Promoting solutions across different environments
  • Utilizing operational tooling and dashboards
  • Ensuring end-to-end production readiness

Summary and Next Steps

Requirements

  • Familiarity with ETL pipelines and data modeling concepts
  • Hands-on experience with intermediate-level PDI transformations
  • Strong proficiency in SQL and scripting

Target Audience

  • Senior data engineers
  • ETL architects
  • Professionals handling complex data integration workloads
 21 Hours

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories