Course Outline
Introduction to the Stratio Platform
- Overview of Stratio's architecture and its core functional modules
- The strategic role of Rocket and Intelligence within the data lifecycle
- Accessing the platform and navigating the Stratio user interface
Utilizing the Rocket Module
- Establishing data ingestion pipelines
- Linking data sources and configuring transformation processes
- Applying PySpark to execute preprocessing tasks within Rocket
PySpark Fundamentals for Stratio Users
- Exploring PySpark data structures and core operations
- Implementing looping constructs, including for, while, and if/else logic
- Authoring custom functions using def and deploying them effectively
Advanced Rocket Implementations with PySpark
- Handling streaming ingestion and real-time transformations
- Integrating loops and functions across batch and real-time processing scenarios
- Adhering to best practices for optimizing PySpark pipeline performance
Investigating the Intelligence Module
- Reviewing data modeling and analytical capabilities
- Conducting feature selection, transformation, and exploratory analysis
- Harnessing PySpark for custom analytics and insight generation
Constructing Advanced Analytics Workflows
- Developing user-defined functions (UDFs) within the Intelligence module
- Employing conditionals and loops to manage complex data logic
- Practical applications: segmentation, aggregation, and predictive modeling
Deployment and Team Collaboration
- Strategies for saving, exporting, and reusing established workflows
- Fostering collaboration among team members on the Stratio platform
- Reviewing outputs and integrating results with downstream tools
Conclusion and Recommended Next Steps
Requirements
- Familiarity with Python programming
- Foundational understanding of data analytics or big data processing principles
- Basic proficiency in Apache Spark and distributed computing architectures
Target Audience
- Data engineers managing Stratio-based platforms
- Analysts and developers utilizing the Rocket and Intelligence modules
- Technical teams in the process of migrating workflows to PySpark within the Stratio environment
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.