Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Foundations of Audio Classification
- Types of sound events: environmental, mechanical, and human-generated.
- Overview of use cases: surveillance, monitoring, and automation.
- Differences between audio classification, detection, and segmentation.
Audio Data and Feature Extraction
- Various types of audio files and their formats.
- Considerations for sampling rate, windowing, and frame size.
- Extracting features such as MFCCs, chroma features, and mel-spectrograms.
Data Preparation and Annotation
- Utilization of datasets like UrbanSound8K, ESC-50, and custom datasets.
- Labeling sound events and defining temporal boundaries.
- Strategies for balancing datasets and augmenting audio data.
Building Audio Classification Models
- Applying convolutional neural networks (CNNs) for audio analysis.
- Model inputs: comparing raw waveforms versus extracted features.
- Selecting loss functions, evaluation metrics, and managing overfitting.
Event Detection and Temporal Localization
- Strategies for frame-based and segment-based detection.
- Refining detections through post-processing with thresholds and smoothing techniques.
- Visualizing predictions on audio timelines.
Advanced Topics and Real-Time Processing
- Applying transfer learning for scenarios with limited data.
- Deploying models using TensorFlow Lite or ONNX.
- Considerations for streaming audio processing and latency.
Project Development and Application Scenarios
- Designing a complete pipeline from data ingestion to classification.
- Developing a proof-of-concept for applications like surveillance, quality control, or monitoring.
- Implementing logging, alerting, and integration with dashboards or APIs.
Summary and Next Steps
Requirements
- A solid understanding of machine learning concepts and model training.
- Proficiency in Python programming and data preprocessing.
- Familiarity with the fundamentals of digital audio.
Audience
- Data scientists.
- Machine learning engineers.
- Researchers and developers specializing in audio signal processing.
21 Hours
