Data engineering & monitoring analytics | Python, PostgreSQL, HTML/CSS/JavaScript
DWDM Optical Sensor Monitoring with Change-Point and Degradation Detection
- Problem
- Operations teams need a consistent way to separate missing telemetry, short failures, persistent signal shifts, and gradual degradation across approximately 400 configured directional optical sensors whose active subset varies over time.
- My Contribution
- Built the incremental Python/PostgreSQL pipeline, data-quality and failure rules, change-point and degradation analysis, paired-sensor evidence, local API, priority workflow, and browser-based monitoring interface as a Junior Programmer at PT Aplikanusa Lintasarta.
Technical details
- Data & Context
- Approximately 400 configured directional optical sensors combine native 5-minute PRTG power telemetry with ENIMS metadata for sensors, links, directions, endpoints, and locations. The active subset can fall below or rise above 300 as sensor availability changes.
- Approach
- Built an incremental workflow from metadata synchronization and telemetry collection through failure grouping, PELT change-point detection, Theil-Sen and Mann-Kendall degradation analysis, paired-sensor evidence, priority ranking, and local dashboard delivery.
- Validation & Controls
- Statistical analysis uses only clean observations. Missing data, downtime, 0 coverage, and low-signal failures remain visible to operations but are excluded from change and trend calculations instead of being filled with invented values.
Project OutputThe pipeline turns raw telemetry into prioritized, traceable investigation views: failure events, persistent downward shifts, gradual degradation, paired-sensor evidence, and dedicated operations, event, and management screens.
Evidence & ScopeThe analysis helps teams decide what to investigate first but does not claim a physical root cause. Internal telemetry, source code, credentials, infrastructure, database contents, and operational screenshots remain confidential.