IMS Bearing Early-Warning Benchmark
A derived-score evaluation of an MCIFT early-warning detector on one IMS Set 2 bearing run.
- Dataset
- IMS Bearing Dataset
- Subset
- IMS Set 2
- Published
- 2026-07-19
Result summary
Test the behaviour on another system.
A comparable study can test whether the same warning behaviour appears on another dataset, machine or operational process. A negative or inconclusive result is still a valid outcome.
What was tested
IMS Set 2 is a physical bearing experiment run to its endpoint. This publication evaluates derived observations from one run. Recordings originate from sampled vibration waveforms, but this page publishes only derived scores. The experiment endpoint is known; the exact physical damage-onset time is not labelled. The detector uses all four IMS Set 2 bearing channels; Bearing 1 is associated with the endpoint failure.
Result timeline
Accessible timeline summary
| Event | Index | Timestamp | Meaning |
|---|---|---|---|
| First candidate | 6 | 2004.02.12.11.32.39 | Threshold crossing without confirmed persistence |
| Candidate runs before sustained run | 18 (17 × 1; 1 × 2) | None met the three-observation requirement | |
| Stable-warning run start | 532 | 2004.02.16.03.12.39 | 451 recording intervals / 4,510 minutes to endpoint, measured from index 532 |
| Second consecutive positive | 533 | 2004.02.16.03.22.39 | Approximately 10 minutes after the same run began |
| Warning confirmation index | 534 | 2004.02.16.03.32.39 | The 3-observation requirement was satisfied approximately 20 minutes after run start |
| Final recording | 983 | 2004.02.19.06.22.39 | Known experiment endpoint, not labelled damage onset |
| Official warning runs | 7 | Positive runs meeting the persistence count | |
Warning persistence rule
An isolated threshold crossing is recorded as a warning candidate. MCIFT first crossed the threshold for the sustained warning event at recording index 532. Index 533 was the second and index 534 the third consecutive positive observation, at which point the warning was confirmed. Recordings are spaced approximately 10 minutes apart: index 532 to 533 is one interval and 533 to 534 is another, approximately 20 minutes in total. Earlier shorter candidate runs did not become official alerts.
Interpretation boundary
The final IMS recording is the experiment endpoint, not a labelled timestamp for the first appearance of physical damage. Therefore, “75 h 10 min before the final recording” must not be interpreted as “75 h 10 min before damage began.” The detector identified a persistent change before the run ended. Real failure-onset lead time requires independently labelled damage progression or physical inspection data.
Methodology
| Item | Value | Class |
|---|---|---|
| Benchmark identifier | ims-early-warning | configured |
| Dataset subset | IMS Set 2 | dataset metadata |
| Detector input channels | All four IMS Set 2 bearing channels: bearing_1, bearing_2, bearing_3, bearing_4 | configured |
| Bearing associated with endpoint failure | Bearing 1 | dataset metadata |
| Source recording count | 984 | derived |
| Feature extraction | Mean detrending of each 20,480-sample recording; conventional features: RMS, peak-to-peak amplitude, kurtosis, crest factor, spectral entropy and frequency-band energy; MCIFT observables: scaled log-RMS, spectral centroid and shared-bin phase across four bearing channels | configured |
| Normalization | Channel scaling by median channel RMS fitted on the reference partition with an epsilon floor; MCIFT information and angular-frequency scales fitted using robust MAD of reference pairwise differences; score calculated as Frobenius distance from the median reference exchange matrix | configured |
| Reference recordings | 98 | configured |
| Calibration recordings | 98 | configured |
| Threshold source | 99.5th percentile of calibration partition | configured |
| MCIFT threshold | 0.3310462580442802 | derived |
| Stable-warning run start | Index 532 | derived |
| Second consecutive positive | Index 533 | derived |
| Warning confirmation index | Index 534 | derived |
| Persistence requirement | 3 consecutive positive observations | configured |
| Time from run start to confirmation | Approximately 20 minutes | derived |
| Reported stable-warning timestamp | Timestamp of index 532: 2004-02-16-03 12:39 | derived |
| Lead to final recording | 451 recording intervals / 4,510 minutes, measured from index 532 | derived |
| Split policy | 98 + 98; evaluation index 196 | configured |
| Missing-data handling | Raw NaN values are not explicitly validated, removed, or imputed. They may propagate into feature calculations, so recordings containing NaNs are not guaranteed to produce valid scores. | implementation metadata |
| Seed | 20260101 | implementation metadata |
| Python version | 3.12.13 | implementation metadata |
| Git commit | 731c249288d67dac4e3a10792980ec99be1de34d | implementation metadata |
| Execution time | 2026-07-18T18:33:52.434327+00:00 | implementation metadata |
| Export time | 2026-07-18 18:33:52 UTC | implementation metadata |
Comparison with baselines
| Method | Stable warning start | Lead to endpoint | Positive recordings | Separate positive runs | Crossings before calibration end |
|---|---|---|---|---|---|
| MCIFT | 2004-02-16 03:12:39 | 75 hr 10 min | 459 | 27 | 2 |
| Conventional vibration-feature deviation | 2004-02-16 04:02:39 | 74 hr 20 min | 454 | 10 | 3 |
MCIFT began its stable run 50 minutes earlier relative to the endpoint and had fewer crossings before calibration ended. The conventional method had fewer fragmented positive runs. Export verdict: not established. Without a labelled damage onset, valid precision, recall and F1 cannot be calculated.
Detailed score table
| Index | Timestamp | MCIFT score | Conventional score | Candidate | Official state (3) |
|---|---|---|---|---|---|
| 0 | 2004.02.12.10.32.39 | 0.179835 | 5.287984 | — | — |
| 1 | 2004.02.12.10.42.39 | 0.297612 | 3.346739 | — | — |
| 2 | 2004.02.12.10.52.39 | 0.311731 | 4.373311 | — | — |
| 3 | 2004.02.12.11.02.39 | 0.326265 | 12.216048 | — | — |
| 4 | 2004.02.12.11.12.39 | 0.220850 | 1.852628 | — | — |
| 5 | 2004.02.12.11.22.39 | 0.320688 | 2.912802 | — | — |
| 6 | 2004.02.12.11.32.39 | 0.335265 | 2.259301 | ✓ | — |
| 7 | 2004.02.12.11.42.39 | 0.303451 | 2.124697 | — | — |
| 8 | 2004.02.12.11.52.39 | 0.131768 | 4.044379 | — | — |
| 9 | 2004.02.12.12.02.39 | 0.218468 | 3.066804 | — | — |
| 10 | 2004.02.12.12.12.39 | 0.243010 | 1.461781 | — | — |
| 11 | 2004.02.12.12.22.39 | 0.193776 | 2.661005 | — | — |
| 12 | 2004.02.12.12.32.39 | 0.081213 | 2.822869 | — | — |
| 13 | 2004.02.12.12.42.39 | 0.283067 | 1.994933 | — | — |
| 14 | 2004.02.12.12.52.39 | 0.235493 | 1.303990 | — | — |
| 15 | 2004.02.12.13.02.39 | 0.283446 | 1.202836 | — | — |
| 16 | 2004.02.12.13.12.39 | 0.138333 | 1.936441 | — | — |
| 17 | 2004.02.12.13.22.39 | 0.220593 | 2.558742 | — | — |
| 18 | 2004.02.12.13.32.39 | 0.156863 | 3.142234 | — | — |
| 19 | 2004.02.12.13.42.39 | 0.243583 | 2.791008 | — | — |
| 20 | 2004.02.12.13.52.39 | 0.174745 | 1.540204 | — | — |
| 21 | 2004.02.12.14.02.39 | 0.215789 | 1.532952 | — | — |
| 22 | 2004.02.12.14.12.39 | 0.287012 | 1.959348 | — | — |
| 23 | 2004.02.12.14.22.39 | 0.152050 | 2.073723 | — | — |
| 24 | 2004.02.12.14.32.39 | 0.062181 | 3.501150 | — | — |
Derived benchmark artifacts
Reproducibility and provenance
- Benchmark repository
- https://github.com/corpobear/MCIFT-Benchmarks
- Git commit
731c249288d67dac4e3a10792980ec99be1de34d- Configuration
ims-set2-v1.yaml- Execution started (UTC)
- 2026-07-18T18:31:18.864811+00:00
- Execution completed (UTC)
- 2026-07-18T18:33:52.434327+00:00
- Seed
- 20260101
- Dataset manifest hash
ec44367d57a672dec140eeec2870d1916f80672d6a5cdc2d8b5fd2ca43aaec21- Status in export
completed-unapproved- SHA-256 · summary.json
1c6a08585b88013ebce956988f2189fd06fba2eb86a1d1ad0c965508bf4b5b08- SHA-256 · scores.csv
d6c717e0bfeb3d7a97e57910feae7a0fc02a890c917db4fc8b10676082727ed8
Export documentation
IMS RESULT DATA HANDOFF This folder contains verified derived IMS benchmark data for another agent to process. It contains no website files, raw vibration recordings, Azure resource identifiers, credentials, tokens, signed URLs, or environment-variable values. Files: - summary.json: exact verified benchmark summary downloaded from private run storage. - scores.csv: exact verified per-recording derived detector scores. - comparison.json: additional MCIFT-versus-conventional statistics derived from scores.csv. - provenance.redacted.json: reproducibility facts with locations and environment details removed. - data-dictionary.json: column meanings and interpretation constraints. Scientific constraint: The IMS experiment labels its final recording but does not provide a verified physical degradation-onset timestamp. Lead time is therefore measured only to the final recording and must not be described as proven damage-prediction lead. Run status is completed but not scientifically approved for publication.
Limitations
- One bearing run was evaluated.
- The exact physical damage onset is not labelled.
- The experiment endpoint is not equivalent to damage onset.
- The result does not prove cross-machine generalization.
- Thresholds may depend on the defined calibration protocol.
- Additional IMS runs and stronger baseline comparisons remain necessary.
- Performance on heterogeneous digital telemetry must be evaluated separately.
- One successful benchmark does not validate the entire MCIFT framework.