Promising development result

IMS Bearing Early-Warning Benchmark

A derived-score evaluation of an MCIFT early-warning detector on one IMS Set 2 bearing run.

Dataset
IMS Bearing Dataset
Subset
IMS Set 2
Published
2026-07-19
01

Result summary

Recordings evaluated984
Reference + calibration98 + 98
First candidate#62004.02.12.11.32.39
Sustained warning run start#5322004.02.16.03.12.39
Warning confirmation#5342004.02.16.03.32.39
Run start to confirmation≈ 20 min
Run-start lead to final recording75 h 10 min451 intervals from index 532
Candidate runs before sustained run18
Official alerts before sustained run0
Crossings before calibration end2
Persistence requirement3 observations≈ 20 min between first and third timestamps
Final stateConfirmed warning active
Method versionims-set2-v1
NEXT TEST

Test the behaviour on another system.

A comparable study can test whether the same warning behaviour appears on another dataset, machine or operational process. A negative or inconclusive result is still a valid outcome.

02

What was tested

IMS Set 2 is a physical bearing experiment run to its endpoint. This publication evaluates derived observations from one run. Recordings originate from sampled vibration waveforms, but this page publishes only derived scores. The experiment endpoint is known; the exact physical damage-onset time is not labelled. The detector uses all four IMS Set 2 bearing channels; Bearing 1 is associated with the endpoint failure.

03

Result timeline

#532 · 2004-02-16-03 12:39Sustained warning run begins. This is the first of three consecutive positive observations.To endpoint: 75 hr 10 minMCIFT: 0.3640 / 0.3310Candidate: yesPersistence count: 1Confirmed warning: no
04

Accessible timeline summary

EventIndexTimestampMeaning
First candidate62004.02.12.11.32.39Threshold crossing without confirmed persistence
Candidate runs before sustained run18 (17 × 1; 1 × 2)None met the three-observation requirement
Stable-warning run start5322004.02.16.03.12.39451 recording intervals / 4,510 minutes to endpoint, measured from index 532
Second consecutive positive5332004.02.16.03.22.39Approximately 10 minutes after the same run began
Warning confirmation index5342004.02.16.03.32.39The 3-observation requirement was satisfied approximately 20 minutes after run start
Final recording9832004.02.19.06.22.39Known experiment endpoint, not labelled damage onset
Official warning runs7Positive runs meeting the persistence count
05

Warning persistence rule

An isolated threshold crossing is recorded as a warning candidate. MCIFT first crossed the threshold for the sustained warning event at recording index 532. Index 533 was the second and index 534 the third consecutive positive observation, at which point the warning was confirmed. Recordings are spaced approximately 10 minutes apart: index 532 to 533 is one interval and 533 to 534 is another, approximately 20 minutes in total. Earlier shorter candidate runs did not become official alerts.

06

Interpretation boundary

The final IMS recording is the experiment endpoint, not a labelled timestamp for the first appearance of physical damage. Therefore, “75 h 10 min before the final recording” must not be interpreted as “75 h 10 min before damage began.” The detector identified a persistent change before the run ended. Real failure-onset lead time requires independently labelled damage progression or physical inspection data.

07

Methodology

ItemValueClass
Benchmark identifierims-early-warningconfigured
Dataset subsetIMS Set 2dataset metadata
Detector input channelsAll four IMS Set 2 bearing channels: bearing_1, bearing_2, bearing_3, bearing_4configured
Bearing associated with endpoint failureBearing 1dataset metadata
Source recording count984derived
Feature extractionMean detrending of each 20,480-sample recording; conventional features: RMS, peak-to-peak amplitude, kurtosis, crest factor, spectral entropy and frequency-band energy; MCIFT observables: scaled log-RMS, spectral centroid and shared-bin phase across four bearing channelsconfigured
NormalizationChannel scaling by median channel RMS fitted on the reference partition with an epsilon floor; MCIFT information and angular-frequency scales fitted using robust MAD of reference pairwise differences; score calculated as Frobenius distance from the median reference exchange matrixconfigured
Reference recordings98configured
Calibration recordings98configured
Threshold source99.5th percentile of calibration partitionconfigured
MCIFT threshold0.3310462580442802derived
Stable-warning run startIndex 532derived
Second consecutive positiveIndex 533derived
Warning confirmation indexIndex 534derived
Persistence requirement3 consecutive positive observationsconfigured
Time from run start to confirmationApproximately 20 minutesderived
Reported stable-warning timestampTimestamp of index 532: 2004-02-16-03 12:39derived
Lead to final recording451 recording intervals / 4,510 minutes, measured from index 532derived
Split policy98 + 98; evaluation index 196configured
Missing-data handlingRaw NaN values are not explicitly validated, removed, or imputed. They may propagate into feature calculations, so recordings containing NaNs are not guaranteed to produce valid scores.implementation metadata
Seed20260101implementation metadata
Python version3.12.13implementation metadata
Git commit731c249288d67dac4e3a10792980ec99be1de34dimplementation metadata
Execution time2026-07-18T18:33:52.434327+00:00implementation metadata
Export time2026-07-18 18:33:52 UTCimplementation metadata
08

Comparison with baselines

MethodStable warning startLead to endpointPositive recordingsSeparate positive runsCrossings before calibration end
MCIFT2004-02-16 03:12:3975 hr 10 min459272
Conventional vibration-feature deviation2004-02-16 04:02:3974 hr 20 min454103

MCIFT began its stable run 50 minutes earlier relative to the endpoint and had fewer crossings before calibration ended. The conventional method had fewer fragmented positive runs. Export verdict: not established. Without a labelled damage onset, valid precision, recall and F1 cannot be calculated.

09

Detailed score table

Download original CSV
IndexTimestampMCIFT scoreConventional scoreCandidateOfficial state (3)
02004.02.12.10.32.390.1798355.287984
12004.02.12.10.42.390.2976123.346739
22004.02.12.10.52.390.3117314.373311
32004.02.12.11.02.390.32626512.216048
42004.02.12.11.12.390.2208501.852628
52004.02.12.11.22.390.3206882.912802
62004.02.12.11.32.390.3352652.259301
72004.02.12.11.42.390.3034512.124697
82004.02.12.11.52.390.1317684.044379
92004.02.12.12.02.390.2184683.066804
102004.02.12.12.12.390.2430101.461781
112004.02.12.12.22.390.1937762.661005
122004.02.12.12.32.390.0812132.822869
132004.02.12.12.42.390.2830671.994933
142004.02.12.12.52.390.2354931.303990
152004.02.12.13.02.390.2834461.202836
162004.02.12.13.12.390.1383331.936441
172004.02.12.13.22.390.2205932.558742
182004.02.12.13.32.390.1568633.142234
192004.02.12.13.42.390.2435832.791008
202004.02.12.13.52.390.1747451.540204
212004.02.12.14.02.390.2157891.532952
222004.02.12.14.12.390.2870121.959348
232004.02.12.14.22.390.1520502.073723
242004.02.12.14.32.390.0621813.501150
1 / 40
10

Derived benchmark artifacts

11

Reproducibility and provenance

Benchmark repository
https://github.com/corpobear/MCIFT-Benchmarks
Git commit
731c249288d67dac4e3a10792980ec99be1de34d
Configuration
ims-set2-v1.yaml
Execution started (UTC)
2026-07-18T18:31:18.864811+00:00
Execution completed (UTC)
2026-07-18T18:33:52.434327+00:00
Seed
20260101
Dataset manifest hash
ec44367d57a672dec140eeec2870d1916f80672d6a5cdc2d8b5fd2ca43aaec21
Status in export
completed-unapproved
SHA-256 · summary.json
1c6a08585b88013ebce956988f2189fd06fba2eb86a1d1ad0c965508bf4b5b08
SHA-256 · scores.csv
d6c717e0bfeb3d7a97e57910feae7a0fc02a890c917db4fc8b10676082727ed8
Export documentation
IMS RESULT DATA HANDOFF

This folder contains verified derived IMS benchmark data for another agent to
process. It contains no website files, raw vibration recordings, Azure resource
identifiers, credentials, tokens, signed URLs, or environment-variable values.

Files:
- summary.json: exact verified benchmark summary downloaded from private run storage.
- scores.csv: exact verified per-recording derived detector scores.
- comparison.json: additional MCIFT-versus-conventional statistics derived from scores.csv.
- provenance.redacted.json: reproducibility facts with locations and environment details removed.
- data-dictionary.json: column meanings and interpretation constraints.

Scientific constraint:
The IMS experiment labels its final recording but does not provide a verified
physical degradation-onset timestamp. Lead time is therefore measured only to
the final recording and must not be described as proven damage-prediction lead.

Run status is completed but not scientifically approved for publication.

12

Limitations

  • One bearing run was evaluated.
  • The exact physical damage onset is not labelled.
  • The experiment endpoint is not equivalent to damage onset.
  • The result does not prove cross-machine generalization.
  • Thresholds may depend on the defined calibration protocol.
  • Additional IMS runs and stronger baseline comparisons remain necessary.
  • Performance on heterogeneous digital telemetry must be evaluated separately.
  • One successful benchmark does not validate the entire MCIFT framework.
13

Verdict

Contact