PointWatch E2E Test Status

prod v3.1.10

Booster Station PortalGrafana A tank cycling between its setpoints, filled by one booster pump.
Booster Station
✓
Booster: Tank fill
The booster pump's control coil has changed state in the last 30 minutes, so the organization rules are cycling the tank between its setpoints
Pump control last changed state 5m28s ago
✓
Booster: Demand latched
The tank's "Demand" variable has been set by a site rule in the last 30 minutes: a site rule writing a variable on the gateway, and the value reaching the server
"Demand" last set to 0 5m42s ago
✓
Booster: Demand mirrored
The booster station's "Demand" variable has been set by an organization rule in the last 30 minutes, and the rule is recorded on it: an organization rule writing a variable across sites
"Demand" last set to 0 5m31s ago
✓
Booster: Pump on notification
The "Pump On Notify" SMS has been received in the last 60 minutes
SMS notification received 9m25s ago
✓
Booster: Cycle mirror notification
The "Cycle Mirror On Notify" SMS has been received in the last 15 minutes
SMS notification received 9m5s ago
Loading… PortalGrafana
Multi-Stage Pumping
✓
Multi-Stage: Runner
Verify the scenario runner keeps finishing scenarios; it is stuck if none has finished in 2h0m0s
last scenario finished 5m19s ago
✓
Multi-Stage: Start order
Let the tank drain below LOW; relays close 3, 2, 1, each at least 15 s after the one above it
passed in 1m22s, ran 27m29s ago
✓
Multi-Stage: Shutdown order
Let the tank fill above HIGH; relays open 1, 2, 3
passed in 9m28s, ran 18m1s ago
✓
Multi-Stage: Failed start
Hold Pump 2's clamp at zero; Fault latches at the ceiling, every relay opens, clearing the fault restarts the chain
passed in 6m14s, ran 9m21s ago
✓
Multi-Stage: Trip mid-run
Drop Pump 2's clamp to zero mid-run; Pump 1 releases, then the fault unwinds Pump 2 and Pump 3
passed in 4m2s, ran 5m19s ago
✓
Multi-Stage: Pump link cut
Sever Pump 2's link; its relay opens within its hold time and Fault latches on F5 once the server marks it offline
passed in 4m18s, ran 47m50s ago (running now)
✓
Multi-Stage: Tank link cut
Sever the tank's link; Demand goes offline, every permissive is vetoed, and the pumps stop bottom-up
passed in 4m40s, ran 41m10s ago
✓
Multi-Stage: Full outage
Sever all four links; every relay is open within ten minutes, bottom-up
passed in 3m32s, ran 37m38s ago
✓
Multi-Stage: Level sensor lost
The tank's IO-100 stops answering; D3 clears Demand and the chain unwinds
passed in 2m28s, ran 35m10s ago
✓
Multi-Stage: Bus cut
Cut Pump 2's RS485 bus; its relay drops on the board's own hold and Pump 1 follows once the server marks Pump 2 offline
passed in 4m14s, ran 30m51s ago
Loading… PortalGrafana
Pump Alternation
✓
Alternation: Runner
Verify the alternation runner keeps finishing scenarios; it is stuck if none has finished in 1h30m0s
last scenario finished 6m8s ago
✓
Alternation: Alternate on cycle
Two free-running cycles; one pump takes each, the turn passes exactly once a cycle, and both are never commanded on together
passed in 9m25s, ran 21m49s ago
✓
Alternation: Deadband
The pump starts above Start, holds through the band, stops below Stop, and does not restart until the well has refilled
passed in 7m9s, ran 14m25s ago
✓
Alternation: Takeover on no start
Hold the lead pump's clamp at zero; its relay opens after the takeover wait, the turn passes, and the standby draws the well down
passed in 5m56s, ran 6m8s ago
✓
Alternation: Takeover on trip
Drop the running pump's clamp mid-cycle; the same rules release it and the standby finishes the cycle
passed in 6m14s, ran 53m16s ago (running now)
✓
Alternation: Well level lost
The well's board stops answering; both relays open, the turn holds, and the same pump takes the cycle when it answers again
passed in 3m31s, ran 49m16s ago
✓
Alternation: Portal outage
Sever the site's link; a full cycle completes and the turn passes with no server, and the portal catches up when it returns
passed in 7m56s, ran 39m29s ago
✓
Alternation: Both pumps dead
Hold both clamps at zero; the turn trades, neither relay is left closed against a pump that is not running, and cycling resumes when they are released
passed in 6m0s, ran 31m44s ago
Loading… PortalGrafana
Relay Timing
✓
Relay Timing: Runner
Verify the relay timing runner keeps finishing scenarios; it is stuck if none has finished in 30m0s
last scenario finished 4m4s ago
✓
Relay Timing: Delayed start and stop
Close Demand; Delayed and Unattended each close after their own on delay and no sooner. Open it; Delayed opens after its off delay, Unattended holds until Reset opens it after its own
passed in 1m41s, ran 9m37s ago
✓
Relay Timing: Start cancelled by release
Open Demand halfway through the shorter on delay; neither Delayed, which is told off, nor Unattended, which is told nothing, ever closes
passed in 1m15s, ran 7m3s ago
✓
Relay Timing: Stop cancelled by demand returning
Close Demand again halfway through Delayed's off delay; the relay stays closed through the time it would have opened
passed in 1m44s, ran 4m4s ago
✓
Relay Timing: Held relay releases after the hold
Sever the site's link with Held on; the Default rule takes over when the hold expires, Held opens after its off delay, and closes again once the portal is back
passed in 5m24s, ran 17m30s ago (running now)
✓
Relay Timing: Release cancelled by the portal returning
Restore the link during Held's off delay; the organization rule commands it on again and the countdown is dropped
passed in 3m38s, ran 13m31s ago
Loading… PortalGrafana
Duplex Multi-Stage
✓
Duplex: Runner
Verify the duplex runner keeps finishing scenarios; it is stuck if none has finished in 2h0m0s
last scenario finished 48s ago
✓
Duplex: Start order
Let the tank drain below LOW; stations start 3, 2, 1, each at least 15 s after the one above it, each with the pump whose turn it is
passed in 16m13s, ran 1h18m37s ago (running now)
✓
Duplex: Shutdown order
Let the tank fill above HIGH; stations stop 1, 2, 3
passed in 6m16s, ran 1h12m20s ago
✓
Duplex: Alternate on cycle
Two free-running cycles; every station runs one pump in the first and the other pump in the second
passed in 17m23s, ran 52m40s ago
✓
Duplex: Takeover on no start
Hold Station 2's lead pump at zero; its standby takes over, the chain completes, and no fault latches
passed in 14m50s, ran 37m49s ago
✓
Duplex: Takeover on trip
Trip Station 2's running pump mid-run; Station 1 releases, the standby takes over, the chain restarts, and no fault latches
passed in 5m0s, ran 32m49s ago
✓
Duplex: Station dead
Hold both of Station 2's pumps at zero; Fault latches at the ceiling, every relay opens, clearing the fault restarts the chain
passed in 26m11s, ran 6m38s ago
✓
Duplex: Full outage
Sever all four links; each station stops on its own Portal link window, bottom-up, before the server can notice, and the chain restarts top-down when the links return
passed in 5m50s, ran 48s ago