Unicis Platform Service Disruption - RESOLVED

Status: ✅ RESOLVED

Incident Duration: ~25 hours 28 minutes (11:24 UTC July 30 - 12:52 UTC July 31)

Resolution Time: 2026-07-31 13:00 UTC

Service: Fully operational on alternative infrastructure

Update, August 19, 2026: Following a full forensic review of the affected server, we have corrected the timeline and root-cause details below, which differ from what we initially reported. We have also completed data recovery for the affected window (see “Data Recovery Update”).

What Happened

Our production VPS on Scaleway became unreachable starting at 11:24 UTC on July 30, 2026 (corrected from the 13:24 UTC originally reported).

Root Cause: Server logs show the instance was shut down by a hypervisor-initiated poweroff at 11:24 UTC, preceded by roughly 23 hours of abnormal network conditions: our systems logged sustained connection-table exhaustion beginning July 29 at 12:00 UTC, and outbound connectivity began failing in stages starting around 06:00 UTC on July 30, several hours before the shutdown.

We have not been able to confirm the specific trigger for this traffic pattern. Our forensic review found:

• No evidence of unauthorized access, admin-account misuse, or local configuration/firewall changes around the time of the incident
• Wazuh file-integrity and rootcheck scans, run in the hours immediately preceding the shutdown, completed with no findings
• No corroborating evidence for a container port-binding change as the trigger — this was our initial working theory, but we were unable to substantiate it against the server’s own logs
• Clear evidence of sustained, elevated connection volume in the ~23 hours before the shutdown, which we believe is what our hosting provider’s automated systems responded to

We are continuing to work with Scaleway to determine the underlying source of that traffic and will update this notice if we learn more.

Recovery Actions Taken

1. ✅ Emergency deployment - Deployed to Hetzner Cloud infrastructure at 22:00 UTC July 30
2. ✅ Data restoration - Initial restoration from backup dated July 26, 2026 (latest available at the time)
3. ✅ Data recovery - Subsequently recovered data from the original Scaleway disk covering the gap between the July 26 backup and the outage (see below)
4. ✅ Service verification - All systems operational and tested
5. ✅ Monitoring enabled - Full monitoring stack active on new infrastructure

Data Recovery Update

At the time of initial resolution, we restored service from a backup dated July 26, 2026, resulting in a data gap covering July 26 12:00 UTC – July 30 13:34 UTC (~4 days).

We have since recovered this data from the original Scaleway disk and merged it back into the production database. This covers:

• Compliance assessments created during this period
• User profile updates
• Data modifications and uploads made during this window

If you notice any records from this period that appear missing or inconsistent, please contact us so we can investigate and reconcile individually — for a recovery of this kind, we recommend spot-checking critical records.

Infrastructure Improvements

Moving forward:

• Primary: Hetzner Online GmbH, Cloud location Falkenstein (BSI C5 Type 2 certified)
• Secondary failover: Additional provider for redundancy (planned)
• Backup strategy: Hourly snapshots + geographic replication
• Monitoring: Enhanced incident detection and automated failover

Scaleway Incident Status

We remain in contact with Scaleway regarding this incident:

• Ticket: #1606734
• Status: Escalated to product team; under joint review given the corrected timeline and mechanism described above
• Expected resolution: Full incident report and remediation plan
• Legal follow-up: Discussing compensation for the service disruption

Thank You

We appreciate your patience during this incident, and your patience with the correction to this report. Your trust in Unicis is important to us, and we are taking this seriously to ensure it doesn’t happen again.

Any questions or data recovery needs? Contact: support@unicis.tech

Last Updated: 2026-08-19