cRIO-9040 freezes after several days - Embedded UI and SSH unresponsive, no CPU/RAM saturation

[Ghis]

Hi everyone,

Has anyone experienced a cRIO-9040 freezing after several days of operation, with no obvious CPU or memory overload?

We’re running LabVIEW RT 2021 with Embedded UI, NI Linux RT 8.10 (kernel 5.10.83-rt58), and controller firmware 25.5.0f112-x64.

The application was doing simple temperature regulation and buffered TDMS recording. No plots were displayed and there had been almost no user interaction over the weekend.

Around 4 AM, all logging stopped. That morning:

• The pointer still moved, but neither the LabVIEW UI nor the desktop menu responded.

• SSH was also inaccessible.

• A manual restart was required.

The last resource samples showed roughly 11% / 22% CPU usage and 51% physical memory usage. No explicit crash was found in the retained logs. Unfortunately, /var/log was volatile, so its contents were lost on restart.

Does this sound familiar? What would you enable beforehand to diagnose the next occurrence, especially if SSH becomes unavailable?

I have the logs and more details about the application if useful. Thanks!