Q-Weigh Prod server - Inbound & Out bound entries were missing in MYSQL table.

Root Cause Identified:

Root cause remained unidentified as no issues were observed from Infra perspective post VM resizing activity.

However, it was learned during the troubleshooting call that client application team implemented some change in application environment around 18^th or 19^th Dec 2022, which might have caused the delay in data synchronization for MYSQL database. Which in result was not even recorded in the schedule backups.

Important events for detailed RCA:

With the help of MS team Q-Weigh Prod server OS was rebooted using old Kernel, post which VM and Q-Weigh application became accessible.

Post restoration of production VM (Qweighprd) – the GRInfra application team reported issue that - inbound entries are visible in MYSQL database tables, however out bound entries are not reflecting in the Q-weigh application since 5:28 pm IST 24^th Dec 2022,

Noventiq GDC Support team tried to restore the missing entries for MYSQL database tables through VM backups taken for date 23^rd,25^th and 27^th Dec 2022, however outbound data entries were still not reflecting in MYSQL database tables.

Noventiq GDC Support team advised GRInfra application team to check the data synchronization at their end. Lastly Application team suggested to restart the Q-Weigh Prod server and confirmed once the inbound data entries will get updated sequentially, the Outbound data entries will also get auto sequentially synchronized.

Post restart of Q-Weigh Prod server both the inbound and out bound data entries got self-synchronized, and data was reflecting up to date as confirmed by GRInfra application team. Through out the investigation no configuration or any other changes were performed by the Noventiq GDC support team.