Postmortem -
Read details
Apr 30, 15:16 UTC
Completed -
Network signaling congestion has been resolved, and 2G/3G and LTE network functionality is currently normal worldwide.
Devices should continue to reattach on their own after any failed requests have timed out or any device back-off periods have expired.
As devices reattach, our team continues to work with affected customers. A post-mortem will be published at status.hologram.io
Apr 24, 03:16 UTC
Update -
Our upstream carrier partners and signaling providers have fixed network congestion issues, and 2G/3G and LTE network functionality is currently normal worldwide. We are continuing to monitor along with our partners.
Devices should continue to reattach on their own after any failed requests have timed out or any device back-off periods have expired.
As devices reattach, our team continues to work with affected customers.
Apr 23, 22:34 UTC
Update -
We are continuing to monitor progress
Apr 23, 21:12 UTC
Update -
Our upstream carrier partners continue to improve on network signaling congestion.
Global LTE networks are operating near normal levels.
Global 2G/3G is still sub-nominal but we have been seeing continuous improvement. Customers in the UK specifically may see issues attaching 2G/3G devices to the network.
US 2G/3G networks are operating near normal levels.
Apr 23, 19:54 UTC
Update -
We are continuing to see more devices reattach as network congestion decreases and continue to monitor the situation with our upstream carrier partners
Apr 23, 17:02 UTC
Update -
Our team is monitoring a small number of network connection requests delayed by signaling network congestion, primarily affecting 2G/3G connection requests. Impacted devices continue to reconnect and overall network connection counts and activity are near normal levels. Our team is actively working with network partners through resolution for remaining devices.
Apr 23, 14:29 UTC
Update -
Signaling congestion has been eliminated and network performance has been restored to prior levels. We will continue to monitor as remaining devices reconnect.
Apr 23, 07:01 UTC
Verifying -
We are seeing 2G and 3G sessions recovering. We will monitor the situation to confirm resolution.
Apr 23, 06:40 UTC
Update -
We are seeing service mostly restored and working well for LTE devices. Our upstream carrier partners are still working to manage signaling traffic to bring the remaining 2G and 3G devices online.
Apr 23, 04:58 UTC
Update -
Issue has been identified as signaling congestion from large number of devices reconnecting. Carriers are working to increase capacity on their systems
Apr 23, 03:26 UTC
Update -
Devices are coming back online from the maintenance window, however this process is moving slower than expected. We are working with our carrier partners to speed this up.
Apr 23, 02:54 UTC
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 22, 22:55 UTC
Scheduled -
One of our carrier partners will be performing planned network maintenance on core packet networking infrastructure on April 22nd, beginning at 22:55 UTC and running until 03:00 UTC April 23rd. This maintenance is necessary for improvements to preventative security measures as well as making overall improvements to network operation. Indigo SIMs will not be impacted.
Impacts: During the active work beginning at 01:00 UTC and through 01:30 UTC April 23rd there may be brief losses of data routing and packet deliverability, resulting in connections being dropped or destination hosts becoming temporarily unreachable. PDP contexts (packet-switched data sessions) and automatic IP address assignment requests may timeout. SIM operations (activation, deactivation, pausing, and unpausing) should not be affected. Tower authentication and circuit-switched SMS should not be affected. Dashboard and API will not be affected.
We recommend avoiding performing critical maintenance or operations on devices during this maintenance window. If you have any questions, please feel free to reach out to
support@hologram.io, and the Hologram team will be standing by during the maintenance window to answer any questions.
Apr 9, 15:14 UTC
