[IGSMAIL-8157] CDDIS - Outage 2 Feb 2022 - Explanation

['Michael, Benjamin P. (GSFC-61A0)' via IGS Mail]

Dear Colleagues,

Yesterday some of you may have noticed that several of the CDDIS services were unavailable.  From about 12:00 UTC to 16:30 UTC the CDDIS data upload facility and data distribution (https) were affected by an internal NASA DNS outage.  Our data distribution using ftp-ssl, GNSS real-time activities and all other services were unaffected.  CDDIS was fully operational during this time but unfortunately all DNS lookups in our private IP space failed.  The system that failed was a triply redundant system.  Both the primary and secondary systems went down and the tertiary system experienced issues with response time.  As such you could get to CDDIS from the outside (public IP space), but any activity that relied on services for load balancing, authentication, etc would fail.  As this is a NASA agency-maintained resource, CDDIS (and other projects) were at the mercy of the agency to get corrected.

I truly apologize for this outage.  If you have any questions or concerns, please feel free to reach out to me to discuss.

R
Pat

Patrick Michael
Manager
Crustal Dynamics Data Information System (CDDIS)
NASA-Goddard Space Flight Center
Greenbelt, MD 20771
301-614-5370
Patrick.Michael at nasa.gov<mailto:Patrick.Michael at nasa.gov>

[signature_1697542868]



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.igs.org/pipermail/igsmail/attachments/20220203/70482e3e/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 2422625 bytes
Desc: image001.png
URL: <http://lists.igs.org/pipermail/igsmail/attachments/20220203/70482e3e/attachment-0001.png>