Due to a problem with Gandi's internal DNS, all of Gandi's services that use its domain name have been impacted. We are currently in the process of bringing them back online.
No server or customer domain name have been affected, nor have any emails been lost; there will be a delay in the reception of mails, however, as there are many waiting in the queue to be delivered.
We apologize for any inconvenience this may have caused.
On Wednesday, September 14th starting at 21:00 GMT (2PM PST / 5PM EST) and lasting for a maximum of 3 hours, Gandi's RoundCube webmail platform will be unavailable.
There will not be any interruption in the reception of emails, and you will see them in your RoundCube interface once it is made operational again.
During this time, you may consult your mails via another webmail, or any client mail (Apple Mail, Thunderbird, Outlook, etc.).
We are currently experiencing an anomaly with the GandiMail service affecting mail reception. Our technical team is investigating the issue. Incoming mail is currently being deferred while the affected subsystem is being diagnosed. Outgoing mail is not affected by this incident.
We sincerely apologise for any inconvenience.
Update 11:00 CET: Mail reception has resumed, and incoming mails are being delivered, though with a bit of delay whilst the backlog is cleared.
Update: 15:30 CET: The incoming mail systems have now been returned to normal operation. The interruption was due to a dysfunction of the anti-spam/policy subsystem which created a backlog of mail queues on the inbound spools. The backlog has now been cleared.
An incident has occured on one of our EQX (Paris) storage nodes, staff is working on it.
We'll keep you informed with this issue.
Update 14:03 CEST : During this filer maintenance, all hosting operations of the virtual servers (start/stop/update resources, ...) have been disabled for the moment.
Update 15:10 CEST : The filer is now stable, virtual server have now access to their disk on this filer. Hosting operations currently waiting (start/stop/conf/update/...) are now being processed.
Update 16:05 CEST : All the hosting operations in progress are now finished. All the virtual servers are now reachable.
An incident has occured on one of our EQX (Paris) storage nodes, staff is on-site to resolve the issue as soon as possible. We'll keep you informed with this issue.
EDIT @2:00am CEST: we're currently trying to resolve an important raid controller issue with the manufacturer support team
EDIT @2:50am CEST: no solution found with support yet, we'll proceed to the hardware replacement of a storage array
EDIT @3:10am CEST: trying to rebuild the raid array now. 1h30 estimated time for more information on the raid status, and we'll have to reboot the affected servers to ensure data integrity.
EDIT @5:00am CEST: rebuild is done. A read-only check was made on the disks and they all look clean. We are now starting the affected servers. Please ro check your filesystem (fsck -n), if possible do a safe full fsck, and take a fresh backup of your server in case an issue arises. We still follow this incident.
EDIT @9:00am CEST: issue is resolved and the storage array is stable. We'll close this incident, and handle individual request at the support level.
Sorry for the unusual delays in the handling of this major issue, and thank you for your patience.
We are currently looking into reports of Comcast users experiencing difficulties accessing Gandi's services.
Update: The problem was due to a bug in bind bind9.8.0 which we have just corrected. Please accept our apologies for any inconvienence this may have caused.