Update - We continue to work through this issue and have had numerous starts/stops with regards to solutions where it appears that data begins to ingest and then returns to delay. This has been escalated both internally and with the appropriate partner to work towards a permanent solution.
Sep 27, 13:07 UTC
Investigating - Data is coming into the system with a delay. Investigating for a cause and resolution.
Sep 4, 22:30 UTC

About This Site

Lithium monitors all of its critical services both internally and through 3rd party services. This page reports on known infrastructure wide incidents affecting Lithium platform. If you're experiencing an availability or a performance issue that isn't shown here, please report it to outage@lithium.com. Subscribing to updates is the best way to stay informed about any issues affecting Lithium platform availability.

Community Operational
AMER Community Datacenter   ? Operational
EMEA Community Datacenter   ? Operational
APAC Community Datacenter   ? Operational
LSI   Operational
API   Operational
CDN   Operational
Social Media Management Operational
AMER & APAC SMM Datacenter   ? Operational
EMEA SMM Datacenter   ? Operational
SMM Analytics   Operational
Twitter API   ? Operational
Facebook API   ? Operational
Other APIs   ? Operational
AMER SMM CRM Connector   Operational
EMEA SMM CRM Connector   Operational
Stage SMM CRM Connector   Operational
Lithium JX Communities Operational
Lithium JX Community Platform   ? Operational
Lithium JX Phoenix (PHX) Datacenter   Operational
Lithium JX Amsterdam (AMS) Datacenter   Operational
Lithium JX Cloud Analytics   Operational
Lithium JX Bunchball   Operational
Lithium JX Video   Operational
Lithium JX Cloud Search   Operational
Lithium JX Rewards   Operational
Lithium JX Streamonce   Operational
Lithium Corporate Operational
The Lithium Community   ? Operational
Lithium Case Management & Portal   Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Nov 15, 2018

No incidents reported today.

Nov 14, 2018

No incidents reported.

Nov 13, 2018

No incidents reported.

Nov 12, 2018
Resolved - All Facebook systems appear to be back up and functioning.
Nov 12, 19:16 UTC
Monitoring - Facebook's API, website (including their status page) and app appears to intermittently be down for many users. We're monitoring our logs and Facebook's status page closely for further information.
Nov 12, 18:28 UTC
Nov 11, 2018

No incidents reported.

Nov 10, 2018

No incidents reported.

Nov 9, 2018
Resolved - The Instagram API issues have been resolved.
Nov 9, 21:23 UTC
Monitoring - The Instagram API and Instagram in general (including their website and phone apps) are encountering slowness and performance issues. We're monitoring the situation closely.
Nov 9, 19:37 UTC
Nov 8, 2018
Resolved - The remaining sites affected by this have completed upgrading successfully.
Nov 8, 20:35 UTC
Update - Most JX sites affected have completed their upgrades and are live again, we are monitoring the last few upgrades to ensure they complete successfully.
Nov 8, 17:17 UTC
Identified - Some Lithium JX sites are currently showing as down for maintenance, Lithium is aware of this issue and are working to get those sites back up as soon as possible. Some customer sites are undergoing a downtime upgrade instead of a HAZDU (rolling upgrade), they will remain down until the upgrade is complete.
Nov 8, 16:59 UTC
Resolved - Newly created content is now showing up in search results as expected.
Nov 8, 17:46 UTC
Investigating - We are aware of multiple customers experiencing errors when trying to search for recently created spaces/content. We have notified the service provider and they are investigating the cause of the search issues.
Nov 2, 16:17 UTC
Nov 7, 2018

No incidents reported.

Nov 6, 2018

No incidents reported.

Nov 5, 2018
Resolved - The SMM Analytics outage has been resolved and everything should now be fully functional again.
Nov 5, 20:41 UTC
Update - SMM Analytics reporting will remain disabled for an additional two hours. Again, we apologize for any inconvenience this may be causing you.
Nov 5, 18:34 UTC
Update - We are still investigating the SMM Analytics outage. All executing reports are currently being purged and all additional reports be rejected for the next two hours. Once this status is resolved you will need to run your reports again. We do apologize for any inconvenience this may cause.
Nov 5, 16:20 UTC
Identified - All US Customers are currently experiencing an outage for SMM analytics. We have identified a problem and will update as soon as we have more information.
Nov 5, 16:06 UTC
Nov 4, 2018

No incidents reported.

Nov 3, 2018

No incidents reported.

Nov 2, 2018
Resolved - Previous DES functionality has been restored.
Nov 2, 18:09 UTC
Investigating - Reports of 5XX response codes are being given when attempting to utilize DES. This is being investigated for a cause and resolution.
Nov 2, 12:45 UTC
Nov 1, 2018
Resolved - Previous DES functionality has been restored.
Nov 1, 18:29 UTC
Investigating - Reports of 5XX response codes are being given when attempting to utilize DES. This is being investigated for a cause and resolution.
Nov 1, 13:59 UTC
Oct 31, 2018

No incidents reported.

Oct 30, 2018
Resolved - Search issues have been resolved.
Oct 30, 20:28 UTC
Update - There is an issue in the PHX datacenter impacting Cloud Search. Currently no results are being provided.
Oct 30, 20:13 UTC
Investigating - We are currently investigating this issue.
Oct 30, 20:12 UTC
Identified - There is an issue in the PHX datacenter impacting Cloud Search. Currently no results are being provided.
Oct 30, 20:11 UTC
Oct 29, 2018

No incidents reported.

Oct 28, 2018
Resolved - Connectivity of the service to the underlying data has been repaired. Previous functionality of DES has been restored.
Oct 28, 02:57 UTC
Investigating - Reports of 502 and 504 response codes are being given when attempting to utilize DES. This is being investigated for a cause and resolution.
Oct 27, 21:33 UTC
Oct 26, 2018
Resolved - This incident has been resolved.
Oct 26, 18:44 UTC
Monitoring - Engineering is still investigating this incident, but the initial suspicion is that Facebook rolled out an API change and has now reverted it. However, a reconnect will be required.

Please have an Administrator of your Facebook page navigate to Account Admin -> Social integrations and perform a Reconnect of any integrations that are in the Reconnect state. We have documentation available on this here:

https://lithosphere.lithium.com/t5/SMM-Solutions/How-do-I-reconnect-a-Facebook-integration-in-Social-Response/ta-p/88078
Oct 26, 20:00 UTC
Update - We are receiving reports that the Facebook reconnects are not resolving this issue. Lithium engineering is investigating further. We will provide another update once we have more information.
Oct 26, 18:11 UTC
Investigating - We are currently investigating reports of Facebook tokens becoming invalidated.
Oct 26, 17:57 UTC
Oct 25, 2018

No incidents reported.

Oct 24, 2018

No incidents reported.

Oct 23, 2018
Resolved - This should now be resolved per Facebook's latest update to https://developers.facebook.com/status/issues/725292911162575
Oct 23, 23:23 UTC
Identified - Latency with Facebook webhooks may result in some delays for ingestion by SMM. Facebook is aware of the problem and investigating, which can be monitored here:

https://developers.facebook.com/status/issues/725292911162575/
Oct 23, 15:43 UTC
Oct 22, 2018
Resolved - The issue should now be resolved. Thank you for your patience!
Oct 22, 23:01 UTC
Update - We are continuing to work on a solution to this and hope to have more updates soon. Thank you for your continued patience!
Oct 22, 21:48 UTC
Investigating - We are currently investigating reports of agents being unable to respond to Twitter conversations due to the following error:

----
Unable to send response to Twitter : Failed to send Twitter status update. User is over daily status update
----

We will update once we have more information.
Oct 22, 19:20 UTC
Oct 21, 2018

No incidents reported.

Oct 20, 2018

No incidents reported.

Oct 19, 2018

No incidents reported.

Oct 18, 2018

No incidents reported.

Oct 17, 2018

No incidents reported.

Oct 16, 2018
Resolved - The issue with the Jive PHX datadenter has been resolved
Oct 16, 16:01 UTC
Monitoring - The issues with the Jive PHX datacenter have been identified and resolved. We will continue to monitor the situation to confirm.
Oct 16, 15:21 UTC
Update - We are continuing to investigate this issue.
Oct 16, 14:25 UTC
Investigating - Jive is aware that United States customers with JX instances on PHX datacenter are having intermittent problems to access their community. Their team has isolated a network issue. At this moment, they are actively working on the actions to resolve the issue. We will continue to provide an update until the issues are resolved. We sincerely apologize for the inconvenience this has caused.
Oct 16, 13:50 UTC
Resolved - Our LSI team has been able to resolve the issue and back filled the missing metrics.

If you do spot anything amiss please file a support case through the portal.
Oct 16, 05:21 UTC
Identified - Our LSI engineering team has found the issue and is currently back filling the metrics. This might take some time.

We will update the status page once the back fill has been completed.
Oct 15, 09:43 UTC
Investigating - We are aware that metrics in LSI for the EMEA region isn't displaying Friday through to today.
We are working with our engineering team to resolve this and backfill the metrics.
Oct 15, 08:45 UTC