tag:status.opennode.com,2005:/historyOpenNode Status - Incident History2024-03-19T08:49:08ZOpenNodetag:status.opennode.com,2005:Incident/195504362023-12-28T13:33:52Z2023-12-28T13:39:51ZExtended maintenance<p><small>Dec <var data-var='date'>28</var>, <var data-var='time'>13:33</var> UTC</small><br><strong>Resolved</strong> - Maintenance has been completed and all systems are fully operational.</p><p><small>Dec <var data-var='date'>28</var>, <var data-var='time'>13:10</var> UTC</small><br><strong>Monitoring</strong> - Due to unforeseen technical challenges, our scheduled maintenance is extended.<br /><br />We apologize for any inconvenience. Updates will follow as we work to resolve this promptly.</p>tag:status.opennode.com,2005:Incident/195001832023-12-28T13:00:15Z2023-12-28T13:00:15ZScheduled Maintenance<p><small>Dec <var data-var='date'>28</var>, <var data-var='time'>13:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'>28</var>, <var data-var='time'>12:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'>21</var>, <var data-var='time'>18:19</var> UTC</small><br><strong>Scheduled</strong> - To enhance our services and ensure their continuous improvement, we will be conducting a scheduled maintenance on Thursday, December 28th, from 12pm to 1pm UTC. During this time, all OpenNode services, including API, dashboard, exchanges, checkouts, and withdrawals, will be temporarily unavailable.<br /><br />We understand the impact this may have on your activities and appreciate your understanding as we work to maintain and upgrade our systems.<br /><br />Should you have any questions, feel free to reach out to us at support@opennode.com.</p>tag:status.opennode.com,2005:Incident/176470702023-12-21T18:11:27Z2023-12-21T18:11:27ZAutomatic Conversion service outage<p><small>Dec <var data-var='date'>21</var>, <var data-var='time'>18:11</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>23:09</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>23:08</var> UTC</small><br><strong>Monitoring</strong> - Entities and Individuals registered in the United States can now onboard with our new provider through the dashboard. Upon completion, automatic conversion and all fiat related services will be reenabled. If you have questions or encounter issues, please reach out to support@opennode.com or visit the Intercom widget on the dashboard</p><p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>21:12</var> UTC</small><br><strong>Identified</strong> - We have recently been informed that one of our banking partners, Wyre, has made the decision to cease operations over the course of the next month. Clients that are onboarded with this provider and rely on fiat-related activities such as conversions will not be able to generate new payments at this time, unless the automatic conversion functionality is turned off.<br /><br />We have already initiated the process of engaging an alternative banking partner to seamlessly address fiat transaction needs. We anticipate having this new partner integrated into our platform within the next few weeks, thereby ensuring that all fiat operations are available and fully operational without any significant interruption.</p>tag:status.opennode.com,2005:Incident/185049022023-09-14T22:06:16Z2023-09-14T22:06:16ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>22:06</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>21:47</var> UTC</small><br><strong>Investigating</strong> - We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.</p>tag:status.opennode.com,2005:Incident/182948162023-08-29T14:46:51Z2023-08-29T14:46:51ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Aug <var data-var='date'>29</var>, <var data-var='time'>14:46</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>20:23</var> UTC</small><br><strong>Identified</strong> - Our Exchange Partner has identified a fix and its working on a resolution.</p><p><small>Aug <var data-var='date'>28</var>, <var data-var='time'>15:26</var> UTC</small><br><strong>Investigating</strong> - We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.<br /><br />In the meantime, all conversions and outgoing bank transfers are disabled.</p>tag:status.opennode.com,2005:Incident/172310462023-05-12T19:00:28Z2023-05-12T23:49:41ZInbound payment webhooks are delayed<p><small>May <var data-var='date'>12</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>Resolved</strong> - Queue is now clean. Incoming payment webhooks are now being delivered instantly.</p><p><small>May <var data-var='date'>12</var>, <var data-var='time'>18:54</var> UTC</small><br><strong>Update</strong> - Incoming payments webhook queue is almost clean. Webhooks should start to operate instantly soon.</p><p><small>May <var data-var='date'>12</var>, <var data-var='time'>18:33</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented, we're monitoring the results.</p><p><small>May <var data-var='date'>12</var>, <var data-var='time'>18:24</var> UTC</small><br><strong>Identified</strong> - We're currently investing an issue where incoming payment webhooks are delayed.</p>tag:status.opennode.com,2005:Incident/161557402023-02-16T02:36:15Z2023-02-16T02:36:15ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>02:36</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved and the platform is fully operational.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>02:28</var> UTC</small><br><strong>Monitoring</strong> - This incident has been resolved and we are monitoring the results. Conversions and bank transfers are now enabled.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>01:09</var> UTC</small><br><strong>Investigating</strong> - We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.<br /><br />In the meantime, all conversions and outgoing bank transfers are disabled.</p>tag:status.opennode.com,2005:Incident/153676742022-12-17T16:06:33Z2022-12-17T16:06:33ZInvestigating issues with email delays<p><small>Dec <var data-var='date'>17</var>, <var data-var='time'>16:06</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>16</var>, <var data-var='time'>23:56</var> UTC</small><br><strong>Identified</strong> - Emails are still being sent and delivered but with significant delays due to an issue our provider.</p>tag:status.opennode.com,2005:Incident/144363112022-12-05T21:13:21Z2022-12-05T21:13:21ZInvestigating connectivity issues<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>21:13</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved and the platform is now fully operational.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>21:06</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implement by our cloud infrastructure provider and we are monitoring the results. Connectivity is coming back up.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>20:59</var> UTC</small><br><strong>Identified</strong> - This issue has been identified and is related to our cloud infrastructure provider. The connectivity issue is partial (it doesn't apply to all regions).</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>20:23</var> UTC</small><br><strong>Investigating</strong> - Our team is investigating an connectivity incident affecting our platform and will provide updates here.</p>tag:status.opennode.com,2005:Incident/135857162022-11-21T22:28:18Z2022-11-21T22:28:18ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>22:28</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved and the platform is fully operational.</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>22:18</var> UTC</small><br><strong>Monitoring</strong> - This incident has been resolved and we are monitoring the results. Conversions and bank transfers are now enabled.</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>22:02</var> UTC</small><br><strong>Investigating</strong> - We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.<br /><br />In the meantime, all conversions and outgoing bank transfers are disabled.</p>tag:status.opennode.com,2005:Incident/126988482022-11-03T20:36:07Z2022-11-03T20:36:07ZProduction maintenance<p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>20:36</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>20:18</var> UTC</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>20:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>21:23</var> UTC</small><br><strong>Scheduled</strong> - OpenNode will be unavailable for about 30 minutes for essential infrastructure upgrades. During this time, payments, transfers, and our online dashboard will be unavailable.</p>tag:status.opennode.com,2005:Incident/110420972022-09-03T00:05:11Z2022-09-03T00:05:11ZLightning payments are taking longer than expected to update its status<p><small>Sep <var data-var='date'> 3</var>, <var data-var='time'>00:05</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved and the platform is fully operational.</p><p><small>Sep <var data-var='date'> 2</var>, <var data-var='time'>23:48</var> UTC</small><br><strong>Update</strong> - A fix has been deployed. We are monitoring for any further issues.</p><p><small>Sep <var data-var='date'> 2</var>, <var data-var='time'>22:30</var> UTC</small><br><strong>Monitoring</strong> - Affected lightning payments are now reflecting their updated status and webhooks were sent.</p><p><small>Sep <var data-var='date'> 2</var>, <var data-var='time'>18:53</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue. Please refer to this page for more updates.</p><p><small>Sep <var data-var='date'> 2</var>, <var data-var='time'>16:53</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented by our engineering team. Paid payments will be updated shortly and webhooks will be fired. Please refer to this page for more updates.</p><p><small>Sep <var data-var='date'> 2</var>, <var data-var='time'>16:50</var> UTC</small><br><strong>Investigating</strong> - We currently investigating an issue where Lightning payments are taking longer than expected to update its status. Lightning payment webhooks are also being affected.</p>tag:status.opennode.com,2005:Incident/107040492022-07-27T21:31:25Z2022-07-27T21:31:25ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>21:31</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved. Conversions and bank transfers are now fully operational.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>21:24</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented by our partner and we are monitoring the results.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>21:18</var> UTC</small><br><strong>Investigating</strong> - We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.<br /><br />In the meantime, all conversions and outgoing bank transfers are disabled.</p>tag:status.opennode.com,2005:Incident/106575572022-07-18T17:30:00Z2022-07-21T02:57:17ZElevated API errors for outbound Lightning payments<p><small>Jul <var data-var='date'>18</var>, <var data-var='time'>17:30</var> UTC</small><br><strong>Resolved</strong> - We're seeing an elevated API error rate on outbound Lightning payments.</p>tag:status.opennode.com,2005:Incident/104958282022-07-08T06:02:18Z2022-07-08T06:02:18ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>06:02</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved. Conversions and bank transfers are now fully operational.</p><p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>05:58</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented by our partner and we are monitoring the results.</p><p><small>Jul <var data-var='date'> 8</var>, <var data-var='time'>02:54</var> UTC</small><br><strong>Investigating</strong> - We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.<br /><br />In the meantime, all conversions and outgoing bank transfers are disabled.</p>tag:status.opennode.com,2005:Incident/103662782022-06-21T07:29:19Z2022-06-21T07:29:19ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>07:29</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved. Conversions and bank transfers are now fully operational.</p><p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>06:58</var> UTC</small><br><strong>Investigating</strong> - We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.<br /><br />In the meantime, all conversions and outgoing bank transfers are disabled.</p>tag:status.opennode.com,2005:Incident/99689252022-05-11T18:57:35Z2022-05-11T18:57:35ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>May <var data-var='date'>11</var>, <var data-var='time'>18:57</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved. Conversions and bank transfers are now fully operational.</p><p><small>May <var data-var='date'>11</var>, <var data-var='time'>18:43</var> UTC</small><br><strong>Identified</strong> - We're receiving a higher API error rate on payment requests initiated by merchants/businesses who have auto-conversion turned on. We have notified our exchange partner and are monitoring for resolution.<br /><br />In the meantime, all conversions and outgoing bank transfers are disabled.</p>tag:status.opennode.com,2005:Incident/92992882022-02-12T15:05:22Z2022-02-12T15:05:22ZInvestigating issues with our platform<p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>15:05</var> UTC</small><br><strong>Resolved</strong> - We have identified and resolved the issue causing intermittent issues with our infrastructure.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>14:39</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating an issue that's causing intermittent failures in our platform. Please refer to this status page to get the latest updates on this incident.</p>tag:status.opennode.com,2005:Incident/87839762021-12-07T18:59:20Z2021-12-07T18:59:20ZOutage on Infrastructure Provider<p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>18:59</var> UTC</small><br><strong>Resolved</strong> - Outgoing transfers are now available.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>18:23</var> UTC</small><br><strong>Monitoring</strong> - Infrastructure provider is now stable and we're monitoring the activity.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>17:57</var> UTC</small><br><strong>Investigating</strong> - We're being affected by a major outage on one of our infrastructure providers. Outgoing transfers will be disabled during this time.</p>tag:status.opennode.com,2005:Incident/82830142021-10-21T16:14:17Z2021-10-21T16:14:17ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>16:14</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>15:46</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>15:36</var> UTC</small><br><strong>Investigating</strong> - We're seeing increased errors in API for payment requests that have auto-conversion enaled. We're waiting for our local currency liquidity provider to fix the issues.</p>tag:status.opennode.com,2005:Incident/79947732021-09-14T23:02:54Z2021-09-14T23:02:54ZElevated API Errors for Payment Requests with Auto-Conversion enabled<p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>23:02</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>21:42</var> UTC</small><br><strong>Update</strong> - A fix was deployed by our partner and the errors are decreasing. Monitoring.</p><p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>21:12</var> UTC</small><br><strong>Monitoring</strong> - We're seeing increased errors in API for payment requests that have auto-conversion enaled. We're waiting for our local currency liquidity provider to fix the issues.</p>tag:status.opennode.com,2005:Incident/76829842021-08-04T20:18:47Z2021-08-10T23:22:46ZOutbound BTC Transfers temporarily disabled<p><small>Aug <var data-var='date'> 4</var>, <var data-var='time'>20:18</var> UTC</small><br><strong>Resolved</strong> - Outbound BTC Transfers via API & Dashboard are now available.</p><p><small>Aug <var data-var='date'> 4</var>, <var data-var='time'>18:29</var> UTC</small><br><strong>Investigating</strong> - Outbound BTC Transfers via API & Dashboard are temporarily disabled</p>tag:status.opennode.com,2005:Incident/76823912021-08-04T17:55:32Z2021-08-04T17:55:32ZProduction Maintenance<p><small>Aug <var data-var='date'> 4</var>, <var data-var='time'>17:55</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'> 4</var>, <var data-var='time'>17:30</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'> 4</var>, <var data-var='time'>17:25</var> UTC</small><br><strong>Scheduled</strong> - OpenNode will be unavailable for about 30 minutes for essential infrastructure upgrades. During this time, payments and our online dashboard will be unavailable.<br /><br />We apologize for any inconvenience this may cause. If you have further questions please contact us at support@opennode.com</p>tag:status.opennode.com,2005:Incident/73334002021-06-25T23:18:10Z2021-06-25T23:18:10ZTimeouts while generating new charges<p><small>Jun <var data-var='date'>25</var>, <var data-var='time'>23:18</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>25</var>, <var data-var='time'>22:01</var> UTC</small><br><strong>Identified</strong> - We are aware of some timeouts while generate new charges due to one of our exchange partners unexpected downtime.</p>tag:status.opennode.com,2005:Incident/58709152021-02-11T15:49:08Z2021-02-11T15:49:08ZPay by Card service interruption<p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>15:49</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>23</var>, <var data-var='time'>17:42</var> UTC</small><br><strong>Investigating</strong> - Pay by Card service is temporarily disabled</p>