Current System Status:
All systems online.
Any issues should now be resolved. Our developers believe they have isolated the issue, which was related to our web servers. Developers are monitoring to make sure it doesn't happen again.
We have received numerous reports of outages impacting customers. We have developers inspecting the issue now and will post here when we have more information. The issue seems to be in and out, so for now we recommend trying the software every few minutes if you're experiencing the outage.
UPDATE: 5/2/3019 1:59pm Pacific
Microsoft's Azure Services is now confirming a global outage. We are continuing to work with them as closely as we are able to get our services back online.
UPDATE: 5/2/2019 1:39pm Pacific
Microsoft Azure (the world's largest cloud provider) is having connectivity issues. Their official statement is as follows: "We are investigating reports of connectivity issues with Azure Services. More information will be provided as it becomes available."
Know that we are working with them as closely as we are able and will continue to update as more information becomes available.
UPDATE: 5/2/2019 1:30pm Pacific
We are aware of the issue and are working on a resolution. Please keep trying every few minutes. If you have created a support ticket please know we will contact you back as soon as we are able. Thank you for your patience while we resolve the issue.
We have received multiple reports of API and token errors. Our developers are aware and are working on a solution.
Development applied a fix. If you are still experiencing these errors, please refresh your browsers/POS Terminal software.
Vantiv Non-Hosted Credit Card Processing Failing
Customers have notified and we have verified that come people processing Vantiv Non-hosted payments are seeing failures.
We were able to successfully run a live card on Vantiv Non-hosted. We will continue to monitor to see if this issue has been resolved by Vantiv or if it is intermittent
We are still seeing errors through Vantiv Non-hosted accounts. We are running advanced trace to see where and why this process is failing. All other credit card services are processing as normal.
Issue is fixed. It was a single PCS cloud server that was out of sync in connecting to the Vantiv Non-Hosted credit card processing. We are putting into place check and blocks to prevent a single server from getting out of sync.
Update on Customer Search Function issue:
The customer database finished indexing early this morning. The customer search should now function as expected. You should also notice a boost in speed if you are on a fast enough network.
Thank you all for your patience
Update on Customer Search Function issue:
During the latest downtime, Party Center Software moved all of our servers and databases to Microsoft Azure. The Azure solution will improve the speed and reliability of our entire system as well as allow us to easily upgrade and scale our hardware over time. During the server migration, the database had to be moved and fully restored. As part of that process, there are a number of database indexes that have to run. These database indexes help to optimize the speed of fetching information from the database tables. Many of you have noticed the slowness or missing data when performing customer searches. This is directly related to an index that is still running. We expect the index to finish performing its task by the end of the day. This is a one-time process that we must let finish. We apologize for the inconvenience and will post another update when then index finishes running. Until then you can continue to use the system as you normally would.
Sales Analysis Report: We've fixed the issue and applied the patch to production. The report will now return the expected results.
Notice of Customer Search Function issue:
We've received several reports today and have confirmed an issue with the customer search function on the software. Currently you are able to search customers via the Alphabet option on the customers page. We are working with the dev team to resolve the issue as soon as possible.
NOTE: In the meantime you can click on the letter of their name from the customer page and use Ctrl + F to find that customer on the page.
Notice of Possible Worldpay Processing Issues:
We've received several reports today of Socket Errors and general slowness of payment processing through Worldpay, particularly through the older Mercury non-hosted payment accounts. This is a Worldpay issue and they should be stable now, but if you receive errors when processing through Worldpay we recommend waiting several minutes and then trying again.
If you continue to receive red error messages, please take a full screenshot of the page (so that we can get the order number with the error information) and submit those screenshots to firstname.lastname@example.org with your facility's name. Thank you!
Notice of possible connectivity issues:
We've received several messages today about slow connections and time-outs when accessing Party Center Software. The problem is related to certain internet service providers, not with our servers or our software. We are working to help resolve the issue but if you continue to experience slower than average internet speed you may need to contact your internet service provider.
These reports have largely come from Arizona and Oklahoma.
April 10, 2018 12:03pm Pacific
Vantiv non-hosted payments is having issues. The PCS token server had issue creating and processing tokens for non-hosted payments. We are still investigating the issue and will put additional safegaurds in place to assure we don't have this issue again.
NOTE: Non-hosted accounts are old technology and they are on their way out. We, as well as everyone else, are depreciating all non-hosted payment options and moving to a hosted platform to reduce or eliminate a lot of the PCI compliance issues that you have with a non-hosted. There have been no, as we can tell, issues with Vantiv using hosted accounts. Those have been live and operational without any known outages over the past 6 months. Switching to a hosted account costs about $50-80 for the encrypted swiper and then a slight settings change on PCS. We recommend all people using non-hosted account move immediately to a hosted account using an encrypted swiper.
March 27th, 2018 @ 8:47am Pacific
There was an issue related to Vantiv gift processing this morning which is now resolved. If you experienced this issue, please reboot/restart Party Center Software. We'll continue monitoring this throughout the day.
March 21st, 2018 @ 8:58am Pacific
Some customers were experiencing the system logging them out. It looks to be related to some security cookie updates to a load balancer. The issue was completely fixed and systems were returned to normal by 9:25am Pacific time.
March 7, 2018 @ 10:14am Pacific
Vantiv is having issues
@10:14am Pacific Time - There seems to be some customers experiencing issues with Vantiv Non-hosted processing. We are reaching out to Vantiv to get an ETA on the resolution.
March 3, 2018
Vantiv is having issues
@2:10pm Pacific Time - We have heard that many customers are returning to normal credit card activity. Vantiv is still working on correcting this issue. There continues to be known outages or slowness in certain areas especially north-eastern US.
@1:45pm Pacific Time- we were notified that some customers may be experiencing localized internet issue from providers such as Comcast. Here is the current outage map from Comcast.
@1:28pm Pacific Time
Some Vantiv customers are experiencing issues processing credit cards due to an issue in Vantiv's systems. Vantiv is aware of this issue and we will be monitoring and will update as we know more. We are still reaching out to our development department leads at Vantiv to see if there is anything else we can do to assure this gets fixed asap. As of now it is an issue solely residing on Vantiv.
February 27, 2018 @ 10:45am PST
CUSTOM THEMEING ISSUE: (Press Control+F5 to refresh screen) All custom online booking themes seem to be reverting to the default theme.The dev team is looking into this and will have a resolution quickly. The online booking looks to be operating normally.
Check back for an update shortly.
February 8, 2018 5:03pm PST
We’ve been notified by Rackspace of an emergency window of downtime occurring tonight in order to address some critical security risks. The 1 hour maintenance window with scheduled downtime will occur tonight, Wednesday, February 8th at 11:30 PM Central Time until 12:30 AM Thursday, February 9th.
While the window is scheduled for 1 hour we do not expect the system to be offline for more than 5-10 minutes according to Rackspace. We know how important it is for you and your business to stay online.
We appreciate your patience and will have the maintenance window staffed and supported should you have questions during that time.