[Jason Wilder]

We have run into quite  a bit of a problem and so far cannot figure this out.  Our Invoicing of Sales Order is taking way longer than normal.  We have a job queue entry that posts orders so I added a log to this that records the Start DateTime, End DateTime and Duration of each and every sales order.  Last Friday we started posting 7,500 orders at 5:30 PM and it didn’t finish until 2 AM.  This is way longer than what it has been in the past.  What I found from the log I created was that at exactly midnight EST our orders start posting almost 3 times faster.  This has happened Friday and Sat night and I am predict will happen tonight (Monday) as well.

We have 2 add-on’s that we feel have something to do with this: Avalara and ChargeLogic (CardConnect is the processor).  Posting a Sales Order with an Avalara web service call and a CardConnect web service call takes 7 to 8 seconds before midnight and 2.5 to 3.5 seconds after midnight.  I have many more details but this should be enough to see if anyone has heard of such a crazy thing before.  Some obvious things we have checked are if there are any magical NAV jobs that run at midnight or SQL maintenance jobs (indexes, stats) but there are none that happen at this time.  Nothing in any log that we can find on the service tier so far. 

The fact that it speeds up generally rules out the code in NAV since its the same code running before and after midnight.  Maybe the internet speeds up 3 times at 12 AM EST but that sounds a little far fetched.  Any thoughts on this would be much appreciated.

——————————
Jason Wilder
Senior Application Developer
Stonewall Kitchen
York ME
——————————

[Mark Anderson]

Hi Jason

I’ve had issues with Avalara performance in past (not with Nav: was an excel add-in I wrote to call their we services)

You can contact Avalara support and have them turn on logging. This will tell you how long their web services take to respond. They did it for me for 24 hours

Other option I can think of is a network monitor. I you monitor the packets at 5:30 for a few mins and 12:30am for a few mins, you should be able to figure out how long each web service is taking to respond

RegARDS

Mark

——————————
Mark Anderson
Director of ERP Systems
Clesen Wholesale
Evanston, IL
——————————
——————————————-

[Jason Wilder]

A correction and an interesting finding.

I was incorrect is saying that ChargeLogic makes a web service call to CardConnect during invoicing.  We have a separate NAS that actually looks at a queue and does the calling to the CardConnect web service.  This NAS processes the queue very fast.  I now think this issue has very little to do with the ChargeLogic web service call to CardConnect.

My other major finding and savior for the next few weeks is that I realized I can manually post orders at the same time (from a different machine) and they post at the fast speed (2.5 to 3.5 seconds).  I expected there to be locking and deadlocking but actually I have run into very little.

Still don’t know what is going on with our automated posting but at least I have a work around for now.  Still looking for suggestions.

——————————
Jason Wilder
Senior Application Developer
Stonewall Kitchen
York ME
——————————
——————————————-

[Chris Farmer]

We have also seen issues where NAV Performance can degrade if there are other jobs running at the same time, ie EDI Jobs.  May be a little basic, but best to check all your bases.

——————————
Chris Farmer
IT Project Manager
TMG Gases
Bryan TX
——————————
——————————————-

[Jason Wilder]

Thanks for the responses!  We found the issue. 

We have some security software called Carbon Protect and Carbon Defense.  Shutting these off fixes the issue 100%.  Posting is now under 2 seconds which is good since it includes a web service call to Avalara.  We still don’t get the midnight making things faster phenomenon but most likely related to the Carbon products I mentioned above do something at that time.

——————————
Jason Wilder
Senior Application Developer
Stonewall Kitchen
York ME
——————————
——————————————-