Error backing up Exchange 2016

Fighting with the backup for my Exchange 2016 server. It was working fine. Then upgrading to 6.4 caused issues and I had to reinstall the Agents. now the Exchange server will not back up. Gives the error below. Any suggestions?

The transfer failed: 'Call to service method exch:8006/.../snapshots POST failed: The transfer failed: 'Insufficient memory to continue the execution of the program.''

Parents
  • Insufficient memory errors are almost always caused by memory issues on the agent being backed up. Can you post the entire stack trace of the error? Also, check the AppRecoveryPM.log file on the Exchange server (c:\programdata\apprecovery\logs\AppRecoveryPM.log) and see what errors are in there.

  • Going to Reboot the server tonight.  There is a line in the log saying a reboot is required.  There are also VSS errors Stack trace is below

    Server side:

    Replay.Agent.Contracts.Transfer.TransferFailedException: The transfer failed: 'There was a problem with the VSS subsystem on 'EXCH'.' ---> System.AggregateException: One or more errors occurred. ---> Replay.Core.Contracts.Transfer.VssGeneralErrorException: There was a problem with the VSS subsystem on 'EXCH'. ---> Replay.Agent.Contracts.ShadowCopy.ShadowCopyException: DoSnapshotSet failed with error: 'Expected provider error. Check the event log for details.' at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.CheckQueryStatus(Action method, String fromMethod, Boolean canBeRetryable) at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.PreBackup() at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.TakeSnapshot() at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.TakeSnapshot(TakeSnapshotRequest request, VolumeName[] volumesToSnap, IVssImplementation vss, IWin32 win32, ITevoLibWrapper tevoLibWrapper, IWmiWrapper wmiWrapper, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& excludedWritersStatuses) at Replay.Agent.Implementation.ShadowCopy.ShadowCopyService.TakeSnapshot(TakeSnapshotRequest request, VolumeName[] volumesToSnap, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& excludedWritersStatuses) at Replay.Agent.Implementation.Transfer.TransferSessionBase.PrepareShadowCopy(TakeSnapshotRequest request, IDriversService driversService, ITevoLibWrapper driverApi, IShadowCopyService shadowCopyService, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& volumesToAssumeAsNotSnappable, List1& excludedWriterStatuses) at Replay.Agent.Implementation.Transfer.TransferSessionBase.PrepareToTakeSnapshot(TakeSnapshotRequest request, IShadowCopyService shadowCopyService, IDriversService driversService, ITevoLibWrapper driverApi, IStorageMetadata metadata, Dictionary2& errorVolumes, IShadowCopy& shadowCopy, Dictionary2& shadowCopyFiles, List1& volumesToAssumeAsNotSnap, List`1& excludedWritersStatuses) at Replay.Agent.Implementation.Transfer.TransferSession.StartTransferSession(String agentHostName, IPAddress coreIPAddress, TakeSnapshotRequest request, CancellationToken cancellationToken, IShadowCopyService shadowCopyService, IDriversService driversService, IStorageService storageService, ITransferDataServerFactory transferDataServerFactory, ITevoLibWrapper driverApi, AgentTransferSettings transferSettings, IBlockChecksumReaderFactory blockChecksumReaderFactory)

    --- End of inner exception stack trace --- at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TakeSnapshotInternal(TransferGroupItem transferGroupItem) at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.<>cDisplayClass169_0.b0(TransferGroupItem item)

    --- End of inner exception stack trace --- --- End of inner exception stack trace --- at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.ExecuteParallel(Action`1 action) at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TakeSnapshot() at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TransferTaskInternal() at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TransferAgentTask() at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TransferTask() at System.Threading.Tasks.Task.Execute()

    Replay.Agent.Contracts.ShadowCopy.ShadowCopyException: DoSnapshotSet failed with error: 'Expected provider error. Check the event log for details.' at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.CheckQueryStatus(Action method, String fromMethod, Boolean canBeRetryable) at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.PreBackup() at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.TakeSnapshot() at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.TakeSnapshot(TakeSnapshotRequest request, VolumeName[] volumesToSnap, IVssImplementation vss, IWin32 win32, ITevoLibWrapper tevoLibWrapper, IWmiWrapper wmiWrapper, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& excludedWritersStatuses) at Replay.Agent.Implementation.ShadowCopy.ShadowCopyService.TakeSnapshot(TakeSnapshotRequest request, VolumeName[] volumesToSnap, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& excludedWritersStatuses) at Replay.Agent.Implementation.Transfer.TransferSessionBase.PrepareShadowCopy(TakeSnapshotRequest request, IDriversService driversService, ITevoLibWrapper driverApi, IShadowCopyService shadowCopyService, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& volumesToAssumeAsNotSnappable, List1& excludedWriterStatuses) at Replay.Agent.Implementation.Transfer.TransferSessionBase.PrepareToTakeSnapshot(TakeSnapshotRequest request, IShadowCopyService shadowCopyService, IDriversService driversService, ITevoLibWrapper driverApi, IStorageMetadata metadata, Dictionary2& errorVolumes, IShadowCopy& shadowCopy, Dictionary2& shadowCopyFiles, List1& volumesToAssumeAsNotSnap, List`1& excludedWritersStatuses) at Replay.Agent.Implementation.Transfer.TransferSession.StartTransferSession(String agentHostName, IPAddress coreIPAddress, TakeSnapshotRequest request, CancellationToken cancellationToken, IShadowCopyService shadowCopyService, IDriversService driversService, IStorageService storageService, ITransferDataServerFactory transferDataServerFactory, ITevoLibWrapper driverApi, AgentTransferSettings transferSettings, IBlockChecksumReaderFactory blockChecksumReaderFactory)

Reply
  • Going to Reboot the server tonight.  There is a line in the log saying a reboot is required.  There are also VSS errors Stack trace is below

    Server side:

    Replay.Agent.Contracts.Transfer.TransferFailedException: The transfer failed: 'There was a problem with the VSS subsystem on 'EXCH'.' ---> System.AggregateException: One or more errors occurred. ---> Replay.Core.Contracts.Transfer.VssGeneralErrorException: There was a problem with the VSS subsystem on 'EXCH'. ---> Replay.Agent.Contracts.ShadowCopy.ShadowCopyException: DoSnapshotSet failed with error: 'Expected provider error. Check the event log for details.' at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.CheckQueryStatus(Action method, String fromMethod, Boolean canBeRetryable) at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.PreBackup() at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.TakeSnapshot() at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.TakeSnapshot(TakeSnapshotRequest request, VolumeName[] volumesToSnap, IVssImplementation vss, IWin32 win32, ITevoLibWrapper tevoLibWrapper, IWmiWrapper wmiWrapper, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& excludedWritersStatuses) at Replay.Agent.Implementation.ShadowCopy.ShadowCopyService.TakeSnapshot(TakeSnapshotRequest request, VolumeName[] volumesToSnap, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& excludedWritersStatuses) at Replay.Agent.Implementation.Transfer.TransferSessionBase.PrepareShadowCopy(TakeSnapshotRequest request, IDriversService driversService, ITevoLibWrapper driverApi, IShadowCopyService shadowCopyService, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& volumesToAssumeAsNotSnappable, List1& excludedWriterStatuses) at Replay.Agent.Implementation.Transfer.TransferSessionBase.PrepareToTakeSnapshot(TakeSnapshotRequest request, IShadowCopyService shadowCopyService, IDriversService driversService, ITevoLibWrapper driverApi, IStorageMetadata metadata, Dictionary2& errorVolumes, IShadowCopy& shadowCopy, Dictionary2& shadowCopyFiles, List1& volumesToAssumeAsNotSnap, List`1& excludedWritersStatuses) at Replay.Agent.Implementation.Transfer.TransferSession.StartTransferSession(String agentHostName, IPAddress coreIPAddress, TakeSnapshotRequest request, CancellationToken cancellationToken, IShadowCopyService shadowCopyService, IDriversService driversService, IStorageService storageService, ITransferDataServerFactory transferDataServerFactory, ITevoLibWrapper driverApi, AgentTransferSettings transferSettings, IBlockChecksumReaderFactory blockChecksumReaderFactory)

    --- End of inner exception stack trace --- at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TakeSnapshotInternal(TransferGroupItem transferGroupItem) at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.<>cDisplayClass169_0.b0(TransferGroupItem item)

    --- End of inner exception stack trace --- --- End of inner exception stack trace --- at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.ExecuteParallel(Action`1 action) at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TakeSnapshot() at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TransferTaskInternal() at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TransferAgentTask() at Replay.Core.Implementation.Transfer.TransferJobHandler.TransferHandler.TransferTask() at System.Threading.Tasks.Task.Execute()

    Replay.Agent.Contracts.ShadowCopy.ShadowCopyException: DoSnapshotSet failed with error: 'Expected provider error. Check the event log for details.' at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.CheckQueryStatus(Action method, String fromMethod, Boolean canBeRetryable) at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.PreBackup() at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.TakeSnapshot() at Replay.Agent.Implementation.ShadowCopy.ShadowCopyInstance.TakeSnapshot(TakeSnapshotRequest request, VolumeName[] volumesToSnap, IVssImplementation vss, IWin32 win32, ITevoLibWrapper tevoLibWrapper, IWmiWrapper wmiWrapper, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& excludedWritersStatuses) at Replay.Agent.Implementation.ShadowCopy.ShadowCopyService.TakeSnapshot(TakeSnapshotRequest request, VolumeName[] volumesToSnap, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& excludedWritersStatuses) at Replay.Agent.Implementation.Transfer.TransferSessionBase.PrepareShadowCopy(TakeSnapshotRequest request, IDriversService driversService, ITevoLibWrapper driverApi, IShadowCopyService shadowCopyService, IStorageMetadata storageMetadata, Dictionary2& shadowCopyFiles, List1& volumesToAssumeAsNotSnappable, List1& excludedWriterStatuses) at Replay.Agent.Implementation.Transfer.TransferSessionBase.PrepareToTakeSnapshot(TakeSnapshotRequest request, IShadowCopyService shadowCopyService, IDriversService driversService, ITevoLibWrapper driverApi, IStorageMetadata metadata, Dictionary2& errorVolumes, IShadowCopy& shadowCopy, Dictionary2& shadowCopyFiles, List1& volumesToAssumeAsNotSnap, List`1& excludedWritersStatuses) at Replay.Agent.Implementation.Transfer.TransferSession.StartTransferSession(String agentHostName, IPAddress coreIPAddress, TakeSnapshotRequest request, CancellationToken cancellationToken, IShadowCopyService shadowCopyService, IDriversService driversService, IStorageService storageService, ITransferDataServerFactory transferDataServerFactory, ITevoLibWrapper driverApi, AgentTransferSettings transferSettings, IBlockChecksumReaderFactory blockChecksumReaderFactory)

Children
No Data