Microsoft hyper v vss writer non retryable error

When taking VSS snapshot with Hyper-V VSS writer on Windows 2012 R2, there are frequently some warning/error logs in Windows Event log. This will make the Hyper-V VSS writer goes to a bad state and in BCD, the BACKUP_METADATA is also missing for the problematic VM.
  • Remove From My Forums
  • Question

  • When taking VSS snapshot with Hyper-V VSS writer on Windows 2012 R2, there are frequently some warning/error logs in Windows Event log. This will make the Hyper-V VSS writer goes to a bad state and in BCD, the

    BACKUP_METADATA is also missing for the problematic VM.

    The logs in Windows Event log are as below:

    In Windows Log->Application, there will be logs as:

    A VSS writer has rejected an event with error 0x800423f4, The writer experienced a non-transient error.  If the backup process is retried,

    the error is likely to reoccur.

    . Changes that the writer made to the writer components while handling the event will not be available to the requester. Check the event log for related events from the application hosting the VSS writer.

    Operation:

       PrepareForSnapshot Event

    Context:

       Execution Context: Writer

       Writer Class Id: {66841cd4-6ded-4f4b-8f17-fd23f8ddc3de}

       Writer Name: Microsoft Hyper-V VSS Writer

       Writer Instance ID: {fec29c4d-410b-4854-96b4-9637f3a24fdc}

       Command Line: C:Windowssystem32vmms.exe

       Process ID: 2024

    In Hyper-V-VMMS there are logs as:

    Could not create backup checkpoint for virtual machine ‘********’: Overlapped I/O operation is in progress. (0x800703E5). (Virtual machine ID 2AD8D389-65AE-45F7-89F8-FDF2F08CE3C2)

    In Hyper-V-Worker there are logs as:

    ‘******’has encountered a fatal error.  The guest operating system reported that it failed with the following error codes: ErrorCode0: 0x7A, ErrorCode1: 0x10EC78, ErrorCode2: 0xC000000E, ErrorCode3: 0x1BA09BE0, ErrorCode4: 0x21D8F000.  If the problem
    persists, contact Product Support for the guest operating system.  (Virtual machine ID 2AD8D389-65AE-45F7-89F8-FDF2F08CE3C2)

    ‘******’ has encountered a fatal error.  The guest operating system reported that it failed with the following error codes: ErrorCode0: 0xEF, ErrorCode1: 0x11F2780, ErrorCode2: 0x0, ErrorCode3: 0x0, ErrorCode4: 0x0.  If the problem persists, contact
    Product Support for the guest operating system.  (Virtual machine ID 16A22441-2ECB-474A-8998-ECA6102DE5AC)

    ‘******’has encountered a fatal error.  The guest operating system reported that it failed with the following error codes: ErrorCode0: 0x7A, ErrorCode1: 0x119AEF8, ErrorCode2: 0xC000000E, ErrorCode3: 0x154C9860, ErrorCode4: 0x335DF592.  If the
    problem persists, contact Product Support for the guest operating system.  (Virtual machine ID A0CD6CF9-529F-4465-AD32-7A7D60069768)

    The problematic VMs are with Windows OS, Windows 2008R2, Windows 2012 R2 and Windows 8.1.

    My question is:

    What is the cause of this problem? The event logs are not understandable at all.

    How should I fix this problem?

Содержание

  1. Microsoft hyper v vss writer non retryable error
  2. Вопрос
  3. Microsoft hyper v vss writer non retryable error
  4. Answered by:
  5. Question
  6. Answers
  7. All replies

Microsoft hyper v vss writer non retryable error

Вопрос

Win2012R2, fully patched! It was all running smoothly over the last months, but suddenly: An errror in VSS making my Backup stop working

I reboot the server, all vss writers are OK

I try a single Backup (ArcServe) procedure and after the failure:

Writer name: ‘Microsoft Hyper-V VSS Writer’
Writer Id: <66841cd4-6ded-4f4b-8f17-fd23f8ddc3de>
Writer Instance Id:
State: [8] Failed Last error: Non-retryable error

A VSS writer has rejected an event with error 0x800423f4, The writer experienced a non-transient error. If the backup process is retried,
the error is likely to reoccur.
. Changes that the writer made to the writer components while handling the event will not be available to the requester. Check the event log for related events from the application hosting the VSS writer.

Operation:
PrepareForSnapshot Event

Context:
Execution Context: Writer
Writer Class Id: <66841cd4-6ded-4f4b-8f17-fd23f8ddc3de>
Writer Name: Microsoft Hyper-V VSS Writer
Writer Instance ID:
Command Line: C:Windowssystem32vmms.exe
Process ID: 2664

Volume Shadow Copy Service error: Unexpected error calling routine IMultiInterfaceEventControl::GetSubscriptions. hr = 0x80010108, The object invoked has disconnected from its clients.
.

Volume Shadow Copy Service error: Error on creating/using the COM+ Writers publisher interface: BackupShutdown [0x80042302, A Volume Shadow Copy Service component encountered an unexpected error.
Check the Application event log for more information.

Источник

Microsoft hyper v vss writer non retryable error

This forum has migrated to Microsoft Q&A. Visit Microsoft Q&A to post new questions.

Answered by:

Question

Anyone have an issue where you cannot backup the windows 2008 host with Hyper-V?

When the backup starts my VMs go to saved/running/saved/running and get stuck in that loop until the Windows backup fails after 30 minutes

All errors in event logs point to VSS and when I run the «vssadmin List writers» command I get this:

Writer name: ‘Microsoft Hyper-V VSS Writer’
Writer Id: <66841cd4-6ded-4f4b-8f17-fd23f8ddc3de>
Writer Instance Id: <849ac9f6-2996-440b-b26d-1c3c9ab49876>
State: [8] Failed
Last error: Retryable error

I have tried rebooting and that has not solved the issue.

I need to install the RTM Hyper-V update- but I would like to get a successful host server backup before I do that.

I was thinking of aside from performing flat file copies of the Guests while they are shutdown- that I maybe able to get a good backup if all the machines are shutdown- but I am not sure if the Hyper-V VSS writer is updated with the RTM version of Hyper-V or if there are some other things I could do to solve this.

I have 2 other machines configured just like this one without issue.

Answers

I am afraid this error message cannot help. Please take a look at the Event Viewer, at Windows LogsApplication, see if any errors or warnings exist relating to VSS or Backup.

If possible, please also try shutting down these VMs and then try the backing up so that we can narrow down the root cause. In addition, shutting down these VMs, then rebooting the host machine may resolve this issue.

A very possible cause is that the virtual hard disk of the VM is being written when you performed the backup, and by some unknown reasons, it cannot reach the «consistent» state. The normal procedure of backing up a running VM is saving/restoring the VM, by using the Windows Server Backup feature, even when you have IS installed. This is to ensure the disk is in a «consistent» state and, this procedure should work well in common scenarios.

If possible, would you please try the following steps to see if it can help? This is one method to ensure running VMs can be backed up via Windows Server Backup. However, we do not recommend this method at this time. If you want to back up the running VM, use the System Center Data Protection Manager (DPM, fow now it doesn’t support Hyper-V, but will come with SP1) or some other third-party backup applications that can work with Hyper-V VSS writer.

Note that you should always back up the Registry before changing it so that once you encounter any problems, you can restore it.

1. Open the Registry Editor (regedit.exe).

2. Navigate to the following registry key:
HKEY_LOCAL_MACHINESOFTWAREMicrosoftWindows NTCurrentVersion

3. Create a new registry key, under the CurrentVersion key, and name the new key WindowsServerBackup .

4. Create a new registry key, under the WindowsServerBackup key created above, and name the new key Application Support .

5. Create a new registry key, under the Under the Application Support created above, and name the new key .

6. Click to highlight the new key. This GUID stands for the relevant Hyper-V VSS writer.

7. Click the Edit menu option in Registry Editor, select New > String Value, and create the following value:

Value name: Application Identifier
Value type: REG_SZ
Value data: Hyper-V

8. Exit Registry Editor.

I hope this can help.

  • Edited by Chang Yin Monday, July 14, 2008 2:24 AM Correcting some information.
  • Proposed as answer by Mike Sterling [MSFT] Tuesday, July 15, 2008 1:31 PM
  • Marked as answer by Laura Zhang Microsoft employee Monday, July 21, 2008 6:56 AM

Yes, the backup should be successful. However, if you have a VM with more than two snapshots, you may encounter an error that you cannot restore the whole server. The workaround is:

1. Delete the VM.

2. Use “Files and Folder” restore option to restore the “Snapshots” folder.

3. Initiate “Application” restore.

The Hyper-V VSS writer should has already been registered on the operating system. The cause that you didn’t see it after running «vssadmin list writers» command might be that, you didn’t start the Virtual Machine Management Service. However, Hyper-V VSS writer doesn’t register with Windows Server Backup feature. If you want to back up your whole server by Windows Server Backup (though we don’t recommend it for now), you need to manually register it by adding the registry keys.

  • Marked as answer by Laura Zhang Microsoft employee Monday, July 21, 2008 6:56 AM

taking a stab in the dark here..

but have you verified that your virtual machine’s Integration Services are at the same level as your Host?

And that you have patched up to Hyper-V RTM?
Brian Ehlert (hopefully you have found this useful)

Yes, as Brian mentioned, you may need to verify if you have installed the matched Integration Service and enabled the Backup IS. Please also note that Windows 2000 Server and Windows XP virtual machines do not support Volume Shadow Services.

Additionally, ensure that while selecting Volumes of backup, you must select all the volumes where VM related files are present.

May I know if you have installed Exchange Server in the VM? We have seen some issues related to this and the resolution now would be Pausing, Saving or Stopping the VM before initiating the backup.

Please also collect the exact error or warning messages in the Event Viewer when the problem occurred so that we can narrow down the root cause.

Thanks for the reply.

The error is:
Log Name: System
Source: Service Control Manager
Date: 7/9/2008 6:44:47 PM
Event ID: 7031
Task Category: None
Level: Error
Keywords: Classic
User: N/A
Computer: SERVER2.pillarpacific.com
Description:
The Block Level Backup Engine Service service terminated unexpectedly. It has done this 1 time(s). The following corrective action will be taken in 120000 milliseconds: Restart the service.

On the Hyper-V Host there are two guests both running W2k8.

The 2 guests are a 32 bit file server and a 64 bit e2k7 server.

When I start the backup- it never gets past the file server so I am not sure if the exchange server issue even comes into play Yet!

I believe that when I upgrade to Hyper-V Rc1 I reinstalled/upgrade the integration components on each VM and by the management functionality it appears to be ok- but I can run the install again in a few days when I can scheduled the downtime for reboot if necessary.

Could the e2k7 server get in the way of Hyper-V VSS writer for all machines or just the e2k7 guest?

I am going to try and mock this up in a separate lab.

I am afraid this error message cannot help. Please take a look at the Event Viewer, at Windows LogsApplication, see if any errors or warnings exist relating to VSS or Backup.

If possible, please also try shutting down these VMs and then try the backing up so that we can narrow down the root cause. In addition, shutting down these VMs, then rebooting the host machine may resolve this issue.

A very possible cause is that the virtual hard disk of the VM is being written when you performed the backup, and by some unknown reasons, it cannot reach the «consistent» state. The normal procedure of backing up a running VM is saving/restoring the VM, by using the Windows Server Backup feature, even when you have IS installed. This is to ensure the disk is in a «consistent» state and, this procedure should work well in common scenarios.

If possible, would you please try the following steps to see if it can help? This is one method to ensure running VMs can be backed up via Windows Server Backup. However, we do not recommend this method at this time. If you want to back up the running VM, use the System Center Data Protection Manager (DPM, fow now it doesn’t support Hyper-V, but will come with SP1) or some other third-party backup applications that can work with Hyper-V VSS writer.

Note that you should always back up the Registry before changing it so that once you encounter any problems, you can restore it.

1. Open the Registry Editor (regedit.exe).

2. Navigate to the following registry key:
HKEY_LOCAL_MACHINESOFTWAREMicrosoftWindows NTCurrentVersion

3. Create a new registry key, under the CurrentVersion key, and name the new key WindowsServerBackup .

4. Create a new registry key, under the WindowsServerBackup key created above, and name the new key Application Support .

5. Create a new registry key, under the Under the Application Support created above, and name the new key .

6. Click to highlight the new key. This GUID stands for the relevant Hyper-V VSS writer.

7. Click the Edit menu option in Registry Editor, select New > String Value, and create the following value:

Value name: Application Identifier
Value type: REG_SZ
Value data: Hyper-V

8. Exit Registry Editor.

I hope this can help.

  • Edited by Chang Yin Monday, July 14, 2008 2:24 AM Correcting some information.
  • Proposed as answer by Mike Sterling [MSFT] Tuesday, July 15, 2008 1:31 PM
  • Marked as answer by Laura Zhang Microsoft employee Monday, July 21, 2008 6:56 AM

OK after I upgradd Hyper-V to RTM I now have a different issue- but related.

1> now my scheduled Host windows backup runs successfully- but is it really successful?

I can restore files but I do not have the bandwidth to test a full server restore-

When I run the vssadmin list writers- there is no longer a reference to the Hyper-V VSS writer.

So does that mean I need to create the keys to get Hyper-V VSS backups working again or are they working and the hyper-V VSS writer is just not listed?

This has me baffled at this time so I am not sure.

The logs do show that the system is looking for the Hyper V VSS but cant find it -but my backups are sucessful so what should I believe.

Now I think that I was originally running Hyper-V Beta- or whatever was released with Win2k8 RTM- and then upgrade hyper-V and all guests as Rc0 RC1 and RTM were released.

What a pain this has been- and I do not think I am out of the waters just yet.

Yes, the backup should be successful. However, if you have a VM with more than two snapshots, you may encounter an error that you cannot restore the whole server. The workaround is:

1. Delete the VM.

2. Use “Files and Folder” restore option to restore the “Snapshots” folder.

3. Initiate “Application” restore.

The Hyper-V VSS writer should has already been registered on the operating system. The cause that you didn’t see it after running «vssadmin list writers» command might be that, you didn’t start the Virtual Machine Management Service. However, Hyper-V VSS writer doesn’t register with Windows Server Backup feature. If you want to back up your whole server by Windows Server Backup (though we don’t recommend it for now), you need to manually register it by adding the registry keys.

  • Marked as answer by Laura Zhang Microsoft employee Monday, July 21, 2008 6:56 AM

I’m having a similar (maybe the same) problem as Omar. At least this was the most relevant thread I could find regarding my issue. Basically, when I run a scheduled backup of the partition containing my running virtual machines, I get the following error under Backup in Event Viewer:

Backup started at ‘<60b71b25-9e51-42b7-bde2-dd68ffb57d03>‘ failed as Volume Shadow copy operation failed for backup volumes with following error code ‘2155348129’.

Here are the results of vssadmin list writers:

Writer name: ‘Microsoft Hyper-V VSS Writer’
Writer Id: <66841cd4-6ded-4f4b-8f17-fd23f8ddc3de>
Writer Instance Id:
State: [8] Failed
Last error: Retryable error

Writer name: ‘System Writer’
Writer Id:
Writer Instance Id:
State: [5] Waiting for completion
Last error: No error

Writer name: ‘ASR Writer’
Writer Id:
Writer Instance Id: <93fe471c-4ec3-4622-84cf-ec8cf652d2d3>
State: [5] Waiting for completion
Last error: No error

Writer name: ‘SqlServerWriter’
Writer Id:
Writer Instance Id: <5f292fcd-4c1b-49d1-b138-0c3fbcd055e9>
State: [5] Waiting for completion
Last error: No error

Writer name: ‘FRS Writer’
Writer Id:
Writer Instance Id:
State: [5] Waiting for completion
Last error: No error

Writer name: ‘Registry Writer’
Writer Id:
Writer Instance Id: <7d149ec2-f9d5-4347-91ac-2d2bba5d52a3>
State: [5] Waiting for completion
Last error: No error

Writer name: ‘Shadow Copy Optimization Writer’
Writer Id: <4dc3bdd4-ab48-4d07-adb0-3bee2926fd7f>
Writer Instance Id: <49819bba-8240-440f-8b8b-81eeaf515a90>
State: [5] Waiting for completion
Last error: No error

Writer name: ‘IIS Metabase Writer’
Writer Id: <59b1f0cf-90ef-465f-9609-6ca8b2938366>
Writer Instance Id:
State: [5] Waiting for completion
Last error: No error

Writer name: ‘COM+ REGDB Writer’
Writer Id: <542da469-d3e1-473c-9f4f-7847f01fc64f>
Writer Instance Id: <3e135d67-aa7a-43c8-9ab2-4d2cb1ed0055>
State: [5] Waiting for completion
Last error: No error

Writer name: ‘IIS Config Writer’
Writer Id: <2a40fd15-dfca-4aa8-a654-1f8c654603f6>
Writer Instance Id:
State: [5] Waiting for completion
Last error: No error

Writer name: ‘WMI Writer’
Writer Id:
Writer Instance Id: <1977aa51-ed31-487b-a38f-1b4fb6376b29>
State: [5] Waiting for completion
Last error: No error

Writer name: ‘NTDS’
Writer Id:
Writer Instance Id: <34cadbe7-08dd-4464-a4aa-8e1fbb8ec899>
State: [5] Waiting for completion
Last error: No error

As you can see, my concern is the Hyper-V VSS Writer Retryable Error.

All of my Virtual Machines and Virtual Hard Disks are on a separate partition (V: drive) on a separate RAID 1 volume. If I run the scheduled backup with only the C: drive selected, it works without any problems. With the V: drive selected in addition, I get the error.

I’ve made sure my system is fully updated. I’m running Windows Server 2008 x64 with Service Pack 1 and all the updates applied. I looked for additional Hyper-V updates only to find I alread have KB956697 installed (http://support.microsoft.com/kb/956697), an update that supposedly fixes an issue regarding VSS backups of virtual machines.

I’ve confirmed that all of the Integration Services files on my virtual machines are the latest version: 6.0.6001.18016. However, I get version 6.0.6001.18125, which is newer, when I run this command on the physical host:

wmic datafile where name=»c:\windows\system32\vmms.exe» get version

Perhaps this is part of the problem, but I can’t seem to find an update for the integration services component, and most of what I have read indicates that 6.0.6001.18016 is the latest version.

I have also tried with and without the registry modification mentioned in the post above.

Any help would be greatly appreciated. Thank you.

Источник

Volume Shadow Copy Error 0x800423f4 — writer error: non retry-able

Error code

Product

Applies to

BA954

BackupAssist

BackupAssist v3 and later

Description

This error occurs when one of the VSS writers is not in a working state and causes the snapshot process to fail.

Resolutions for Hyper-V

The solutions below are for Hyper-V Server and Hyper-V guest (VM) backups. Solutions for other types of backups are in the next section.

When troubleshooting problems with Hyper-V backups, it is important to first determine which guest/s is causing the error. You can do this by checking the Hyper-V VMSS logs, as shown below. You may also be able to identify the guest from the information in the backup report. If you are not able to identify the guest, try backing up the guests one at a time until the errant guest is found.

The guest causing the error can be confirmed by running the backup again without that guest and checking that the backup runs without errors. You can also try a VSS backup on the guest itself using a trial version of BackupAssist. The success or failure of this backup will help to further narrow down what could be causing the error.

If the problem is with backing up data within a guest, will you need to open the Event Viewer inside that guest and review the VSS log entries. These may identify the exact cause of the VSS error.

ClosedTo view the Hyper-V VMMS logs:

  1. Click the Start button.
  2. Click Control Panel.
  3. Click System and Maintenance.
  4. Click Administrative Tools.
  5. Double-click Event Viewer.
  6. In the left hand navigation window, browse to Applications and Services Logs > Microsoft > Windows > Hyper-V-VMMS.

Solution 1 — Re-initialize the guest’s Volume Shadow Copy Requester service

This solution applies when error 0x8004230F is mentioned in a Hyper-V-VMMS event log entry with id 10150 for a specific guest, or when this error number is shown during a failed VSS backup inside a guest.

  1. Log into the Hyper-V guest (VM).
  2. Delete registry key HKEY_LOCAL_MACHINESYSTEMCurrentControlSetServicesVSSProviders{74600e39-7dc5-4567-a03b-f091d6c7b092}.
  3. Restart the service ‘Hyper-V Volume Shadow Copy Requester’ or restart the guest.

Warning: Changes to the registry should only be performed by an experienced Systems admin. Mistakes can render the system inoperable.

Solution 2 — Change the Production checkpoints to standard

This is a known issue for pre-2016 Domain Controllers running in VMs on 2016 / Win10 Hypervisors. The problem may be related to the new Hyper-V Production Checkpoint architecture.

To resolve this problem, in the VM’s settings, change from Production checkpoints to Standard on guests that are domain controllers running pre-2016 OS, when the Hyper-V host is running Windows Server 2016.

Solution 3 — Review the VMMS logs

This error can occur if there is a VSS problem within the guest operating system preventing the Hyper-V VSS writer from successfully backing up the guest from the host level. The cause can be found by looking for errors in the Event Viewer, particularly VSS or SPP events, which will most likely be the cause of a failure within the host. To do this, open the Event Viewer on the guest machine, however instead of browsing to Hyper-V VMMS, browse to Windows Logs > Application.

ClosedTo view the Hyper-V VMMS logs:

  1. Click the Start button.
  2. Click Control Panel.
  3. Click System and Maintenance.
  4. Click Administrative Tools.
  5. Double-click Event Viewer.
  6. In the left hand navigation window, browse to Applications and Services Logs > Microsoft > Windows > Hyper-V-VMMS.

Solution 4 — Run a backup with «Backup (volume checkpoint)» integration service temporarily disabled

This solution applies when error 0x80070490 is mentioned in a Hyper-V-VMMS event log entry with id 10150. This has been seen on hosts running Windows Server 2012 R2 and Windows Server 2016.

To resolve this error, temporarily disable the «Backup (volume checkpoint)» integration service and run a test backup of the guest. If this succeeds, re-enable the service and the next backup of the guest should continue to succeed.

Resolutions for other backup types

Solution 1 — If multiple backup solutions installed

Many backup solutions have their own proprietary snapshot manager which can cause conflicts with other backup solutions installed on the system.

If you have (or had) more than one backup program installed on your system, disable/uninstall all of the programs except for BackupAssist, and run the backup job again.

It is best practice to only have one backup solution installed at any one time.

You should also run a registry cleaner after the other backup solutions have been uninstalled: https://www.backupassist.com/blog/support/how-to-resolve-a-ba910-volume-shadow-copy-error-0x80004230/.

Solution 2 — If the problem is a failing VSS writer

If the reason for the error is a failing VSS writer, it’s recommended to find which one is causing the issue.

To do this, open an elevated command prompt and run the following command: vssadmin list writers

This will provide an output of all VSS writers known to Windows on that machine. Look specifically for the Last error detail and anything that does not show No Error is most likely to be the cause of the error.

Solution 3 — If there are Volume Shadow Copy errors within Event Viewer

VSS can write additional information to the event logs of your system which will provide information to help resolve the issue.

Open Event Viewer by clicking on Start > Run > Eventvwr to see if there are any specific VSS warnings or errors being generated from the system during the backup process. You will specifically want to look at the Application and System logs.

Solution 4 — If the problem is that the SQL Agent is not allowed to run

This is generated because the SQL writer has conflicts with the SharePoint VSS writer.

It is known that removing the GUID entry from the following registry key resolves this error:
HKEY_LOCAL_MACHINE/ SOFTWARE/ MICROSOFT/ MICROSOFT SQL SERVER/ SHAREPOINT/ SQLSERVERAGENT

Stopping the SQL VSS Writer Service can also resolve this error.

To do this, browse to Administrative Tools > Services and find SQL Server VSS Writer in the list. Once located, click on Stop to the left hand side of the Services screen.

Solution 5 — If the problem is that the Sqlvdi.dll file is unregistered on the system

This error is generated if there is an issue with the file Sqlvdi.dll on the system.

Microsoft outline how to resolve this for Windows Server 2003 in their KB: https://support.microsoft.com/en-us/kb/830575.

Microsoft outline how to resolve this for SBS 2011 and Windows Server 2008 in their KB: https://support.microsoft.com/en-us/kb/2615182

Last updated

Created

Further assistance

14th Dec 2017

20th Aug 2007

BackupAssist Support page

TwoTabs

Lurker
Posts: 1
Liked: never
Joined: Jan 28, 2019 4:17 pm
Full Name: John Lance
Contact:

VSS writers constanly failing during backup

Veeam Support — Case # 03375512

For the past week we have been experiencing failed backup’s due to A VSS writer issue. I have restarted the physical machine and have restarted services. Nothing seems to be fixing the issue. This started happening after the latest update. I also ran shadowdisk and it didnt come up with any problems. The Microsoft Hyper v VSS writer always come back failed with a non retryable error

This is just an example of one of them.

Code: Select all

1/28/2019 10:48:23 AM :: Queued for processing at 1/28/2019 10:48:23 AM  
1/28/2019 10:48:23 AM :: Required backup infrastructure resources have been assigned  
1/28/2019 10:48:28 AM :: VM processing started at 1/28/2019 10:48:28 AM  
1/28/2019 10:48:28 AM :: VM size: 127.0 GB (28.3 GB used)  
1/28/2019 10:48:28 AM :: VM is now in the required state for processing  
1/28/2019 10:48:30 AM :: Preparing to create snapshot  
1/28/2019 10:49:01 AM :: Using guest interaction proxy FFLD-Venyu.fairfield.com (Same subnet)  
1/28/2019 10:49:04 AM :: Inventorying guest system  
1/28/2019 10:49:08 AM :: Subscribing to guest processing components  
1/28/2019 10:49:12 AM :: Failed to create snapshot (Microsoft Software Shadow Copy provider 1.0) (mode: Veeam application-aware processing) Details: Writer 'Microsoft Hyper-V VSS Writer' is failed at 'VSS_WS_FAILED_AT_PREPARE_SNAPSHOT'.
The writer experienced a non-transient error.  If the backup process is retried,
the error is likely to reoccur.
--tr:Failed to verify writers state.
--tr:Failed to perform pre-backup tasks.  
1/28/2019 10:51:44 AM :: Transaction logs will not be truncated  
1/28/2019 10:51:54 AM :: Retrying snapshot creation attempt (Writer 'Microsoft Hyper-V VSS Writer' is failed at 'VSS_WS_FAILED_AT_PREPARE_SNAPSHOT'.
The writer experienced a non-transient error.  If the backup process is retried,
the error is likely to reoccur.
--tr:Failed to verify writers state.
--tr:Failed to perform pre-backup tasks.)  
1/28/2019 10:51:54 AM :: Task has been rescheduled  
1/28/2019 10:52:17 AM :: Failed to create snapshot (Microsoft Software Shadow Copy provider 1.0) (mode: Veeam application-aware processing) Details: Writer 'Microsoft Hyper-V VSS Writer' is failed at 'VSS_WS_FAILED_AT_PREPARE_SNAPSHOT'.
The writer experienced a non-transient error.  If the backup process is retried,
the error is likely to reoccur.
--tr:Failed to verify writers state.
--tr:Failed to perform pre-backup tasks.  
1/28/2019 10:54:42 AM :: Retrying snapshot creation attempt (Writer 'Microsoft Hyper-V VSS Writer' is failed at 'VSS_WS_FAILED_AT_PREPARE_SNAPSHOT'.
The writer experienced a non-transient error.  If the backup process is retried,
the error is likely to reoccur.
--tr:Failed to verify writers state.
--tr:Failed to perform pre-backup tasks.)  
1/28/2019 10:54:42 AM :: Queued for processing at 1/28/2019 10:54:42 AM  
1/28/2019 10:54:44 AM :: Unable to allocate processing resources. Error: Writer 'Microsoft Hyper-V VSS Writer' is failed at 'VSS_WS_FAILED_AT_PREPARE_SNAPSHOT'.
The writer experienced a non-transient error.  If the backup process is retried,
the error is likely to reoccur.
--tr:Failed to verify writers state.
--tr:Failed to perform pre-backup tasks.  
1/28/2019 10:54:44 AM :: Network traffic verification detected no corrupted blocks  
1/28/2019 10:54:44 AM :: Processing finished with errors at 1/28/2019 10:54:44 AM


nielsengelen

Veeam Software
Posts: 5253
Liked: 1094 times
Joined: Jul 15, 2013 11:09 am
Full Name: Niels Engelen
Contact:

Re: VSS writers constanly failing during backup

Post

by nielsengelen » Jan 30, 2019 8:34 am

Best would be to let support assist you here ad vss related errors can be very specific per case. They will have more insight into full logs and may ask you to perform some additional tasks. Thanks.

Personal blog: https://foonet.be
GitHub: https://github.com/nielsengelen


Mike Resseler

Product Manager
Posts: 7762
Liked: 1171 times
Joined: Feb 08, 2013 3:08 pm
Full Name: Mike Resseler
Location: Belgium
Contact:

Re: VSS writers constanly failing during backup

Post

by Mike Resseler » Jan 30, 2019 5:25 pm

Hi John,

Niels is correct about working with the engineers. The VSS_WS_FAILED_AT_PREPARE_SNAPSHOT mostly means that inside the guest VM some writers are called (or prepared) and fail. Is it always the same backup job? And the same VM(s)? Or on a specific host?


ianbutton1

Enthusiast
Posts: 58
Liked: 18 times
Joined: Oct 14, 2016 3:54 pm
Full Name: Ian Button
Contact:

Re: VSS writers constanly failing during backup

Post

by ianbutton1 » Jan 31, 2019 12:56 pm
1 person likes this post

Hi,
A workaround that I used after discovering this happening on our Hyper-V guests was to create a batch-file that stopped & restarted all the VSS services on the failed servers
1. Either manually — on any guests showing the above message in Veeam GUI logs, restart 3 Windows services – “Hyper-V Volume Shadow Copy Requestor”, “Microsoft Software Shadow Copy Provider”, and “Volume Shadow Copy”; then retry the job. See also Veeam KB2041.
2. Or a quick way to stop & start these services on a list of servers is to run CMD.EXE (as administrator) on VBR server, then run the batch-file (below) with syntax “sc1 failedserver1 failedserver2 failedserver3 …”

Haven’t seen the problem lately, though — perhaps a Windows update resolved the problem, or upgrading to 9.5 U3

Batch file below. It’s pretty crude, but it worked! Good luck!

Ian

Code: Select all

REM SC1.bat - IB 13/7/2017 
REM Resets shadow copy services on targets, for retries of Veeam Hyper-V jobs
REM Syntax is "sc1 server1 server2 ..."
@echo off
cls
if "%1"=="" goto error
:start
if "%1"=="" goto end
echo.
echo Processing server %1
echo -------------------------------------
echo Stopping 3 services - please wait (up to a minute) .....
REM stop Hyper-V Volume Shadow Copy Requestor service
echo 1 vmicvss . . .
sc \%1 stop vmicvss > nul
REM stop Microsoft Software Shadow Copy Provider service
echo 2 swprv . . .
sc \%1 stop swprv > nul
REM stop Volume Shadow Copy service
echo 3 vss . . .
sc \%1 stop vss > nul

echo Restarting 3 services - please wait (up to a minute) .....
REM start Hyper-V Volume Shadow Copy Requestor service
echo 1 vmicvss . . .
sc \%1 start vmicvss > nul
REM start Microsoft Software Shadow Copy Provider service
echo 2 swprv . . .
sc \%1 start swprv > nul
REM start Volume Shadow Copy service
echo 3 vss . . .
sc \%1 start vss > nul
echo Now please wait 20 seconds for restarts to finish, then ...
pause

echo Checking services are running - please wait (up to a minute) .....
sc \%1 query vmicvss
sc \%1 query swprv
sc \%1 query vss
echo If all 3 show "State : 4 Running", then Veeam backup of server %1 should work.
echo =======================================
pause

shift
goto start
cls

:end
Echo Now retry failed Veeam job
pause
goto :EOF

:error
Echo No server name entered - syntax is "sc1 server1 server2 ..."
pause


Are you stuck with hyper-v VSS writer failed? We can help you fix it.

This error occurs when the VSS writer service failed.

At Bobcares, we often get requests regarding Hyper-V as a part of our Server Management Services.

Today let’s discuss how our Support Engineers resolve Hyper-v VSS writer failed for our customers.

Causes for Hyper-v VSS writer failed

Volume Shadow Copy is a windows service that helps capture and creates snapshots. The VSS writer tells the backup tool how to back up the data.

Causes for the error is when VSS writers fail. There are multiple reasons for the VSS writer to fail.

One of the common reason is when two or more resources try to use the writer at the same time.

Thus, to resolve the error we restart the service or reset the VSS WMI writer.

Let’s discuss how our Support Engineers resolve this error for our customers.

How to fix Hyper-v VSS writer failed

Recently one of our customers contacted us regarding writer failure error. Let’s now discuss how our Support Engineers resolve the error for our customers.

Restarting failed writer service

First, we open the command prompt with administrative privilege.

Then we find out the failed writers using the command

vssadmin list writers

Then we find the service corresponding to the VSS writer.

After that, restart windows service corresponding to the writer. After restarting the service we check the writers.

The VSS writers were all stable.

Hyper-V VSS writer failed

Thus, it resolves the error.

Re-register the writers

Recently one of the customer contacted us regarding the same error. We restarted the service but still, the error was occurring. The available option is to reset the WMI Writers. Let’s discuss how our Support Engineers resolve the error for our customer.

To re-register the VSS WMI Writer we open the command prompt with administrator privileges.

We move to the directory wbem using the command

cd %windir%system32wbem

And we use the below commands to reset the WMI writer.

for /f %s in ('dir /b *.dll') do regsvr32 /s %s

wmiprvse /regserver

winmgmt /regserver

Thus, we reset the VSS WMI writer to resolve the error.

Service not running in the client-server

One of the common reasons for this error to occur is that the service might be not running. Thus, our Support Engineers start the service from the Hyper-V manager.

To restart the service from Hyper-V Manager. We Open Hyper-V Manager.

Then we click on the name of the server. In the Actions pane, we click Start Service.

Thus, it resolves the error.

[Need assistance with Hyper-V error – We can help you fix it]

Conclusion

In short, we have discussed the causes for the ‘Hyper-V VSS writer failed’ error to occur. Also, we have discussed how our Support Engineers resolve the error for our customers.

PREVENT YOUR SERVER FROM CRASHING!

Never again lose customers to poor server speed! Let us help you.

Our server experts will monitor & maintain your server 24/7 so that it remains lightning fast and secure.

GET STARTED

var google_conversion_label = «owonCMyG5nEQ0aD71QM»;

Macrium Reflect uses a Microsoft service called Volume Shadow Copy Service (VSS) to create disk images and backup files when in use.

VSS is a copy-on-write driver that intercepts disk writes before they actually happen. The contents of the disk are written to a shadow copy buffer before the write takes place. The disk image, therefore, represents an exact point-in-time and is not affected by disk write activity during image creation.

When VSS fails you are unable to create a disk image or backup open files with Macrium Reflect. Macrium Reflect cannot cause VSS to fail. Any failure is caused by other software or system configuration problems and will affect every program that uses VSS. Failures must be located and fixed for disk images and file backups to complete successfully. 

VSS requires at least one New Technology File System (NTFS) to be present and online to operate. Otherwise, the error: E_PROVIDER_VETO shows.

  1. When VSS fails there is usually an indication in the image or backup log file which shows in the Macrium Reflect log:

  2. Alternatively, the main VSS log can be seen as an option under the log view:

  3. If required, and you are using the Macrium Reflect email component, you can send these logs via email. Right click the log entry.
     
  4. select Send backup logs via email.
     
  5. A common error is Failed to Create Volume Snapshot followed by a hex result code. The result code is an error code from VSS. Googling VSS + Result Code often comes up with a solution to the VSS problems

You may also see:

Backup aborted! - Unable to open file handle for '\?GLOBALROOTDeviceHarddiskVolumeShadowCopyxxx'
The process cannot access the file because it is being used by another process.

This may be associated with a ‘VolSnap’ error in your Windows logs.

VSS uses writer components to ensure that the file system is in a stable state when creating your disk image. For example, SQL database writers ensure that all transactions to databases are complete before allowing the shadow copy service to continue. Windows includes a VSS administration program that can list the status of all VSS Writers you have on your system.

Open a command prompt and type ‘vssadmin list writers’. In Vista/7/8 and Servers 2008 and later, make sure you start the command prompt with elevated privileges. This will list all your VSS writers with their current state and last error. (Link to instructions on creating elevated command prompt at bottom of tutorial).

Typical output:

Microsoft Windows [Version 6.0.6001]
Copyright (c) 2006 Microsoft Corporation.  All rights reserved.

C:Windowssystem32>vssadmin list writers
vssadmin 1.1 - Volume Shadow Copy Service administrative command-line tool
(C) Copyright 2001-2005 Microsoft Corp.

Writer name: 'System Writer'
Writer Id: {e8132975-6f93-4464-a53e-1050253ae220}
Writer Instance Id: {4e66d2f2-136c-434b-9a67-234a3b5d38e6}
State: [1] Stable
Last error: Non-retryable error

Writer name: 'ASR Writer'
Writer Id: {be000cbe-11fe-4426-9c58-531aa6355fc4}
Writer Instance Id: {9c9a72d9-70f4-414d-88e2-9894fd7f13ca}
State: [1] Stable
Last error: No error

Writer name: 'IIS Metabase Writer'
Writer Id: {59b1f0cf-90ef-465f-9609-6ca8b2938366}
Writer Instance Id: {ac62d67f-bc4f-4ae0-90d1-9fc058a8880f}
State: [5] Waiting for completion
Last error: No error

Writer name: 'Shadow Copy Optimization Writer'
Writer Id: {4dc3bdd4-ab48-4d07-adb0-3bee2926fd7f}
Writer Instance Id: {0b6a11ac-b009-44ec-a9f2-f3b94de74c7d}
State: [1] Stable
Last error: No error

Writer name: 'MSSearch Service Writer'
Writer Id: {cd3f2362-8bef-46c7-9181-d62844cdc0b2}
Writer Instance Id: {f9626a21-0848-4fca-a7a0-287ce50ebec7}
State: [5] Waiting for completion
Last error: No error

Writer name: 'IIS Config Writer'
Writer Id: {2a40fd15-dfca-4aa8-a654-1f8c654603f6}
Writer Instance Id: {04a208b8-943b-425d-a694-6cc179ab6d46}
State: [5] Waiting for completion
Last error: No error

Writer name: 'Registry Writer'
Writer Id: {afbab4a2-367d-4d15-a586-71dbb18f8485}
Writer Instance Id: {6a4ffe24-b297-4602-b04b-0bf63caa5cd5}
State: [1] Stable
Last error: No error

Writer name: 'COM+ REGDB Writer'
Writer Id: {542da469-d3e1-473c-9f4f-7847f01fc64f}
Writer Instance Id: {894ebce3-7aec-4e9b-8b38-36d3eb624145}
State: [1] Stable
Last error: No error

Writer name: 'BITS Writer'
Writer Id: {4969d978-be47-48b0-b100-f328f07ac1e0}
Writer Instance Id: {dbe2fb09-898f-4b60-8539-3ca1e6cc4b67}
State: [1] Stable
Last error: No error

Writer name: 'WMI Writer'
Writer Id: {a6ad56c2-b509-4e6c-bb19-49d8f43532f0}
Writer Instance Id: {06504311-56ee-4f9e-82e6-1dc08ff7eb2c}
State: [5] Waiting for completion
Last error: No error

Writers with an error state or where the last error isn’t ‘No Error’ are probably causing a problem.


Look for messages in your Windows logs.

When VSS fails you will always get a corresponding message in your Windows event log.

  1. Right click on ‘My computer’
  2. Select ‘Manage’
  3. Expand the ‘Event Viewer’ node
  4. Look in the ‘Application’ message node for error messages  relating to ‘VSS’, ‘Shadow Copy’ or ‘VolSnap’.
  5. If you find any messages then these with give you an ‘Event ID’ and sometimes a ‘Result Code’ or ‘hr’. These two pieces of information can generally pin point the cause of your VSS failure. Try Googling the Event ID(s) and Result Code(s) for more information.

Make sure that the VSS service isn’t disabled

Changing the startup type of the VSS service and rebooting can often resolve issues.

  1. Right click on ‘My Computer’.
  2. Select ‘Manage’.
  3. Select the ‘Services’ tree node.
  4. Right click on ‘Volume Shadow Copy’
  5. Select Properties
  6. Change the startup type to ‘Automatic’
  7. Reboot

Re-register the VSS components

Sometimes re-registering VSS core components can fix errors. Copy the following commands to Notepad and save the file with a ‘.bat’ extension. Run the .bat file by opening a command prompt and entering the .bat file name.

cd /d %windir%system32
net stop vss
net stop swprv
regsvr32 /s ole32.dll
regsvr32 /s oleaut32.dll
regsvr32 /s vss_ps.dll
vssvc /register
regsvr32 /s /i swprv.dll
regsvr32 /s /i eventcls.dll
regsvr32 /s es.dll
regsvr32 /s stdprov.dll
regsvr32 /s vssui.dll
regsvr32 /s msxml.dll
regsvr32 /s msxml3.dll
regsvr32 /s msxml4.dll
vssvc /register
net start swprv
net start vss

We also provide a program which will recreate the correct registry setting and re-register all VSS components. Please download one of the below programs to fix your problem:

VSSfix 32bit — download
VSSfix 64bit — download


Resources

http://en.wikipedia.org/wiki/Shadow_Copy
http://technet.microsoft.com/en-us/library/cc785914.aspx


VSS error articles:


It is very probable that others have had a similar problem to you, so use Google as much as you can to find potential solutions. If all else fails you should contact Microsoft support for a resolution.

Понравилась статья? Поделить с друзьями:
  • Microsoft flight simulator x ошибка пакета установщика windows
  • Microsoft outlook как изменить вид
  • Microsoft flight simulator 2020 ошибка при установке
  • Microsoft outlook 2010 как изменить подпись
  • Microsoft flight simulator 2020 как изменить время