Fixing a “Failed or FailedAndSuspended” Database Content Index in Exchange Server 2013/2016
Uses of Content Index is it will try to search Mailbox content in both Outlook and OWA (Outlook Web Access).
Sometimes there are chances of Database Failover and Switchover.
When Automatic Switchover or Failover takes place then checking Content Index State will be a good move.
Note: Rebuilding or Repairing the Content Index can cause High CPU Utilization on the servers. So it is recommended to perform such task only on the Week Ends or After Hours.
Checking the Content Index using the Below command
Get-MailboxDatabaseCopyStatus * |fl -auto
This will show all the Content Index State for all the Databases in the Organization
Today I’ve found my Database Content Index FailedAndSuspended as shown below:
Verified with above error mentioned using Command line in Exchange Management Shell & found the same as shown below:
Events that can be generated to identify the situation is Event ID 1012 as shown below:
Ok now it’s confirmed let’s proceed with troubleshooting steps
First Stop the services
1: Microsoft Exchange Search
Command : Stop-Service MsExchangeFastSearch
2: Microsoft Exchange Search Host Controller
Command : Stop-Service HostControllerService
Now it’s time to identify the Database to Rename, Delete or Moving the Content Index “Catalog Folder”
If you don’t know the Path of Database (EDB File Path) then run the below command it will show the EDB File Path
Locate the folder then this “Catalog Folder or Guid” can be either Renamed, deleted or Moved to another location.
Here I’ve Renamed the folder to “Guid.old” as shown below:
Then I’ve restarted both the services as shown below:
Ones you start the service check the status of the Content Index for the Databases which are “Failed or FailedAndSuspended” by running the below command:
Get-MailboxDatabaseCopyStatus -Server “Server Name”
First it will go Unknown state
Then status of Content Index will be changed from Unknown state to Crawling
as shown below:
Slowly the status of the Content Index will be changed from Crawling to Healthy
Both the Databases changed to Healthy State from Crawling as shown below:
If this is Server is Member of DAG then run the below command as shown below:
Command :
Update-MailboxDatabaseCopy “Database NameServer Name” -CatalogOnly -BeginSeed
If you have multiple Databases and it’s Content Index in “Failed or FailedAndSuspended” State then run the below command:
Command :
Get-MailboxDatabaseCopyStatus * |Where {$_.ContentIndexState -eq “FailedAndSuspended” |Update-MailboxDatabaseCopy -CatalogOnly
Hello,
Scenario :
— i need to move our Existing Mailboxes to a new Exchange install on a New 2012r2
— the automatically generated database at install starts with Content index Status : FailedAndSuspended
— newly created database start with : FailedAndSuspended
— after restarting the Services MSExchange Services Host Controller and Search deleting the .single Folder the Status is : FailedAndSuspended
-after creating a new Mailbox in the Database : FailedAndSuspended
-after
Stop-Service HostControllerService
Stop-Service MSexchangeFastService
Dismounting Database
deleting Folder «GUID.single»
start-Service HostControllerService
start-Service MSexchangeFastService
Mounting Database
after that ContentIndexStatus goes to : Failed and Suspended
And Administrator Event log Shows :
The FastFeeder component received a connection exception from FAST. Error details: System.ServiceModel.FaultException`1[System.ServiceModel.ExceptionDetail]: Internal error while processing request (Fehlerdetail ist gleich Ein ExceptionDetail, vermutlich erstellt durch IncludeExceptionDetailInFaults=TRUE, mit dem Wert: Microsoft.Ceres.InteractionEngine.Component.ProcessingEngineException: Internal error while processing request bei Microsoft.Ceres.InteractionEngine.Component.CieProcessingEngine.LogAndRethrowException(Exception e) bei Microsoft.Ceres.InteractionEngine.Component.CieProcessingEngine.Close(Guid flowIdentifier) bei Microsoft.Ceres.InteractionEngine.Component.CieProcessingEngine.ExecuteSearchFlowAndGetResultCollection(String flowName, IEnumerable`1 inputData, String outputName) bei SyncInvokeExecuteSearchFlowAndGetResultCollection(Object , Object[] , Object[] ) bei System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]& outputs) bei System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc& rpc) bei System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc& rpc) bei System.ServiceModel.Dispatche...).
The indexing of mailbox database Live_sample1 encountered an unexpected exception. Error details: Microsoft.Exchange.Search.Core.Abstraction.OperationFailedException: The component operation has failed. ---> Microsoft.Exchange.Search.Engine.FeedingSkippedForCorruptionException: "Feeding was skipped for 'f14fa5db-4d58-4da1-8869-215c08a6a582 (Live_sample1)' due to the state 'Failed', error code: 'CatalogCorruption', failure code: '4321345', failure reason: 'Journal has been detected as invalid.'." bei Microsoft.Exchange.Search.Engine.SearchFeedingController.InternalExecutionStart() bei Microsoft.Exchange.Search.Core.Common.Executable.InternalExecutionStart(Object state) --- Ende der internen Ausnahmestapelüberwachung --- bei Microsoft.Exchange.Search.Core.Common.Executable.EndExecute(IAsyncResult asyncResult) bei Microsoft.Exchange.Search.Engine.SearchRootController.ExecuteComplete(IAsyncResult asyncResult)
Beim Starten der Sitzung "FastDocTracingSession" ist der folgende Fehler aufgetreten: 0xC0000035. Translated : At session start "FastDocTracingSession" occured this error : 0xC0000035.
P.S. Test Mailbox on the database works
There is no DAG as we have only 2 Servers and one of them we want to retire which is the whole point of the move .
Exchange Version 2013 CU15
Version 15.0 (Build 1263.5)
//EDIT:
Content Index Error Message in Exchange PS :
Get-MailboxDatabaseCopyStatus | select ContentIndexErrorCode , ContentIndexErrorMessage
Output: 19 The content index is corrupted.
DiskPErcent Free Space 77% ~ 700 GB
Tried to move Logfiles to different Mounts even to USB mount still same result …
//EDIT: I have also followed this tutorial
exchange-event-log-fehler-1012-msexchangeis-368343
Removed all folders in C:Program FilesMicrosoftExchange ServerV15BinSearchCeresHostControllerDataNodesFsis
and uninstalled and installed search
.installconfig.ps1 -action U -datafolder "c:Program FilesMicrosoftExchange ServerV15BinSearchCeresHostControllerData"
02.
.installconfig.ps1 -action I -datafolder "c:Program FilesMicrosoftExchange ServerV15BinSearchCeresHostControllerData"I have Followed this tutorial :
- Create a new Active Directory group that is named “ContentSubmitters,” and then grant Admistrators and NetworkService full access to the group. This is a dummy group and should be used as a placeholder only. You might want to add a description so that the group is not removed.
- Force or wait for Active Directory replication.
- Restart the following services:
- Microsoft Exchange Search
- Microsoft Exchange Search Host Controller
Still isntantly FailedAndSuspended...
Just Getting Event 1009 MsExchangeFastSearch ….
// Now i have completly uninstalled exchange from the Server , removed all traces Folders / files and registry entries , uninstalled
UML 4.0 and reinstalled , repaired installed C++ redistributables and then tried reinstalling Exchange 2013 CU 15 fresh after install the autogenerated databases state is «FailedAndSuspended»
Please helpt any Feedback apreciated , i Need to move the Mailboxes asap to the new Server and database but dont want to risk it now when
on the second server databases cant be indexed for some reason ….
Hello,
Scenario :
— i need to move our Existing Mailboxes to a new Exchange install on a New 2012r2
— the automatically generated database at install starts with Content index Status : FailedAndSuspended
— newly created database start with : FailedAndSuspended
— after restarting the Services MSExchange Services Host Controller and Search deleting the .single Folder the Status is : FailedAndSuspended
-after creating a new Mailbox in the Database : FailedAndSuspended
-after
Stop-Service HostControllerService
Stop-Service MSexchangeFastService
Dismounting Database
deleting Folder «GUID.single»
start-Service HostControllerService
start-Service MSexchangeFastService
Mounting Database
after that ContentIndexStatus goes to : Failed and Suspended
And Administrator Event log Shows :
The FastFeeder component received a connection exception from FAST. Error details: System.ServiceModel.FaultException`1[System.ServiceModel.ExceptionDetail]: Internal error while processing request (Fehlerdetail ist gleich Ein ExceptionDetail, vermutlich erstellt durch IncludeExceptionDetailInFaults=TRUE, mit dem Wert: Microsoft.Ceres.InteractionEngine.Component.ProcessingEngineException: Internal error while processing request bei Microsoft.Ceres.InteractionEngine.Component.CieProcessingEngine.LogAndRethrowException(Exception e) bei Microsoft.Ceres.InteractionEngine.Component.CieProcessingEngine.Close(Guid flowIdentifier) bei Microsoft.Ceres.InteractionEngine.Component.CieProcessingEngine.ExecuteSearchFlowAndGetResultCollection(String flowName, IEnumerable`1 inputData, String outputName) bei SyncInvokeExecuteSearchFlowAndGetResultCollection(Object , Object[] , Object[] ) bei System.ServiceModel.Dispatcher.SyncMethodInvoker.Invoke(Object instance, Object[] inputs, Object[]& outputs) bei System.ServiceModel.Dispatcher.DispatchOperationRuntime.InvokeBegin(MessageRpc& rpc) bei System.ServiceModel.Dispatcher.ImmutableDispatchRuntime.ProcessMessage5(MessageRpc& rpc) bei System.ServiceModel.Dispatche...).
The indexing of mailbox database Live_sample1 encountered an unexpected exception. Error details: Microsoft.Exchange.Search.Core.Abstraction.OperationFailedException: The component operation has failed. ---> Microsoft.Exchange.Search.Engine.FeedingSkippedForCorruptionException: "Feeding was skipped for 'f14fa5db-4d58-4da1-8869-215c08a6a582 (Live_sample1)' due to the state 'Failed', error code: 'CatalogCorruption', failure code: '4321345', failure reason: 'Journal has been detected as invalid.'." bei Microsoft.Exchange.Search.Engine.SearchFeedingController.InternalExecutionStart() bei Microsoft.Exchange.Search.Core.Common.Executable.InternalExecutionStart(Object state) --- Ende der internen Ausnahmestapelüberwachung --- bei Microsoft.Exchange.Search.Core.Common.Executable.EndExecute(IAsyncResult asyncResult) bei Microsoft.Exchange.Search.Engine.SearchRootController.ExecuteComplete(IAsyncResult asyncResult)
Beim Starten der Sitzung "FastDocTracingSession" ist der folgende Fehler aufgetreten: 0xC0000035. Translated : At session start "FastDocTracingSession" occured this error : 0xC0000035.
P.S. Test Mailbox on the database works
There is no DAG as we have only 2 Servers and one of them we want to retire which is the whole point of the move .
Exchange Version 2013 CU15
Version 15.0 (Build 1263.5)
//EDIT:
Content Index Error Message in Exchange PS :
Get-MailboxDatabaseCopyStatus | select ContentIndexErrorCode , ContentIndexErrorMessage
Output: 19 The content index is corrupted.
DiskPErcent Free Space 77% ~ 700 GB
Tried to move Logfiles to different Mounts even to USB mount still same result …
//EDIT: I have also followed this tutorial
exchange-event-log-fehler-1012-msexchangeis-368343
Removed all folders in C:Program FilesMicrosoftExchange ServerV15BinSearchCeresHostControllerDataNodesFsis
and uninstalled and installed search
.installconfig.ps1 -action U -datafolder "c:Program FilesMicrosoftExchange ServerV15BinSearchCeresHostControllerData"
02.
.installconfig.ps1 -action I -datafolder "c:Program FilesMicrosoftExchange ServerV15BinSearchCeresHostControllerData"I have Followed this tutorial :
- Create a new Active Directory group that is named “ContentSubmitters,” and then grant Admistrators and NetworkService full access to the group. This is a dummy group and should be used as a placeholder only. You might want to add a description so that the group is not removed.
- Force or wait for Active Directory replication.
- Restart the following services:
- Microsoft Exchange Search
- Microsoft Exchange Search Host Controller
Still isntantly FailedAndSuspended...
Just Getting Event 1009 MsExchangeFastSearch ….
// Now i have completly uninstalled exchange from the Server , removed all traces Folders / files and registry entries , uninstalled
UML 4.0 and reinstalled , repaired installed C++ redistributables and then tried reinstalling Exchange 2013 CU 15 fresh after install the autogenerated databases state is «FailedAndSuspended»
Please helpt any Feedback apreciated , i Need to move the Mailboxes asap to the new Server and database but dont want to risk it now when
on the second server databases cant be indexed for some reason ….