This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

ITShop Search Error: System.AggregateException: The operation has timed out (Version 8.0.1)

Hey Folks,

 

So after installing the application server and ITShop portal, I am having an issue with the search feature. Whenever I attempt to search for any item in either the top bar or within a new request I get the following:

When I interrogate the application log in the ITShop web application directory I am seeing the following:

2018-05-14 10:51:16.0457 ERROR (    WebLog vu4ba34nlwj54ymqartkn4c5) : System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at VI.WebRuntime.WebConfigConnectionString.Connect()
   at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
   at System.Lazy`1.CreateValue()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Lazy`1.get_Value()
   at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
   at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
   at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at VI.WebRuntime.VI_StandardWeb.VI_ITShop_ProductSelection_FindProduct.<>c__DisplayClass1f.<GridBand2_SubControls>b__1b(Object _s, EventArgs _e)
   at System.Web.UI.Control.OnPreRender(EventArgs e)
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Page.ProcessRequestMain(Boolean includeStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint)
---> (Inner Exception #0) System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at VI.WebRuntime.WebConfigConnectionString.Connect()
   at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
   at System.Lazy`1.CreateValue()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Lazy`1.get_Value()
   at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
   at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
   at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
---> (Inner Exception #0) System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()<---
<---
 System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at VI.WebRuntime.WebConfigConnectionString.Connect()
   at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
   at System.Lazy`1.CreateValue()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Lazy`1.get_Value()
   at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
   at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
   at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at VI.WebRuntime.VI_StandardWeb.VI_ITShop_ProductSelection_FindProduct.<>c__DisplayClass1f.<GridBand2_SubControls>b__1b(Object _s, EventArgs _e)
   at System.Web.UI.Control.OnPreRender(EventArgs e)
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Page.ProcessRequestMain(Boolean includeStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint)
---> (Inner Exception #0) System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at VI.WebRuntime.WebConfigConnectionString.Connect()
   at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
   at System.Lazy`1.CreateValue()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Lazy`1.get_Value()
   at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
   at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
   at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
---> (Inner Exception #0) System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()<---
<---
    at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at VI.WebRuntime.VI_StandardWeb.VI_ITShop_ProductSelection_FindProduct.<>c__DisplayClass1f.<GridBand2_SubControls>b__1b(Object _s, EventArgs _e)
   at System.Web.UI.Control.OnPreRender(EventArgs e)
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Page.ProcessRequestMain(Boolean includeStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint)

I have removed and re-added both the webportal and app server. Not 100% where the timeout would occur or where I can adjust the parameter that governs this.

I don't see any errors in the application server app log.

Any insight would be awesome as I am building some demo use cases that depend on search and have not been successful in clearing this error.

 

Thanks!

Parents
  • Did you install an index and crawler for the search on the app server?
    Is the web portal authentication direct to the database? Then you need an authentication to the app server (with installed index and crawler) for the search as well.
Reply
  • Did you install an index and crawler for the search on the app server?
    Is the web portal authentication direct to the database? Then you need an authentication to the app server (with installed index and crawler) for the search as well.
Children
  • Hey Geraldine,

    So it seems that this issue has emerged again, and I have not been able to get this working correctly. While I can request and approve things that are registered in the ITShop, I am still having some issues when searching for items.

    What I have done:

    • Uninstalled all of the web applications
    • Installed the ApplicationServer

      • DB authentication as the system user (VIAdmin in this case for lab purposes
      • Have tried running the pool as the "ApplicationPoolIdentity" and also as a specific service account.
      • Ensured that the  roles "Search Service" and "Search Indexing Service" are selected during install (all boxes checked)

    • Installed the web portal
      |
      • DB authentication as the system user (VIAdmin in this case for lab purposes)
      • Ensured that the application server can be seen and selected
        • Tried both enforcing the certificate and not during the configuration
      • After installing, I see no reference to the application server in the web.config (not sure if this is relevant but I read some other threads where someone asked to check this)
        • I also tried to configure using the "WebDesigner.ConfigFileEditor" after the fact, but this did not yield any results.

    Other things worthy of note:

    • I can interrogate the Application API via a system API account that I created for testing using some of the nice sample scripts adapted for some of my test cases.
    • The app server shows up as a web application in the JobQueueInfo viewer.
    • I ensured that the identity manager service account has full permissions to the directories that the web apps live in.

    What happens:

    • When working in the portal I can toggle the "Include child categories" checkbox and get results.
      • The same is true for when I hit the "White Pages", users show up.
      • When I attempt to search however, the search takes a long time (30+ seconds), times out and bubbles up the error that I opened the thread with.
    • Subsequent searches fail immediately after the initial timeout occurs. See the output from the log below (I do not see any errors in the app server logs, both apps are installed in the same site instance).

    Below is the latest output from the log from the user portal that correlates to the search I just tried. Not sure what I am doing wrong here, but I have to demonstrate this to some stakeholders on this coming Monday and would love to have this figured out. Any insights would be greatly appreciated.

    I updated the output in the log after changing the portal config to trace logging.

    2018-06-01 07:12:04.9534  INFO ( ObjectLog 00pa1a34hszkpzhlwfdejvgq) : User Rehm, Omar (Dialog user: CCC-336E891ED192412DA3302B08BBDD5519, X fields: LAB\REHMO) authenticated. 
    2018-06-01 07:12:05.0784  INFO (    WebLog 00pa1a34hszkpzhlwfdejvgq) : Module instance created: VI_MyData_WhitePages 
    2018-06-01 07:12:05.0784  INFO (    WebLog 00pa1a34hszkpzhlwfdejvgq) : Creating form VI_MyData_WhitePages Search 
    2018-06-01 07:12:08.1098  INFO (    WebLog kgcspbaig2kyed4k2cpe11xj) : Module instance created: VI_Session 
    2018-06-01 07:12:08.1254  INFO (    WebLog kgcspbaig2kyed4k2cpe11xj) : Session kgcspbaig2kyed4k2cpe11xj started 
    2018-06-01 07:12:08.1254  INFO (    WebLog kgcspbaig2kyed4k2cpe11xj) : Disposing session kgcspbaig2kyed4k2cpe11xj 
    2018-06-01 07:12:08.1254  INFO (    WebLog kgcspbaig2kyed4k2cpe11xj) : Session kgcspbaig2kyed4k2cpe11xj ended. Now 2 active sessions. 
    2018-06-01 07:12:10.5473 ERROR (    WebLog 00pa1a34hszkpzhlwfdejvgq) : VI.Base.ViException: An exception has occurred while executing the form method F0_ctl00_ControlRef8_ControlRef15_ControlRef15_ControlRef8b_Main_Main_GridBand2_gridLoader_ctl03_GridSearchBox. ---> System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
       at System.Net.HttpWebRequest.GetResponse()
       at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
       at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
       at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
       at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
       at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
       at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
       at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
       at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
       --- End of inner exception stack trace ---
       at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
       at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
       at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
       at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
       at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
       at VI.Base.IoC.ContainerBuilder.Build()
       at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
       at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
       at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
       --- End of inner exception stack trace ---
       at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
       at VI.WebRuntime.WebConfigConnectionString.Connect()
       at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
       at System.Lazy`1.CreateValue()
    --- End of stack trace from previous location where exception was thrown ---
       at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
       at System.Lazy`1.get_Value()
       at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
       at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
       at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
    --- End of stack trace from previous location where exception was thrown ---
       at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
       at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
       at VI.WebRuntime.WebControls.GridSearchBox.GridSearchFormMethod.<ExecuteAsync>d__8.MoveNext()
       --- End of inner exception stack trace ---
       at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
       at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
       at VI.Base.SyncActions.Do(Func`1 action)
       at VI.WebRuntime.Compatibility.SyncExtensions.Execute(IFormMethod formMethod, HttpContextBase context, IFormRenderPart renderPart, CancellationToken ct)
       at VI.WebRuntime.FormMethodHandler.ExecuteFormMethod(HttpContextBase context, String renderPartId, IDictionary`2 parameters, String clientId)
       --- End of inner exception stack trace ---
       at VI.WebRuntime.FormMethodHandler.ExecuteFormMethod(HttpContextBase context, String renderPartId, IDictionary`2 parameters, String clientId) VI.Base.ViException: An exception has occurred while executing the form method F0_ctl00_ControlRef8_ControlRef15_ControlRef15_ControlRef8b_Main_Main_GridBand2_gridLoader_ctl03_GridSearchBox. ---> System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
       at System.Net.HttpWebRequest.GetResponse()
       at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
       at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
       at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
       at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
       at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
       at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
       at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
       at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
       --- End of inner exception stack trace ---
       at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
       at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
       at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
       at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
       at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
       at VI.Base.IoC.ContainerBuilder.Build()
       at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
       at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
       at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
       --- End of inner exception stack trace ---
       at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
       at VI.WebRuntime.WebConfigConnectionString.Connect()
       at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
       at System.Lazy`1.CreateValue()
    --- End of stack trace from previous location where exception was thrown ---
       at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
       at System.Lazy`1.get_Value()
       at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
       at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
       at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
    --- End of stack trace from previous location where exception was thrown ---
       at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task)
       at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
       at VI.WebRuntime.WebControls.GridSearchBox.GridSearchFormMethod.<ExecuteAsync>d__8.MoveNext()
       --- End of inner exception stack trace ---
       at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
       at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
       at VI.Base.SyncActions.Do(Func`1 action)
       at VI.WebRuntime.Compatibility.SyncExtensions.Execute(IFormMethod formMethod, HttpContextBase context, IFormRenderPart renderPart, CancellationToken ct)
       at VI.WebRuntime.FormMethodHandler.ExecuteFormMethod(HttpContextBase context, String renderPartId, IDictionary`2 parameters, String clientId)
       --- End of inner exception stack trace ---
       at VI.WebRuntime.FormMethodHandler.ExecuteFormMethod(HttpContextBase context, String renderPartId, IDictionary`2 parameters, String clientId)    at VI.WebRuntime.FormMethodHandler.ExecuteFormMethod(HttpContextBase context, String renderPartId, IDictionary`2 parameters, String clientId)
    2018-06-01 07:12:12.1099  INFO (    WebLog mcmvarrzbrsltig0yrcbnwqz) : Module instance created: VI_Session