Identity Manager

ITShop Search Error: System.AggregateException: The operation has timed out (Version 8.0.1)

Hey Folks,

 

So after installing the application server and ITShop portal, I am having an issue with the search feature. Whenever I attempt to search for any item in either the top bar or within a new request I get the following:

When I interrogate the application log in the ITShop web application directory I am seeing the following:

2018-05-14 10:51:16.0457 ERROR (    WebLog vu4ba34nlwj54ymqartkn4c5) : System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at VI.WebRuntime.WebConfigConnectionString.Connect()
   at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
   at System.Lazy`1.CreateValue()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Lazy`1.get_Value()
   at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
   at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
   at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at VI.WebRuntime.VI_StandardWeb.VI_ITShop_ProductSelection_FindProduct.<>c__DisplayClass1f.<GridBand2_SubControls>b__1b(Object _s, EventArgs _e)
   at System.Web.UI.Control.OnPreRender(EventArgs e)
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Page.ProcessRequestMain(Boolean includeStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint)
---> (Inner Exception #0) System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at VI.WebRuntime.WebConfigConnectionString.Connect()
   at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
   at System.Lazy`1.CreateValue()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Lazy`1.get_Value()
   at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
   at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
   at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
---> (Inner Exception #0) System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()<---
<---
 System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at VI.WebRuntime.WebConfigConnectionString.Connect()
   at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
   at System.Lazy`1.CreateValue()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Lazy`1.get_Value()
   at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
   at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
   at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at VI.WebRuntime.VI_StandardWeb.VI_ITShop_ProductSelection_FindProduct.<>c__DisplayClass1f.<GridBand2_SubControls>b__1b(Object _s, EventArgs _e)
   at System.Web.UI.Control.OnPreRender(EventArgs e)
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Page.ProcessRequestMain(Boolean includeStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint)
---> (Inner Exception #0) System.AggregateException: One or more errors occurred. ---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at VI.WebRuntime.WebConfigConnectionString.Connect()
   at VI.WebRuntime.ServiceConnection.BuildAppServerConnection()
   at System.Lazy`1.CreateValue()
--- End of stack trace from previous location where exception was thrown ---
   at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
   at System.Lazy`1.get_Value()
   at VI.WebRuntime.ServiceConnection.GetAppServerOrDefaultConnection()
   at VI.WebRuntime.Data.SearchHelper..ctor(Nullable`1 isSearchWithPrefix, ISession session)
   at VI.WebRuntime.Data.SearchBasedFilter.<LoadAsync>d__1.MoveNext()
---> (Inner Exception #0) System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The operation has timed out
   at System.Net.HttpWebRequest.GetResponse()
   at ServiceStack.ServiceClientBase.Send[TResponse](String httpMethod, String relativeOrAbsoluteUrl, Object request)
   at QBM.AppServer.Client.AppServerClient.Get[T](IReturn`1 request)
   at QBM.AppServer.Client.ServerReachableCheck..ctor(IAppServerClient client, Int32 connectionTimeout)
   at QBM.AppServer.Client.ServiceClientFactory.<>c__DisplayClass1_0.<RegisterGlobalServices>b__6(IComponentContext ctx)
   at VI.Base.IoC.ContainerBuilder.<>c__DisplayClass5_0`1.<Register>b__0(IComponentContext ctx)
   at VI.Base.IoC.LifetimeScopeImpl._GetOrCreate[T](LifetimeScopeImpl requestingScope, ComponentRegistration registration)
   at VI.Base.IoC.LifetimeScopeImpl._InternalResolve[T](LifetimeScopeImpl requestingScope, String name, T& ret)
   at VI.Base.IoC.LifetimeScopeImpl.Resolve[T]()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at VI.Base.IoC.LifetimeScopeImpl._ForceResolve(Type type, String name)
   at VI.Base.IoC.LifetimeScopeImpl..ctor(IReadOnlyDictionary`2 anonymousRegistrations, IReadOnlyDictionary`2 namedRegistrations, LifetimeScopeImpl parent)
   at VI.Base.IoC.ContainerBuilder.Build()
   at VI.DB.Entities.SessionFactoryImpl..ctor(ConnectionType connectionType, ContainerBuilder rootScopeBuilder, Action`2 registerSessionServices, Action`2 registerPermissionSessionServices, Boolean withoutSafeWrapper)
   at VI.DB.Entities.SessionFactoryConfiguration._CreateSessionFactory(IDbFactory factory, String connectionString)
   at VI.DB.DbApp.<ConnectAsync>d__5.MoveNext()<---
<---
    at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at VI.WebRuntime.VI_StandardWeb.VI_ITShop_ProductSelection_FindProduct.<>c__DisplayClass1f.<GridBand2_SubControls>b__1b(Object _s, EventArgs _e)
   at System.Web.UI.Control.OnPreRender(EventArgs e)
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Control.PreRenderRecursiveInternal()
   at System.Web.UI.Page.ProcessRequestMain(Boolean includeStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint)

I have removed and re-added both the webportal and app server. Not 100% where the timeout would occur or where I can adjust the parameter that governs this.

I don't see any errors in the application server app log.

Any insight would be awesome as I am building some demo use cases that depend on search and have not been successful in clearing this error.

 

Thanks!

  • Just wanted to add that outside of search and some basic slowness, everything else seems to work fine. Request/approve, etc..
  • Hello

    It appears that the application server is not responding due to the timeout, I wonder if it sees the request at all?

    Are you able to access the application server from the web server?

    You may need to increase the HttpRunTime in the web.config.

    Trevor
  • Hey Trevor,

    Interesting, I will take a look.

    Which app are you suggesting that I consider increasing the HttpRunTime for? The App server or the web portal?

    Thanks!
  • Did you install an index and crawler for the search on the app server?
    Is the web portal authentication direct to the database? Then you need an authentication to the app server (with installed index and crawler) for the search as well.
  • Hey Geraldine,

    I have got things working, but it appears that perhaps this was a self inflicted issue. At one point I configured Oauth for the portal, and abandoned this so that I could test different use cases against different people within the heirarchy.

    Not 100% what exactly fixed the issue, but what I did was the following:

    - In designer, I disabled all of the Oauth configurations.
    - I then uninstalled the web portal
    - I re-installed the web portal and made sure that it could reach the app server.

    It is odd because I did use the web designer to change the authentication used for the portal, but for some reason it seemed to be continuing to register exceptions that contained references to client ID.

    I do not understand how I would separately install the index or crawler as I only know how to install the portal or appserver using the web installer.

    Thanks a bunch for the suggestions though, I have tucked them into the reference bank for the future.