TIBCO-BW-TEAAGENT-500409: Failed to Start Application Instance

My scenario is,I am having one application running in one node. (TEADomainAppSpaceAppNodeDBQuery.application), subsequently, I have created another node, TEADomainAppSpaceAppNode_2 and the observation is, the existing application is also getting deployed into AppNode_2 without my knowledge and which shows status as Failed,

And exception is,

TIBCO-BW-TEAAGENT-500409: Failed to start Application instance

Details

TIBCO-BW-ADMIN-500444: Failed to start Application in AppNode [TEANode_2]. Check the AppNode log files for messages starting with TIBCO-THOR-FRWK, TIBCO-BW-FRWK, or TIBCO-BW-SR-FRWK for details. Application State [StartFailed], reason : TIBCO-BW-FRWK-600026: Failed to start BW Module [DBQuery:1.0.0.201407111702], <CausedBy> TIBCO-BW-FRWK-600064: Failed to create Shared Resource [dbquery.HTTPConnectorResource]. For the cause look for log message with prefix "TIBCO-BW-SR-FRWK" in this log file..CausedByjava.lang.RuntimeException: TIBCO-BW-FRWK-600064: Failed to create Shared Resource [dbquery.HTTPConnectorResource]. For the cause look for log message with prefix "TIBCO-BW-SR-FRWK" in this log file.

Log File:-01:24:58.990 ERROR [CM Configuration Updater (Update: pid={ c.t.b.s.r.c.SharedResourceModulePropertyTracker - TIBCO-BW-SR-FRWK-502000: Failed to start SharedResource [dbquery.HTTPConnectorResource] for Module [DBQuery:1.0.0.201407111702], DeploymentUnit [DBQuery.application:1.0].

<CausedBy> com.tibco.bw.sharedresource.http.runtime.inbound.jetty.HttpConnectorLifeCycleFault: TIBCO-BW-SR-HTTP-CONNECTOR-500004: Unable to start HTTP Server instance for resource [dbquery.HTTPConnectorResource].

<CausedBy> com.tibco.bw.sharedresource.http.runtime.inbound.jetty.HttpConnectorException: TIBCO-BW-SR-HTTP-CONNECTOR-500012: Failed to create HTTP Connector resource [dbquery.HTTPConnectorResource] configured with port [localhost:8443].

<CausedByjava.net.BindException: Address already in use: bind

01:24:59.716 ERROR [qtp1020704416-49] com.tibco.thor.frwk.Application - TIBCO-THOR-FRWK-600026: Failed to start BW Application [DBQuery.application:1.0]. Reason: TIBCO-BW-FRWK-600026: Failed to start BW Module [DBQuery:1.0.0.201407111702], <CausedBy> TIBCO-BW-FRWK-600064: Failed to create Shared Resource [dbquery.HTTPConnectorResource]. For the cause look for log message with prefix "TIBCO-BW-SR-FRWK" in this log file..

<CausedByjava.lang.RuntimeException: TIBCO-BW-FRWK-600064: Failed to create Shared Resource [dbquery.HTTPConnectorResource]. For the cause look for log message with prefix "TIBCO-BW-SR-FRWK" in this log file.

Then I tried uploading my 2nd application, event went smooth but no EAR file in TEA UI but a “Folder icon”.

Subsequently, I tried uploading it again then I could see the Calculator.application_1.0.0.ear.

After upload, I tried 2nd application deployment then application deployment scope available is,AppSpace, can’t we have AppNode selection option to specify the further specific scope till Node ?or it’s OOTB functionality to deploy the application on all the available AppNodes under respective DomainAppSpace ?

Also what is the significance/scope of “Profile” option here ?

I tried deploying my 2nd application with default HTTP connector resource port as “8080” where I received following Failed to deploy error mentioning failed to create shared resource, HTTPConnectorResource.

00:34:43.518 ERROR [CM Configuration Updater (Update: pid={ c.t.b.s.r.c.SharedResourceModulePropertyTracker - TIBCO-BW-SR-FRWK-502000: Failed to start SharedResource [calculator.HTTPConnectorResource] for Module [Calculator:1.0.0.201407122210], DeploymentUnit [Calculator.application:1.0].

<CausedBy> com.tibco.bw.sharedresource.http.runtime.inbound.jetty.HttpConnectorException: TIBCO-BW-SR-HTTP-CONNECTOR-500012: Failed to create HTTP Connector resource [calculator.HTTPConnectorResource] configured with port [sbankar-t420:8080].

<CausedByjava.net.BindException: Address already in use: bind

Looks like, the port “8080” has already been reserved by AppNode, “TEANode”, with PID as 23556.

But got bit confused to see thatAppNode, TEANode is reserving some other ports,

And subsequently, when I checked the Application tab, surprising part was, application got deployed on both the nodes with status as running on one node but failed to start on another as snapped below.

So what is the scope of shared resource port ? So instead of sharing shared resource port across nodes,

is it getting deployed on port 8080 for Node 1 & trying another instance deployment for Node2 which is failing due to port clash?

To confirm the same, I stopped AppNode, “TEANode” and made another AppNode, TEANode_2 alive.

Then I tried deploying the same application again and here is the result,

Now, if I start the other AppNode, TEANodeand try to run the application instance then it fails with the same address binding exception,

01:14:41.876 ERROR [qtp1020704416-52] c.t.b.s.r.c.SharedResourceModulePropertyTracker - TIBCO-BW-SR-FRWK-502000: Failed to start SharedResource [calculator.HTTPConnectorResource] for Module [Calculator:1.0.0.201407122210], DeploymentUnit [Calculator.application:1.0].

<CausedBy> com.tibco.bw.sharedresource.http.runtime.inbound.jetty.HttpConnectorException: TIBCO-BW-SR-HTTP-CONNECTOR-500012: Failed to create HTTP Connector resource [calculator.HTTPConnectorResource] configured with port [sbankar-t420:8080].

<CausedByjava.net.BindException: Address already in use: bind

01:14:41.942 ERROR [qtp1020704416-52] com.tibco.thor.frwk.Application - TIBCO-THOR-FRWK-600026: Failed to start BW Application [Calculator.application:1.0]. Reason: TIBCO-BW-FRWK-600026: Failed to start BW Module [Calculator:1.0.0.201407122210], <CausedBy> TIBCO-BW-FRWK-600064: Failed to create Shared Resource [calculator.HTTPConnectorResource]. For the cause look for log message with prefix "TIBCO-BW-SR-FRWK" in this log file..