NATT Probe and IKE stats detailed tables not displaying any data on visualization tab

[psjawale]

JIRA bug: http://mvjira.mv.usa.alcatel.com:8080/browse/VSD-26147
NATT Probe and ike stats detailed tables not displaying any data on visualization tab on clicking on any of the blocks

natt_stats detailed messages are present on elastic search

{
"took": 3,
"timed_out": false,
"_shards": {
"total": 5,
"successful": 5,
"failed": 0
},
"hits": {
"total": 10,
"max_score": 1.8787708,
"hits": [
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnLwV3aTKP1nBrjIl",
"_score": 1.8787708,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "2",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "secondary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "130.104.0.6",
"DstUplinkRole": "primary",
"VscIPSecPort": "1044",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "1062",
"ProbeVxLanIP": "130.104.0.6",
"ProbeVxLanPort": "1083",
"VscVxLanPort": "1033",
"timestamp": 1538011214941,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port2",
"Reason": "VSC learnt IPs flapped. Probe Learnt IPs flapped. "
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnaZ63aTKP1nBrjLS",
"_score": 1.8787708,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "2",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "secondary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "0.0.0.0",
"DstUplinkRole": "primary",
"VscIPSecPort": "1044",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "0",
"ProbeVxLanIP": "130.104.0.6",
"ProbeVxLanPort": "1083",
"VscVxLanPort": "1033",
"timestamp": 1538011275062,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port2",
"Reason": "VSC learnt IPSec IP flapped. Probe Learnt VxLan IP flapped. IPSec probe timed out. "
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnhur3aTKP1nBrjMZ",
"_score": 1.7227666,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "1",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "primary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "130.104.0.5",
"DstUplinkRole": "primary",
"VscIPSecPort": "1040",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "1072",
"ProbeVxLanIP": "130.104.0.5",
"ProbeVxLanPort": "1071",
"VscVxLanPort": "1033",
"timestamp": 1538011305138,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port1",
"Reason": "Probe Learnt IPSec IP flapped. "
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnpDe3aTKP1nBrjNn",
"_score": 1.7227666,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "1",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "primary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "130.104.0.5",
"DstUplinkRole": "primary",
"VscIPSecPort": "1040",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "1072",
"ProbeVxLanIP": "130.104.0.5",
"ProbeVxLanPort": "1071",
"VscVxLanPort": "1033",
"timestamp": 1538011335166,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port1",
"Reason": ""
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnpDe3aTKP1nBrjNm",
"_score": 1.4604024,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "2",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "secondary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "130.104.0.6",
"DstUplinkRole": "primary",
"VscIPSecPort": "1040",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "1062",
"ProbeVxLanIP": "130.104.0.6",
"ProbeVxLanPort": "1083",
"VscVxLanPort": "1033",
"timestamp": 1538011335166,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port2",
"Reason": ""
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnhur3aTKP1nBrjMa",
"_score": 1.3426193,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "2",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "secondary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "130.104.0.6",
"DstUplinkRole": "primary",
"VscIPSecPort": "1040",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "1062",
"ProbeVxLanIP": "130.104.0.6",
"ProbeVxLanPort": "1083",
"VscVxLanPort": "1033",
"timestamp": 1538011305138,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port2",
"Reason": "Probe Learnt IPSec IP flapped. "
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnwYP3aTKP1nBrjOw",
"_score": 1.3426193,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "1",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "primary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "130.104.0.5",
"DstUplinkRole": "primary",
"VscIPSecPort": "1040",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "1072",
"ProbeVxLanIP": "130.104.0.5",
"ProbeVxLanPort": "1071",
"VscVxLanPort": "1033",
"timestamp": 1538011365183,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port1",
"Reason": ""
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnLwV3aTKP1nBrjIm",
"_score": 0.8912171,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "1",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "primary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "130.104.0.5",
"DstUplinkRole": "primary",
"VscIPSecPort": "1044",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "1072",
"ProbeVxLanIP": "130.104.0.5",
"ProbeVxLanPort": "1071",
"VscVxLanPort": "1033",
"timestamp": 1538011214941,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port1",
"Reason": "VSC learnt IPs flapped. Probe Learnt IPs flapped. "
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnaZ63aTKP1nBrjLR",
"_score": 0.8912171,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "1",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "primary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "0.0.0.0",
"DstUplinkRole": "primary",
"VscIPSecPort": "1044",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "0",
"ProbeVxLanIP": "130.104.0.5",
"ProbeVxLanPort": "1071",
"VscVxLanPort": "1033",
"timestamp": 1538011275062,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port1",
"Reason": "VSC learnt IPSec IP flapped. Probe Learnt VxLan IP flapped. IPSec probe timed out. "
}
}
,
{
"_index": "nuage_natt-2018-09-27",
"_type": "nuage_doc_type",
"_id": "AWYYnwYP3aTKP1nBrjOx",
"_score": 0.8912171,
"_source": {
"VscVxLanIP": "130.104.0.1",
"SrcUplinkIndex": "2",
"VscIPSecIP": "130.104.0.1",
"SrcUplinkRole": "secondary",
"SrcNSG": "209.193.65.111",
"DstNSG": "214.22.183.82",
"ProbeIPSecIP": "130.104.0.6",
"DstUplinkRole": "primary",
"VscIPSecPort": "1040",
"DstUplinkIndex": "1",
"ProbeIPSecPort": "1062",
"ProbeVxLanIP": "130.104.0.6",
"ProbeVxLanPort": "1083",
"VscVxLanPort": "1033",
"timestamp": 1538011365183,
"SourceNSG": "ovs-2",
"EnterpriseName": "test_organization",
"DestinationNSG": "ovs-1",
"DstUplink": "port1",
"SrcUplink": "port2",
"Reason": ""
}
}
]
}
}

IKE-stats detailed messages on elastic

{
"took": 2,
"timed_out": false,
"_shards": {
"total": 5,
"successful": 5,
"failed": 0
},
"hits": {
"total": 6,
"max_score": 1,
"hits": [
{
"_index": "nuage_ike_probestats-2018-09-29",
"_type": "nuage_doc_type",
"_id": "AWYioWeFt8ut3ipE3PUI",
"_score": 1,
"_source": {
"Tier2State": "STOPPED",
"ProbeState": "DOWN",
"MultipleStatesChanged": false,
"SrcNSG": "151.160.28.95",
"Tier1URLInfo": [
{
"UrlFailureReason ": "PROBE_TIME_OUT_FAILURE",
"UrlUUID": "eda89869-4604-4f4a-b957-713f94ff286e",
"UrlString": "http://google.com",
"UrlState": "DOWN"
}
],
"TunnelID": "2ee2b2c3-8172-430c-a4e4-d3391f372dd3",
"ProbeFailureReason": "TIER_1",
"ProbeID": "29a291af-c9df-4e0f-9c75-bf991b735d88",
"timestamp": 1538179292477,
"Tier1State": "DOWN",
"ProbeName": "test-probe-1",
"SourceNSG": "ovs-2",
"TunnelName": "My_Ikev2_Gw_Conn_1-2"
}
}
,
{
"_index": "nuage_ike_probestats-2018-09-29",
"_type": "nuage_doc_type",
"_id": "AWYioduvt8ut3ipE3PVo",
"_score": 1,
"_source": {
"Tier2State": "STOPPED",
"ProbeState": "DOWN",
"MultipleStatesChanged": false,
"SrcNSG": "211.126.137.197",
"Tier1URLInfo": [
{
"UrlFailureReason ": "PROBE_TIME_OUT_FAILURE",
"UrlUUID": "eda89869-4604-4f4a-b957-713f94ff286e",
"UrlString": "http://google.com",
"UrlState": "DOWN"
}
],
"TunnelID": "a43c38dd-3a05-41c0-8c7d-afc95e9ccc1b",
"ProbeFailureReason": "TIER_1",
"ProbeID": "29a291af-c9df-4e0f-9c75-bf991b735d88",
"timestamp": 1538179322832,
"Tier1State": "DOWN",
"ProbeName": "test-probe-1",
"SourceNSG": "ovs-3",
"TunnelName": "My_Ikev2_Gw_Conn_1-3"
}
}
,
{
"_index": "nuage_ike_probestats-2018-09-29",
"_type": "nuage_doc_type",
"_id": "AWYiolDht8ut3ipE3PXR",
"_score": 1,
"_source": {
"Tier2State": "UP",
"ProbeState": "UP",
"MultipleStatesChanged": false,
"SrcNSG": "211.126.137.197",
"Tier1URLInfo": [
{
"UrlUUID": "eda89869-4604-4f4a-b957-713f94ff286e",
"UrlString": "http://google.com",
"UrlState": "UP"
}
],
"TunnelID": "a43c38dd-3a05-41c0-8c7d-afc95e9ccc1b",
"ProbeID": "29a291af-c9df-4e0f-9c75-bf991b735d88",
"timestamp": 1538179352807,
"Tier1State": "UP",
"ProbeName": "test-probe-1",
"SourceNSG": "ovs-3",
"TunnelName": "My_Ikev2_Gw_Conn_1-3"
}
}
,
{
"_index": "nuage_ike_probestats-2018-09-29",
"_type": "nuage_doc_type",
"_id": "AWYioot6t8ut3ipE3PYF",
"_score": 1,
"_source": {
"Tier2State": "UP",
"ProbeState": "UP",
"MultipleStatesChanged": false,
"SrcNSG": "151.160.28.95",
"Tier1URLInfo": [
{
"UrlUUID": "eda89869-4604-4f4a-b957-713f94ff286e",
"UrlString": "http://google.com",
"UrlState": "UP"
}
],
"TunnelID": "998680e2-3b38-48aa-97d7-2ae2f71845ae",
"ProbeID": "29a291af-c9df-4e0f-9c75-bf991b735d88",
"timestamp": 1538179368525,
"Tier1State": "UP",
"ProbeName": "test-probe-1",
"SourceNSG": "ovs-2",
"TunnelName": "My_Ikev2_Gw_Conn_2-2"
}
}
,
{
"_index": "nuage_ike_probestats-2018-09-29",
"_type": "nuage_doc_type",
"_id": "AWYioaEWt8ut3ipE3PU5",
"_score": 1,
"_source": {
"Tier2State": "STOPPED",
"ProbeState": "DOWN",
"MultipleStatesChanged": false,
"SrcNSG": "151.160.28.95",
"Tier1URLInfo": [
{
"UrlFailureReason ": "PROBE_TIME_OUT_FAILURE",
"UrlUUID": "eda89869-4604-4f4a-b957-713f94ff286e",
"UrlString": "http://google.com",
"UrlState": "DOWN"
}
],
"TunnelID": "998680e2-3b38-48aa-97d7-2ae2f71845ae",
"ProbeFailureReason": "TIER_1",
"ProbeID": "29a291af-c9df-4e0f-9c75-bf991b735d88",
"timestamp": 1538179308452,
"Tier1State": "DOWN",
"ProbeName": "test-probe-1",
"SourceNSG": "ovs-2",
"TunnelName": "My_Ikev2_Gw_Conn_2-2"
}
}
,
{
"_index": "nuage_ike_probestats-2018-09-29",
"_type": "nuage_doc_type",
"_id": "AWYiolDht8ut3ipE3PXQ",
"_score": 1,
"_source": {
"Tier2State": "UP",
"ProbeState": "UP",
"MultipleStatesChanged": false,
"SrcNSG": "151.160.28.95",
"Tier1URLInfo": [
{
"UrlUUID": "eda89869-4604-4f4a-b957-713f94ff286e",
"UrlString": "http://google.com",
"UrlState": "UP"
}
],
"TunnelID": "2ee2b2c3-8172-430c-a4e4-d3391f372dd3",
"ProbeID": "29a291af-c9df-4e0f-9c75-bf991b735d88",
"timestamp": 1538179352524,
"Tier1State": "UP",
"ProbeName": "test-probe-1",
"SourceNSG": "ovs-2",
"TunnelName": "My_Ikev2_Gw_Conn_1-2"
}
}
]
}
}

[psjawale]

c.c @bmukheja @natabal

[bharat-mukheja]

@nxanil - The root issue for this is that there is a bug in listeners. I checked a couple of places and it was not updating the values of variables in the context. Can you please fetch the master and see what the bug is?

[natabal]

@nxanil Please address this issue. See attach as well an exception in the console log.

[psjawale]

Above issue not seen any more.

However, facing a different issue with ike_stats events table
http://mvjira.mv.usa.alcatel.com:8080/browse/VSD-26264

Please refer attached images
in image table1 when a probe entry is selected in Probe status events table, we see empty rows in Tier URL events table.
On clicking on different block 2-3 times or refreshing page, URLs appear in the Tier URL events table as seen in image table2

[bharat-mukheja]

Thanks @psjawale for informing us. Taking a look at the issue.

[bharat-mukheja]

@nxanil can you please look into this fast?

[nxanil]

@psjawale
Could you please test the above issue now on the latest code. Thanks