Category Archives: Networking

29 Nov

Facebook FNA node update

In March 2018 I mapped nodes of Facebook globally using the airport string they use in the CDN URLs (detailed post here). Since then I posted a couple of times updates on as they are adding more nodes. There also have been questions via emails and comments on the blog in recent times about updated data.

Here goes latest data as on 22 Nov 2019. It’s published here.

Global stats

  • Total nodes increased from 2204 as from Aug 2018 to 3184 now in Nov 2019.
  • Highest number FNA nodes are AS28573 (CLARO S.A., BR). They have 111 nodes!
  • 2nd highest is AS27699 (TELEFÔNICA BRASIL S.A, BR) with 47 nodes.
  • 3rd highest is AS18881 which seems to be related to 2nd highest with 37 nodes.
  • After Brazil, it’s Indian operators with highest number of visible FNAs in the world.
  • Highest number of FNA nodes are in city of Sao Paulo (Airport code: SAO). There are 88 nodes there.
  • 2nd higest is Rio (Airport code: GIG +RBR+SDU) with 51 nodes.
  • 3rd higest is Dhaka, Bangladesh with 48 nodes.
  • Out of total 3184 nodes, 2228 nodes have an IPv6 address & are dual stacked. That is about 69.97%.

Indian stats

  • Airtel AS9498 has highest number of Facebook FNA caching nodes. They got 33 nodes which is nice jump.
  • Jio got 2nd highest in India with around 32 nodes.
  • Vodafone AS38266 has got 25 nodes, while IDEA Cellular (with whom they merged recently) has got 13 nodes.
  • One interesting addition here seems to be AS18229 (CtrlS datacenter) in Hyderabad. Likely the node is to serve the traffic of their sister company – Pioneer Labs.
  • In total there are 208 Facebook FNA caching nodes in India.

Remember number of nodes is just a number & may not reflect actual capacity.

Indian FNA node list

ASNAS Name IPv4IPv6Airport CodeAirport Name
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.156.172404:a800:6:21:face:b00c:0:a7AMDAhmedabad
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.155.172404:a800:6:28:face:b00c:0:a7BBIBhubaneswar
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.133.812404:a800:6:3f:face:b00c:0:a7BBIBhubaneswar
9498BBIL-AP BHARTI Airtel Ltd., IN116.119.39.182404:a800:6:5e:face:b00c:0:a7BEKRae
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.155.812404:a800:6:29:face:b00c:0:a7BHOBhopal
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.129.172404:a800:6:4e:face:b00c:0:a7BHOBhopal
9498BBIL-AP BHARTI Airtel Ltd., IN157.240.191.1452a03:2887:ff05:200:face:b00c:0:a7BOMBombay
9498BBIL-AP BHARTI Airtel Ltd., IN157.240.191.192a03:2887:ff05:0:face:b00c:0:a7BOMBombay
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.139.1482404:a800:6:3c:face:b00c:0:a7CCJCalicut
9498BBIL-AP BHARTI Airtel Ltd., IN157.240.185.172a03:2887:ff06:0:face:b00c:0:a7CCUCalcutta
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.194.2092404:a800:6:1c:face:b00c:0:a7CCUCalcutta
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.129.2112404:a800:6:51:face:b00c:0:a7CJBCoimbatore
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.128.182404:a800:6:52:face:b00c:0:a7DBDDhanbad
9498BBIL-AP BHARTI Airtel Ltd., IN157.240.189.172a03:2887:ff03:0:face:b00c:0:a7DELDelhi
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.139.832404:a800:6:3b:face:b00c:0:a7DELDelhi
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.156.2092404:a800:6:27:face:b00c:0:a7GAUGuwahati
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.139.2122404:a800:6:3d:face:b00c:0:a7IXCChandigarh
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.194.1452404:a800:6:1b:face:b00c:0:a7IXEMangalore
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.133.1462404:a800:6:40:face:b00c:0:a7IXJJammu
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.132.832404:a800:6:43:face:b00c:0:a7IXRRanchi
9498BBIL-AP BHARTI Airtel Ltd., IN157.240.182.172a03:2887:ff0a:0:face:b00c:0:a7JAIJaipur
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.132.192404:a800:6:42:face:b00c:0:a7JDHJodhpur
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.128.832404:a800:6:53:face:b00c:0:a7JRHJorhat
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.156.812404:a800:6:22:face:b00c:0:a7LKOLucknow
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.128.2122404:a800:6:55:face:b00c:0:a7LUHLudhiana
9498BBIL-AP BHARTI Airtel Ltd., IN157.240.190.172a03:2887:ff04:0:face:b00c:0:a7MAAMadras
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.129.822404:a800:6:4f:face:b00c:0:a7NAGNagpur
9498BBIL-AP BHARTI Airtel Ltd., IN157.240.184.172a03:2887:ff08:0:face:b00c:0:a7PATPatna
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.155.1452404:a800:6:2a:face:b00c:0:a7PNQPoona
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.133.2112404:a800:6:41:face:b00c:0:a7RPRRaipur
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.130.2112404:a800:6:4d:face:b00c:0:a7STVSurat
9498BBIL-AP BHARTI Airtel Ltd., IN157.240.183.172a03:2887:ff09:0:face:b00c:0:a7VGAVijayawada
9498BBIL-AP BHARTI Airtel Ltd., IN182.79.128.1462404:a800:6:54:face:b00c:0:a7VNSVaranasi
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.90.172405:200:1611:2885:face:b00c:0:a7AGRAgra
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.88.812405:200:1609:2885:face:b00c:0:a7AMDAhmedabad
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.90.1452405:200:1615:2885:face:b00c:0:a7BBIBhubaneswar
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.90.2092405:200:160d:2885:face:b00c:0:a7BHOBhopal
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.180.2122405:200:163a:1818:face:b00c:0:a7BHOBhopal
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.88.172405:200:1608:2885:face:b00c:0:a7BLRBangalore
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.63.172405:200:1602:2885:face:b00c:0:a7BOMBombay
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.63.2092405:200:1606:2885:face:b00c:0:a7CCUCalcutta
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.180.1452405:200:1617:2885:face:b00c:0:a7CCUCalcutta
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.92.192405:200:163d:2885:face:b00c:0:a7CCUCalcutta
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.91.172405:200:1614:2885:face:b00c:0:a7COKCochin
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.63.1452405:200:160b:2885:face:b00c:0:a7DELDelhi
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.62.1452405:200:1605:2885:face:b00c:0:a7DELDelhi
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.182.172405:200:163c:2885:face:b00c:0:a7DELDelhi
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.90.812405:200:1612:2885:face:b00c:0:a7GAUGuwahati
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.88.1452405:200:160a:2885:face:b00c:0:a7HYDHyderabad
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.180.172405:200:1638:2885:face:b00c:0:a7HYDHyderabad
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.88.2092405:200:160a:1817:face:b00c:0:a7HYDHyderabad
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.181.172405:200:1635:2885:face:b00c:0:a7IXCChandigarh
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.91.812405:200:161a:2885:face:b00c:0:a7IXJJammu
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.181.1452405:200:1636:2885:face:b00c:0:a7IXMMadurai
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.89.1452405:200:160f:2885:face:b00c:0:a7JAIJaipur
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.181.2092405:200:1637:2885:face:b00c:0:a7KNUKanpur
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.89.2092405:200:161c:2885:face:b00c:0:a7LUHLudhiana
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.63.812405:200:1607:2885:face:b00c:0:a7MAAMadras
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.62.172405:200:1604:2885:face:b00c:0:a7NAGNagpur
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.91.1452405:200:1613:2885:face:b00c:0:a7PATPatna
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.182.812405:200:1633:2885:face:b00c:0:a7PATPatna
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.180.812405:200:161d:2885:face:b00c:0:a7SHLShillong
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.92.1452405:200:161b:2885:face:b00c:0:a7SLVSimla
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.92.812405:200:1610:2885:face:b00c:0:a7SXRSrinagar
55836RELIANCEJIO-IN Reliance Jio Infocomm Limited, IN49.44.181.812405:200:163b:2885:face:b00c:0:a7UDRUdaipur
38266VODAFONE-IN Vodafone India Ltd., IN1.38.9.2092402:3a80:c008:13:face:b00c:0:a7AGRAgra
38266VODAFONE-IN Vodafone India Ltd., IN1.38.7.172402:3a80:c000:13:face:b00c:0:a7AMDAhmedabad
38266VODAFONE-IN Vodafone India Ltd., IN1.38.9.172402:3a80:c00c:13:face:b00c:0:a7BLRBangalore
38266VODAFONE-IN Vodafone India Ltd., IN1.38.8.172402:3a80:c002:13:face:b00c:0:a7BOMBombay
38266VODAFONE-IN Vodafone India Ltd., IN112.79.42.1452402:3a80:c01b:13:face:b00c:0:a7BOMBombay
38266VODAFONE-IN Vodafone India Ltd., IN42.106.166.192402:3a80:c002:15:face:b00c:0:a7BOMBombay
38266VODAFONE-IN Vodafone India Ltd., IN112.79.33.172402:3a80:c011:13:face:b00c:0:a7CCJCalicut
38266VODAFONE-IN Vodafone India Ltd., IN1.38.7.2092402:3a80:c009:13:face:b00c:0:a7CCUCalcutta
38266VODAFONE-IN Vodafone India Ltd., IN112.79.43.172402:3a80:c01c:13:face:b00c:0:a7CJBCoimbatore
38266VODAFONE-IN Vodafone India Ltd., IN1.38.9.812402:3a80:c00e:13:face:b00c:0:a7COKCochin
38266VODAFONE-IN Vodafone India Ltd., IN1.38.7.812402:3a80:c005:13:face:b00c:0:a7DELDelhi
38266VODAFONE-IN Vodafone India Ltd., IN1.38.5.172402:3a80:c006:13:face:b00c:0:a7DELDelhi
38266VODAFONE-IN Vodafone India Ltd., IN112.79.39.172402:3a80:c015:13:face:b00c:0:a7DELDelhi
38266VODAFONE-IN Vodafone India Ltd., IN1.38.5.812402:3a80:c00a:13:face:b00c:0:a7GAUGuwahati
38266VODAFONE-IN Vodafone India Ltd., IN112.79.38.172402:3a80:c016:13:face:b00c:0:a7IXCChandigarh
38266VODAFONE-IN Vodafone India Ltd., IN42.106.167.202402:3a80:c01c:15:face:b00c:0:a7IXMMadurai
38266VODAFONE-IN Vodafone India Ltd., IN1.38.9.1452402:3a80:c004:13:face:b00c:0:a7JAIJaipur
38266VODAFONE-IN Vodafone India Ltd., IN112.79.40.172402:3a80:c017:13:face:b00c:0:a7JDHJodhpur
38266VODAFONE-IN Vodafone India Ltd., IN1.38.7.1452402:3a80:c007:13:face:b00c:0:a7LKOLucknow
38266VODAFONE-IN Vodafone India Ltd., IN1.38.8.1452402:3a80:c00b:13:face:b00c:0:a7MAAMadras
38266VODAFONE-IN Vodafone India Ltd., IN112.79.42.172402:3a80:c01a:13:face:b00c:0:a7NAGNagpur
38266VODAFONE-IN Vodafone India Ltd., IN1.38.8.812402:3a80:c003:3:face:b00c:0:a7PNQPoona
38266VODAFONE-IN Vodafone India Ltd., IN112.79.32.172402:3a80:c010:13:face:b00c:0:a7RAJRajkot
38266VODAFONE-IN Vodafone India Ltd., IN1.38.5.1452402:3a80:c001:13:face:b00c:0:a7STVSurat
38266VODAFONE-IN Vodafone India Ltd., IN112.79.36.172402:3a80:c014:13:face:b00c:0:a7VNSVaranasi
55644IDEANET1-IN Idea Cellular Limited, IN223.196.153.172400:c700:300:0:face:b00c:0:a7AMDAhmedabad
55644IDEANET1-IN Idea Cellular Limited, IN223.196.112.172400:c700:104:0:face:b00c:0:a7BLRBangalore
55644IDEANET1-IN Idea Cellular Limited, IN223.196.3.812400:c700:4:0:face:b00c:0:a7BOMBombay
55644IDEANET1-IN Idea Cellular Limited, IN223.196.149.1452400:c700:a000:0:face:b00c:0:a7CCUCalcutta
55644IDEANET1-IN Idea Cellular Limited, IN223.196.58.172400:c700:1080:0:face:b00c:0:a7COKCochin
55644IDEANET1-IN Idea Cellular Limited, IN223.196.64.172400:c700:186:0:face:b00c:0:a7DELDelhi
55644IDEANET1-IN Idea Cellular Limited, IN223.196.145.1452400:c700:1280:0:face:b00c:0:a7DELDelhi
55644IDEANET1-IN Idea Cellular Limited, IN223.196.147.1452400:c700:1100:0:face:b00c:0:a7HYDHyderabad
55644IDEANET1-IN Idea Cellular Limited, IN223.196.92.812400:c700:202:0:face:b00c:0:a7IDRIndore
55644IDEANET1-IN Idea Cellular Limited, IN223.196.151.1452400:c700:1200:0:face:b00c:0:a7IXCChandigarh
55644IDEANET1-IN Idea Cellular Limited, IN223.196.155.172400:c700:380:0:face:b00c:0:a7JAIJaipur
55644IDEANET1-IN Idea Cellular Limited, IN223.196.79.172400:c700:280:0:face:b00c:0:a7LKOLucknow
55644IDEANET1-IN Idea Cellular Limited, IN223.196.82.172400:c700:83:0:face:b00c:0:a7PNQPoona
18207YOU-INDIA-AP YOU Broadband & Cable India Ltd., IN203.187.230.81AMDAhmedabad
18207YOU-INDIA-AP YOU Broadband & Cable India Ltd., IN203.187.249.17BDQBaronda
17488HATHWAY-NET-AP Hathway IP Over Cable Internet, IN202.88.157.812403:c00:b00:b:face:b00c:0:a7BLRBangalore
17488HATHWAY-NET-AP Hathway IP Over Cable Internet, IN202.88.184.172403:c00:0:b:face:b00c:0:a7BOMBombay
18207YOU-INDIA-AP YOU Broadband & Cable India Ltd., IN203.187.217.210BOMBombay
17488HATHWAY-NET-AP Hathway IP Over Cable Internet, IN202.88.147.1452403:c00:d00:b:face:b00c:0:a7DELDelhi
17488HATHWAY-NET-AP Hathway IP Over Cable Internet, IN202.88.191.172403:c00:f00:b:face:b00c:0:a7HYDHyderabad
18207YOU-INDIA-AP YOU Broadband & Cable India Ltd., IN123.201.147.146HYDHyderabad
17488HATHWAY-NET-AP Hathway IP Over Cable Internet, IN202.88.160.812403:c00:c00:b:face:b00c:0:a7MAAMadras
18207YOU-INDIA-AP YOU Broadband & Cable India Ltd., IN203.187.250.17PNQPoona
17488HATHWAY-NET-AP Hathway IP Over Cable Internet, IN202.88.187.172403:c00:900:b:face:b00c:0:a7PNQPoona
18207YOU-INDIA-AP YOU Broadband & Cable India Ltd., IN123.201.167.17STVSurat
17488HATHWAY-NET-AP Hathway IP Over Cable Internet, IN116.72.7.812403:c00:800:b:face:b00c:0:a7STVSurat
18207YOU-INDIA-AP YOU Broadband & Cable India Ltd., IN203.109.89.21VTZVishakhapatnam
17665IN2CABLE-AP AS Number of Indusind Media and communication Ltd., IN203.192.251.209BLRBangalore
17665IN2CABLE-AP AS Number of Indusind Media and communication Ltd., IN103.69.221.172001:df7:6e00:3:face:b00c:0:a7BOMBombay
17665IN2CABLE-AP AS Number of Indusind Media and communication Ltd., IN203.192.223.145BOMBombay
17665IN2CABLE-AP AS Number of Indusind Media and communication Ltd., IN103.57.141.209BOMBombay
17665IN2CABLE-AP AS Number of Indusind Media and communication Ltd., IN203.192.214.147DELDelhi
17665IN2CABLE-AP AS Number of Indusind Media and communication Ltd., IN103.69.222.17PNQPoona
45916GTPL-AS-AP Gujarat Telelink Pvt Ltd, IN43.250.166.209AMDAhmedabad
45916GTPL-AS-AP Gujarat Telelink Pvt Ltd, IN150.129.171.209BDQBaronda
133982EXCITEL-AS-IN Excitel Broadband Private Limited, IN103.56.230.209DELDelhi
133982EXCITEL-AS-IN Excitel Broadband Private Limited, IN103.48.198.209DELDelhi
133982EXCITEL-AS-IN Excitel Broadband Private Limited, IN103.212.157.146DELDelhi
133982EXCITEL-AS-IN Excitel Broadband Private Limited, IN144.48.73.145HYDHyderabad
45916GTPL-AS-AP Gujarat Telelink Pvt Ltd, IN103.250.190.209RAJRajkot
45916GTPL-AS-AP Gujarat Telelink Pvt Ltd, IN150.107.253.209STVSurat
24309CABLELITE-AS-AP Atria Convergence Technologies Pvt. Ltd. Broadband Internet Service Provider INDIA, IN202.83.22.172406:7400:4:1:face:b00c:0:a7BLRBangalore
131269BEAMTELE-AS-AP ACTFIBERNET Pvt Ltd, IN106.51.156.209CJBCoimbatore
24309CABLELITE-AS-AP Atria Convergence Technologies Pvt. Ltd. Broadband Internet Service Provider INDIA, IN49.207.35.172406:7400:b7:0:face:b00c:0:a7MAAMadras
131269BEAMTELE-AS-AP ACTFIBERNET Pvt Ltd, IN49.205.163.209TIRTirupati
131269BEAMTELE-AS-AP ACTFIBERNET Pvt Ltd, IN49.205.167.209VGAVijayawada
24309CABLELITE-AS-AP Atria Convergence Technologies Pvt. Ltd. Broadband Internet Service Provider INDIA, IN106.51.40.81VTZVishakhapatnam
45769DVOIS-IN D-Vois Broadband Pvt Ltd, IN1.186.201.172400:1f00:b7:2:face:b00c:0:a7BLRBangalore
45769DVOIS-IN D-Vois Broadband Pvt Ltd, IN1.186.190.172400:1f00:0:d:face:b00c:0:a7BOMBombay
45194SIPL-AS Syscon Infoway Pvt. Ltd., IN110.5.75.172401:a100:2:4:face:b00c:0:a7BOMBombay
17747SITINETWORS-IN-AP SITI NETWORKS LIMITED, IN103.225.178.2092406:3c80:1:3:face:b00c:0:a7CCUCalcutta
17465ASIANET Cable ISP in India, IN202.88.226.812406:8800:9000:4000:face:b00c:0:a7COKCochin
17747SITINETWORS-IN-AP SITI NETWORKS LIMITED, IN103.217.246.172402:ea80:0:1:face:b00c:0:a7DELDelhi
18209BEAMTELE-AS-AP Atria Convergence Technologies pvt ltd, IN49.207.34.17DELDelhi
55824NKN-CORE-NW NKN Core Network, IN180.149.52.832405:8a00:a:20:face:b00c:0:a7DELDelhi
13490BUCKEYECABLEVISION – Buckeye Cablevision, Inc., US72.240.67.82DTWDetroit
18209BEAMTELE-AS-AP Atria Convergence Technologies pvt ltd, IN183.82.15.172406:b400:7:5:face:b00c:0:a7HYDHyderabad
17754EXCELL-AS Excellmedia, IN202.133.50.812401:fb00:0:1:face:b00c:0:a7HYDHyderabad
134033HIREACH-BROADBAND-AS HIREACH BROADBAND PRIVATE LTD, IN103.224.157.812001:df4:5f00:2:face:b00c:0:a7HYDHyderabad
55824NKN-CORE-NW NKN Core Network, IN180.149.62.182405:8a00:1a:4:face:b00c:0:a7MAAMadras
45194SIPL-AS Syscon Infoway Pvt. Ltd., IN183.87.151.1452401:a100:3:3:face:b00c:0:a7PNQPoona
13490BUCKEYECABLEVISION – Buckeye Cablevision, Inc., US72.240.67.18TOLToledo
17465ASIANET Cable ISP in India, IN202.164.151.2092406:8800:0:5:face:b00c:0:a7TRVTrivandrum
17754EXCELL-AS Excellmedia, IN175.101.127.81VGAVijayawada
134033HIREACH-BROADBAND-AS HIREACH BROADBAND PRIVATE LTD, IN103.57.132.812001:df4:5f01:2:face:b00c:0:a7WGCWarrangal
132933CTPLAND-AS CharotarTelelink Pvt Ltd, IN45.64.189.1452402:7780:1:fb:face:b00c:0:a7AMDAhmedabad
55947BBNL-IN Bangalore Broadband Network Pvt Ltd, IN43.247.159.812404:1f00:fac3:b00c:face:b00c:0:a7BLRBangalore
45648BELLTELE-AS-IN Bell Teleservices India Pvt Ltd., ISP having own OFC network in Bangalore, India., IN111.125.202.172400:d280:4:1:face:b00c:0:a7BLRBangalore
132559GATIK-AS-IN Gatik Business Solutions, IN103.16.68.147BLRBangalore
135724PVTABNL-AS Allnet Broadband Network Pvt Ltd, IN103.69.20.2102001:df4:5c00:fffb:face:b00c:0:a7BLRBangalore
56268SREERAM-NED1-IN Northeast Dataa Network Pvt Ltd, IN43.224.129.209BLRBangalore
9829BSNL-NIB National Internet Backbone, IN117.252.90.20BLRBangalore
58678INTECHONLINE-IN Intech Online Private Limited, IN124.108.16.2092404:bd00:1:4:face:b00c:0:a7BOMBombay
55352MCPL-IN Microscan Computers Private Limited, IN103.226.191.2092406:9e00:3:1:face:b00c:0:a7BOMBombay
18196SEVENSTAR-AS Seven Star Internet Service Provider, IN202.134.164.2092402:f200:301:0:face:b00c:0:a7BOMBombay
45117INPL-IN-AP Ishan_s Network, IN103.214.129.172405:f600:41:2:face:b00c:0:a7BOMBombay
133720SOFTCALLCOC-AS SOFT CALL CUST-O-CARE PRIVATE LIMITED, IN139.5.47.209BOMBombay
55832HOMESYSTEM-AS-AP HOME SYSTEMS PVT.LTD, IN120.88.176.145BOMBombay
55862WNET-IN Wan & Lan Internet Pvt Ltd, IN49.128.164.17BOMBombay
24554FIVE-NET-AS-IN Fivenetwork Solution India Pvt Ltd Internet, IN202.177.230.145BOMBombay
38457HNS-AS-AP Honesty Net Solution (I) Pvt Ltd, IN111.91.127.81BOMBombay
136334VNPL-AS Vortex Netsol Private Limited, IN103.88.222.812001:df5:b00:f00:face:b00c:0:a7BOMBombay
132296SEVENSTARDIGITAL-AS-AP Seven Star Digital Network Private Limited, IN103.233.140.145BOMBombay
134014NET4USERVICES-AS-IN NET 4 U SERVICES PVT LTD, IN103.59.200.2092402:fbc0:0:4:face:b00c:0:a7BOMBombay
135739INETWORK-AS-IN Inetwork Solutions Pvt Ltd, IN103.76.101.17BOMBombay
132220JPRDIGITAL-IN JPR Digital Pvt. Ltd., IN183.87.171.172403:7100:2:1:face:b00c:0:a7BOMBombay
133968LOGON-AS-IN Logon Broadband, IN103.203.228.145BOMBombay
137098DNSPL-AS Delix Net Solution Pvt. Ltd, IN111.125.198.83BOMBombay
23860ALLIANCE-GATEWAY-AS-AP Alliance Broadband Services Pvt. Ltd., IN203.171.243.145CCUCalcutta
45804MEGHBELA-IN MEGHBELA BROADBAND, IN103.56.238.17CCUCalcutta
45775WISHNET-AS-AP WISH NET PRIVATE LIMITED, IN27.131.215.145CCUCalcutta
45335IKF-IN-AS-AP IKF POWERNET, IN180.87.233.17CCUCalcutta
135760SPEDNT-AS Speednet Unique Network Pvt Ltd, IN103.75.163.2102404:9740:2:1:face:b00c:0:a7CCUCalcutta
132976KINGSBROADBAND-AS-IN Kings Broadband Pvt Ltd, IN150.242.21.2092001:df6:e400:f800:face:b00c:0:a7COKCochin
58969KCCL-AS Kerala Communicators Cable Limited, IN137.59.84.145COKCochin
132116ANINETWORK-IN Ani Network Pvt Ltd, IN45.248.174.81DELDelhi
132453TRIPLE-PLAY-IN TRIPLE PLAY BROADBAND PRIVATE LIMITED, IN150.242.84.145DELDelhi
58965ABSPL-AS-IN ANJANI BROADBAND SOLUTIONS PVT.LTD., IN103.233.117.812001:df7:2b00:0:face:b00c:0:a7DELDelhi
45184DEN-ISP-AS-IN-AP Den Digital Entertainment Pvt. Ltd. AS ISP india, IN112.196.177.172401:4300:4:9:face:b00c:0:a7DELDelhi
133275GIGANTIC-AS Gigantic Infotel Pvt Ltd, IN103.59.199.145DELDelhi
133648MAGNUSTELELINKS-AS-IN MNR Broadband Services Pvt. Ltd., IN43.231.57.81DELDelhi
45235GEONET GEOCITY NETWORK SOLUTIONS PVT LTD, IN119.42.153.145DELDelhi
10029SHYAMSPECTRA-AS SHYAM SPECTRA PVT LTD, IN125.63.114.172001:fd0:0:c:face:b00c:0:a7DELDelhi
136696SIFI-AS-IN Sifi Online Pvt Ltd, IN103.48.110.17DELDelhi
134026ULTRANET-AS Ultranet services private limited, IN103.55.88.1452001:df2:d00:4:face:b00c:0:a7DELDelhi
58640NEXTRA-IN NEXTRA TELESERVICES PVT. LTD., IN103.228.115.212DELDelhi
135772POWERNETCOMM-AS Powernet Communications Pvt.ltd., INRemoved on the request of networkRemoved on the request of networkDELDelhi
133676PNPL-AS Precious netcom pvt ltd, IN45.248.24.18DELDelhi
134341JDMBROADBAND-AS jdm broadband services pvt ltd, IN103.49.118.83DELDelhi
132934SKYMAX-AS Skymax Broadband Services Pvt. Ltd., IN103.65.28.147DELDelhi
18229CTRLS-AS-IN CtrlS Datacenters Ltd., IN182.18.191.2092400:3b00:1:c3:face:b00c:0:a7HYDHyderabad
59164APOLLOONLINE-AS Apollo Online Services Pvt ltd, IN103.245.197.209HYDHyderabad
17483CITYSERV-AS-AP CityOnline Services Ltd, IN202.62.66.172404:f100:500:1:face:b00c:0:a7HYDHyderabad
17917QTLTELECOM-AS-AP Quadrant Televentures Limited, IN103.3.34.812403:8400:0:40:face:b00c:0:a7IXCChandigarh
133661NETPLUS-AS Netplus Broadband Services Private Limited, IN103.41.21.17LUHLudhiana
132770GAZON-AS-IN Gazon Communications India Limited, IN43.241.24.2092404:4980:1:3:face:b00c:0:a7PNQPoona
136284PTPL-AS-IN Paradise Telecom Pvt Ltd, IN103.97.167.210PNQPoona
56209RKINFRATEL-IN R. K. INFRATEL LIMITED, IN202.71.2.172406:2100:3:0:face:b00c:0:a7STVSurat

Exploring to get a node of Facebook or just any other content network for your network? You can find their contact details in PeeringDB.

Disclaimer: This is my personal blog and post is done purely in my personal capacity and has nothing to do with my employeer.

10 Sep

NIXI permits content players!

I am in Chiang Mai, Thailand for APNIC 48 conference. Earlier today attended APIX meeting where many IX members from Asian community gave an update including NIXI i.e National Internet Exchange of India.

As per the update NIXI now allows content players to peer at the exchange. NIXI earlier had a strict requirement of telecom license for anyone to peer but as of now it allows anyone with IP address and AS number to be part of the exchange just like all other exchanges. This is a really good development coming this year after their announcement of the removal of x-y charge. One strange thing remains that their website is still not updated to reflect that which is probably just work in progress. As per representative from NIXI they now openly welcome all content players to peer at NIXI.

What more needs to be done?

Well, a couple more changes are needed.
Here’s what I requested to the representative from NIXI:

  1. Removal of forced multi-lateral peering policy. Forced multilateral is bad idea in modern times. Many large networks (especially the ones dealing with anycast based service) would usually not like to peer at route server.
  2. So far NIXI has discouraged bilateral BGP sessions in the policy. Technically any members can create bilateral sessions but were denied in the policy. That needs to be changed. Bilateral/multilateral peering is a technical decision and should be left to individual networks operators.
  3. NIXI needs to migrate to software-based route servers like bird with auto-config generation to include features like IRR filtering, RPKI filtering, BGP communities support and much more.

Remove forced multilateral, but what about Indian incumbents?

This is an old interesting discussion. Basically due to “forced” multilateral peering policy – everyone is on route servers and that includes incumbents like Tata Communications, Airtel, BSNL and other large networks like Jio and Voda/IDEA as well. The argument there is if multi-lateral peering is not forced, local ISPs won’t be able to peer with these networks. Part of these arguments comes from a mindset which still believes the world’s traffic flows from tier 1 operators to tier 2 and tier 3. A very large part of modern internet traffic flows from content players to eyeball networks (where “eye balls” are). Content players deliver this traffic through a mix of backbone + peering as well as by putting caching nodes inside the ISPs network (like Google’s GGC, Facebook’s FNA, Netflix OCA, Akamai caching node etc). The success of an IX depends on meeting the content players and eyeball players. To connect eyeball players (which are usually spread across the region) one needs circuits i.e dark fibre, DWDM waves, or any sort of transport network. As long as these three things are in place, IX can be a success.

Look at any large IX doing over few hundred Gigabits of traffic or even terabit of traffic and ask does local incumbent telco peers openly at that IX? Does BT openly peers at LINX in London? Do Deutsche Telekom peers openly at DECIX Frankfurt? Does AT&T, Verizon, Comcast peer openly at various Equinix and Coresite exchanges spread across the US? Answer to most of these is no and that is just fine. I would personally hope that these networks do but if they do not it’s not something which blocks the development. In the same way, having Airtel/Tata/Jio/Voda-IDEA at NIXI is great and I would hope they stay but the success of NIXI does not depend on these. As long as transport circuits are available (which they are!) from enough players with competition it would be fine. As of now across India, one can take transport circuit from Airtel, Tata, Voda/IDEA, Powergrid. Railtel, Reliance Communications and more!

Forced multilateral and routing issues…

One recent issue which E2E Networks (a cloud provider based in India) faced was to send traffic to Jio. Suddenly traffic going from E2E to Jio via Tata Comm was going from outside India. As per discussions, routing was tweaked to send traffic out to Jio via Airtel and still, there were issues of routing from outside India. The issue went on for a couple of days and was eventually fixed by speaking to both ends. Issue was there due to ongoing peering issues between Jio – Tata Comm and Jio – Airtel.

Now the funny thing here is that Netmagic (which takes care of routing for E2E) connects to NIXI and Jio also connects to NIXI. During this entire time, both Netmagic (on behalf of E2E) and Jio had enough capacity at NIXI but that could not be utilised because of forced multilateral peering policy. If routes were announced to NIXI route server, that would have probably fixed the Jio issue but would also attract traffic from Airtel/Tata which was not specifically desired due to their known port capacity issues at NIXI.

Ending this post with my quote which I often give in these discussions – “Remember somewhere up the transit path there’s always peering!” 🙂

Disclaimer:

  1. This post is done in my personal capacity and nowhere reflect the views of my employer.
  2. I am on board of the mentioned organisation E2E Networks (more on it here)

05 Apr

Tata – Airtel domestic peering IRR filtering and OpenDNS latency!

Last month I noticed quite high latency with Cisco’s OpenDNS from my home fibre connection. The provider at home is IAXN (AS134316) which is peering with content folks in Delhi besides transit from Airtel. 

ping -c 5 208.67.222.222
PING 208.67.222.222 (208.67.222.222) 56(84) bytes of data.
64 bytes from 208.67.222.222: icmp_seq=1 ttl=51 time=103 ms
64 bytes from 208.67.222.222: icmp_seq=2 ttl=51 time=103 ms
64 bytes from 208.67.222.222: icmp_seq=3 ttl=51 time=103 ms
64 bytes from 208.67.222.222: icmp_seq=4 ttl=51 time=103 ms
64 bytes from 208.67.222.222: icmp_seq=5 ttl=51 time=103 ms


--- 208.67.222.222 ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4005ms
rtt min/avg/max/mdev = 103.377/103.593/103.992/0.418 ms

This is bit on the higher side as from Haryana to Mumbai (OpenDNS locations list here). My ISP is backhauling from Faridabad which is probably 6-8ms away from my city and 2-3ms further to Delhi and from there to Mumbai around 30ms. Thus latency should be around ~40-45ms.

Here’s how forward trace looked like

traceroute 208.67.222.222
traceroute to 208.67.222.222 (208.67.222.222), 30 hops max, 60 byte packets
 1  172.16.0.1 (172.16.0.1)  0.730 ms  0.692 ms  0.809 ms
 2  axntech-dynamic-218.140.201.103.axntechnologies.in (103.201.140.218)  4.904 ms  4.314 ms  4.731 ms
 3  10.10.26.1 (10.10.26.1)  6.000 ms  6.414 ms  6.326 ms
 4  10.10.26.9 (10.10.26.9)  6.836 ms  7.135 ms  7.047 ms
 5  nsg-static-77.249.75.182-airtel.com (182.75.249.77)  9.344 ms  9.416 ms  9.330 ms
 6  182.79.243.201 (182.79.243.201)  62.274 ms 182.79.177.69 (182.79.177.69)  66.874 ms 182.79.239.193 (182.79.239.193)  61.297 ms
 7  121.240.1.201 (121.240.1.201)  85.789 ms  82.250 ms  79.591 ms
 8  172.25.81.134 (172.25.81.134)  110.049 ms 172.31.29.245 (172.31.29.245)  114.350 ms  113.673 ms
 9  172.31.133.210 (172.31.133.210)  112.598 ms 172.19.138.86 (172.19.138.86)  114.889 ms 172.31.133.210 (172.31.133.210)  113.415 ms
10  115.110.234.50.static.mumbai.vsnl.net.in (115.110.234.50)  125.770 ms  125.056 ms  123.779 ms
11  resolver1.opendns.com (208.67.222.222)  113.648 ms  115.044 ms  106.066 ms

Forward trace looks fine except that latency jumps as soon as we hit Tata AS4755 backbone. OpenDNS connects with Tata AS4755 inside India and announces their anycast prefixes to them. If the forward trace is logically correct but has high latency, it often reflects the case of bad return path. Thus I requested friends at OpenDNS to share the return path towards me. As expected, it was via Tata AS6453 Singapore.

Here’s what Tata AS4755 Mumbai router had for IAXN prefix: 

BGP routing table entry for 14.102.188.0/22 
Paths: (1 available, best #1, table Default-IP-Routing-Table) 
Not advertised to any peer 
6453 9498 134316 134316 134316 134316 134316 134316 134316 134316 134316 134316 
192.168.203.194 from 192.168.199.193 (192.168.203.194) 
Origin IGP, localpref 62, valid, internal, best 
Community: 4755:44 4755:97 4755:888 4755:2000 4755:3000 4755:47552 6453:50 6453:3000 6453:3400 6453:3402 
Originator: 192.168.203.194, Cluster list: 192.168.199.193 192.168.194.15 
Last update: Mon Mar 25 15:26:36 2019

Thus what was happening is this:

Forward path: IAXN (AS134316) > Airtel (AS9498) > Tata (AS4755) > OpenDNS (AS36692)

Return path: OpenDNS (AS36692) > Tata (AS4755) > Tata (AS6453) > Airtel (AS9498) > IAXN (AS134316)

While this may seem like a Tata – Airtel routing issue but it wasn’t. I could see some of the prefixes with a direct path as well. Here’s a trace from Tata AS4755 Mumbai PoP to an IP from a different pool of IAXN: 

traceroute to 103.87.46.1 (103.87.46.1), 15 hops max, 60 byte packets
1 * * *
2 172.31.170.210 (172.31.170.210) 0.911 ms 0.968 ms 0.643 ms
3 172.23.78.233 (172.23.78.233) 1.233 ms 0.821 ms 0.810 ms
4 172.17.125.249 (172.17.125.249) 23.540 ms 23.454 ms 23.367 ms
5 115.110.232.174.static.Delhi.vsnl.net.in (115.110.232.174) 49.175 ms 48.832 ms 49.107 ms
6 182.79.153.87 (182.79.153.87) 48.777 ms 182.79.153.83 (182.79.153.83) 49.043 ms 182.79.177.127 (182.79.177.127) 54.879 ms
7 103.87.46.1 (103.87.46.1) 60.865 ms 60.540 ms 60.644 ms

This clearly was fine. So why Tata was treating 103.87.46.0/24 different from 14.102.188.0/22? The reason for that lies in following:

  • Airtel (AS9498) very likely peers with Tata (AS4755). They do interconnect for sure as we see in traceroutes and my understanding is that it’s based on settlement-free peering for Indian traffic.
  • Airtel (AS9498) buys IP transit from Tata (AS6453) (besides a few others). Tata AS6453 is carrying the routing announcements to other networks in the transit free zone and that confirms that Airtel (at least technically) has a downstream customer relationship here.
  • Tata (AS4755) has IRR based filters on peering but not the Tata (AS6453) for it’s downstream. Hence while Tata rejected the route in India, they did accept that in Singapore PoP.
  • My IP was from prefix 14.102.188.0/22 and there was no valid route object for it at any of key IRRs like ATLDB, APNIC or RADB. But other prefix 103.87.46.0/24 did had a valid route object on APNIC.

Now after almost 10 days of it, my ISP has changed the BGP announcement and announcing 14.102.189.0/24 (which does a valid route object on APNIC). This fixes the routing problem and give me pretty decent latency with OpenDNS: 

ping -c 5 208.67.222.222
PING 208.67.222.222 (208.67.222.222): 56 data bytes
64 bytes from 208.67.222.222: icmp_seq=0 ttl=55 time=52.552 ms
64 bytes from 208.67.222.222: icmp_seq=1 ttl=55 time=53.835 ms
64 bytes from 208.67.222.222: icmp_seq=2 ttl=55 time=53.330 ms
64 bytes from 208.67.222.222: icmp_seq=3 ttl=55 time=52.700 ms
64 bytes from 208.67.222.222: icmp_seq=4 ttl=55 time=52.504 ms

--- 208.67.222.222 ping statistics ---
5 packets transmitted, 5 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 52.504/52.984/53.835/0.518 ms

So if you are a network operator and originating prefixes, please do document them in any of the IRRs. You can do that via IRR of your RIR (APNIC, ARIN etc) or a free IRR like ALTDB. If you have downstreams, make sure to create AS SET, add downstreams ASNs in your AS SET and also include that AS SET on peeringdb for the world to see!

Misc Notes

  • Posted strictly in my personal capacity and has nothing to do with my employrer.
  • Thanks for folks from Cisco/OpenDNS for quick replies with relevant data which helped in troubleshooting. 🙂