From 99f791a46ab824afd1ab7c2a03b3042280b4c398 Mon Sep 17 00:00:00 2001 From: Ilya Shakhat Date: Wed, 22 Jun 2016 16:16:15 +0300 Subject: [PATCH] Publish remaining tenant networking reports This patch adds new reports: * north-south performance report * QoS performance report Change-Id: I413e7c16ac3c221f168f3a6070881bd0fadff008 --- .../1196de14-f218-406c-94e0-996899e3c01b.svg | 4 + .../543a5067-262f-4c0a-8466-6104acab5ca1.svg | 4 + .../7a9de86c-3cf7-449a-991a-0cacb9f6f22c.svg | 4 + .../e9116c3a-9eff-4343-9108-730bff5c167e.svg | 4 + .../ed64971f-fb42-4526-a7a7-6aecbbdd60e8.svg | 4 + .../f31693a7-4b4d-4ccd-a11a-8089e0d56ede.svg | 4 + .../perf_l3_north_south/index.rst | 147 ++++++++++++++++++ .../3b6ce92f-9aca-40a4-8eeb-f7ba6fc5bea1.svg | 4 + .../4b80944c-2ec8-45a0-8d9e-f67d9c631f8a.svg | 4 + .../d3e16faa-71c6-4742-8202-71302b1492da.svg | 4 + .../qos_perf_l2/index.rst | 106 +++++++++++++ 11 files changed, 289 insertions(+) create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/1196de14-f218-406c-94e0-996899e3c01b.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/543a5067-262f-4c0a-8466-6104acab5ca1.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/7a9de86c-3cf7-449a-991a-0cacb9f6f22c.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/e9116c3a-9eff-4343-9108-730bff5c167e.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/ed64971f-fb42-4526-a7a7-6aecbbdd60e8.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/f31693a7-4b4d-4ccd-a11a-8089e0d56ede.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/index.rst create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/3b6ce92f-9aca-40a4-8eeb-f7ba6fc5bea1.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/4b80944c-2ec8-45a0-8d9e-f67d9c631f8a.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/d3e16faa-71c6-4742-8202-71302b1492da.svg create mode 100644 doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/index.rst diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/1196de14-f218-406c-94e0-996899e3c01b.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/1196de14-f218-406c-94e0-996899e3c01b.svg new file mode 100644 index 0000000..629fdec --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/1196de14-f218-406c-94e0-996899e3c01b.svg @@ -0,0 +1,4 @@ + +Pygal000.10.10.20.20.30.30.40.4036912time, s0.426176071213.65384615388.53846153846025.2249022164435.461538462036.795958279435.461538462048.3670143416435.4615384620.106681823759.9380704042328.592721744071.5091264668435.461538462083.0801825293435.461538462094.6512385919435.4615384620106.222294654435.4615384620117.793350717435.4615384620129.36440678435.4615384620140.935462842435.4615384620152.506518905435.4615384620.1067228317164.077574967328.551641870175.64863103435.4615384620187.219687093435.4615384620.1066246033198.790743155328.65004250210.361799218435.4615384620221.93285528435.4615384620233.503911343435.4615384620245.074967405435.4615384620256.646023468435.4615384620268.217079531435.4615384620279.788135593435.4615384620291.359191656435.4615384620302.930247718435.4615384620314.501303781435.4615384620.1067609787326.072359844328.5134280330337.643415906435.4615384620349.214471969435.4615384620360.785528031435.4615384620.1493806839372.356584094285.8190185790383.927640156435.4615384620395.498696219435.4615384620407.069752282435.4615384620.1067152023418.640808344328.5592846370430.211864407435.4615384620441.782920469435.4615384620453.353976532435.4615384620464.925032595435.4615384620476.496088657435.4615384620488.06714472435.4615384620499.638200782435.4615384620511.209256845435.4615384620.1279792786522.780312907307.2579365150534.35136897435.4615384620545.922425033435.4615384620557.493481095435.4615384620569.064537158435.4615384620580.63559322435.4615384620.1066532135592.206649283328.6213821220603.777705346435.4615384620615.348761408435.4615384620626.919817471435.4615384620638.490873533435.4615384620650.061929596435.4615384620661.632985658435.4615384620673.204041721435.4615384620684.775097784435.4615384620696.346153846435.461538462213.6538461538368.6780177831225.224902216434.7604143895636.795958279235.110976426048.3670143416435.461538462559.9380704042268.502736765071.5091264668435.461538462083.0801825293435.461538462494.6512385919301.8944971040106.222294654435.4615384620117.793350717435.4615384621129.36440678402.0697781220140.935462842435.4615384620152.506518905435.4615384624164.077574967301.8944971040175.64863103435.4615384620187.219687093435.4615384622198.790743155368.6780177830210.361799218435.4615384620221.93285528435.4615384620233.503911343435.4615384620245.074967405435.4615384623256.646023468335.2862574441268.217079531402.0697781220279.788135593435.4615384620291.359191656435.4615384620302.930247718435.4615384620314.501303781435.4615384622326.072359844368.6780177830337.643415906435.4615384620349.214471969435.4615384620360.785528031435.4615384623372.356584094335.2862574440383.927640156435.4615384620395.498696219435.4615384620407.069752282435.4615384623418.640808344335.2862574440430.211864407435.4615384621441.782920469402.0697781220453.353976532435.4615384620464.925032595435.4615384622476.496088657368.6780177830488.06714472435.4615384620499.638200782435.4615384620511.209256845435.4615384622522.780312907368.6780177831534.35136897402.0697781220545.922425033435.4615384620557.493481095435.4615384620569.064537158435.4615384620580.63559322435.4615384622592.206649283368.6780177830603.777705346435.4615384620615.348761408435.4615384622626.919817471368.6780177830638.490873533435.4615384621650.061929596402.0697781220661.632985658435.4615384620673.204041721435.4615384620684.775097784435.4615384620696.346153846435.461538462bandwidth, Mbit/sretransmits \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/543a5067-262f-4c0a-8466-6104acab5ca1.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/543a5067-262f-4c0a-8466-6104acab5ca1.svg new file mode 100644 index 0000000..34869a0 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/543a5067-262f-4c0a-8466-6104acab5ca1.svg @@ -0,0 +1,4 @@ + +Pygal000.20.20.40.40.60.60.80.8111.21.21.41.41.61.61.81.8time, s1.8914.07692307699.807692307690.702808386692.2820512821317.8397043250.7219861623170.487179487312.8637857180.7699664004248.692307692300.4147007460.8199568056326.897435897287.4440522610.7350563699405.102564103309.4725535960.691076393483.307692308320.883719760.6979947661561.512820513319.0886596010.8159056175639.717948718288.4951847240.6121144711717.923076923341.371397907ping_icmp, ms \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/7a9de86c-3cf7-449a-991a-0cacb9f6f22c.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/7a9de86c-3cf7-449a-991a-0cacb9f6f22c.svg new file mode 100644 index 0000000..b9540ad --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/7a9de86c-3cf7-449a-991a-0cacb9f6f22c.svg @@ -0,0 +1,4 @@ + +Pygal0010001000200020003000300040004000500050006000600070007000027.7142857155.4285714383.14285714110.8571429138.5714286166.2857143194time, s4798.81286612.5154.0484530235929.88967923.09322033987.7195869857280.13038633.6864406788.538461538467109.76600644.279661016918.52900860267139.80674754.872881355916.76735257645179.9678865.4661016949131.6966732136190.00434976.059322033972.46588282175099.7638786.6525423729136.4000151754910.00175597.2457627119147.5280887024809.999466107.838983051153.3924458744919.404984118.43220339146.9766624034960.517883129.025423729144.5657102995089.912415139.618644068136.9777265015099.782944150.211864407136.3988966645100.154877160.805084746136.3770856845078.91655171.398305085137.6225485325011.034012181.991525424141.6033318954959.955215192.584745763144.5987063964969.816208203.177966102144.0204358155029.802322213.771186441140.5027163215119.981766224.36440678135.2143927075179.853439234.957627119131.7033842845150.117874245.550847458133.4471441225399.837494256.144067797118.8030288695369.949341266.737288136120.5557368015390.024185277.330508475119.3785031715419.998169287.923728814117.6207619365410298.516949153118.2070768545470.00885309.110169492114.6880240955469.751358319.703389831114.7031240035129.861832330.296610169134.6350036145179.786682340.889830508131.7072990755209.741592351.483050847129.9506763525240.030289362.076271186128.1744796735160.02655372.669491525132.8660772615159.807205383.262711864132.8789401475170.01152393.855932203132.2805363545269.737244404.449152542126.4323976035360.212326415.042372881121.1267370565349.912643425.63559322121.7307334085310.096741436.228813559124.0656267135309.848785446.822033898124.0801673665219.936371457.415254237129.3528318155200.119019468.008474576130.5149655365209.980011478.601694915129.9366949555219.812393489.194915254129.3601021415239.896774499.788135593128.1823092555199.184418510.381355932130.5697726135180.768967520.974576271131.6496957195170.030594531.56779661132.2794178425079.860687542.161016949137.56718225187.416077552.754237288131.259894375312.519073563.347457627123.9235757195339.994431573.940677966122.3123595255259.904861584.533898305127.0089904165189.971893595.127118644131.1100155845209.980011605.720338983129.9366949555260.17189616.313559322126.9933312515469.465256626.906779661114.719901685460.252762637.5115.260142861012.5435.461538462023.093220339435.461538462033.686440678435.461538462044.2796610169435.461538462054.8728813559435.461538462065.4661016949435.461538462076.0593220339435.46153846219486.652542372924.96593194556497.2457627119300.0403074460107.838983051435.4615384620118.43220339435.4615384620129.025423729435.4615384620139.618644068435.4615384620150.211864407435.4615384620160.805084746435.4615384620171.398305085435.4615384620181.991525424435.461538462106192.584745763211.1701245920203.177966102435.4615384620213.771186441435.4615384620224.36440678435.4615384620234.957627119435.4615384620245.550847458435.4615384620256.144067797435.4615384620266.737288136435.4615384620277.330508475435.4615384620287.923728814435.4615384620298.516949153435.4615384620309.110169492435.4615384620319.703389831435.4615384620330.296610169435.4615384620340.889830508435.4615384620351.483050847435.4615384620362.076271186435.4615384620372.669491525435.4615384620383.262711864435.4615384620393.855932203435.46153846275404.449152542276.7647833650415.042372881435.4615384620425.63559322435.4615384620436.228813559435.4615384620446.822033898435.4615384620457.415254237435.4615384620468.008474576435.4615384620478.601694915435.46153846221489.194915254391.0264470350499.788135593435.461538462102510.381355932219.633951530520.974576271435.4615384620531.56779661435.46153846233542.161016949365.6349662190552.754237288435.4615384620563.347457627435.4615384620573.940677966435.4615384620584.533898305435.4615384620595.127118644435.4615384620605.720338983435.4615384620616.313559322435.4615384620626.906779661435.4615384620637.5435.461538462bandwidth, Mbit/sretransmits \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/e9116c3a-9eff-4343-9108-730bff5c167e.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/e9116c3a-9eff-4343-9108-730bff5c167e.svg new file mode 100644 index 0000000..8f42cbb --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/e9116c3a-9eff-4343-9108-730bff5c167e.svg @@ -0,0 +1,4 @@ + +Pygal00100001000020000200003000030000400004000050000500006000060000700007000080000800009000090000100000100000110000110000120000120000130000130000140000140000150000150000time, s14114013.730769230859.654565884814876025.367014341635.870397027114535037.003259452446.51396865514809048.639504563237.961655968614184060.275749674157.469668483114745071.911994784939.959276450114551083.548239895746.014563534614800095.184485006538.2425713488146060106.82073011744.2978584333144070118.45697522850.509209618143240130.09322033953.0998736799144630141.7294654548.7612916967143730153.36571056151.5704454987140870165.00195567160.4973120254141690176.63820078257.9378607835143530188.27444589352.1947018992155820199.91069100413.8341460907155870211.54693611513.6780819906155420223.18318122615.0826588916152070234.81942633625.5389535994147960246.45567144738.3674226289152950258.09191655822.7922254373149660269.72816166933.061243225130940281.3644067891.4916423084145950293.0006518944.6411994536151690304.63689700126.7250407603153230316.27314211221.9182664767151790327.90938722326.41291256118440339.545632334130.507667337121920351.181877445119.645605969146130362.81812255544.0793686932152000374.45436766625.7574433396148550386.09061277736.5258662476150520397.72685788830.376940703150130409.36310299931.5942406839151180420.9993481128.3168945815152280432.6355932224.8834843789146360444.27183833143.3614738326151830455.90808344226.2880612799147290467.54432855340.4586815705145760479.18057366445.234243034155470490.81681877414.9265947915150800502.45306388529.5029817423155610514.08930899614.4896153112157110525.7255541079.80769230769156050537.36179921813.1162512302155630548.99804432914.4271896711150770560.63428943929.5966202024151940572.2705345525.9447202597137470583.90677966171.1096708333153170595.54302477222.1055433968152090607.17926988325.4765279593151550618.81551499327.1620202406145270630.45176010446.7636712152147930642.08800521538.461061089145700653.72425032645.4215199542151460665.36049543727.4429356208150970676.99674054828.9723638019145920688.63298565844.7348379137151160700.26923076928.3793202215packets, pps \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/ed64971f-fb42-4526-a7a7-6aecbbdd60e8.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/ed64971f-fb42-4526-a7a7-6aecbbdd60e8.svg new file mode 100644 index 0000000..f6a33a5 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/ed64971f-fb42-4526-a7a7-6aecbbdd60e8.svg @@ -0,0 +1,4 @@ + +Pygal00100001000020000200003000030000400004000050000500006000060000700007000080000800009000090000100000100000110000110000120000120000130000130000140000140000time, s14927013.73076923089.8076923076914087025.367014341637.403530515214484037.003259452424.361211743314458048.639504563225.215368640214340060.275749674129.091926864613894071.911994784943.744002865213807083.548239895746.60214325113789095.184485006547.1934826412137970106.82073011746.9306651344135350118.45697522855.5379384801141300130.09322033935.9908864165142130141.7294654533.2641547841143100153.36571056130.0774925149141850165.00195567134.1840160576142060176.63820078233.4941201024144630188.27444589325.0511076985146460199.91069100419.0391572319144780211.54693611524.5583248734146710223.18318122618.2178525233145430234.81942633622.4229326311144600246.45567144725.1496642635142320258.09191655832.6399632055141020269.72816166936.91074769142180281.3644067833.0998938423140670293.0006518938.060574282140610304.63689700138.2576874121139710316.27314211241.2143843629142500327.90938722332.0486238154141820339.54563233434.2825726227141180351.18187744536.3851126766141820362.81812255534.2825726227142460374.45436766632.1800325688144530386.09061277725.3796295819145130397.72685788823.4084982814143580409.36310299928.5005874744145350420.9993481122.6857501379142580432.6355932231.7858063087142040444.27183833133.5598244791140430455.90808344238.8490268022140630467.54432855338.1919830354140340479.18057366439.1446964973141330490.81681877435.8923298514139870502.45306388540.6887493494139360514.08930899642.3642109549136640525.72555410751.3000061839137050537.36179921849.9530664619138110548.99804432946.4707344976136700560.63428943951.1028930539137560572.2705345548.2776048565136300583.90677966152.4169805876138600595.54302477244.8609772689137930607.17926988347.0620738878138170618.81551499346.2736213676137560630.45176010448.2776048565138930642.08800521543.7768550536139500653.72425032641.9042803181139990665.36049543740.2945230893139020676.99674054843.4811853585139800688.63298565840.9187146678138560700.26923076944.9923860222packets, pps \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/f31693a7-4b4d-4ccd-a11a-8089e0d56ede.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/f31693a7-4b4d-4ccd-a11a-8089e0d56ede.svg new file mode 100644 index 0000000..951b192 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/f31693a7-4b4d-4ccd-a11a-8089e0d56ede.svg @@ -0,0 +1,4 @@ + +Pygal000.20.20.40.40.60.60.80.8111.21.21.41.41.61.6time, s1.6914.07692307699.807692307690.735819662102.057692308286.6806852310.6780266112190.038461538303.4504029960.8150383287278.019230769263.6939305610.8509950021366.0253.2604397660.804103717453.980769231266.8668094870.9178498322541.961538462233.8612799280.8291458152629.942307692259.6003836210.9084375297717.923076923236.592432778ping_icmp, ms \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/index.rst b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/index.rst new file mode 100644 index 0000000..65e1903 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/perf_l3_north_south/index.rst @@ -0,0 +1,147 @@ +.. _openstack_l3_north_south_performance: + +OpenStack L3 North-South Performance +************************************ + +In this scenario Shaker launches 1 pair of instances on different compute +nodes. Instances are in different networks connected to different routers, +master accesses slave by floating ip. The traffic goes from one network via +external network to the other network. + +**Scenario**: + +.. code-block:: yaml + + deployment: + accommodation: + - pair + - single_room + - compute_nodes: 2 + template: l3_north_south.hot + description: In this scenario Shaker launches 1 pair of instances on different compute + nodes. Instances are in different networks connected to different routers, master + accesses slave by floating ip. The traffic goes from one network via external network + to the other network. + execution: + tests: + - class: flent + method: ping + sla: + - '[type == ''agent''] >> (stats.ping_icmp.avg < 2.0)' + time: 10 + title: Ping + - class: iperf3 + sla: + - '[type == ''agent''] >> (stats.bandwidth.avg > 5000)' + - '[type == ''agent''] >> (stats.retransmits.max < 10)' + title: TCP + - bandwidth: 0 + class: iperf3 + datagram_size: 32 + sla: + - '[type == ''agent''] >> (stats.packets.avg > 100000)' + title: UDP + udp: true + file_name: /opt/stack/.venv/local/lib/python2.7/site-packages/shaker/scenarios/openstack/perf_l3_north_south.yaml + title: OpenStack L3 North-South Performance + +Ping +==== + +**Test Specification**: + +.. code-block:: yaml + + class: flent + method: ping + sla: + - '[type == ''agent''] >> (stats.ping_icmp.avg < 2.0)' + time: 10 + title: Ping + +.. image:: f31693a7-4b4d-4ccd-a11a-8089e0d56ede.* + +**Stats**: + +============= ======== ======== ======== +Metric Min Avg Max +============= ======== ======== ======== +ping_icmp, ms 0.68 0.91 1.69 +============= ======== ======== ======== + +**SLA**: + +========================= =========== ================= ======== +Expression Concurrency Node Result +========================= =========== ================= ======== +stats.ping_icmp.avg < 2.0 1 node-9.domain.tld OK +========================= =========== ================= ======== + +TCP +=== + +**Test Specification**: + +.. code-block:: yaml + + class: iperf3 + interval: 1 + sla: + - '[type == ''agent''] >> (stats.bandwidth.avg > 5000)' + - '[type == ''agent''] >> (stats.retransmits.max < 10)' + title: TCP + +.. image:: 7a9de86c-3cf7-449a-991a-0cacb9f6f22c.* + +**Stats**: + +================= ======== ======== ======== +Metric Min Avg Max +================= ======== ======== ======== +bandwidth, Mbit/s 4798.81 5321.76 7280.13 +retransmits 9 194 +================= ======== ======== ======== + +**SLA**: + +========================== =========== ================= ======== +Expression Concurrency Node Result +========================== =========== ================= ======== +stats.bandwidth.avg > 5000 1 node-9.domain.tld OK +stats.retransmits.max < 10 1 node-9.domain.tld FAIL +========================== =========== ================= ======== + +UDP +=== + +**Test Specification**: + +.. code-block:: yaml + + bandwidth: 0 + class: iperf3 + datagram_size: 32 + interval: 1 + sla: + - '[type == ''agent''] >> (stats.packets.avg > 100000)' + title: UDP + udp: true + +.. image:: ed64971f-fb42-4526-a7a7-6aecbbdd60e8.* + +**Stats**: + +============ ======== ======== ======== +Metric Min Avg Max +============ ======== ======== ======== +packets, pps 135350 141101 149270 +============ ======== ======== ======== + +**SLA**: + +========================== =========== ================= ======== +Expression Concurrency Node Result +========================== =========== ================= ======== +stats.packets.avg > 100000 1 node-9.domain.tld OK +========================== =========== ================= ======== + diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/3b6ce92f-9aca-40a4-8eeb-f7ba6fc5bea1.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/3b6ce92f-9aca-40a4-8eeb-f7ba6fc5bea1.svg new file mode 100644 index 0000000..1490ded --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/3b6ce92f-9aca-40a4-8eeb-f7ba6fc5bea1.svg @@ -0,0 +1,4 @@ + +Pygal00101020203030404050506060707080809090047.1111111194.22222222141.3333333188.4444444235.5555556282.6666667329.7777778376.8888889424time, s91.3872718812.73076923088.538461538468.46919059823.5195567145395.8970254338.48951339734.3083441982395.8020858219.91945266745.0971316819389.1220081659.7065925655.8859191656390.1164014778.1262874666.6747066493397.4989253419.79213714677.463494133389.7167729829.93947982888.2522816167389.0284496549.81416702399.0410691004389.613858628.340196609109.829856584396.4996313458.382167816120.618644068396.30355943810.06994247131.407431551388.4189827858.446292877142.196219035396.00399399711.41529083152.985006519382.1340784578.275432587163.773794003396.8021817489.813690186174.562581486389.6160862049.854888916185.35136897389.4236229828.404884338196.140156454396.1974373568.552799225206.928943937395.50644092711.60593033217.717731421381.2434905398.297624588228.506518905396.6985100079.942054749239.295306389389.0164207038.296957016250.084093872396.7016286249.963512421260.872881356388.9161794418.36063385271.66166884396.4041571129.791946411282.450456323389.7176640159.939956665293.239243807389.026222078.254718781304.028031291396.8989479789.749507904314.816818774389.91591895411.54193878325.605606258381.5424322568.404655457336.394393742396.1985065968.552513123347.183181226395.50777747810.0279808357.971968709388.6150101418.148021698368.760756193397.3973920829.854221344379.549543677389.4267415999.962749481390.33833116388.9197435759.813976288401.127118644389.6147496548.360862732411.915906128396.4030878728.531780243422.704693611395.6046328129.835243225433.493481095389.51539942610.06851196444.282268579388.4256655368.254966736455.071056063396.8977896358.446922302465.859843546396.00105358710.00509262476.64863103388.72193415311.75575256487.437418514380.5435837778.318805695498.226205997396.5995607458.21182251509.014993481397.09934139810.11314392519.803780965388.2171637128.275432587530.592568449396.80218174810.02588272541.381355932388.6248115089.962368011552.170143416388.9215256428.255176544562.9589309396.89680949810.17656326573.747718383387.9208950958.382539749584.536505867396.30182192311.56291962595.325293351381.4444185798.296709061606.114080834396.7027869689.942436218616.902868318389.0146386368.843708038627.691655802394.14743673410.07890701638.480443286388.3771042148.126115799649.269230769397.49972727242412.730769230815.019215015613523.5195567145301.5942892517534.3083441982361.0908444567345.0971316819363.0740629639455.8859191656342.2502686418066.6747066493356.1327981898277.463494133354.1495796829388.2522816167343.2418778948999.0410691004347.20831490880109.829856584356.13279818981120.618644068355.141188935100131.407431551336.30061312182142.196219035354.14957968296152.985006519340.26705013481163.773794003355.14118893590174.562581486346.21670565566185.35136897370.01532773664196.140156454371.99854624383206.928943937353.157970428113217.717731421323.40969282682228.506518905354.14957968269239.295306389367.04049997689250.084093872347.20831490897260.872881356339.27544088177271.66166884359.10762594993282.450456323343.24187789489293.239243807347.20831490858304.028031291377.948201764112314.816818774324.4013020886325.605606258350.18314266878336.394393742358.11601669690347.183181226346.21670565587357.971968709349.19153341586368.760756193350.18314266872379.549543677364.06567221696390.33833116340.267050134105401.127118644331.34256685361411.915906128374.97337400482422.704693611354.14957968280433.493481095356.13279818965444.282268579371.0069369970455.071056063366.04889072364465.859843546371.99854624362476.64863103373.9817647588487.437418514348.19992416171498.226205997365.05728146972509.014993481364.065672216103519.803780965333.3257853668530.592568449368.0321092392541.381355932344.23348714885552.170143416351.17475192282562.9589309354.149579682100573.747718383336.30061312189584.536505867347.20831490895595.325293351341.25865938870606.114080834366.048890723104616.902868318332.33417610763627.691655802372.990155497108638.480443286328.36773909385649.269230769351.174751922bandwidth, Mbit/sretransmits \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/4b80944c-2ec8-45a0-8d9e-f67d9c631f8a.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/4b80944c-2ec8-45a0-8d9e-f67d9c631f8a.svg new file mode 100644 index 0000000..2440d32 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/4b80944c-2ec8-45a0-8d9e-f67d9c631f8a.svg @@ -0,0 +1,4 @@ + +Pygal000.10.10.20.20.30.30.40.40.50.50.60.60.70.70.80.80.90.9111.11.11.21.2time, s1.2614.07692307699.807692307690.56999556992.2820512821278.3533728790.4910749724170.487179487309.0688065430.5566379894248.692307692283.5520645480.3832243841326.897435897351.0436234230.462956228405.102564103320.0124570480.4466384125483.307692308326.3632552140.3136345644561.512820513378.1275733620.5337885584639.717948718292.4449292110.4542969573717.923076923323.382594453ping_icmp, ms \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/d3e16faa-71c6-4742-8202-71302b1492da.svg b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/d3e16faa-71c6-4742-8202-71302b1492da.svg new file mode 100644 index 0000000..b54f6fc --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/d3e16faa-71c6-4742-8202-71302b1492da.svg @@ -0,0 +1,4 @@ + +Pygal00100000100000200000200000300000300000400000400000time, s23818013.7307692308226.76531681738956025.367014341652.983396089839549037.003259452446.175846942639417048.639504563247.69118671939839060.275749674142.846691373140050071.911994784940.424443700140041083.548239895740.527762321338936095.184485006553.2129930257380500106.82073011763.3841372828383780118.45697522859.6187475352394600130.09322033947.197553307392740141.7294654549.3328048102396690153.36571056144.7982653276388140165.00195567154.6135343342378070176.63820078266.1737400531385360188.27444589357.8049317422383750199.91069100459.6531870756385560211.54693611557.5753348064389960223.18318122652.5242022182391190234.81942633651.1121810628408280246.45567144731.4931228965403450258.09191655837.0378888967360260269.72816166986.6193471884387100281.3644067855.8074384005419550293.0006518918.5553355627412170304.63689700127.0274624947394540316.27314211247.2664323878398150327.90938722343.1222076961416410339.54563233422.1600074551421790351.18187744515.9838498814392000362.81812255550.1823134727380460374.45436766663.4300566699377690386.09061277766.6099742311378280397.72685788865.9326632704379180409.36310299964.8994770592380270420.9993481163.648173759383110432.6355932260.3878972702383750444.27183833159.6531870756387200455.90808344255.6926399326388880467.54432855353.7640256716387840479.18057366454.9579297379389010490.81681877453.6147876634390500502.45306388551.9042904914387860514.08930899654.9349700444386590525.72555410756.3929105868385950537.36179921857.1276207815384330548.99804432958.9873559617380060560.63428943963.8892505416378800572.2705345565.3357112373387600583.90677966155.2334460609377660595.54302477266.6444137715386460607.17926988356.5421485951421770618.81551499316.006809575388030630.45176010454.7398126489378950642.08800521565.1635135354375440653.72425032669.1929397592377030665.36049543767.3676441193406060676.99674054834.0416488842425510688.63298565811.7133468751427170700.2692307699.80769230769packets, pps \ No newline at end of file diff --git a/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/index.rst b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/index.rst new file mode 100644 index 0000000..9d45506 --- /dev/null +++ b/doc/source/test_results/tenant_networking/neutron_vxlan_dvr_200/qos_perf_l2/index.rst @@ -0,0 +1,106 @@ +.. _openstack_l2_qos_performance: + +OpenStack L2 QoS Performance +**************************** + +In this scenario Shaker launches 1 pair of instances in the same tenant +network. Each instance is hosted on a separate compute node. The traffic goes +within the tenant network (L2 domain). Neutron QoS feature is used to limit +traffic throughput to 10 Mbit/s. + +**Scenario**: + +.. code-block:: yaml + + deployment: + accommodation: + - pair + - single_room + - compute_nodes: 2 + template: l2_qos.hot + description: In this scenario Shaker launches 1 pair of instances in the same tenant + network. Each instance is hosted on a separate compute node. The traffic goes within + the tenant network (L2 domain). Neutron QoS feature is used to limit traffic throughput + to 10 Mbit/s. + execution: + tests: + - class: flent + method: ping + time: 10 + title: Ping + - class: iperf3 + title: TCP + - bandwidth: 0 + class: iperf3 + datagram_size: 32 + title: UDP + udp: true + title: OpenStack L2 QoS Performance + +Ping +==== + +**Test Specification**: + +.. code-block:: yaml + + class: flent + method: ping + time: 10 + title: Ping + +.. image:: 4b80944c-2ec8-45a0-8d9e-f67d9c631f8a.* + +**Stats**: + +============= ======== ======== ======== +Metric Min Avg Max +============= ======== ======== ======== +ping_icmp, ms 0.31 0.55 1.26 +============= ======== ======== ======== + +TCP +=== + +**Test Specification**: + +.. code-block:: yaml + + class: iperf3 + interval: 1 + title: TCP + +.. image:: 3b6ce92f-9aca-40a4-8eeb-f7ba6fc5bea1.* + +**Stats**: + +================= ======== ======== ======== +Metric Min Avg Max +================= ======== ======== ======== +bandwidth, Mbit/s 8.13 10.69 91.39 +retransmits 58 90 424 +================= ======== ======== ======== + +UDP +=== + +**Test Specification**: + +.. code-block:: yaml + + bandwidth: 0 + class: iperf3 + datagram_size: 32 + interval: 1 + title: UDP + udp: true + +.. image:: d3e16faa-71c6-4742-8202-71302b1492da.* + +**Stats**: + +============ ======== ======== ======== +Metric Min Avg Max +============ ======== ======== ======== +packets, pps 238180 388859 427170 +============ ======== ======== ========