From ippm-admin@advanced.org Sat Feb 1 04:29:52 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id EAA02831 for ; Sat, 1 Feb 2003 04:29:51 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h119V4BN001854; Sat, 1 Feb 2003 04:31:04 -0500 Received: from web13310.mail.yahoo.com (web13310.mail.yahoo.com [216.136.173.222]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with SMTP id h119ULBN001831 for ; Sat, 1 Feb 2003 04:30:22 -0500 Message-ID: <20030201093021.35725.qmail@web13310.mail.yahoo.com> Received: from [68.102.103.236] by web13310.mail.yahoo.com via HTTP; Sat, 01 Feb 2003 01:30:21 PST From: Ameet Patil To: ippm@advanced.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="0-432120486-1044091821=:34939" X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] Need help with Video Over MPLS Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Sat, 1 Feb 2003 01:30:21 -0800 (PST) --0-432120486-1044091821=:34939 Content-Type: text/plain; charset=us-ascii Hi there, I am a masters student at Wichita State University,USA. I was looking for a project topic in Video over Mpls, or just any topic in MPLS. I do have access to simulation softwares like Op-Net. I also have access to a routers lab. Please let me know at the earliest.... Thanks, Ameet --------------------------------- Do you Yahoo!? Yahoo! Mail Plus - Powerful. Affordable. Sign up now --0-432120486-1044091821=:34939 Content-Type: text/html; charset=us-ascii

Hi there, I am a masters student at Wichita State University,USA. I was looking for a project topic in Video over Mpls, or just any topic in MPLS. I do have access to simulation softwares like Op-Net. I also have access to a routers lab. Please let me know at the earliest....

Thanks, Ameet



Do you Yahoo!?
Yahoo! Mail Plus - Powerful. Affordable. Sign up now --0-432120486-1044091821=:34939-- _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From tq_live_ideas-admin@advanced.org Sat Feb 1 06:49:52 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id GAA04655 for ; Sat, 1 Feb 2003 06:49:51 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h11BrQBN006838 for ; Sat, 1 Feb 2003 06:53:26 -0500 Date: Sat, 01 Feb 2003 06:53:26 -0500 Message-ID: <20030201115326.5751.38664.Mailman@mailhost.advanced.org> Subject: advanced.org mailing list memberships reminder From: mailman-owner@advanced.org To: ippm-archive@ietf.org X-No-Archive: yes List-Id: Multiple lists at advanced.org X-Ack: no Sender: tq_live_ideas-admin@advanced.org Errors-To: tq_live_ideas-admin@advanced.org X-BeenThere: tq_live_ideas@thinkquest.org X-Mailman-Version: 2.0.12 Precedence: bulk X-Virus-Scanned: by AMaViS-ng (Milter interface) This is a reminder, sent out once a month, about your advanced.org mailing list memberships. It includes your subscription info and how to use it to change it or unsubscribe from a list. You can visit the URLs to change your membership status or configuration, including unsubscribing, setting digest-style delivery or disabling delivery altogether (e.g., for a vacation), and so on. In addition to the URL interfaces, you can also use email to make such changes. For more info, send a message to the '-request' address of the list (for example, ippm-request@advanced.org) containing just the word 'help' in the message body, and an email message will be sent to you with instructions. If you have questions, problems, comments, etc, send them to mailman-owner@advanced.org. Thanks! Passwords for ippm-archive@lists.ietf.org: List Password // URL ---- -------- ippm@advanced.org jTPE http://mailhost.advanced.org/mailman/options/ippm/ippm-archive%40lists.ietf.org From ippm-admin@advanced.org Mon Feb 3 06:44:51 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id GAA03536 for ; Mon, 3 Feb 2003 06:44:51 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h13Bk4CN025466; Mon, 3 Feb 2003 06:46:04 -0500 Received: from hotmail.com (f57.sea2.hotmail.com [207.68.165.57]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h13BjACN025326 for ; Mon, 3 Feb 2003 06:45:10 -0500 Received: from mail pickup service by hotmail.com with Microsoft SMTPSVC; Mon, 3 Feb 2003 03:45:09 -0800 Received: from 193.116.20.220 by sea2fd.sea2.hotmail.msn.com with HTTP; Mon, 03 Feb 2003 11:45:09 GMT X-Originating-IP: [193.116.20.220] From: "gab jones" To: ippm@advanced.org Mime-Version: 1.0 Content-Type: text/plain; format=flowed Message-ID: X-OriginalArrivalTime: 03 Feb 2003 11:45:09.0997 (UTC) FILETIME=[B48631D0:01C2CB79] X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] netflow analyzer Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Mon, 03 Feb 2003 11:45:09 +0000 Hi, This are to people who have cisco netflow enabled on their router. Il like to know what netflow analyzers people are currently using. I am currently looking into NetQos report analyzer. Is there anyone currently using this? If they are what do they think of the product? Anyone please just list what product or open source tool they are currently using to analyze netflow data and why? Suggestions on what netflow analyzer are good out there is it better to use open source e.g flow-tools, cflowd I know with the open source they have powerful command line utilities to examine flows thanks regards, gab _________________________________________________________________ Surf together with new Shared Browsing http://join.msn.com/?page=features/browse&pgmarket=en-gb&XAPID=74&DI=1059 _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Mon Feb 3 12:03:44 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA13295 for ; Mon, 3 Feb 2003 12:03:44 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h13H44CN002290; Mon, 3 Feb 2003 12:04:04 -0500 Received: from web10203.mail.yahoo.com (web10203.mail.yahoo.com [216.136.130.67]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with SMTP id h118qFBN000999 for ; Sat, 1 Feb 2003 03:52:16 -0500 Message-ID: <20030201085215.41152.qmail@web10203.mail.yahoo.com> Received: from [203.197.138.177] by web10203.mail.yahoo.com via HTTP; Sat, 01 Feb 2003 00:52:15 PST From: balajambunathan r To: ippm@advanced.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] a doubt!! Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Sat, 1 Feb 2003 00:52:15 -0800 (PST) Respected sir, I am doing a simulation of the existing tcp/ip network and a full optical network for file transfer. I need a performance metric for comparing these two networks. I will be thankful to you if you could kindly send me a reply. Yours sincerely, R.Balajambunathan __________________________________________________ Do you Yahoo!? Yahoo! Mail Plus - Powerful. Affordable. Sign up now. http://mailplus.yahoo.com _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Mon Feb 3 12:03:57 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA13310 for ; Mon, 3 Feb 2003 12:03:57 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h13H4CCN002326; Mon, 3 Feb 2003 12:04:13 -0500 Received: from isis.lip6.fr (isis.lip6.fr [132.227.60.2]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h13EnQCO030369 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=FAIL) for ; Mon, 3 Feb 2003 09:49:27 -0500 Received: from tibre.lip6.fr (tibre.lip6.fr [132.227.74.2]) by isis.lip6.fr (8.12.4/jtpda-5.4+victor) with ESMTP id h13EnPlE032205 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=NO) ; Mon, 3 Feb 2003 15:49:25 +0100 X-pt: isis.lip6.fr Received: from LIP60MU1PINK59 (perse [132.227.61.88]) by tibre.lip6.fr (8.11.6/8.11.3) with SMTP id h13EnP314501; Mon, 3 Feb 2003 15:49:25 +0100 (MET) From: =?iso-8859-1?Q?Kav=E9_Salamatian?= To: "gab jones" , Subject: RE: [ippm] netflow analyzer Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2911.0) Importance: Normal X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2600.0000 In-Reply-To: X-Scanned-By: isis.lip6.fr X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Mon, 3 Feb 2003 15:48:45 +0100 Content-Transfer-Encoding: 8bit Dear Gab, you might have a look to the following paper NetFlow: Information loss or win?, by Anja Feldman & al, that might be downloaded from IMW 2002 web pages at http://www.icir.org/vern/imw-2002/program.html. It analyse what netflow can do. Bests Kavé Salamatian -----Message d'origine----- De : ippm-admin@advanced.org [mailto:ippm-admin@advanced.org]De la part de gab jones Envoyé : lundi 3 février 2003 12:45 À : ippm@advanced.org Objet : [ippm] netflow analyzer Hi, This are to people who have cisco netflow enabled on their router. Il like to know what netflow analyzers people are currently using. I am currently looking into NetQos report analyzer. Is there anyone currently using this? If they are what do they think of the product? Anyone please just list what product or open source tool they are currently using to analyze netflow data and why? Suggestions on what netflow analyzer are good out there is it better to use open source e.g flow-tools, cflowd I know with the open source they have powerful command line utilities to examine flows thanks regards, gab _________________________________________________________________ Surf together with new Shared Browsing http://join.msn.com/?page=features/browse&pgmarket=en-gb&XAPID=74&DI=1059 _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Tue Feb 4 08:50:59 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id IAA22483 for ; Tue, 4 Feb 2003 08:50:59 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h14Dr3CN003696; Tue, 4 Feb 2003 08:53:04 -0500 Received: from dogwood.cisco.com (dogwood.cisco.com [161.44.11.19]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h14DqCCN003676 for ; Tue, 4 Feb 2003 08:52:13 -0500 Received: from RHOLLEYW2K1 (dhcp-64-102-43-113.cisco.com [64.102.43.113]) by dogwood.cisco.com (8.8.6 (PHNE_14041)/CISCO.SERVER.1.2) with SMTP id IAA01245 for ; Tue, 4 Feb 2003 08:52:12 -0500 (EST) From: "Robert Holley" To: Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2910.0) Importance: Normal X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2600.0000 In-Reply-To: <87snb8awui.fsf@cain.internet2.edu> X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] IPPM MIB Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Tue, 4 Feb 2003 08:52:12 -0500 Content-Transfer-Encoding: 7bit All, Does anyone know of any implementations of the IPPM MIB? I would be interested in finding any test agents etc. thanks in advance Bob _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Tue Feb 4 14:36:04 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id OAA02502 for ; Tue, 4 Feb 2003 14:36:04 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h14Jc3CN014700; Tue, 4 Feb 2003 14:38:03 -0500 Received: from u-mail.rd.francetelecom.com (u-mail.rd.francetelecom.com [208.25.178.63]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h14JbDCN014681 for ; Tue, 4 Feb 2003 14:37:13 -0500 Received: by U-MAIL with Internet Mail Service (5.5.2653.19) id ; Tue, 4 Feb 2003 11:37:12 -0800 Message-ID: <037E7050631FD611AAFD0002A509146A834A09@U-MAIL2> From: JEWITT Jessie / FTR&D / US To: "'Robert Holley '" Cc: "'ippm@advanced.org'" Subject: RE: [ippm] IPPM MIB MIME-Version: 1.0 X-Mailer: Internet Mail Service (5.5.2653.19) Content-Type: multipart/alternative; boundary="----_=_NextPart_001_01C2CC85.72A2BE20" X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Tue, 4 Feb 2003 11:41:44 -0800 This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. ------_=_NextPart_001_01C2CC85.72A2BE20 Content-Type: text/plain; charset="iso-8859-1" Robert- As co-author of the mib with Emile Stephan (France Telecom R&D), we are currently completing an implementation of the mib in our labs in South San Francisco. Jessie Jewitt -----Original Message----- From: Robert Holley To: ippm@advanced.org Sent: 2/4/03 5:59 AM Subject: [ippm] IPPM MIB All, Does anyone know of any implementations of the IPPM MIB? I would be interested in finding any test agents etc. thanks in advance Bob _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm ------_=_NextPart_001_01C2CC85.72A2BE20 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable RE: [ippm] IPPM MIB

 Robert-
   As co-author of the mib with Emile = Stephan (France Telecom R&D), we are currently completing an = implementation of the mib in our labs in South San Francisco. =

Jessie Jewitt

-----Original Message-----
From: Robert Holley
To: ippm@advanced.org
Sent: 2/4/03 5:59 AM
Subject: [ippm] IPPM MIB

All,

Does anyone know of any implementations of the IPPM = MIB?

I would be interested in finding any test agents = etc.

thanks in advance
Bob
_______________________________________________
ippm mailing list
ippm@advanced.org
http://mailhost.advanced.org/mailman/listinfo/ippm=

------_=_NextPart_001_01C2CC85.72A2BE20-- _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Thu Feb 6 13:32:21 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id NAA29488 for ; Thu, 6 Feb 2003 13:32:21 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h16IW4CN027998; Thu, 6 Feb 2003 13:32:04 -0500 Received: from Modus.surfnetusa.com (modus.surfnetusa.com [208.201.152.19]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h16IVoCO027979 for ; Thu, 6 Feb 2003 13:31:51 -0500 Received: from mainserver.surfnetusa.com (unverified [208.201.152.2]) by Modus.surfnetusa.com (Vircom SMTPRS 2.0.241) with ESMTP id for ; Thu, 6 Feb 2003 10:29:42 -0800 Received: from lsanca1-ar16-4-46-057-169.lsanca1.dsl-verizon.net (lsanca1-ar16-4-46-057-169.lsanca1.dsl-verizon.net [4.46.57.169]) by mainserver.bookholt.com (NTMail 5.06.0016/AX0201.00.06a07d84) with ESMTP id wmieqcaa for ippm@advanced.org; Thu, 6 Feb 2003 10:29:37 -0800 Message-Id: <5.1.0.14.2.20030206102633.024b96d8@mail.merike.com> X-Sender: kaeo.merike@mail.merike.com X-Mailer: QUALCOMM Windows Eudora Version 5.1 To: "'ippm@advanced.org'" From: Merike Kaeo Cc: matt@internet2.edu Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] upcoming meeting Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Thu, 06 Feb 2003 10:29:28 -0800 Hello. In trying to ascertain how much time we would need for the upcoming meeting, please let Matt and I know if you would like to present any material and what the approximate time that you would need is. Thanks. - Merike _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Sun Feb 9 10:23:25 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id KAA00282 for ; Sun, 9 Feb 2003 10:23:25 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h19FP4CN014743; Sun, 9 Feb 2003 10:25:04 -0500 Received: from www.apara.com ([64.106.140.220]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h19FOvCN014724 for ; Sun, 9 Feb 2003 10:24:58 -0500 Received: from www.apara.com (localhost.localdomain [127.0.0.1]) by www.apara.com (8.11.6/8.11.6) with ESMTP id h19Fj2Q22217 for ; Sun, 9 Feb 2003 21:15:02 +0530 Received: from alok (PPP-219-65-149-64.bng.vsnl.net.in [219.65.149.64]) (authenticated) by www.apara.com (8.11.6/8.11.6) with ESMTP id h19Fixt22202 for ; Sun, 9 Feb 2003 21:15:00 +0530 Message-ID: <031a01c2d04f$add4e680$81c802c0@alok> From: "alok" To: X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 5.00.2615.200 X-MIMEOLE: Produced By Microsoft MimeOLE V5.00.2615.200 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] Congestion avoidance and Fair queueing algorithms Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Sun, 9 Feb 2003 20:56:48 +0530 Hello, I would like to know if there are people working on testing the following: 1. capping the Max TCP window size to 8192 bytes (or some such value) 2. using such TCP machines with such capabilities and "FQ" in the core, where the queue size on the switching/routing nodes is based on window size=8192 bytes, what is the pattern of congestion/packet loss, number of retransmissions seen...... 3. assuming TCP RENO is the default mechanism and SREJ/SACK methods are not used, are there any published results with similar topologies? thanks and rgds Alok Dube _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Fri Feb 14 12:00:41 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA27220 for ; Fri, 14 Feb 2003 12:00:41 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1EH05CN012025; Fri, 14 Feb 2003 12:00:05 -0500 Received: from mesa.acns.ColoState.EDU (mesa.acns.colostate.edu [129.82.100.130]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1EGxGCN011974 for ; Fri, 14 Feb 2003 11:59:17 -0500 Received: from lamar.colostate.edu (lamar.acns.colostate.edu [129.82.100.75]) by mesa.acns.ColoState.EDU (AIX4.3/8.9.3/8.9.3) with ESMTP id JAA77056 for ; Fri, 14 Feb 2003 09:59:16 -0700 Received: from engr.colostate.edu (res096090.halls.colostate.edu [129.82.96.90] (may be forged)) by lamar.colostate.edu (AIX5.1/8.11.0/8.8.8) with ESMTP id h1EGxGI312790; Fri, 14 Feb 2003 09:59:16 -0700 Message-ID: <3E4D20C4.8070605@engr.colostate.edu> From: Nischal M Piratla User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.0.1) Gecko/20020823 Netscape/7.0 X-Accept-Language: en-us, en MIME-Version: 1.0 To: ippm@advanced.org CC: Anura Jayasumana , Abhijit A Bare Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] New metric for packet reordering. Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Fri, 14 Feb 2003 10:00:52 -0700 Content-Transfer-Encoding: 7bit Dear ippm Members, We have come up with a new metric to measure packet reordering. We have posted a ID and here is the link: http://www.ietf.org/internet-drafts/draft-jayasumana-reorder-density-00.txt This draft may interest you all. Please feel free to send any comments/suggestions. Thanks, Nischal Piratla _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Fri Feb 14 15:50:39 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA04579 for ; Fri, 14 Feb 2003 15:50:38 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1EKn4CN019175; Fri, 14 Feb 2003 15:49:04 -0500 Received: from basie.internet2.edu (basie.internet2.edu [207.75.164.22]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1EKn0CN019159 for ; Fri, 14 Feb 2003 15:49:00 -0500 Received: from localhost (localhost.localdomain [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 4BA3D7B485; Fri, 14 Feb 2003 15:49:00 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 5FFEB7B46C; Fri, 14 Feb 2003 15:48:59 -0500 (EST) To: Jeff Brainard Cc: ippm@advanced.org Subject: Re: [ippm] SMTP traffic metrics References: <3E02050B.9010606@mirapoint.com> From: stanislav shalunov In-Reply-To: <3E02050B.9010606@mirapoint.com> Message-ID: <87bs1esi4l.fsf@cain.internet2.edu> Lines: 26 X-Mailer: Gnus v5.7/Emacs 20.4 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS 0.3.12pre8 Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: 14 Feb 2003 15:48:58 -0500 Jeff Brainard writes: > I'm looking for metrics on the % of Internet traffic that is email > (Port 25 SMTP). This can either be presented as 'raw packets' or > 'number of connections.' Thanks for any info you might have to pass > along... Jeff, Sorry about this incredibly late reply. I can speak for Abilene, the Internet2 backbone (now moving from 2.5Gb/s to 10Gb/s). Most university-to-university traffic in the U.S. is likely to traverse it. On Abilene, the percentage of `mail' traffic (which includes ports for protocols like SMTP, POP3, IMAP, encrypted versions of these, etc., all combined) comprises about 0.4% of octets and 0.6% of packets. See http://netflow.internet2.edu/weekly/ for more information. -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ Democracy is a form of government that substitutes election by the incompetent many for appointment by the corrupt few. -- G. B. Shaw _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Mon Feb 17 05:56:46 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id FAA19793 for ; Mon, 17 Feb 2003 05:56:46 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1HAw4CN019894; Mon, 17 Feb 2003 05:58:04 -0500 Received: from birch.ripe.net (birch.ripe.net [193.0.1.96]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1HAv5CN019878 for ; Mon, 17 Feb 2003 05:57:06 -0500 Received: from x49.ripe.net (x49.ripe.net [193.0.1.49]) by birch.ripe.net (8.12.5/8.11.6) with ESMTP id h1HAv5Aq014348; Mon, 17 Feb 2003 11:57:05 +0100 Received: from localhost (henk@localhost) by x49.ripe.net (8.12.4/8.12.6) with ESMTP id h1HAv3Qg004791; Mon, 17 Feb 2003 11:57:04 +0100 X-Authentication-Warning: x49.ripe.net: henk owned process doing -bs From: "Henk Uijterwaal (RIPE-NCC)" To: Nischal M Piratla cc: ippm@advanced.org, Anura Jayasumana , Abhijit A Bare Subject: Re: [ippm] New metric for packet reordering. In-Reply-To: <3E4D20C4.8070605@engr.colostate.edu> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Mon, 17 Feb 2003 11:57:03 +0100 (CET) Nischal, > We have come up with a new metric to measure packet reordering. We have > posted a ID and here is the link: > > http://www.ietf.org/internet-drafts/draft-jayasumana-reorder-density-00.txt > > This draft may interest you all. Please feel free to send any > comments/suggestions. 1. If I understand the algorithm correctly, then it needs an array in_buffer[N] with N the number of packets in a stream. This is not very practical, when I make a VoIP phonecall, then I never know how long it is going to last in advance and thus how I should dimension this array. 2. Can you include the same examples as in the other reordering metrics so one can compare the algorithms? Henk ------------------------------------------------------------------------------ Henk Uijterwaal Email: henk.uijterwaal@ripe.net RIPE Network Coordination Centre WWW: http://www.ripe.net/home/henk P.O.Box 10096 Singel 258 Phone: +31.20.5354414 1001 EB Amsterdam 1016 AB Amsterdam Fax: +31.20.5354445 The Netherlands The Netherlands Mobile: +31.6.55861746 ------------------------------------------------------------------------------ That problem that we weren't having yesterday, is it better? (Big ISP NOC) _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Mon Feb 17 09:28:41 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id JAA22876 for ; Mon, 17 Feb 2003 09:28:41 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1HES5CN025716; Mon, 17 Feb 2003 09:28:05 -0500 Received: from almso2.proxy.att.com (almso2.att.com [192.128.166.71]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1HERsCN025700 for ; Mon, 17 Feb 2003 09:27:54 -0500 Received: from hogpa.mt.att.com ([135.16.74.2]) by almso2.proxy.att.com (AT&T IPNS/MSO-4.0) with SMTP id h1HERqHS000899; Mon, 17 Feb 2003 09:27:52 -0500 (EST) Received: from acmortonw.att.com by hogpa.mt.att.com (SMI-8.6/ATTEMS-1.4.1 sol2) id JAA27457; Mon, 17 Feb 2003 09:27:50 -0500 Message-Id: <5.1.0.14.0.20030217091903.02c3eda0@135.16.74.2> X-Sender: acm1@135.16.74.2 X-Mailer: QUALCOMM Windows Eudora Version 5.1 To: "Henk Uijterwaal (RIPE-NCC)" , Nischal M Piratla From: Al Morton Subject: Re: [ippm] New metric for packet reordering. Cc: ippm@advanced.org, Anura Jayasumana , Abhijit A Bare In-Reply-To: References: <3E4D20C4.8070605@engr.colostate.edu> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Mon, 17 Feb 2003 09:27:27 -0500 At 11:57 AM 02/17/2003 +0100, Henk Uijterwaal (RIPE-NCC) wrote: >Nischal, > >... > >2. Can you include the same examples as in the other reordering metrics > so one can compare the algorithms? > >Henk Case b, packet loss (1,2,4,5,6,7) is sufficient for comparison. No reordered packets arrive, yet this metric reports reordering density. The existing metrics maintain orthogonality between loss and reordering. Perhaps this algorithm would be better characterized as a receiver buffer occupation function. Al _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Mon Feb 17 18:10:49 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA03619 for ; Mon, 17 Feb 2003 18:10:49 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1HNC4CN008032; Mon, 17 Feb 2003 18:12:04 -0500 Received: from goku.engr.colostate.edu (goku.engr.colostate.edu [129.82.224.16]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1HNB7CN008008 for ; Mon, 17 Feb 2003 18:11:08 -0500 Received: from engr.colostate.edu (zurix.engr.colostate.edu [129.82.224.183]) by goku.engr.colostate.edu (8.12.0.Beta7/8.12.0.Beta7) with ESMTP id h1HNAgKQ025664; Mon, 17 Feb 2003 16:10:43 -0700 (MST) Message-ID: <3E516CC6.5010002@engr.colostate.edu> From: Nischal M Piratla User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.0.1) Gecko/20020823 Netscape/7.0 X-Accept-Language: en-us, en MIME-Version: 1.0 To: "Henk Uijterwaal (RIPE-NCC)" CC: ippm@advanced.org, Anura Jayasumana , Abhijit A Bare Subject: Re: [ippm] New metric for packet reordering. References: Content-Type: multipart/alternative; boundary="------------070501060607000802040106" X-ECS-MailScanner: Found to be clean X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Mon, 17 Feb 2003 16:14:14 -0700 --------------070501060607000802040106 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Dear Henk Uijterwaal, Please find the answers below: 1. If I understand the algorithm correctly, then it needs an array in_buffer[N] with N the number of packets in a stream. This is not very practical, when I make a VoIP phonecall, then I never know how long it is going to last in advance and thus how I should dimension this array in_buffer (N): The dimension of this array is DT. DT is the threshold after which the packet is considered useless or lost. This array dimension can be chosen based on the application. . For example in VoIP, if a packet arrives after 150msec (in theory) it can be discarded. Based on the codec selection, we can determine the packet size, max delay and in turn the value of DT after which the packet is rendered useless. For a TCP connection this DT value would not exceed the number of packets in the TCP send queue. Thus, it is not necessary to know the number of packets before hand. Dt imposes a limit on when one should consider a packet to be lost. 2. Can you include the same examples as in the other reordering metrics so one can compare the algorithms? I have picked one example from Al Morton's draft on reorder metric here. I hope it is ok to use the text from the draft "...Table 1 Example with Packet 4 Reordered, Sending order(SrcNum@Src): 1,2,3,4,5,6,7,8,9,10 SrcNum Src Dst Dst Posit. Late @Dst NextExp Time Time Delay IPDV Order Offset Time 1 1 0 68 68 1 2 2 20 88 68 0 2 3 3 40 108 68 0 3 5 4 80 148 68 -82 4 6 6 100 168 68 0 5 7 7 120 188 68 0 6 8 8 140 208 68 0 7 4 9 60 210 150 82 8 4 62 9 9 160 228 68 0 9 10 10 180 248 68 0 10 Each column gives the following information: SrcNum Packet sequence number at the Source. NextExp The value of NextExp when the packet arrived(before update). SrcTime Packet time stamp at the Source, ms. DstTime Packet time stamp at the Destination, ms. Delay 1-way delay of the packet, ms. IPDV IP Packet Delay Variation, ms IPDV = Delay(SrcNum)-Delay(SrcNum-1)..." Reorder Density for the above example: SrcNum @Dst NextExp Displacement Frequency 1 1 0 F[0] = 1 2 2 0 F[0]++ 3 3 0 F[0]++ 5 4 1 F[1] = 1 6 4 2 F[2] = 1 7 4 3 F[3] = 1 8 4 4 F[4] = 1 4 4 0 F[0]++ 9 9 0 F[0]++ 10 10 0 F[0]++ Normalized F[i] for all i: F[0] = 0.6, F[1] = 0.1, F[2] = 0.1, F[3] = 0.1, F[4] = 0.1 we In this case, if we can set DT = 3, then the table will look like this: SrcNum @Dst Expected Displacement Frequency 1 1 0 F[0] = 1 2 2 0 F[0]++ 3 3 0 F[0]++ 5 4 1 F[1] = 1 6 4 2 F[2] = 1 7 4 3 F[3] = 1 8 4 0 F[0]++ { after the current packet's (8) arrival, packet '4' is rendered useless!} 4 9 0 F[0]++ { should we count this as F[0] occurence?) 9 9 0 F[0]++ 10 10 0 F[0]++ Normalized F[i] for all i: F[0] = 0.7, F[1] = 0.1, F[2] = 0.1, F[3] = 0.1 Other examples in current metrics are almost similar. However, there are no examples with packet duplication. Here is one for the metric proposed. (Note: Packet '5' is duplicated.) SrcNum @Dst NextExp Displacement Frequency 1 1 0 F[0] = 1 2 2 0 F[0]++ 3 3 0 F[0]++ 5 4 1 F[1] = 1 6 4 2 F[2] = 1 7 4 3 F[3] = 1 8 4 4 F[4] = 1 4 4 0 F[0]++ 5 9 0 F[0]++ 9 9 0 F[0]++ Normalized F[i] for all i: F[0] = 0.6, F[1] = 0.1, F[2] = 0.1, F[3] = 0.1, F[4] = 0.1. At the arrival of a duplicate packet the buffer occupancy is held the same as the duplicate packet will be discarded and the contents of the buffer remain. If you need more examples or explanation, please feel free to send us an email. Thanks, Nischal Piratla ****************************************** Research Assistant Computer Networking Research Laboratory Department of Electrical and Computer Eng. Colorado State University, Fort Collins, CO 80523 Voice: +1 970-491-7974 Fax: +1 970-491-2249 http://www.engr.colostate.edu/~nischal ******************************************* Henk Uijterwaal (RIPE-NCC) wrote: >Nischal, > > > >>We have come up with a new metric to measure packet reordering. We have >>posted a ID and here is the link: >> >>http://www.ietf.org/internet-drafts/draft-jayasumana-reorder-density-00.txt >> >>This draft may interest you all. Please feel free to send any >>comments/suggestions. >> >> > >1. If I understand the algorithm correctly, then it needs an array > in_buffer[N] with N the number of packets in a stream. This is not > very practical, when I make a VoIP phonecall, then I never know how > long it is going to last in advance and thus how I should dimension > this array. > >2. Can you include the same examples as in the other reordering metrics > so one can compare the algorithms? > >Henk > > >------------------------------------------------------------------------------ >Henk Uijterwaal Email: henk.uijterwaal@ripe.net >RIPE Network Coordination Centre WWW: http://www.ripe.net/home/henk >P.O.Box 10096 Singel 258 Phone: +31.20.5354414 >1001 EB Amsterdam 1016 AB Amsterdam Fax: +31.20.5354445 >The Netherlands The Netherlands Mobile: +31.6.55861746 >------------------------------------------------------------------------------ > >That problem that we weren't having yesterday, is it better? (Big ISP NOC) > --------------070501060607000802040106 Content-Type: text/html; charset=US-ASCII Content-Transfer-Encoding: 7bit Dear Henk Uijterwaal,

Please find the answers below:
1. If I understand the algorithm correctly, then it needs an array
   in_buffer[N] with N the number of packets in a stream. This is not
   very practical, when I make a VoIP phonecall, then I never know how
   long it is going to last in advance and thus how I should dimension
   this array
in_buffer (N): The dimension of this array is DT. DT is the threshold after which the packet is considered useless or lost. This array dimension can be chosen based on the application. . For example in VoIP, if a packet arrives after 150msec (in theory) it can be discarded. Based on the codec selection, we can determine the packet size, max delay and in turn the value of DT after which the packet is rendered useless. For a TCP connection this DT value would not exceed the number of packets in the TCP send queue. Thus, it is not necessary to know the number of packets before hand. Dt imposes a limit on when one should consider a packet to be lost.

2. Can you include the same examples as in the other reordering metrics
   so one can compare the algorithms?
I have picked one example from Al Morton's draft on reorder metric here. I hope it is ok to use the text from the draft <draft-ietf-ippm-reordering-01.txt>

"...Table 1 Example with Packet 4 Reordered,
   Sending order(SrcNum@Src): 1,2,3,4,5,6,7,8,9,10
   SrcNum       Src     Dst                     Dst     Posit.  Late
   @Dst NextExp Time    Time    Delay   IPDV    Order   Offset  Time	 
    1     1       0      68      68              1				
    2     2      20      88      68       0      2
    3     3      40     108      68       0      3
    5     4      80     148      68     -82      4
    6     6     100     168      68       0      5
    7     7     120     188      68       0      6
    8     8     140     208      68       0      7
    4     9      60     210     150      82      8      4       62
    9     9     160     228      68       0      9
   10    10     180     248      68       0     10

   Each column gives the following information:

   SrcNum   Packet sequence number at the Source.
   NextExp   The value of NextExp when the packet arrived(before
   update).
   SrcTime  Packet time stamp at the Source, ms.
   DstTime  Packet time stamp at the Destination, ms.
   Delay    1-way delay of the packet, ms.
   IPDV     IP Packet Delay Variation, ms
            IPDV = Delay(SrcNum)-Delay(SrcNum-1)..."
   
Reorder Density for the above example:
  SrcNum       
   @Dst NextExp  Displacement	 Frequency
    1     1          0              F[0] = 1				
    2     2          0              F[0]++
    3     3          0              F[0]++
    5     4          1              F[1] = 1
    6     4          2              F[2] = 1
    7     4          3              F[3] = 1
    8     4          4              F[4] = 1
    4     4          0              F[0]++  
    9     9          0              F[0]++
   10    10          0              F[0]++

Normalized F[i] for all i: F[0] = 0.6, F[1] = 0.1, F[2] = 0.1, F[3] = 0.1, F[4] = 0.1
we 
In this case, if we can set DT = 3, then the table will look like this:

  SrcNum       
   @Dst Expected  Displacement	 Frequency
    1     1          0              F[0] = 1				
    2     2          0              F[0]++
    3     3          0              F[0]++
    5     4          1              F[1] = 1
    6     4          2              F[2] = 1
    7     4          3              F[3] = 1
    8     4          0              F[0]++       { after the current packet's (8) arrival, packet '4' is rendered useless!}
    4     9          0              F[0]++       { should we count this as F[0] occurence?)
    9     9          0              F[0]++
   10    10          0              F[0]++

Normalized F[i] for all i: F[0] = 0.7, F[1] = 0.1, F[2] = 0.1, F[3] = 0.1

Other examples in current metrics are almost similar. However, there are no examples with packet duplication. Here is one for the metric proposed. (Note: Packet '5' is duplicated.)

  SrcNum       
   @Dst NextExp  Displacement	 Frequency
    1     1          0              F[0] = 1				
    2     2          0              F[0]++
    3     3          0              F[0]++
    5     4          1              F[1] = 1
    6     4          2              F[2] = 1
    7     4          3              F[3] = 1
    8     4          4              F[4] = 1
    4     4          0              F[0]++
    5     9          0              F[0]++    
    9     9          0              F[0]++
   
Normalized F[i] for all i: F[0] = 0.6, F[1] = 0.1, F[2] = 0.1, F[3] = 0.1, F[4] = 0.1. 

At the arrival of a duplicate packet the buffer occupancy is held the same as the duplicate packet will be discarded and the contents of the buffer remain.
If you need more examples or explanation, please feel free to send us an email.

Thanks,
Nischal Piratla
******************************************
Research Assistant
Computer Networking Research Laboratory
Department of Electrical and Computer Eng.
Colorado State University,
Fort Collins, CO 80523
Voice: +1 970-491-7974
Fax:   +1 970-491-2249
http://www.engr.colostate.edu/~nischal
*******************************************


Henk Uijterwaal (RIPE-NCC) wrote:
Nischal,

  
We have come up with a new metric to measure packet reordering. We have
posted a ID and here is the link:

http://www.ietf.org/internet-drafts/draft-jayasumana-reorder-density-00.txt

This draft may interest you all. Please feel free to send any
comments/suggestions.
    

1. If I understand the algorithm correctly, then it needs an array
   in_buffer[N] with N the number of packets in a stream. This is not
   very practical, when I make a VoIP phonecall, then I never know how
   long it is going to last in advance and thus how I should dimension
   this array.

2. Can you include the same examples as in the other reordering metrics
   so one can compare the algorithms?

Henk


------------------------------------------------------------------------------
Henk Uijterwaal                             Email: henk.uijterwaal@ripe.net
RIPE Network Coordination Centre            WWW: http://www.ripe.net/home/henk
P.O.Box 10096          Singel 258           Phone: +31.20.5354414
1001 EB Amsterdam      1016 AB Amsterdam    Fax: +31.20.5354445
The Netherlands        The Netherlands      Mobile: +31.6.55861746
------------------------------------------------------------------------------

That problem that we weren't having yesterday, is it better? (Big ISP NOC)
--------------070501060607000802040106-- _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Tue Feb 18 01:05:18 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id BAA09892 for ; Tue, 18 Feb 2003 01:05:18 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1I684CN018571; Tue, 18 Feb 2003 01:08:04 -0500 Received: from basie.internet2.edu (basie.internet2.edu [207.75.164.22]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1I67TCN018555 for ; Tue, 18 Feb 2003 01:07:30 -0500 Received: from localhost (localhost.localdomain [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id CF9517B493; Tue, 18 Feb 2003 01:07:29 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id CA51A7B484; Tue, 18 Feb 2003 01:07:28 -0500 (EST) To: Nischal M Piratla Cc: ippm@advanced.org Subject: Re: [ippm] New metric for packet reordering. References: <3E4D20C4.8070605@engr.colostate.edu> From: stanislav shalunov In-Reply-To: <3E4D20C4.8070605@engr.colostate.edu> Message-ID: <87heb2ktpc.fsf@cain.internet2.edu> Lines: 22 X-Mailer: Gnus v5.7/Emacs 20.4 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS 0.3.12pre8 Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: 18 Feb 2003 01:07:27 -0500 Nischal, I seem to be having a difficulty interpreting your algorithm as presented in the internet-draft. For example, I am looking at the following: > If (D < DT) > /*Store arrived packet in buffer.*/ > D = D + 1; > Else > [...] Is the comment an actual comment or a pseudocode statement? Would it perhaps be convenient for you to provide some runnable C code that we could play with to better understand your definition? -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ "Which one is worse? Both are worse." -- V. I. Lenin _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Tue Feb 18 15:41:11 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA07844 for ; Tue, 18 Feb 2003 15:41:10 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1IKf5CN009643; Tue, 18 Feb 2003 15:41:05 -0500 Received: from hotmail.com (f100.sea2.hotmail.com [207.68.165.100]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1IKebCN009624 for ; Tue, 18 Feb 2003 15:40:37 -0500 Received: from mail pickup service by hotmail.com with Microsoft SMTPSVC; Tue, 18 Feb 2003 12:40:36 -0800 Received: from 193.116.20.220 by sea2fd.sea2.hotmail.msn.com with HTTP; Tue, 18 Feb 2003 20:40:36 GMT X-Originating-IP: [193.116.20.220] From: "gab.seun jones.ewulomi" To: ippm@advanced.org Mime-Version: 1.0 Content-Type: text/plain; format=flowed Message-ID: X-OriginalArrivalTime: 18 Feb 2003 20:40:36.0803 (UTC) FILETIME=[FDCA0130:01C2D78D] X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] statistics techniques Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Tue, 18 Feb 2003 20:40:36 +0000 Hi Guys, My apologies on the somewhat easy question Im doing a active test just using ping(via script). I have the script to ping a device(100 counts) then send it to a file. My main question is what will give a more accurate rtt. 1)taking the mean of all 100 pings 2)median 3)mode Just want techniques on what others would use and why regards, gab _________________________________________________________________ Surf together with new Shared Browsing http://join.msn.com/?page=features/browse&pgmarket=en-gb&XAPID=74&DI=1059 _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Tue Feb 18 15:45:05 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA08008 for ; Tue, 18 Feb 2003 15:45:05 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1IKl4CN009871; Tue, 18 Feb 2003 15:47:04 -0500 Received: from basie.internet2.edu (basie.internet2.edu [207.75.164.22]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1IKl0CN009855 for ; Tue, 18 Feb 2003 15:47:00 -0500 Received: from localhost (localhost.localdomain [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 37CCF7B4E1; Tue, 18 Feb 2003 15:47:00 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 4FA647B4DA; Tue, 18 Feb 2003 15:46:59 -0500 (EST) To: "gab.seun jones.ewulomi" Cc: ippm@advanced.org Subject: Re: [ippm] statistics techniques References: From: stanislav shalunov In-Reply-To: Message-ID: <87vfzhmi4d.fsf@cain.internet2.edu> Lines: 21 X-Mailer: Gnus v5.7/Emacs 20.4 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS 0.3.12pre8 Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: 18 Feb 2003 15:46:58 -0500 "gab.seun jones.ewulomi" writes: > Im doing a active test just using ping(via script). I have the script to > ping a device(100 counts) then send it to a file. > > My main question is what will give a more accurate rtt. > > 1)taking the mean of all 100 pings > 2)median > 3)mode How can you compute the mean when some of the values are close to infinity (losses)? Median and minimum make a lot more sense. -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ A fanatic is one who can't change his mind and won't change the subject. -- Winston Churchill _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Tue Feb 18 17:33:43 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id RAA10355 for ; Tue, 18 Feb 2003 17:33:43 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1IMU4CN013782; Tue, 18 Feb 2003 17:30:04 -0500 Received: from smtp.noos.fr (nan-smtp-04.noos.net [212.198.2.73]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1IMTXCO013733 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=FAIL) for ; Tue, 18 Feb 2003 17:29:34 -0500 Received: (qmail 30384814 invoked by uid 0); 18 Feb 2003 22:29:32 -0000 Received: from unknown (HELO LIP60MU1PINK59) ([212.198.206.108]) (envelope-sender ) by 212.198.2.73 (qmail-ldap-1.03) with SMTP for ; 18 Feb 2003 22:29:32 -0000 From: =?iso-8859-1?Q?Kav=E9_Salamatian?= To: "stanislav shalunov" , "gab.seun jones.ewulomi" Cc: Subject: RE: [ippm] statistics techniques Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2911.0) X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2600.0000 Importance: Normal In-Reply-To: <87vfzhmi4d.fsf@cain.internet2.edu> X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Tue, 18 Feb 2003 23:28:46 +0100 Content-Transfer-Encoding: 8bit >> Im doing a active test just using ping(via script). I have the script to >> ping a device(100 counts) then send it to a file. >> >> My main question is what will give a more accurate rtt. >> >> 1)taking the mean of all 100 pings >> 2)median >> 3)mode >How can you compute the mean when some of the values are close to >infinity (losses)? This might not be a problem. There is a lot of methods for dealing with missing values. However there is a more fundamental question. What do you expect from the mean or the median or the mode ? Sometimes trivial questions are the most difficult to answer. For example suppose that you have measure the rtt for 100 counts, maybe you are searching for a formula f(.) that will combine the results obtained in the past measurements to predict the rtt in measurement 101. If this is your goal clearly the mean or mode or median is not the best estimator. If your problem is to find a parametric representation of the rtt distribution that have as parameter the mean, please define initially what a prior parametric structure are you supposing. If your problem is something else please define it. Sometime, when I read some papers or draft in Internet measurement it remind me of the following oriental story: Somebody had lost his key in a dark yard but he was wandering about the key in the room. A fellow ask him: you have lost the key in the yard but you are searching it here. The guy answer: but there is light here and the yard is dark.... Regards Kavé Salamatian Associate Professor, LIP6-UPMC _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Tue Feb 18 18:04:22 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id SAA10854 for ; Tue, 18 Feb 2003 18:04:22 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1IN75CN014985; Tue, 18 Feb 2003 18:07:05 -0500 Received: from basie.internet2.edu (basie.internet2.edu [207.75.164.22]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1IN6sCN014969 for ; Tue, 18 Feb 2003 18:06:54 -0500 Received: from localhost (localhost.localdomain [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 2B4AB7B4E1; Tue, 18 Feb 2003 18:06:54 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 144B27B4E3; Tue, 18 Feb 2003 18:06:53 -0500 (EST) To: Kavé Salamatian Cc: ippm@advanced.org Subject: Re: [ippm] statistics techniques References: From: stanislav shalunov In-Reply-To: Message-ID: <87isvhmbn9.fsf@cain.internet2.edu> Lines: 29 X-Mailer: Gnus v5.7/Emacs 20.4 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS 0.3.12pre8 Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: 18 Feb 2003 18:06:50 -0500 I can not speak for the original poster, but since you appear to be addressing me while (not?) answering his questions: 1. The values of delay for lost packets are not ``missing''. They are potentially very large unknowable values. That packet that I sent last year and that appeared to be lost might still be delivered one day. 2. The necessity for aggregation is more about human consumption of data than about using it to predict anything or to compute parameters of a distribution (there's no distribution). Minimum (or something close to it) is meaningful in itself: given enough measurements, it's a reasonable guess of propagation delay. Median is useful for several reasons: a. It reflects the whole sample. b. It is well-defined for samples where more than 50% of packets arrived during the measurement (thus making it widely usable). c. It is robust. d. It is easy to understand. -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ A fanatic is one who can't change his mind and won't change the subject. -- Winston Churchill _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Wed Feb 19 07:26:54 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id HAA21636 for ; Wed, 19 Feb 2003 07:26:53 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1JCS4CN002871; Wed, 19 Feb 2003 07:28:04 -0500 Received: from laposte.enst-bretagne.fr (laposte.enst-bretagne.fr [192.108.115.3]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1JCR3CN002725 for ; Wed, 19 Feb 2003 07:27:04 -0500 Received: from antares.enst-bretagne.fr (antares.enst-bretagne.fr [192.44.75.8]) by laposte.enst-bretagne.fr (8.11.6/8.11.6) with ESMTP id h1JCR6W10928; Wed, 19 Feb 2003 13:27:06 +0100 Received: from enst-bretagne.fr (taureau-tse.enst-bretagne.fr [192.44.75.100]) by antares.enst-bretagne.fr (8.11.6/8.11.6) with ESMTP id h1JCQwa21935; Wed, 19 Feb 2003 13:26:58 +0100 (MET) Message-ID: <3E53775C.7B1F19B@enst-bretagne.fr> From: Sandrine Vaton X-Mailer: Mozilla 4.75 [fr] (Windows NT 5.0; U) X-Accept-Language: fr MIME-Version: 1.0 To: stanislav shalunov CC: =?iso-8859-1?Q?Kav=E9?= Salamatian , ippm@advanced.org Subject: Re: [ippm] statistics techniques References: <87isvhmbn9.fsf@cain.internet2.edu> Content-Type: multipart/alternative; boundary="------------A219A405EB655A485166653D" X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by amavisd-milter (http://amavis.org/) at enst-bretagne.fr Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Wed, 19 Feb 2003 13:23:56 +0100 --------------A219A405EB655A485166653D Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit stanislav shalunov a écrit : > I can not speak for the original poster, but since you appear to be > addressing me while (not?) answering his questions: > > 1. The values of delay for lost packets are not ``missing''. They are > potentially very large unknowable values. That packet that I sent > last year and that appeared to be lost might still be delivered one > day. The word "missing" should be understood in the sense of "unobserved" but in the sense of "censored". In statistics a model with "censored data" is a model such that is X>xmax you do not observe X but you anyhow have the information that X was superior to xmax. This is a classical problem in the industry for example or in polling. In your case the actual value of delay is not known when the delay is too big but you know that (delay > delay_max): this is already some information on the value of the delay and this should be taken into account in your estimation procedure. For censored values problems a powerful algorithm is the Expectation Maximization algorithm. You can also use Baysian techniques to simulate the value of the delay on the information that the delay is superior to delay_max. In both cases you suppose a statistical model for your series of delays and you try to estimate the parameters of that model (mean, variance, etc...) on the basis of a series of delays. > > > 2. The necessity for aggregation is more about human consumption of > data than about using it to predict anything or to compute > parameters of a distribution (there's no distribution). Minimum > (or something close to it) is meaningful in itself: given enough > measurements, it's a reasonable guess of propagation delay. Median > is useful for several reasons: > > a. It reflects the whole sample. > > b. It is well-defined for samples where more than 50% of packets > arrived during the measurement (thus making it widely usable). > I do not agree with point b. If only 50% of the packets were delivered and if you estimate the mean delay as the mean over the packets delivered then you will strongly underestimate the average delay (you do not take into account those packets that are not delivered yet but that could be delivered one day). > > c. It is robust. > In what sense? > > d. It is easy to understand. > > Sandrine Vaton http://perso-info.enst-bretagne.fr/~vaton --------------A219A405EB655A485166653D Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit  

stanislav shalunov a écrit :

I can not speak for the original poster, but since you appear to be
addressing me while (not?) answering his questions:

1. The values of delay for lost packets are not ``missing''.  They are
   potentially very large unknowable values.  That packet that I sent
   last year and that appeared to be lost might still be delivered one
   day.

The word "missing" should be understood in the sense of "unobserved" but in the sense of "censored". In statistics a model with "censored data" is a model such that is X>xmax you do not observe X but you anyhow have the information that X was superior to xmax. This is a classical problem in the industry for example or in polling. In your case the actual value of delay is not known when the delay is too big but you know that (delay > delay_max): this is already some information on the value of the delay and this should be taken into account in your estimation procedure.

For censored values problems a powerful algorithm is the Expectation Maximization algorithm. You can also use Baysian techniques to simulate the value of the delay on the information that the delay is superior to delay_max. In both cases you suppose a statistical model for your series of delays and you try to estimate the parameters of that model (mean, variance, etc...) on the basis of a series of delays.

 

2. The necessity for aggregation is more about human consumption of
   data than about using it to predict anything or to compute
   parameters of a distribution (there's no distribution).  Minimum
   (or something close to it) is meaningful in itself: given enough
   measurements, it's a reasonable guess of propagation delay.  Median
   is useful for several reasons:

   a. It reflects the whole sample.

   b. It is well-defined for samples where more than 50% of packets
      arrived during the measurement (thus making it widely usable).
 


I do not agree with point b. If only 50% of the packets were delivered and if you estimate the mean delay as the mean over the packets delivered then you will strongly underestimate the average delay (you do not take into account those packets that are not delivered yet but that could be delivered one day).
 

 
   c. It is robust.
 
In what sense?
 
 
   d. It is easy to understand.
 
 

Sandrine Vaton
http://perso-info.enst-bretagne.fr/~vaton
  --------------A219A405EB655A485166653D-- _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Wed Feb 19 22:00:09 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id WAA16729 for ; Wed, 19 Feb 2003 22:00:09 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1K324CN029293; Wed, 19 Feb 2003 22:02:04 -0500 Received: from basie.internet2.edu (basie.internet2.edu [207.75.164.22]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1K31rCN029277 for ; Wed, 19 Feb 2003 22:01:53 -0500 Received: from localhost (localhost.localdomain [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 5D1537B4DD; Wed, 19 Feb 2003 22:01:53 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 49F1D7B488; Wed, 19 Feb 2003 22:01:52 -0500 (EST) To: Sandrine Vaton Cc: ippm@advanced.org Subject: Re: [ippm] statistics techniques References: <87isvhmbn9.fsf@cain.internet2.edu> <3E53775C.7B1F19B@enst-bretagne.fr> From: stanislav shalunov In-Reply-To: <3E53775C.7B1F19B@enst-bretagne.fr> Message-ID: <87of57lko2.fsf@cain.internet2.edu> Lines: 30 X-Mailer: Gnus v5.7/Emacs 20.4 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS 0.3.12pre8 Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: 19 Feb 2003 22:01:49 -0500 Sandrine Vaton writes: > The word "missing" should be understood in the sense of "unobserved" but > in the sense of "censored". And, if you know that the delay was greater than some value and have no knowledge of the distribution, what do you do? > > Median is useful for several reasons: > > b. It is well-defined for samples where more than 50% of packets > > arrived during the measurement (thus making it widely usable). > > > > I do not agree with point b. If only 50% of the packets were > delivered and if you estimate the mean delay as the mean over the > packets delivered Sure. That's why I talk about _median_, not mean. > > c. It is robust. > In what sense? It is not significantly affected by small amounts of noise. -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ Sex is the mathematics urge sublimated. -- M. C. Reed. _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Wed Feb 19 23:22:33 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id XAA18782 for ; Wed, 19 Feb 2003 23:22:33 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1K4P5CN031644; Wed, 19 Feb 2003 23:25:05 -0500 Received: from mesa.acns.ColoState.EDU (mesa.acns.colostate.edu [129.82.100.130]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1K4ODCN031625 for ; Wed, 19 Feb 2003 23:24:14 -0500 Received: from lamar.colostate.edu (lamar.acns.colostate.edu [129.82.100.75]) by mesa.acns.ColoState.EDU (AIX4.3/8.9.3/8.9.3) with ESMTP id VAA62394; Wed, 19 Feb 2003 21:24:11 -0700 Received: from engr.colostate.edu (res096090.halls.colostate.edu [129.82.96.90] (may be forged)) by lamar.colostate.edu (AIX5.1/8.11.0/8.8.8) with ESMTP id h1K4OAw05248; Wed, 19 Feb 2003 21:24:10 -0700 Message-ID: <3E5458CF.9040802@engr.colostate.edu> From: Nischal M Piratla User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.0.1) Gecko/20020823 Netscape/7.0 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Al Morton CC: "Henk Uijterwaal (RIPE-NCC)" , ippm@advanced.org, Anura Jayasumana , Abhijit A Bare Subject: Re: [ippm] New metric for packet reordering. References: <3E4D20C4.8070605@engr.colostate.edu> <5.1.0.14.0.20030217091903.02c3eda0@135.16.74.2> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Wed, 19 Feb 2003 21:25:51 -0700 Content-Transfer-Encoding: 7bit Dear Al Morton, Your question gives rise to a very interesting issue - the orthogonality of reordering and other phenomena, including losses and duplication of packets. 1) Loss: With the sequence (1,2,4,5,6,7) it is possible to conclude that packet 3 is lost only if we are not expecting any more packets in the sequence. The key question here is "When should a packet be considered lost?" When it does not arrive during a certain time threshold, or when the packet does not arrive till measurements are completed? Stated differently, is a packet considered lost if it does not arrive within some useful time period, or is it considered lost until it arrives? From the point of view of higher level protocols or applications, the former is desirable. Also, in case of continuous monitoring of reorder in a network, latter is not possible. Considering a packet to be lost if it does not arrive during the measurement period does not necessarily make loss and reordering measurements orthogonal. After debating along these lines and considering the usefulness of the metric, we decided to move ahead of any packet that did not arrive within a given time or threshold (DT). [ In fact, considering packets that do not arrive within the measurement periods equivalent to starting with DT= no of packets arriving in measurement period, and decreasing DT by 1 with each arriving packet. ] Another interesting question is whether we should consider (arrived but) dropped packets as lost packets ? 2) Duplication: These are the packets that are duplicated due to whatever reason. Should we have a reorder metric that is orthogonal to it as well? It is possible to argue that reordering has nothing to do with duplication and these packets should not be taken into consideration. If we consider duplicate packet as a reordered packet, the reorder metric is not the same for sequences with duplication and sequences without duplication. Consider the example: (1,2,3,2,4,5,6) If we consider packet '2' second occurrence as reordering then the orthogonality between duplicate packet and reorder is not maintained. When we were thinking about these issues, we also considered Van Paxson & etal.'s RFC 2330. I am quoting the requirements that they stated for the performance metrics "+ The metrics must be concrete and well-defined, + A methodology for a metric should have the property that it is repeatable: if the methodology is used multiple times under identical conditions, the same measurements should result in the same measurements. + The metrics must exhibit no bias for IP clouds implemented with identical technology, + The metrics must exhibit understood and fair bias for IP clouds implemented with non-identical technology, + The metrics must be useful to users and providers in understanding the performance they experience or provide, + The metrics must avoid inducing artificial performance goals." We thought of the usefulness as one important criteria. Till recently, we had only % reordering and as the example in the draft indicated the definition was not concrete (and ambiguous) and hence the usefulness was very limited. Lack of a concrete definition also makes it difficult to reproduce the results. I hope this answers your query. Please feel free to send any additional comments/suggestions. Thank you, Nischal Piratla Al Morton wrote: > At 11:57 AM 02/17/2003 +0100, Henk Uijterwaal (RIPE-NCC) wrote: > >> Nischal, >> >> ... >> >> 2. Can you include the same examples as in the other reordering metrics >> so one can compare the algorithms? >> >> Henk > > > Case b, packet loss (1,2,4,5,6,7) is sufficient for comparison. > No reordered packets arrive, yet this metric reports reordering > density. The existing metrics maintain orthogonality between > loss and reordering. Perhaps this algorithm would be better > characterized as a receiver buffer occupation function. > > Al > > _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Wed Feb 19 23:30:19 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id XAA18866 for ; Wed, 19 Feb 2003 23:30:18 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1K4X4CN032012; Wed, 19 Feb 2003 23:33:04 -0500 Received: from mesa.acns.ColoState.EDU (mesa.acns.colostate.edu [129.82.100.130]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1K4WGCN031980 for ; Wed, 19 Feb 2003 23:32:17 -0500 Received: from lamar.colostate.edu (lamar.acns.colostate.edu [129.82.100.75]) by mesa.acns.ColoState.EDU (AIX4.3/8.9.3/8.9.3) with ESMTP id VAA87454; Wed, 19 Feb 2003 21:32:14 -0700 Received: from engr.colostate.edu (res096090.halls.colostate.edu [129.82.96.90] (may be forged)) by lamar.colostate.edu (AIX5.1/8.11.0/8.8.8) with ESMTP id h1K4WDw168992; Wed, 19 Feb 2003 21:32:13 -0700 Message-ID: <3E545AB2.1080108@engr.colostate.edu> From: Nischal M Piratla User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.0.1) Gecko/20020823 Netscape/7.0 X-Accept-Language: en-us, en MIME-Version: 1.0 To: stanislav shalunov CC: ippm@advanced.org, Anura Jayasumana , Abhijit A Bare Subject: RE: [ippm] New metric for packet reordering Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Wed, 19 Feb 2003 21:33:54 -0700 Content-Transfer-Encoding: 7bit Stanislav, Please find the link of C code for reorder density computation: http://www.engr.colostate.edu/ece/Research/cnrl/code/RD.c Feel free to send any more comments. - Nischal -------- Original Message -------- >Subject: Re: [ippm] New metric for packet reordering. >Date: 18 Feb 2003 01:07:27 -0500 >From: stanislav shalunov >To: Nischal M Piratla >CC: ippm@advanced.org >References: <3E4D20C4.8070605@engr.colostate.edu> > >Nischal, > >I seem to be having a difficulty interpreting your algorithm as >presented in the internet-draft. > >For example, I am looking at the following: > > > > If (D < DT) > /*Store arrived packet in buffer.*/ > D = D + 1; > Else > [...] > > >Is the comment an actual comment or a pseudocode statement? > >Would it perhaps be convenient for you to provide some runnable C code >that we could play with to better understand your definition? > >-- >Stanislav Shalunov http://www.internet2.edu/~shalunov/ > >"Which one is worse? Both are worse." -- V. I. Lenin _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Thu Feb 20 06:01:38 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id GAA07116 for ; Thu, 20 Feb 2003 06:01:38 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KB24CN008973; Thu, 20 Feb 2003 06:02:04 -0500 Received: from birch.ripe.net (birch.ripe.net [193.0.1.96]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KB1lCN008956 for ; Thu, 20 Feb 2003 06:01:48 -0500 Received: from x49.ripe.net (x49.ripe.net [193.0.1.49]) by birch.ripe.net (8.12.5/8.11.6) with ESMTP id h1KB1lAq018228; Thu, 20 Feb 2003 12:01:47 +0100 Received: from localhost (henk@localhost) by x49.ripe.net (8.12.4/8.12.6) with ESMTP id h1KB1jdL022045; Thu, 20 Feb 2003 12:01:46 +0100 X-Authentication-Warning: x49.ripe.net: henk owned process doing -bs From: "Henk Uijterwaal (RIPE-NCC)" To: Nischal M Piratla cc: Al Morton , , Anura Jayasumana , Abhijit A Bare Subject: Re: [ippm] New metric for packet reordering. In-Reply-To: <3E5458CF.9040802@engr.colostate.edu> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Thu, 20 Feb 2003 12:01:45 +0100 (CET) Nischal, > 1) Loss: With the sequence (1,2,4,5,6,7) it is possible to conclude that > packet 3 is lost only if we are not expecting any more packets in the > sequence. The key question here is "When should a packet be considered > lost?" When it does not arrive during a certain time threshold, or when > the packet does not arrive till measurements are completed? Time threshold, with the limit set by the application (and can be set to infinite). The problem is when an application asks for a resend, if this happens after (say) 3 packets, then ( 1, 2, 4, 5, 6, 7, 3, 8) is as interesting as (1, 2, 4, 5, 6, 7, 8). > 2) Duplication: These are the packets that are duplicated due to > whatever reason. Should we have a reorder metric that is orthogonal to > it as well? Yes, duplication is different from reordering. If packets are duplicated, then most applications will ignore the second copy, this doesn't take any CPU cycles. Reordering means that the packets have to be put back into order, this does require effort by the application. Henk ------------------------------------------------------------------------------ Henk Uijterwaal Email: henk.uijterwaal@ripe.net RIPE Network Coordination Centre WWW: http://www.ripe.net/home/henk P.O.Box 10096 Singel 258 Phone: +31.20.5354414 1001 EB Amsterdam 1016 AB Amsterdam Fax: +31.20.5354445 The Netherlands The Netherlands Mobile: +31.6.55861746 ------------------------------------------------------------------------------ That problem that we weren't having yesterday, is it better? (Big ISP NOC) _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Thu Feb 20 09:38:33 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id JAA15873 for ; Thu, 20 Feb 2003 09:38:33 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KEf4CN015262; Thu, 20 Feb 2003 09:41:05 -0500 Received: from laposte.enst-bretagne.fr (laposte.enst-bretagne.fr [192.108.115.3]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KEeiCN015236 for ; Thu, 20 Feb 2003 09:40:44 -0500 Received: from antares.enst-bretagne.fr (antares.enst-bretagne.fr [192.44.75.8]) by laposte.enst-bretagne.fr (8.11.6/8.11.6) with ESMTP id h1KEeor09216 for ; Thu, 20 Feb 2003 15:40:50 +0100 Received: from enst-bretagne.fr (taureau-tse.enst-bretagne.fr [192.44.75.100]) by antares.enst-bretagne.fr (8.11.6/8.11.6) with ESMTP id h1KEefa21215 for ; Thu, 20 Feb 2003 15:40:41 +0100 (MET) Message-ID: <3E54E832.5BA51C3B@enst-bretagne.fr> From: Sandrine Vaton X-Mailer: Mozilla 4.75 [fr] (Windows NT 5.0; U) X-Accept-Language: fr MIME-Version: 1.0 To: ippm@advanced.org Subject: [Fwd: [ippm] statistics techniques] Content-Type: multipart/mixed; boundary="------------3A76D79B54EDA823D4F14E2F" X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by amavisd-milter (http://amavis.org/) at enst-bretagne.fr Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Thu, 20 Feb 2003 15:37:38 +0100 Il s'agit d'un message multivolet au format MIME. --------------3A76D79B54EDA823D4F14E2F Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit --------------3A76D79B54EDA823D4F14E2F Content-Type: message/rfc822 Content-Disposition: inline X-Mozilla-Status2: 00000000 Message-ID: <3E5379E6.DC1A251C@enst-bretagne.fr> Date: Wed, 19 Feb 2003 13:34:47 +0100 From: Sandrine Vaton X-Mailer: Mozilla 4.75 [fr] (Windows NT 5.0; U) X-Accept-Language: fr MIME-Version: 1.0 To: stanislav shalunov Subject: Re: [ippm] statistics techniques References: <87vfzhmi4d.fsf@cain.internet2.edu> Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit I suggest that you enrich your model as follows: 1/ the packet can be lost (with probability p) or delivered with probability (1-p) 2/ if the packet is in the second class (the packets that have been delivered or that will be delivered one day) then the rtt is a random variable whose probability density function is f(x) (for example an exponential distribution with mean 1/lambda). The domain of definition of f(x) being the real positive line. If you are in the second class then it is possible that the packet has not yet arrived because the observation window is of finite size but you have the information that rtt>rtt_max and this information should be taken into account in your estimation procedure. Sandrine Vaton http://perso-info.enst-bretagne.fr/~vaton stanislav shalunov a écrit : > "gab.seun jones.ewulomi" writes: > > > Im doing a active test just using ping(via script). I have the script to > > ping a device(100 counts) then send it to a file. > > > > My main question is what will give a more accurate rtt. > > > > 1)taking the mean of all 100 pings > > 2)median > > 3)mode > > How can you compute the mean when some of the values are close to > infinity (losses)? > > Median and minimum make a lot more sense. > > -- > Stanislav Shalunov http://www.internet2.edu/~shalunov/ > > A fanatic is one who can't change his mind and won't change the > subject. -- Winston Churchill > _______________________________________________ > ippm mailing list > ippm@advanced.org > http://mailhost.advanced.org/mailman/listinfo/ippm --------------3A76D79B54EDA823D4F14E2F-- _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Thu Feb 20 09:41:12 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id JAA15949 for ; Thu, 20 Feb 2003 09:41:11 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KEg4CN015346; Thu, 20 Feb 2003 09:42:05 -0500 Received: from laposte.enst-bretagne.fr (laposte.enst-bretagne.fr [192.108.115.3]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KEexCN015243 for ; Thu, 20 Feb 2003 09:41:00 -0500 Received: from antares.enst-bretagne.fr (antares.enst-bretagne.fr [192.44.75.8]) by laposte.enst-bretagne.fr (8.11.6/8.11.6) with ESMTP id h1KEf7r09259 for ; Thu, 20 Feb 2003 15:41:07 +0100 Received: from enst-bretagne.fr (taureau-tse.enst-bretagne.fr [192.44.75.100]) by antares.enst-bretagne.fr (8.11.6/8.11.6) with ESMTP id h1KEewa21227 for ; Thu, 20 Feb 2003 15:40:58 +0100 (MET) Message-ID: <3E54E843.ED59E183@enst-bretagne.fr> From: Sandrine Vaton X-Mailer: Mozilla 4.75 [fr] (Windows NT 5.0; U) X-Accept-Language: fr MIME-Version: 1.0 To: ippm@advanced.org Subject: [Fwd: [ippm] statistics techniques] Content-Type: multipart/mixed; boundary="------------2CB19F7FAC2BC598045BED51" X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by amavisd-milter (http://amavis.org/) at enst-bretagne.fr Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Thu, 20 Feb 2003 15:37:55 +0100 Il s'agit d'un message multivolet au format MIME. --------------2CB19F7FAC2BC598045BED51 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit --------------2CB19F7FAC2BC598045BED51 Content-Type: message/rfc822 Content-Disposition: inline X-Mozilla-Status2: 00000000 Message-ID: <3E54DB0E.CA5C2D2E@enst-bretagne.fr> Date: Thu, 20 Feb 2003 14:41:35 +0100 From: Sandrine Vaton X-Mailer: Mozilla 4.75 [fr] (Windows NT 5.0; U) X-Accept-Language: fr MIME-Version: 1.0 To: stanislav shalunov Subject: Re: [ippm] statistics techniques References: <87isvhmbn9.fsf@cain.internet2.edu> <3E53775C.7B1F19B@enst-bretagne.fr> <87of57lko2.fsf@cain.internet2.edu> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit > And, if you know that the delay was greater than some value and have > no knowledge of the distribution, what do you do? > SV -> Most of the time the Expectation Maximization algorithm is very useful for dealing with censored data. > > > > Median is useful for several reasons: > > > > b. It is well-defined for samples where more than 50% of packets > > > arrived during the measurement (thus making it widely usable). > > > > > > > I do not agree with point b. If only 50% of the packets were > > delivered and if you estimate the mean delay as the mean over the > > packets delivered > > Sure. That's why I talk about _median_, not mean. > SV -> Hum hum I did not get that point. That looks tricky. But, unless you are in a model with only one parameter (an exponential distribution for example) the median will not be sufficient to fully determine the distribution. > > > > c. It is robust. > > > In what sense? > > It is not significantly affected by small amounts of noise. > SV -> This is true when the noise is additive with a symetric distribution around the origin. > > -- > Stanislav Shalunov http://www.internet2.edu/~shalunov/ > > Sex is the mathematics urge sublimated. -- M. C. Reed. --------------2CB19F7FAC2BC598045BED51-- _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Thu Feb 20 11:09:15 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id LAA19414 for ; Thu, 20 Feb 2003 11:09:15 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KGC4CN018616; Thu, 20 Feb 2003 11:12:04 -0500 Received: from basie.internet2.edu (basie.internet2.edu [207.75.164.22]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KGBxCN018600 for ; Thu, 20 Feb 2003 11:12:00 -0500 Received: from localhost (localhost.localdomain [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 9153F7B4F0; Thu, 20 Feb 2003 11:11:59 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 8A3227B4B6; Thu, 20 Feb 2003 11:11:58 -0500 (EST) To: Nischal M Piratla Cc: ippm@advanced.org, Anura Jayasumana , Abhijit A Bare Subject: Re: [ippm] New metric for packet reordering References: <3E545AB2.1080108@engr.colostate.edu> From: stanislav shalunov In-Reply-To: <3E545AB2.1080108@engr.colostate.edu> Message-ID: <87r8a3j5it.fsf@cain.internet2.edu> Lines: 25 X-Mailer: Gnus v5.7/Emacs 20.4 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS 0.3.12pre8 Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: 20 Feb 2003 11:11:54 -0500 Nischal M Piratla writes: > http://www.engr.colostate.edu/ece/Research/cnrl/code/RD.c Nischal, It seems that: * When `late' packets are encountered, your metric behaves like N-reordering; * When `early' packets are encountered, your metric reports same degree of reordering as N-reordering, but larger number of packets are reported as reordered; * When there are any missing packets, it reports high degrees of reordering for a whole bunch of packets. This last is a show-stopper as far as I am concerned. -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ A fanatic is one who can't change his mind and won't change the subject. -- Winston Churchill _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Thu Feb 20 12:09:29 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA21632 for ; Thu, 20 Feb 2003 12:09:29 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KH83CN020529; Thu, 20 Feb 2003 12:08:04 -0500 Received: from basie.internet2.edu (basie.internet2.edu [207.75.164.22]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KH7DCN020507 for ; Thu, 20 Feb 2003 12:07:14 -0500 Received: from localhost (localhost.localdomain [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id B9C247B4F0; Thu, 20 Feb 2003 12:07:13 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 8C0C57B4B6; Thu, 20 Feb 2003 12:07:12 -0500 (EST) To: Sandrine Vaton Cc: ippm@advanced.org Subject: Re: [ippm] statistics techniques References: <87isvhmbn9.fsf@cain.internet2.edu> <3E53775C.7B1F19B@enst-bretagne.fr> <87of57lko2.fsf@cain.internet2.edu> <3E54DB0E.CA5C2D2E@enst-bretagne.fr> <87of57j5ct.fsf@cain.internet2.edu> <3E550222.3633D4DB@enst-bretagne.fr> From: stanislav shalunov In-Reply-To: <3E550222.3633D4DB@enst-bretagne.fr> Message-ID: <8765rekhj4.fsf@cain.internet2.edu> Lines: 63 X-Mailer: Gnus v5.7/Emacs 20.4 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS 0.3.12pre8 Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: 20 Feb 2003 12:07:11 -0500 Sandrine Vaton writes: > stanislav shalunov a écrit : > > > Sandrine Vaton writes: > > > > > SV -> Hum hum I did not get that point. That looks tricky. But, > > > unless you are in a model with only one parameter (an exponential > > > distribution for example) the median will not be sufficient to fully > > > determine the distribution. > > > > As would be the mean. > > > > But, I didn't even say I make any assumptions about the model. > > The problem is that most of the time you need more than one parameter to > characterize a distribution. For example for a Gaussian distribution you need > the mean and the variance, unless you suppose that there is a relationship > between mean and variance (for example variance=mean^c with c=...) How does this make mean relevant? I am saying that it is a better practice to report median of delays than attempt to report mean of delays. > > > SV -> This is true when the noise is additive with a symetric distribution > > > around the origin. > > > > Suppose 1% of measurements is distorted (by a very large margin). > > Median is unlikely to be affected. Mean is. > > The median will be affected if you have more than 50% of "censored" > RTT. I agree with you for saying that with only 1% then the median > is not affected. If more than 50% of packets are lost, you ought to report median=infinity. If any packets are lost, you ought to report mean=infinity. Which one is better? > But once again the median is maybe not the only parameter of > interest. In particular, the distribution of the delays is clearly > not exponential, is it? It is unlikely that packet delay is a random quantity from a statistical point of view. (There's no probability space, there's a feedback loop, etc.) Certainly different measurements (taken close enough) are not independent. If one were to model delay as an i.i.d. random quantity, then shifted exponentially distributed delay (two parameters) might be appropriate for certain regimes, but polynomial distribution (perhaps 1/(a*(x-b)^3), two parameters again) seems better supported by evidence. Others suggested gamma-distribution and a host of heavy-tail distributions. There are certainly at least two independent quantities: the propagation delay and some measure of the queuing delay. I like minimum and median to represent these two. -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ A fool's brain digests philosophy into folly, science into superstition, and art into pedantry. Hence University education. -- G. B. Shaw _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Thu Feb 20 15:24:48 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id PAA28384 for ; Thu, 20 Feb 2003 15:24:48 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KKR4CN027204; Thu, 20 Feb 2003 15:27:04 -0500 Received: from hotmail.com (f81.sea2.hotmail.com [207.68.165.81]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1KKQ7CN027179 for ; Thu, 20 Feb 2003 15:26:07 -0500 Received: from mail pickup service by hotmail.com with Microsoft SMTPSVC; Thu, 20 Feb 2003 12:26:06 -0800 Received: from 193.116.20.220 by sea2fd.sea2.hotmail.msn.com with HTTP; Thu, 20 Feb 2003 20:26:06 GMT X-Originating-IP: [193.116.20.220] From: "gab.seun jones.ewulomi" To: shalunov@internet2.edu, Sandrine.Vaton@enst-bretagne.fr Cc: ippm@advanced.org Subject: Re: [ippm] statistics techniques Mime-Version: 1.0 Content-Type: text/plain; format=flowed Message-ID: X-OriginalArrivalTime: 20 Feb 2003 20:26:06.0932 (UTC) FILETIME=[4C21B940:01C2D91E] X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Thu, 20 Feb 2003 20:26:06 +0000 Hi Guys, First of all my sincere apologies for any mis-understanding I could have caused. I didnt think it would matter to explain my goal because i thought it was a trivial question(thanks Kave for the wise words). I am by no means as clued up as you guys (just a beginner who isnt scared to do some mathematical crunching). Please bear with il just try and explain as my knowledg permits me. This question was a cause of a little discussion/arguement with my boss and I in which I tried to explain that the median of the ping collection we took would make more sense than the mean. first of all we have private network meaning we manage all our links and the isp's do all the switching at the exchange points. So in any case rtt should I say is fairly constant to nodes(sites - assuming taking into consideration transmission and propagation and also assuming no traffic) the only think that could probably bumps up the rtt are queueing or process delays at each hop. What I expect from this test is to find out as Kave.S stated the rtt distribution within the 100 count. Although I definately welcome taking it further as Kave.S and Sandrine.V suggested by being able to predict rtt from past measurements e.g predict rtt in count 101. I will still greatly appreciate any pointers. Taking this into consideration and as Stanislav stated you might get losses which will probably throw away trying to work out the average e.g loss could be > rtt_max. Also I found out when I worked out both the mean and median and mode, they were always usually equal which i think implies that the data are symmetrically distributed(im only assuming within this 100 count in which all the values are not far from the median. They aren't that dispersed). But taking the median took into consideration the skew which was very minimal. Taking the Mean I found out doesnt tell you much about whether there is a fit within a particular range. Taking all this in I automatically assumed the median showed a more true picture. I do agree that delay should be taken into consideration and if we know what delay_max is and if we get delay > delay_max as suggested will certainly be worthy information to know(I havent gone as using bayesian techniques yet to determine what the delay would be). My goal was to find out the differences by comparing means or medians which I believe are both measures of the center of a distribution(please correct me if im wrong). If the data were totally symmetrical distributed(no skews), taking the mean would(i think) be a reliable measure of the center or average. I wanted to graphically illustrate approximate location of the quartiles, including the median, and the extreme values. Basically have short term view of mean rtt as well as median rtt I certainly need to enrich my model as Sandrine.V suggested because I havent taking into account packets that could be lost or delivered at a later time This has gone well beyond me any more pointers will be greatly appreciated regards, seun >From: stanislav shalunov >To: Sandrine Vaton >CC: ippm@advanced.org >Subject: Re: [ippm] statistics techniques >Date: 20 Feb 2003 12:07:11 -0500 > >Sandrine Vaton writes: > > > stanislav shalunov a écrit : > > > > > Sandrine Vaton writes: > > > > > > > SV -> Hum hum I did not get that point. That looks tricky. But, > > > > unless you are in a model with only one parameter (an exponential > > > > distribution for example) the median will not be sufficient to fully > > > > determine the distribution. > > > > > > As would be the mean. > > > > > > But, I didn't even say I make any assumptions about the model. > > > > The problem is that most of the time you need more than one parameter to > > characterize a distribution. For example for a Gaussian distribution you >need > > the mean and the variance, unless you suppose that there is a >relationship > > between mean and variance (for example variance=mean^c with c=...) > >How does this make mean relevant? I am saying that it is a better >practice to report median of delays than attempt to report mean of delays. > > > > > SV -> This is true when the noise is additive with a symetric >distribution > > > > around the origin. > > > > > > Suppose 1% of measurements is distorted (by a very large margin). > > > Median is unlikely to be affected. Mean is. > > > > The median will be affected if you have more than 50% of "censored" > > RTT. I agree with you for saying that with only 1% then the median > > is not affected. > >If more than 50% of packets are lost, you ought to report median=infinity. >If any packets are lost, you ought to report mean=infinity. > >Which one is better? > > > But once again the median is maybe not the only parameter of > > interest. In particular, the distribution of the delays is clearly > > not exponential, is it? > >It is unlikely that packet delay is a random quantity from a >statistical point of view. (There's no probability space, there's a >feedback loop, etc.) Certainly different measurements (taken close >enough) are not independent. > >If one were to model delay as an i.i.d. random quantity, then shifted >exponentially distributed delay (two parameters) might be appropriate >for certain regimes, but polynomial distribution (perhaps >1/(a*(x-b)^3), two parameters again) seems better supported by >evidence. Others suggested gamma-distribution and a host of >heavy-tail distributions. > >There are certainly at least two independent quantities: the >propagation delay and some measure of the queuing delay. I like >minimum and median to represent these two. > >-- >Stanislav Shalunov http://www.internet2.edu/~shalunov/ > >A fool's brain digests philosophy into folly, science into superstition, >and art into pedantry. Hence University education. -- G. B. Shaw >_______________________________________________ >ippm mailing list >ippm@advanced.org >http://mailhost.advanced.org/mailman/listinfo/ippm _________________________________________________________________ Chat online in real time with MSN Messenger http://messenger.msn.co.uk _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Thu Feb 20 21:42:09 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id VAA07028 for ; Thu, 20 Feb 2003 21:42:09 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1L2h5CN005841; Thu, 20 Feb 2003 21:43:05 -0500 Received: from mail.cad.zju.edu.cn (cad.zju.edu.cn [210.32.131.2]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with SMTP id h1L2gcCN005825 for ; Thu, 20 Feb 2003 21:42:42 -0500 Received: (qmail 25751 invoked from network); 21 Feb 2003 02:49:28 -0000 Received: from unknown (HELO cad.zju.edu.cn) (210.32.131.97) by 210.32.131.2 with SMTP; 21 Feb 2003 02:49:28 -0000 Message-ID: <3E559261.246E1216@cad.zju.edu.cn> From: Jing Shen Reply-To: jshen@cad.zju.edu.cn Organization: State Key Lab of CAD&CG X-Mailer: Mozilla 4.79 [en] (X11; U; SunOS 5.6 sun4u) X-Accept-Language: en MIME-Version: 1.0 To: stanislav shalunov CC: Sandrine Vaton , ippm@advanced.org Subject: Re: [ippm] statistics techniques References: <87isvhmbn9.fsf@cain.internet2.edu> <3E53775C.7B1F19B@enst-bretagne.fr> <87of57lko2.fsf@cain.internet2.edu> <3E54DB0E.CA5C2D2E@enst-bretagne.fr> <87of57j5ct.fsf@cain.internet2.edu> <3E550222.3633D4DB@enst-bretagne.fr> <8765rekhj4.fsf@cain.internet2.edu> Content-Type: text/plain; charset=gb2312 Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Fri, 21 Feb 2003 10:43:45 +0800 Content-Transfer-Encoding: 7bit The RTT value is at least related to two factors: the time of measurement and the status of network. To some of the measurement, RTT reaches its bigest value at 9-10 o'clock and 15-16 o'clock, and the lowest value is reached at 3-5 o'clock. So it's self-similar, and from viewpoint of statics mathematical expectation should be value we need. In a 100 sample points measurement, it may be a better choice to take the median value if the measurement time is fixed. >It is unlikely that packet delay is a random quantity from a >statistical point of view. (There's no probability space, there's a >feedback loop, etc.) Certainly different measurements (taken close >enough) are not independent. >If one were to model delay as an i.i.d. random quantity, then shifted >exponentially distributed delay (two parameters) might be appropriate >for certain regimes, but polynomial distribution (perhaps >1/(a*(x-b)^3), two parameters again) seems better supported by >evidence. Others suggested gamma-distribution and a host of >heavy-tail distributions. >There are certainly at least two independent quantities: the >propagation delay and some measure of the queuing delay. I like >minimum and median to represent these two. -- Jing Shen ********************************************************************** * The SunShine of life is made up of very little beams which is * * bright all the time * ********************************************************************** _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Fri Feb 21 08:32:55 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id IAA28890 for ; Fri, 21 Feb 2003 08:32:55 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1LDJ4CN021205; Fri, 21 Feb 2003 08:19:05 -0500 Received: from laposte.enst-bretagne.fr (laposte.enst-bretagne.fr [192.108.115.3]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1LDIACN021186 for ; Fri, 21 Feb 2003 08:18:11 -0500 Received: from antares.enst-bretagne.fr (antares.enst-bretagne.fr [192.44.75.8]) by laposte.enst-bretagne.fr (8.11.6/8.11.6) with ESMTP id h1LDIGr25753; Fri, 21 Feb 2003 14:18:16 +0100 Received: from enst-bretagne.fr (taureau-tse.enst-bretagne.fr [192.44.75.100]) by antares.enst-bretagne.fr (8.11.6/8.11.6) with ESMTP id h1LDI8a21053; Fri, 21 Feb 2003 14:18:08 +0100 (MET) Message-ID: <3E562657.CC4C2DE3@enst-bretagne.fr> From: Sandrine Vaton X-Mailer: Mozilla 4.75 [fr] (Windows NT 5.0; U) X-Accept-Language: fr MIME-Version: 1.0 To: stanislav shalunov CC: ippm@advanced.org Subject: Re: [ippm] statistics techniques References: <87isvhmbn9.fsf@cain.internet2.edu> <3E53775C.7B1F19B@enst-bretagne.fr> <87of57lko2.fsf@cain.internet2.edu> <3E54DB0E.CA5C2D2E@enst-bretagne.fr> <87of57j5ct.fsf@cain.internet2.edu> <3E550222.3633D4DB@enst-bretagne.fr> <8765rekhj4.fsf@cain.internet2.edu> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by amavisd-milter (http://amavis.org/) at enst-bretagne.fr Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Fri, 21 Feb 2003 14:15:04 +0100 Content-Transfer-Encoding: 7bit > > > > > The problem is that most of the time you need more than one parameter to > > characterize a distribution. For example for a Gaussian distribution you need > > the mean and the variance, unless you suppose that there is a relationship > > between mean and variance (for example variance=mean^c with c=...) > > How does this make mean relevant? I am saying that it is a better > practice to report median of delays than attempt to report mean of delays. > SV -> I think that we do not understand each other. What I was saying is that only *one* parameter is generally not enough to characterize the distribution of the delays. > If more than 50% of packets are lost, you ought to report median=infinity. > If any packets are lost, you ought to report mean=infinity. > > Which one is better? > SV -> No. There ARE ways of estimating the finite mean (or median) even if a majority of packets are lost. And the estimate will not be infinite (fortunately...). For example the proportion of packets for which you do not have the rtt gives you a lot of information on the parameters of the distribution of delays (this proportion is a quartile of the distribution). > It is unlikely that packet delay is a random quantity from a > statistical point of view. (There's no probability space, there's a > feedback loop, etc.) Certainly different measurements (taken close > enough) are not independent. > SV -> Here we come to an agreement. The successive measurements should not be considered as independent. I am completely in favor of tha point of view and I have been defending that point of view for years! From my simulations I even found out that most of the time a Hidden Markov Model (HMM) was a valuable approach. Broadly speaking the channel can be considered as a finite state random machine (a Markov chain) with 4 or 5 states and the distribution of the delay depends on the state of the channel at present. This enriched model should not prevent you from defining a distribution for the delay. In the case of a HMM this distribution is a weighted mixture of the component distributions (the weights being defined by the stationary regime of the "underlying" Markov chain, that is to say the the channel). See my Web page http://perso-info.enst-bretagne.fr/~vaton for a series of publications in that sense. I also made available some software that I wrote for training the parameters of a HMM on a series of packet loss as well as some MCMC algorithms for various applications in network characterization. > > If one were to model delay as an i.i.d. random quantity, then shifted > exponentially distributed delay (two parameters) might be appropriate > for certain regimes, but polynomial distribution (perhaps > 1/(a*(x-b)^3), two parameters again) seems better supported by > evidence. Others suggested gamma-distribution and a host of > heavy-tail distributions. > You can choose any law you want! You can even define the distribution by an analytical formula even if it does not correspond to a well known distribution ( -x^2 cos(x) + 3 x sin (x)+3800 is not forbidden if you feel that it better fits your empirical distribution...) Kind regards, Sandrine Vaton. _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Fri Feb 21 12:40:31 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id MAA08377 for ; Fri, 21 Feb 2003 12:40:31 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1LHh4CN029399; Fri, 21 Feb 2003 12:43:05 -0500 Received: from hotmail.com (f24.sea2.hotmail.com [207.68.165.24]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1LHgICN029372 for ; Fri, 21 Feb 2003 12:42:18 -0500 Received: from mail pickup service by hotmail.com with Microsoft SMTPSVC; Fri, 21 Feb 2003 09:42:17 -0800 Received: from 193.116.20.220 by sea2fd.sea2.hotmail.msn.com with HTTP; Fri, 21 Feb 2003 17:42:15 GMT X-Originating-IP: [193.116.20.220] From: "gab.seun jones.ewulomi" To: jshen@cad.zju.edu.cn, shalunov@internet2.edu Cc: Sandrine.Vaton@enst-bretagne.fr, ippm@advanced.org Subject: Re: [ippm] statistics techniques Mime-Version: 1.0 Content-Type: text/plain; format=flowed Message-ID: X-OriginalArrivalTime: 21 Feb 2003 17:42:17.0978 (UTC) FILETIME=[94081DA0:01C2D9D0] X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Fri, 21 Feb 2003 17:42:15 +0000 hi, I presume thats why I chose to use the median because i was just using 100 counts as by base measurement. The time is a big factor because as you rightly stated even if the rtt reached a max at time t and reached a minimum at time t. I will certain like to know about the rtt at especially the max t time. Assuming I will start doing counts=100 at 2hr intervals =1200 counts per day. So will taken the mean, median, max rtt, min rtt be a good starting point. Also will taking the variance for like chunks of the samples e.g for every daily sample of 1200 count take the variance sample size(count)<500 daily(from the daily samples) give me the spread of a distribution about its average value within a set of sample data or is there a better way to approach this regards, gab >From: Jing Shen Reply-To: jshen@cad.zju.edu.cn To: stanislav shalunov CC: >Sandrine Vaton , ippm@advanced.org Subject: Re: [ippm] statistics >techniques Date: Fri, 21 Feb 2003 10:43:45 +0800 > >The RTT value is at least related to two factors: the time of measurement >and the status of network. To some of the measurement, RTT reaches its >bigest value at 9-10 o'clock and 15-16 o'clock, and the lowest value is >reached at 3-5 o'clock. So it's self-similar, and from viewpoint of statics >mathematical expectation should be value we need. > >In a 100 sample points measurement, it may be a better choice to take the >median value if the measurement time is fixed. > > > > > >It is unlikely that packet delay is a random quantity from a >statistical >point of view. (There's no probability space, there's a >feedback loop, >etc.) Certainly different measurements (taken close >enough) are not >independent. > > >If one were to model delay as an i.i.d. random quantity, then shifted > >exponentially distributed delay (two parameters) might be appropriate > >for certain regimes, but polynomial distribution (perhaps >1/(a*(x-b)^3), >two parameters again) seems better supported by >evidence. Others suggested >gamma-distribution and a host of >heavy-tail distributions. > > >There are certainly at least two independent quantities: the >propagation >delay and some measure of the queuing delay. I like >minimum and median to >represent these two. > > >-- >Jing Shen > > > > >********************************************************************** * >The SunShine of life is made up of very little beams which is * * bright >all the time * >********************************************************************** >_______________________________________________ ippm mailing list >ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm _________________________________________________________________ It's fast, it's easy and it's free. Get MSN Messenger today! http://messenger.msn.co.uk _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Wed Feb 26 10:54:00 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id KAA13043 for ; Wed, 26 Feb 2003 10:53:59 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1QFqXCN022585; Wed, 26 Feb 2003 10:52:35 -0500 Received: from isis.lip6.fr (isis.lip6.fr [132.227.60.2]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1JIfuCO014763 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=FAIL) for ; Wed, 19 Feb 2003 13:41:59 -0500 Received: from tibre.lip6.fr (tibre.lip6.fr [132.227.74.2]) by isis.lip6.fr (8.12.4/jtpda-5.4+victor) with ESMTP id h1JIfsVR009806 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=NO) for ; Wed, 19 Feb 2003 19:41:54 +0100 X-pt: isis.lip6.fr Received: from LIP60MU1PINK59 (rp-dhcp2 [132.227.61.202]) by tibre.lip6.fr (8.11.6/8.11.3) with SMTP id h1JIfr309560 for ; Wed, 19 Feb 2003 19:41:53 +0100 (MET) From: =?iso-8859-1?Q?Kav=E9_Salamatian?= To: Subject: RE: [ippm] statistics techniques Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2911.0) X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2600.0000 Importance: Normal X-Scanned-By: isis.lip6.fr X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Wed, 19 Feb 2003 19:41:09 +0100 Content-Transfer-Encoding: 7bit >I can not speak for the original poster, but since you appear to be >addressing me while (not?) answering his questions: Not only, but the community. I think that the kind of trivial question I am asking are not so trivial and they will shed some light on what we are doing and on what is asked. >1. The values of delay for lost packets are not ``missing''. They are > potentially very large unknowable values. That packet that I sent > last year and that appeared to be lost might still be delivered one > day. Some of the inexisting values are indeed missing (relative to real packet loss). Some of them are censored values. The two problems are well known and well documented. It suffices to have a look to a good introductory level statistical book. >2. The necessity for aggregation is more about human consumption of > data than about using it to predict anything or to compute > parameters of a distribution (there's no distribution). Correct. The Occam's razor, which is attributed to the mediaeval philosopher William of Occam (living in 15th century in the oldish europe), underlies that in all scientific modelling and theory building we should choose from a set of otherwise equivalent models of a given phenomenon the simplest one. However using this razor should be done with some cautions (as using any razor). By aggregating are you not loosing something essential ?? Clearly the statistical mean, mode, median, is not a universal aggregation tools. In fact using the mean, mode or median as a aggregation tools pre suppose (even if you are not aware of this, you are doing it) that you can describe the compressed (aggregated observation) in only this value. Clearly there is only one case that this is a valid assumption, the poisson pdf. Out of this you need at least the variance, you will have a parametric a priori which is the gaussian. You are saying there is no distribution. But if you are in the real world there is always distribution, and every computation is an estimation, and for every estimation there is a statistical test. By using the mean, median or mode as an aggregation parameter, what is the statistical test.... If you think, you will see that the statistical test is "H0: The estimated mean, median or mode is the parameter of a model describing the measurements". In every test you have an associated risk. The risk is relative to the application you are doing of the test results. Let's suppose that I calculate the mean and I erase the measurement, now I use only the mean to replace the erased values. Now if I use a quadratic risk function, my risk is asymptotycally converging (under stationnarity and ergodicity conditions) to the variance of the measured parameter. Is this risk acceptable? Sometimes, yes, sometimes not. This is why the aggregation question has not any universal answer (out of classical non lossy compression schemes as Lempel Ziv and so). If arbitrary answer is possible I would rather like and estimate the first derivative of the Characteristic function calculated at s=0. It is a more pedantic and funnier aggregation parameter :-))) > Minimum (or something close to it) is meaningful in itself: given enough > measurements, it's a reasonable guess of propagation delay. Great. You have in mind a parametric model that the observed delay is the summation of the propagation delay and a positive perturbation parameter (let say it n). Your estimator is the minimal value oberved over N observations and your associated risk with a quadratic risk function is converging (under the same stationnarity and ergodicity constraints) to E{Min{d_1, ..., D_N}}. > Median is useful for several reasons: > > > a. It reflects the whole sample. It reflects only the mean aspect of the sample, not the whole sample. > b. It is well-defined for samples where more than 50% of packets > arrived during the measurement (thus making it widely usable). It is well defined whenever one measurment is avaiable, however the risk induced by using this estimate of the mean can be large if a quadratic criteria is used and less than 50% of packets arrived during the measurements. > c. It is robust. To what kind of problem. Let suppose that I have a network which have two set of routing table. One for night and one for days. Routing change every night at 8 PM sharp and 8 AM Sharp. I have regularly measured the delay from 9 AM to 9 PM. Now is median robust to this? Clearly median, mode and mean are not robust. > d. It is easy to understand. -- Stanislav Shalunov http://www.internet2.edu/~shalunov/ A fanatic is one who can't change his mind and won't change the subject. -- Winston Churchill _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Fri Feb 28 08:13:44 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id IAA26210 for ; Fri, 28 Feb 2003 08:13:43 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1SDG4CN031205; Fri, 28 Feb 2003 08:16:04 -0500 Received: from basie.internet2.edu (basie.internet2.edu [207.75.164.22]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1SDFTCN031189 for ; Fri, 28 Feb 2003 08:15:29 -0500 Received: from localhost (localhost.localdomain [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 506367B4B7; Fri, 28 Feb 2003 08:15:29 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by basie.internet2.edu (Postfix) with ESMTP id 66AA87B493; Fri, 28 Feb 2003 08:15:28 -0500 (EST) To: Allison Mankin Cc: ippm@advanced.org Subject: Re: [ippm] IESG review of draft-ietf-ippm-owdp-reqs-04.txt References: From: stanislav shalunov In-Reply-To: Message-ID: <874r6omtqo.fsf@cain.internet2.edu> Lines: 32 X-Mailer: Gnus v5.7/Emacs 20.4 X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS 0.3.12pre8 Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: 28 Feb 2003 08:15:27 -0500 http://www.internet2.edu/~shalunov/ippm/draft-ietf-ippm-owdp-reqs-05.txt has been submitted to the internet-drafts repository. Its purpose is to address replay attack issues raised in Steve Bellovin's security review. To save you the trouble of digging it out and running diff, the following substantially new text was included: 6.6. Replay Attacks OWAMP-Control must be resistant to any replay attacks. OWAMP-Test, on the other hand, is a protocol for network measurement. One of the attributes of networks is packet duplication. OWAMP-Test has to be suitable for measurement of duplication. This would make it vulnerable to attacks that involve replaying a recent packet. For the recipient of such a packet it is impossible to determine whether the duplication is malicious or naturally occurring. OWAMP-Test should measure all duplication -- malicious or otherwise. Note that this is similar to delay attacks: an attacker can hold up a packet for some short period of time and then release it to continue on its way to the recipient. There's no way such delay can be reliably distinguished from naturally occuring delay by the recipient. OWAMP-Test should measure the network as it was. Note, however, that this does not prevent the data from being sanitized at a later stage of processing, analysis, or consumption. Some sanity checks (those that are deemed reliable and erring on the side of inclusion) should be performed by OWAMP-Test recipient immediately. _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Fri Feb 28 19:09:23 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id TAA17737 for ; Fri, 28 Feb 2003 19:09:23 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h21095CN018421; Fri, 28 Feb 2003 19:09:05 -0500 Received: from mesa.acns.ColoState.EDU (mesa.acns.colostate.edu [129.82.100.130]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h2108FCN018405 for ; Fri, 28 Feb 2003 19:08:16 -0500 Received: from lamar.colostate.edu (lamar.acns.colostate.edu [129.82.100.75]) by mesa.acns.ColoState.EDU (AIX4.3/8.9.3/8.9.3) with ESMTP id RAA23732; Fri, 28 Feb 2003 17:08:15 -0700 Received: from engr.colostate.edu (res097074.halls.colostate.edu [129.82.97.74] (may be forged)) by lamar.colostate.edu (AIX5.1/8.11.0/8.8.8) with ESMTP id h21087g566894; Fri, 28 Feb 2003 17:08:07 -0700 Message-ID: <3E5FFA02.3090600@engr.colostate.edu> From: Nischal Piratla User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.0.1) Gecko/20021003 X-Accept-Language: en-us, en MIME-Version: 1.0 To: stanislav shalunov CC: ippm@advanced.org, Anura Jayasumana , Abhijit A Bare Subject: Re: [ippm] New metric for packet reordering References: <3E545AB2.1080108@engr.colostate.edu> <87r8a3j5it.fsf@cain.internet2.edu> Content-Type: multipart/alternative; boundary="------------020603070408050403010202" X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Fri, 28 Feb 2003 17:08:34 -0700 --------------020603070408050403010202 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Stanislav, Thank you for the comments. Here are the clarifications. > It seems that: > > * When `late' packets are encountered, your metric behaves like > N-reordering; > > * When `early' packets are encountered, your metric reports same > degree of reordering as N-reordering, but larger number of packets > are reported as reordered; > RD algorithm does not behave like N-reordering. Here are just a couple of simple examples: Example 1: For the sequence <1,4,5,2,3> RD output: displacement absolute normalized 0 2 0.400 1 1 0.200 2 2 0.400 3 0 0.000 4 0 0.000 N-reordering output: 1-reordering = 25.000000% 2-reordering = 33.333333% no 3-reordering 1-reordering = 1 2-reordering = 1 no 3-reordering In this sequence, RD shows that there are two packets with F[D=2] namely seq #s: 5 and 2. N-reordering treats only packet 2 as 1-reordered and 2-reordered. According to RD, even after seq # 2 arrives the buffer requirement is '2' as seq #. 3 has not yet arrived. However, this conclusion cannot be derived from N-reordering. Example 2: For the sequence <1,2,3,4,5,2,1> RD output: displacement absolute normalized 0 7 1.000 1 0 0.000 2 0 0.000 3 0 0.000 N-reordering output: 1-reordering = 33.333333% 2-reordering = 40.000000% 3-reordering = 50.000000% 4-reordering = 33.333333% 5-reordering = 50.000000% no 6-reordering 1-reordering = 2 2-reordering = 2 3-reordering = 2 4-reordering = 1 5-reordering = 1 no 6-reordering In this example, the N-reordering algo shows that there is 5-reordering. If you look at the sequence there are two duplicate packets namely, seq#s 2 & 1. In RD, the F[D] does not exist for D>0 i.e., there is no reordering. As one can see, the sequence has no reordering. ************************************** > * When there are any missing packets, it reports high degrees of > reordering for a whole bunch of packets. > > This last is a show-stopper as far as I am concerned. > RD has a concept of DT i.e., threshold after which the packet is assumed lost. This takes care of the above issue. Moreover, we compared it with existing N-reordering for a sequence where the seq #2 comes after 40 packets, then N-reordering shows very high reordering. Here is the sequence Sequence: <1,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,2> RD output with DT = 5: displacement absolute normalized 0 36 0.878 1 1 0.024 2 1 0.024 3 1 0.024 4 1 0.024 5 1 0.024 N-reordering output: 1-reordering = 2.500000% 2-reordering = 2.564103% 3-reordering = 2.631579% 4-reordering = 2.702703% 5-reordering = 2.777778% 6-reordering = 2.857143% 7-reordering = 2.941176% 8-reordering = 3.030303% 9-reordering = 3.125000% 10-reordering = 3.225806% 11-reordering = 3.333333% 12-reordering = 3.448276% 13-reordering = 3.571429% 14-reordering = 3.703704% 15-reordering = 3.846154% 16-reordering = 4.000000% 17-reordering = 4.166667% 18-reordering = 4.347826% 19-reordering = 4.545455% 20-reordering = 4.761905% 21-reordering = 5.000000% 22-reordering = 5.263158% 23-reordering = 5.555556% 24-reordering = 5.882353% 25-reordering = 6.250000% 26-reordering = 6.666667% 27-reordering = 7.142857% 28-reordering = 7.692308% 29-reordering = 8.333333% 30-reordering = 9.090909% 31-reordering = 10.000000% 32-reordering = 11.111111% 33-reordering = 12.500000% 34-reordering = 14.285714% 35-reordering = 16.666667% 36-reordering = 20.000000% 37-reordering = 25.000000% 38-reordering = 33.333333% 39-reordering = 50.000000% no 40-reordering This example clearly shows that N-reordering is much more susceptible to delayed packets as it cannot treat them as lost when their useful life is over, whereas with RD this is taken care of. So we have to disagree with the above statement That certainly eliminates RD metric from show-stopper's list. Please feel free to send more comments so that we can make this metric more useful for everyone. Thank You, Nischal *********************************************** Research Assistant Computer Networking Research Laboratory Department of Electrical and Computer Eng. Colorado State University, Fort Collins, CO 80523 Voice: +1 970-491-7974 Fax: +1 970-491-2249 http://www.engr.colostate.edu/ece/Research/cnrl *********************************************** stanislav shalunov wrote: >Nischal M Piratla writes: > > > >>http://www.engr.colostate.edu/ece/Research/cnrl/code/RD.c >> >> > >Nischal, > >It seems that: > >* When `late' packets are encountered, your metric behaves like > N-reordering; > >* When `early' packets are encountered, your metric reports same > degree of reordering as N-reordering, but larger number of packets > are reported as reordered; > >* When there are any missing packets, it reports high degrees of > reordering for a whole bunch of packets. > >This last is a show-stopper as far as I am concerned. > > > --------------020603070408050403010202 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit Stanislav,
Thank you for the comments. Here are the clarifications.

It seems that:

* When `late' packets are encountered, your metric behaves like
 N-reordering;

* When `early' packets are encountered, your metric reports same
 degree of reordering as N-reordering, but larger number of packets
 are reported as reordered;

RD algorithm does not behave like N-reordering. Here are just  a couple of simple  examples:

Example 1:
For the sequence <1,4,5,2,3>
RD output:
displacement absolute normalized
0 2 0.400
1 1 0.200
2 2 0.400
3 0 0.000
4 0 0.000


N-reordering output:
1-reordering = 25.000000%
2-reordering = 33.333333%
no 3-reordering

1-reordering = 1
2-reordering = 1
no 3-reordering

In this sequence, RD shows that there are two packets with F[D=2] namely seq #s: 5 and 2. N-reordering treats only packet 2 as 1-reordered and 2-reordered. According to RD, even after seq # 2 arrives the buffer requirement is '2' as seq #. 3 has not yet arrived. However, this conclusion cannot be derived from N-reordering.
   
    Example 2:
For the sequence <1,2,3,4,5,2,1>
RD output:
displacement absolute normalized
0 7 1.000
1 0 0.000
2 0 0.000
3 0 0.000

N-reordering output:
1-reordering = 33.333333%
2-reordering = 40.000000%
3-reordering = 50.000000%
4-reordering = 33.333333%
5-reordering = 50.000000%
no 6-reordering


1-reordering = 2
2-reordering = 2
3-reordering = 2
4-reordering = 1
5-reordering = 1
no 6-reordering

In this example, the N-reordering algo shows that there is 5-reordering. If you look at the sequence there are two duplicate packets namely, seq#s 2 & 1. In RD, the F[D] does not exist for D>0 i.e., there is no reordering. As one can see, the sequence has no reordering.

**************************************
* When there are any missing packets, it reports high degrees of
 reordering for a whole bunch of packets.

This last is a show-stopper as far as I am concerned.

RD has a concept of DT i.e., threshold after which the packet is assumed lost. This  takes care of the above issue. Moreover, we compared it with existing N-reordering for a sequence where the seq #2 comes after 40 packets, then N-reordering shows very high reordering. Here is the sequence

Sequence: <1,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,2>

RD output with DT = 5:
displacement absolute normalized
0 36 0.878
1 1 0.024
2 1 0.024
3 1 0.024
4 1 0.024
5 1 0.024


N-reordering output:

1-reordering = 2.500000%
2-reordering = 2.564103%
3-reordering = 2.631579%
4-reordering = 2.702703%
5-reordering = 2.777778%
6-reordering = 2.857143%
7-reordering = 2.941176%
8-reordering = 3.030303%
9-reordering = 3.125000%
10-reordering = 3.225806%
11-reordering = 3.333333%
12-reordering = 3.448276%
13-reordering = 3.571429%
14-reordering = 3.703704%
15-reordering = 3.846154%
16-reordering = 4.000000%
17-reordering = 4.166667%
18-reordering = 4.347826%
19-reordering = 4.545455%
20-reordering = 4.761905%
21-reordering = 5.000000%
22-reordering = 5.263158%
23-reordering = 5.555556%
24-reordering = 5.882353%
25-reordering = 6.250000%
26-reordering = 6.666667%
27-reordering = 7.142857%
28-reordering = 7.692308%
29-reordering = 8.333333%
30-reordering = 9.090909%
31-reordering = 10.000000%
32-reordering = 11.111111%
33-reordering = 12.500000%
34-reordering = 14.285714%
35-reordering = 16.666667%
36-reordering = 20.000000%
37-reordering = 25.000000%
38-reordering = 33.333333%
39-reordering = 50.000000%
no 40-reordering

This example clearly shows that N-reordering is much more susceptible to delayed packets as it cannot treat them as lost when their useful life is over, whereas with RD this is taken care of.  So we have to disagree with the above statement That certainly eliminates RD metric from show-stopper's list.

Please feel free to send more comments so that we can make this metric more useful for everyone. 
Thank You,
Nischal

***********************************************
Research Assistant
Computer Networking Research Laboratory
Department of Electrical and Computer Eng.
Colorado State University,
Fort Collins, CO 80523
Voice: +1 970-491-7974
Fax:   +1 970-491-2249
http://www.engr.colostate.edu/ece/Research/cnrl
***********************************************

stanislav shalunov wrote:
Nischal M Piratla <nischal@engr.colostate.edu> writes:

  
http://www.engr.colostate.edu/ece/Research/cnrl/code/RD.c
    

Nischal,

It seems that:

* When `late' packets are encountered, your metric behaves like
  N-reordering;

* When `early' packets are encountered, your metric reports same
  degree of reordering as N-reordering, but larger number of packets
  are reported as reordered;

* When there are any missing packets, it reports high degrees of
  reordering for a whole bunch of packets.

This last is a show-stopper as far as I am concerned.

  


--------------020603070408050403010202-- _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm From ippm-admin@advanced.org Fri Feb 28 21:40:16 2003 Received: from mailhost.advanced.org (root@mailhost.advanced.org [12.29.241.3]) by ietf.org (8.9.1a/8.9.1a) with ESMTP id VAA20632 for ; Fri, 28 Feb 2003 21:40:16 -0500 (EST) Received: from mailhost.advanced.org (localhost [127.0.0.1]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h212V4CN022159; Fri, 28 Feb 2003 21:31:04 -0500 Received: from jaguar.icir.org (jaguar.icir.org [192.150.187.74]) by mailhost.advanced.org (8.12.6/8.12.6/Debian-8) with ESMTP id h1SLG8CO013381 (version=TLSv1/SSLv3 cipher=EDH-RSA-DES-CBC3-SHA bits=168 verify=NO) for ; Fri, 28 Feb 2003 16:16:09 -0500 Received: from jaguar.icir.org (localhost [127.0.0.1]) by jaguar.icir.org (8.12.3/8.12.3) with ESMTP id h1SLG73I085982 for ; Fri, 28 Feb 2003 13:16:07 -0800 (PST) (envelope-from vern@jaguar.icir.org) Message-Id: <200302282116.h1SLG73I085982@jaguar.icir.org> To: ippm@advanced.org From: Vern Paxson X-Virus-Scanned: by AMaViS-ng (Milter interface) X-Virus-Scanned: by AMaViS-ng (Milter interface) Subject: [ippm] Internet Measurement Conference 2003 call for papers now available Sender: ippm-admin@advanced.org Errors-To: ippm-admin@advanced.org X-BeenThere: ippm@advanced.org X-Mailman-Version: 2.0.12 Precedence: bulk List-Help: List-Post: List-Subscribe: , List-Id: IETF IP Performance Metrics Working Group List List-Unsubscribe: , List-Archive: Date: Fri, 28 Feb 2003 13:16:07 -0800 [apologies for multiple copies] The Internet Measurement Conference 2003 will be held October 27-29, 2003 in Miami, USA. This is the continuation of the 2001 and 2002 Internet Measurement Workshops. If potentially interested, please see the call for papers at: http://www.icir.org/vern/imc-2003/ Key dates: submissions due May 16 (must be registered by May 9), notification July 18, camera-ready due August 22. For questions relating to the program, contact the program committee chair, Mark Crovella . _______________________________________________ ippm mailing list ippm@advanced.org http://mailhost.advanced.org/mailman/listinfo/ippm