Return-path: Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1J3J3N-0000xs-Bo; Fri, 14 Dec 2007 17:30:45 -0500 Received: from pmol by megatron.ietf.org with local (Exim 4.43) id 1J3J3M-0000xm-FF for pmol-confirm+ok@megatron.ietf.org; Fri, 14 Dec 2007 17:30:44 -0500 Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1J3J3F-0000uU-53; Fri, 14 Dec 2007 17:30:37 -0500 Received: from mail164.messagelabs.com ([216.82.253.131]) by ietf-mx.ietf.org with smtp (Exim 4.43) id 1J3J3E-0002sp-NC; Fri, 14 Dec 2007 17:30:37 -0500 X-VirusChecked: Checked X-Env-Sender: daryl@level3.net X-Msg-Ref: server-6.tower-164.messagelabs.com!1197671434!5544938!3 X-StarScan-Version: 5.5.12.14.2; banners=-,-,- X-Originating-IP: [209.245.18.106] Received: (qmail 2797 invoked from network); 14 Dec 2007 22:30:35 -0000 Received: from unknown.level3.net (HELO f10bb8-10) (209.245.18.106) by server-6.tower-164.messagelabs.com with SMTP; 14 Dec 2007 22:30:35 -0000 Received: from montag.eng.level3.com (montag.eng.l3.com [10.1.68.57]) by f10bb8-10 (Postfix) with ESMTP id 6D7354441; Fri, 14 Dec 2007 22:30:35 +0000 (GMT) Subject: [PMOL] SIP End-to-End Performance Metrics From: Daryl Malas To: pmol@ietf.org Content-Type: text/plain Date: Fri, 14 Dec 2007 15:42:06 -0700 Message-Id: <1197672127.7806.53.camel@montag.eng.level3.com> Mime-Version: 1.0 X-Mailer: Evolution 2.6.0 (2.6.0-1) Content-Transfer-Encoding: 7bit X-Spam-Score: -4.0 (----) X-Scan-Signature: 2409bba43e9c8d580670fda8b695204a Cc: sipping@ietf.org X-BeenThere: pmol@ietf.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance Metrics at Other Layers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: pmol-bounces@ietf.org At the conference, I introduced the SIP End-to-End Performance Metrics draft (draft-malas-performance-metrics-08) to the PMOL working group. Although this draft is referenced in the PMOL WG charter, I wanted to ask everyone to review the draft and provide feedback of whether or not you feel the current version is ready for the WG to accept as a working group item. A couple of questions came up, which I think should be answered regarding this consideration: Is the SIPPING WG content with the current set of metrics? Are there too many? Do these metrics capture the relevant concerns of performance regarding the SIP protocol? Are these metrics depicted accurately from a SIP protocol perspective? In addition to these questions, I have a couple of tasks from the PMOL group to include in the next revision. Here is a link to the draft: http://www.ietf.org/internet-drafts/draft-malas-performance-metrics-08.txt Thanks... Daryl _______________________________________________ PMOL mailing list PMOL@ietf.org https://www1.ietf.org/mailman/listinfo/pmol Return-path: Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1J0NHX-00057y-Jd; Thu, 06 Dec 2007 15:25:15 -0500 Received: from pmol by megatron.ietf.org with local (Exim 4.43) id 1J0NHW-00057p-GJ for pmol-confirm+ok@megatron.ietf.org; Thu, 06 Dec 2007 15:25:14 -0500 Received: from [10.90.34.44] (helo=chiedprmail1.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1J0NHW-00057h-6B for pmol@ietf.org; Thu, 06 Dec 2007 15:25:14 -0500 Received: from mail29.messagelabs.com ([216.82.249.147]) by chiedprmail1.ietf.org with smtp (Exim 4.43) id 1J0NHV-0003pT-OC for pmol@ietf.org; Thu, 06 Dec 2007 15:25:14 -0500 X-VirusChecked: Checked X-Env-Sender: daryl@level3.net X-Msg-Ref: server-15.tower-29.messagelabs.com!1196972710!764987!7 X-StarScan-Version: 5.5.12.14.2; banners=-,-,- X-Originating-IP: [209.245.18.106] Received: (qmail 15857 invoked from network); 6 Dec 2007 20:25:12 -0000 Received: from unknown.level3.net (HELO f10bb8-10) (209.245.18.106) by server-15.tower-29.messagelabs.com with SMTP; 6 Dec 2007 20:25:12 -0000 Received: from montag.eng.level3.com (montag.eng.l3.com [10.1.68.57]) by f10bb8-10 (Postfix) with ESMTP id BB2B24441 for ; Thu, 6 Dec 2007 20:25:12 +0000 (GMT) Subject: [PMOL] SIP Perf Metrics Draft -08 From: Daryl Malas To: pmol@ietf.org Content-Type: text/plain Date: Thu, 06 Dec 2007 13:36:12 -0700 Message-Id: <1196973373.7806.17.camel@montag.eng.level3.com> Mime-Version: 1.0 X-Mailer: Evolution 2.6.0 (2.6.0-1) Content-Transfer-Encoding: 7bit X-Spam-Score: 0.0 (/) X-Scan-Signature: 30ac594df0e66ffa5a93eb4c48bcb014 X-BeenThere: pmol@ietf.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance Metrics at Other Layers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: pmol-bounces@ietf.org I apologize, but I realized the SIP Performance Metrics draft had become expired while we determined the appropriate home (now PMOL) for it. I submitted a new revision this morning for reference during this afternoon's session. http://www.ietf.org/internet-drafts/draft-malas-performance-metrics-08.txt --Daryl _______________________________________________ PMOL mailing list PMOL@ietf.org https://www1.ietf.org/mailman/listinfo/pmol Return-path: Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1J0MVr-0001GC-2w; Thu, 06 Dec 2007 14:35:59 -0500 Received: from pmol by megatron.ietf.org with local (Exim 4.43) id 1J0MVp-0001G2-BF for pmol-confirm+ok@megatron.ietf.org; Thu, 06 Dec 2007 14:35:57 -0500 Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1J0MVp-0001Fs-1e for pmol@ietf.org; Thu, 06 Dec 2007 14:35:57 -0500 Received: from umi.kikuken.org ([202.126.16.27] helo=ari.kikuken.org) by ietf-mx.ietf.org with smtp (Exim 4.43) id 1J0MVm-0002eG-SD for pmol@ietf.org; Thu, 06 Dec 2007 14:35:57 -0500 Received: (qmail 21637 invoked from network); 7 Dec 2007 04:35:52 +0900 Received: from unknown (HELO localhost) (218.100.15.124) by umi.kikuken.org with SMTP; 7 Dec 2007 04:35:52 +0900 Date: Fri, 07 Dec 2007 04:35:50 +0900 (JST) Message-Id: <20071207.043550.249533965.yu@kikuken.org> To: alan.d.clark@telchemy.com Subject: Re: [PMOL] FW: draft-morton-perf-metrics-framework-01 From: KIKUCHI Yutaka In-Reply-To: <20071206175751.187B54DC00B@mail.globalsuite.net> References: <20071206175751.187B54DC00B@mail.globalsuite.net> Organization: Kochi Univ. of Tech. X-Mailer: Mew version 4.2.53 on Emacs 22.0.50 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Spam-Score: 0.0 (/) X-Scan-Signature: bdc523f9a54890b8a30dd6fd53d5d024 Cc: zin@jaist.ac.jp, ogashiwa@noware.co.jp, satoru@ft.solteria.net, pmol@ietf.org, nagami@inetcore.com X-BeenThere: pmol@ietf.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance Metrics at Other Layers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: pmol-bounces@ietf.org Alan, and folks, Here is a brief report of our experience of the framework I-D. Sorry for the message just before the PMOL meeting. Totally, the framework was useful to check our draft. I want that some points will be more strictly described because results of the test might includes arbitrary evaluations. For example, in "the tests of the usefulness" of the section 3.2, we could say both YES and NO in some situations. Moreover we could avoid discussions about nerve cases. In the section 3.6 "Qualifying Metrics", we need concrete criteria of some qualifications to show unambiguity, repeatability and implementability. The section 3.7 "Reporting Models" felt strange to me, because there are some typical ways, i.e. SNMP and syslog, for reporting in OAM most cases. It seems a rare case to define a new reporting model on metrics definition. I think it may be useful for metrics developers to mention about "security considerations" and "IANA considerations" even it always should be written in all the proposals. Refer to our I-D draft-kikuchi-passive-measure-01.txt for an evaluation example. Note that this evaluation was based on the -00 version of the framework draft. We hope the report helps. -- Yu. > > Apologies - we forgot to forward this to the PMOL list!! > > Regards > > Alan > > > > > A new version of I-D, draft-morton-perf-metrics-framework-01.txt has been > successfuly submitted by Alan Clark and posted to the IETF repository. > > Filename: draft-morton-perf-metrics-framework > Revision: 01 > Title: Framework for Performance Metric Development > Creation_date: 2007-11-18 > WG ID: Independent Submission > Number_of_pages: 11 > > Abstract: > This memo describes a framework and guidelines for the development of > performance metrics that are beyond the scope of existing working group > charters in the IETF. In this version, the memo refers to a Performance > Metrics Entity, or PM Entity, which may in future be a working group or > directorate or a combination of these two.Requirements Language > > The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", > "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this > document are to be interpreted as described in RFC 2119 [RFC2119]. > > > http://www.ietf.org/internet-drafts/draft-morton-perf-metrics-framework-01.t > xt > > The IETF Secretariat. > > > > > _______________________________________________ > PMOL mailing list > PMOL@ietf.org > https://www1.ietf.org/mailman/listinfo/pmol > _______________________________________________ PMOL mailing list PMOL@ietf.org https://www1.ietf.org/mailman/listinfo/pmol Return-path: Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1J0Kz2-0000Wo-GK; Thu, 06 Dec 2007 12:58:00 -0500 Received: from pmol by megatron.ietf.org with local (Exim 4.43) id 1J0Kz1-0000Th-Cp for pmol-confirm+ok@megatron.ietf.org; Thu, 06 Dec 2007 12:57:59 -0500 Received: from [10.90.34.44] (helo=chiedprmail1.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1J0Kyv-0000Qu-8p for pmol@ietf.org; Thu, 06 Dec 2007 12:57:53 -0500 Received: from mail.globalsuite.net ([69.46.103.200]) by chiedprmail1.ietf.org with smtp (Exim 4.43) id 1J0Kyu-00014g-T7 for pmol@ietf.org; Thu, 06 Dec 2007 12:57:53 -0500 X-AuditID: c0a8013c-ad722bb000001e2e-61-4758381f03ba Received: from TELCHADCPC (unknown [24.85.64.125]) by mail.globalsuite.net (Symantec Mail Security) with ESMTP id 187B54DC00B for ; Thu, 6 Dec 2007 10:57:50 -0700 (MST) From: "Alan Clark" To: Date: Thu, 6 Dec 2007 12:55:54 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook, Build 11.0.5510 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2962 Thread-Index: AcgqXkov1Z6+1qfARqK8AIGMd3ynZwN0pfQg Message-Id: <20071206175751.187B54DC00B@mail.globalsuite.net> X-Brightmail-Tracker: AAAAAA== X-Spam-Score: 0.0 (/) X-Scan-Signature: 69a74e02bbee44ab4f8eafdbcedd94a1 Subject: [PMOL] FW: draft-morton-perf-metrics-framework-01 X-BeenThere: pmol@ietf.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance Metrics at Other Layers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: pmol-bounces@ietf.org Apologies - we forgot to forward this to the PMOL list!! Regards Alan A new version of I-D, draft-morton-perf-metrics-framework-01.txt has been successfuly submitted by Alan Clark and posted to the IETF repository. Filename: draft-morton-perf-metrics-framework Revision: 01 Title: Framework for Performance Metric Development Creation_date: 2007-11-18 WG ID: Independent Submission Number_of_pages: 11 Abstract: This memo describes a framework and guidelines for the development of performance metrics that are beyond the scope of existing working group charters in the IETF. In this version, the memo refers to a Performance Metrics Entity, or PM Entity, which may in future be a working group or directorate or a combination of these two.Requirements Language The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this document are to be interpreted as described in RFC 2119 [RFC2119]. http://www.ietf.org/internet-drafts/draft-morton-perf-metrics-framework-01.t xt The IETF Secretariat. _______________________________________________ PMOL mailing list PMOL@ietf.org https://www1.ietf.org/mailman/listinfo/pmol Return-path: Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1J0AS3-00006K-QQ; Thu, 06 Dec 2007 01:43:15 -0500 Received: from pmol by megatron.ietf.org with local (Exim 4.43) id 1J0AS2-000069-8q for pmol-confirm+ok@megatron.ietf.org; Thu, 06 Dec 2007 01:43:14 -0500 Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1J0ARw-00005S-3Z for pmol@ietf.org; Thu, 06 Dec 2007 01:43:08 -0500 Received: from mail121.messagelabs.com ([216.82.241.195]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1J0ARq-0005i7-6y for pmol@ietf.org; Thu, 06 Dec 2007 01:43:06 -0500 X-VirusChecked: Checked X-Env-Sender: acmorton@att.com X-Msg-Ref: server-12.tower-121.messagelabs.com!1196923380!25945268!1 X-StarScan-Version: 5.5.12.14.2; banners=-,-,- X-Originating-IP: [144.160.128.149] Received: (qmail 32474 invoked from network); 6 Dec 2007 06:43:01 -0000 Received: from sbcsmtp9.sbc.com (HELO flph024.enaf.ffdc.sbc.com) (144.160.128.149) by server-12.tower-121.messagelabs.com with AES256-SHA encrypted SMTP; 6 Dec 2007 06:43:01 -0000 Received: from enaf.ffdc.sbc.com (localhost.localdomain [127.0.0.1]) by flph024.enaf.ffdc.sbc.com (8.14.0/8.14.0) with ESMTP id lB66h0iR013217 for ; Wed, 5 Dec 2007 22:43:00 -0800 Received: from klph001.kcdc.att.com (klph001.kcdc.att.com [135.188.3.11]) by flph024.enaf.ffdc.sbc.com (8.14.0/8.14.0) with ESMTP id lB66grrg013191 for ; Wed, 5 Dec 2007 22:42:53 -0800 Received: from kcdc.att.com (localhost.localdomain [127.0.0.1]) by klph001.kcdc.att.com (8.14.0/8.14.0) with ESMTP id lB66grl3012745 for ; Thu, 6 Dec 2007 00:42:53 -0600 Received: from maillennium.att.com (mailgw1.maillennium.att.com [135.25.114.99]) by klph001.kcdc.att.com (8.14.0/8.14.0) with ESMTP id lB66gggg012717 for ; Thu, 6 Dec 2007 00:42:50 -0600 Message-Id: <200712060642.lB66gggg012717@klph001.kcdc.att.com> Received: from acmt.att.com (unknown[135.210.81.40](misconfigured sender)) by maillennium.att.com (mailgw1) with SMTP id <20071206064241gw10010g3ge>; Thu, 6 Dec 2007 06:42:41 +0000 X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Thu, 06 Dec 2007 01:42:39 -0500 To: pmol@ietf.org From: Al Morton Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed X-Spam-Score: -2.5 (--) X-Scan-Signature: cf4fa59384e76e63313391b70cd0dd25 Subject: [PMOL] Remote Participation URLs X-BeenThere: pmol@ietf.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance Metrics at Other Layers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: pmol-bounces@ietf.org For those who wish to participate remotely, we have: Start time: 13:00 Vancouver Canada time (16:00 EST) Jabber Instructions http://www.ietf.org/meetings/text_conf.html Jabber Room pmol@jabber.ietf.org Slides not all posted yet (scroll down to pmol in OPS area) https://datatracker.ietf.org/meeting/70/materials.html Unicast Audio http://videolab.uoregon.edu/events/ietf/ pmol is on Channel 4 in Salon F _______________________________________________ PMOL mailing list PMOL@ietf.org https://www1.ietf.org/mailman/listinfo/pmol