From nobody Wed Oct 19 08:48:05 2016 Return-Path: X-Original-To: maprg@ietfa.amsl.com Delivered-To: maprg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 60AEF129670 for ; Wed, 19 Oct 2016 08:48:04 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.902 X-Spam-Level: X-Spam-Status: No, score=-1.902 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=viavisolutions.onmicrosoft.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id O1uM1y-6b29W for ; Wed, 19 Oct 2016 08:48:02 -0700 (PDT) Received: from NAM03-BY2-obe.outbound.protection.outlook.com (mail-by2nam03on0115.outbound.protection.outlook.com [104.47.42.115]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A442912966F for ; Wed, 19 Oct 2016 08:48:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=viavisolutions.onmicrosoft.com; s=selector1-viavisolutions-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=ldODkLus6Be61GGMnR0GUCiQBrh8gFaG5MHfEUsqdaU=; b=R9BWtrmGLXp/GckXzZnE2kZUgtEgqNajIfeIH9IQwg66WMa3V7+eYlEdzdgOVkb4S6VshvFSIMd3zaZ+j6MRbBZyX6vicMC3ZJwq9ASgHsKYP99dTHOG5Y70hbdwZpw3sDkdCxngy6ec4nzykVyixC2wXcP1fbnNLJN8HrRwxs4= Received: from MWHPR18MB1536.namprd18.prod.outlook.com (10.173.243.142) by MWHPR18MB1536.namprd18.prod.outlook.com (10.173.243.142) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.669.16; Wed, 19 Oct 2016 15:48:02 +0000 Received: from MWHPR18MB1536.namprd18.prod.outlook.com ([10.173.243.142]) by MWHPR18MB1536.namprd18.prod.outlook.com ([10.173.243.142]) with mapi id 15.01.0669.018; Wed, 19 Oct 2016 15:48:02 +0000 From: Barry Constantine To: "maprg@irtf.org" Thread-Topic: Benchmarking Network Devices and their VNF Counterparts Thread-Index: AdIqH+NZ8DPYj0f4SJiphWQv89Bi/g== Date: Wed, 19 Oct 2016 15:48:01 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=Barry.Constantine@viavisolutions.com; x-originating-ip: [104.129.194.59] x-ms-office365-filtering-correlation-id: bdba653f-2ec1-49cb-b438-08d3f8374ef5 x-microsoft-exchange-diagnostics: 1; MWHPR18MB1536; 7:9l4ZZ+yADESiYL0WCroj/05a1msXzkH3TPi0QDb0L0euIlmDUBDWKhQFgyXmWPuTW8bohDaJmje80h1hG+4/kP256S6TqQUar934jc1qBTOCwoQ3+UlR8qcdfNgTbK6M/KA5rn2ePXJ5Gj3tzrlVmQtYfOpDiXX7Kcoo8pMZnet0UC2+sAlNeWwv6nm4vX101fMkKaFVMaNuZhF3NQuDdlsBbpOmehGQf4jufK9FvqhnRNnHWSwiJW3/zLw2GJVkvg++4etBmIBq2HTix3qwN3pBbCNmQhikalQxz07mk0tNyd4z8asQHJWmOl3KeEk13SzsfWk1EFhTIy3dAFx6Dkku3QbzOwBXm3+rsBw7qW8= x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:MWHPR18MB1536; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040176)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6055026); SRVR:MWHPR18MB1536; BCL:0; PCL:0; RULEID:; SRVR:MWHPR18MB1536; x-forefront-prvs: 0100732B76 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(979002)(6009001)(7916002)(199003)(189002)(99286002)(54356999)(19300405004)(7696004)(8676002)(9686002)(86362001)(5660300001)(8936002)(110136003)(122556002)(19625215002)(10400500002)(76576001)(87936001)(5002640100001)(50986999)(33656002)(11100500001)(6916009)(101416001)(2351001)(2900100001)(77096005)(19580395003)(3660700001)(81166006)(106356001)(229853001)(15975445007)(16236675004)(68736007)(9326002)(97736004)(107886002)(66066001)(19609705001)(92566002)(790700001)(74316002)(5630700001)(7846002)(102836003)(7736002)(2906002)(586003)(6116002)(3280700002)(105586002)(3846002)(5640700001)(450100001)(81156014)(1730700003)(189998001)(2501003)(969003)(989001)(999001)(1009001)(1019001); DIR:OUT; SFP:1102; SCL:1; SRVR:MWHPR18MB1536; H:MWHPR18MB1536.namprd18.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; received-spf: None (protection.outlook.com: viavisolutions.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/alternative; boundary="_000_MWHPR18MB1536D335F9CEA1E5A7DB428696D20MWHPR18MB1536namp_" MIME-Version: 1.0 X-OriginatorOrg: viavisolutions.com X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Oct 2016 15:48:01.7484 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: c44ec86f-d007-4b6c-8795-8ea75e4a6f9b X-MS-Exchange-Transport-CrossTenantHeadersStamped: MWHPR18MB1536 Archived-At: Subject: [Maprg] Benchmarking Network Devices and their VNF Counterparts X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Oct 2016 15:48:04 -0000 --_000_MWHPR18MB1536D335F9CEA1E5A7DB428696D20MWHPR18MB1536namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hello, I am new to this list and have participated in IETF BMWG over the years. I'm interested in any benchmarking measurements that have been conducted an= d ideally published which illustrates performance of various virtualized ne= twork functions (VNFs). Simple example would be multi-layer VNF switch results of an RFC 2544 test,= etc. Thanks, Barry --_000_MWHPR18MB1536D335F9CEA1E5A7DB428696D20MWHPR18MB1536namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hello,

 

I am new to this list and have participated in IETF = BMWG over the years.

 

I’m interested in any benchmarking measurement= s that have been conducted and ideally published which illustrates performa= nce of various virtualized network functions (VNFs).

 

Simple example would be multi-layer VNF switch resul= ts of an RFC 2544 test, etc.

 

Thanks,

Barry

--_000_MWHPR18MB1536D335F9CEA1E5A7DB428696D20MWHPR18MB1536namp_-- From nobody Thu Oct 20 03:10:06 2016 Return-Path: X-Original-To: maprg@ietfa.amsl.com Delivered-To: maprg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 6247A129515 for ; Thu, 20 Oct 2016 03:10:04 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: 0.91 X-Spam-Level: X-Spam-Status: No, score=0.91 tagged_above=-999 required=5 tests=[BAYES_50=0.8, DKIM_SIGNED=0.1, T_DKIM_INVALID=0.01] autolearn=no autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=neutral reason="invalid (public key: not available)" header.d=xhdeng.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id X7ylp_LtFinw for ; Thu, 20 Oct 2016 03:10:02 -0700 (PDT) Received: from auriel.instanthosting.com.au (auriel.instanthosting.com.au [116.0.20.231]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 057A51294D5 for ; Thu, 20 Oct 2016 03:10:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xhdeng.com; s=default; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date: Content-Transfer-Encoding:Content-Type:MIME-Version:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=GeC5o8sgccqYgsWcVy/5MKseRr7vGLbHM1RtIBbsCrw=; b=C8PWE5hblORT6BCyAM12bmOxxt twyHlUdCc/Lc6C9qssTbaneQKjFJ2xtjl3SRFakweqBYMX6ee76974v93vJnRE2OdOvImpyaq9i8v hmiZSytGpBv+wX0I5+jjyAFtBjBS1a+64SJYwFtSa2Q0tTEp9T2R0s27U6ZuLnIbxQSE=; Received: from [::1] (port=59259 helo=xhdeng.com) by auriel.instanthosting.com.au with esmtpa (Exim 4.87) (envelope-from ) id 1bx9zz-001C28-6P; Thu, 20 Oct 2016 20:50:55 +1100 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Thu, 20 Oct 2016 20:50:55 +1100 From: xiaohong.deng@xhdeng.com To: maprg@irtf.org In-Reply-To: References: Message-ID: X-Sender: xiaohong.deng@xhdeng.com User-Agent: Roundcube Webmail/1.1.4 X-cPanel-MailScanner-Information: Please contact the ISP for more information X-cPanel-MailScanner-ID: 1bx9zz-001C28-6P X-cPanel-MailScanner: Found to be clean X-cPanel-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-2.899, required 3, ALL_TRUSTED -1.00, BAYES_00 -1.90, URIBL_BLOCKED 0.00) X-cPanel-MailScanner-From: xiaohong.deng@xhdeng.com X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - auriel.instanthosting.com.au X-AntiAbuse: Original Domain - irtf.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - xhdeng.com X-Get-Message-Sender-Via: auriel.instanthosting.com.au: authenticated_id: xiaohong.deng@xhdeng.com X-Authenticated-Sender: auriel.instanthosting.com.au: xiaohong.deng@xhdeng.com X-Source: X-Source-Args: X-Source-Dir: Archived-At: Cc: Dave@plonka.us, mirja.kuehlewind@tik.ee.ethz.ch Subject: [Maprg] Measurement Tools and Platforms X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Oct 2016 10:10:04 -0000 Hi all, I wonder why measurement Lab https://www.measurementlab.net/ is not listed in Measurement Tools and Platforms, under the MAPRG wiki page? Any comments? Thanks, -x From nobody Thu Oct 20 03:57:10 2016 Return-Path: X-Original-To: maprg@ietfa.amsl.com Delivered-To: maprg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E847E1295DB for ; Thu, 20 Oct 2016 03:57:08 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: 0.91 X-Spam-Level: X-Spam-Status: No, score=0.91 tagged_above=-999 required=5 tests=[BAYES_50=0.8, DKIM_SIGNED=0.1, T_DKIM_INVALID=0.01] autolearn=no autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=neutral reason="invalid (public key: not available)" header.d=xhdeng.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JViuIOEgDhC3 for ; Thu, 20 Oct 2016 03:57:07 -0700 (PDT) Received: from auriel.instanthosting.com.au (auriel.instanthosting.com.au [116.0.20.231]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4EBEA1295BD for ; Thu, 20 Oct 2016 03:57:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xhdeng.com; s=default; h=Message-ID:Subject:Cc:To:From:Date:Content-Transfer-Encoding: Content-Type:MIME-Version:Sender:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=f30I1fyT6+2CLqNmSFgyqy2Zx9lXpX/yZCjg83nnPPQ=; b=Wj7GPjUIG8JEkILH7gRsE3ix09 wOJig9szeYDgNpyBxH2mIncCTgZLaNR8iT5Ga70owI5TYhZjkswiVx3CrkMpHosj+NT0xY6q6x9Mo YlXmdGxG8ss7ejNS3BxqV4F6tQ4/d29vGj8OZzysXbA713xHeSCH/oxjcSwvRketdwto=; Received: from [::1] (port=58742 helo=xhdeng.com) by auriel.instanthosting.com.au with esmtpa (Exim 4.87) (envelope-from ) id 1bx9wP-001Axe-2Z; Thu, 20 Oct 2016 20:47:13 +1100 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Thu, 20 Oct 2016 20:47:12 +1100 From: xiaohong.deng@xhdeng.com To: maprg@irtf.org Message-ID: X-Sender: xiaohong.deng@xhdeng.com User-Agent: Roundcube Webmail/1.1.4 X-cPanel-MailScanner-Information: Please contact the ISP for more information X-cPanel-MailScanner-ID: 1bx9wP-001Axe-2Z X-cPanel-MailScanner: Found to be clean X-cPanel-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-2.899, required 3, ALL_TRUSTED -1.00, BAYES_00 -1.90, URIBL_BLOCKED 0.00) X-cPanel-MailScanner-From: xiaohong.deng@xhdeng.com X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - auriel.instanthosting.com.au X-AntiAbuse: Original Domain - irtf.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - xhdeng.com X-Get-Message-Sender-Via: auriel.instanthosting.com.au: authenticated_id: xiaohong.deng@xhdeng.com X-Authenticated-Sender: auriel.instanthosting.com.au: xiaohong.deng@xhdeng.com X-Source: X-Source-Args: X-Source-Dir: Archived-At: Cc: Dave@Plonka.US, mirja.kuehlewind@tik.ee.ethz.ch Subject: Re: [Maprg] Call for Contributions: IETF-97, Soul X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Oct 2016 10:57:09 -0000 Hi WG and Chairs, I notice the first call for contribution deadline has passed. Don't know if there is a second round call. If so, I'd send a request in between. :) Either way, please give a feedback. I'd like request 20 minutes on Maprg Soul meeting to present the following topic (which has been presented at AusNoG Sep. 2016) A link to the presentation: http://www.ausnog.net/sites/default/files/ausnog-2016/presentations/1.6_Xiaohong_Deng_AusNOG2016.pdf Abstract of the talk: Broadband network performance is multi-faceted, dependent on factors such as access link characteristics, speed-tier, server distance, host buffers, ISP network dimensioning, and time-of-day. Daily or monthly aggregates, published by content providers such as Netflix and Youtube, present a highly simplified view that do not distinguish the impact of the above factors, making the comparisons potentially unfair and incorrect. Our paper revisits broadband performance using open data from M-Lab, utilizing nearly 5 million measurements taken over a 12-month period across 19 ISPs in 3 continents. We first develop a tool that allows a non-expert to query, process, and visualize M-Lab data by applying various filters and granularities via a simple web-based interface. Using this tool, we characterize the influence of the various factors, and find that there are significant biases affecting the averages, including disparities amongst households in their frequency of testing and access speed-tier, that contribute to fluctuations and biases in ISP performance comparisons. We then apply statistical and causal inference techniques to reduce the sampling bias, and find that the disparity amongst ISPs is lower than current averaging methods indicate, with hourly variations giving a truer indication of well-dimensioned ISP networks. Thank you, -x From nobody Thu Oct 20 08:19:09 2016 Return-Path: X-Original-To: maprg@ietfa.amsl.com Delivered-To: maprg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 05255129657 for ; Thu, 20 Oct 2016 08:19:07 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.6 X-Spam-Level: X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=plonka-us.20150623.gappssmtp.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XxGxoUnt_mOJ for ; Thu, 20 Oct 2016 08:19:05 -0700 (PDT) Received: from mail-it0-x232.google.com (mail-it0-x232.google.com [IPv6:2607:f8b0:4001:c0b::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E42DD1294F0 for ; Thu, 20 Oct 2016 08:19:04 -0700 (PDT) Received: by mail-it0-x232.google.com with SMTP id 66so96053413itl.1 for ; Thu, 20 Oct 2016 08:19:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=plonka-us.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=7z0C4cpvvCECAaK27zYnFNMIW/2HmLeEyt6zg19tMqA=; b=RQvZHiRJVme0x4WNn06JLW/QbSVnGvrTCjMiIWa9P89toDoRA4rjYtncxiHVQRio3z I4oNEoPEVgeSLQ+dG6hpZYKdH5YMjwz2xW5Qc3fsr9rV/l5n48pG42TYQ/p6gEw8C3Tn 2SDRDeJqEbgYq7YAUejW685U0Fq2mDT6WBhQb8d8HyMPA0GGaWt/WtwSfRtORCpJnIWL H+Za/loSajyLktQhDigKpCJAkEyLbXtdhDlXzpBgUnsqRRUZodLmI3BZcdw0YYOpz6i3 mo+AOvCrPQtMmWHCTiAx3rIBX8CMLkq/m/f4Z/cPAUEVMhh8bM8/VvbitnxG14TImS0H bEAw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=7z0C4cpvvCECAaK27zYnFNMIW/2HmLeEyt6zg19tMqA=; b=EU1J7c4XY0CFmPBMQYi/F+wcDszaZ5i+jETXdais5Raeh2TtcKtYKUSZA+6PM4S3oc 1UIDj4ZY/0ZipSzPH7zTKcUcxSwxMk638ANtwTYvyLTEVmCtHYxfear0NdDSOTMWGKwl VJezR0ToDVZ5SPo0+ge2n1TbRRqXZD7gb/n6UvNhTQjFIjSr2w1CCJIPxjhy2fHSMYrN xI428xro3giN44xs/7oc6qux4/ZviGulGvMUImSxfA6NzrB3Imf9wlTgu36/cWh2/tSq 0/8TmGfCLxCZPN4mGH4ypM8GUWNioSB3CmqiqMj5Eu17o7OuafoLIvfjjX5dkH1WbTz9 yakw== X-Gm-Message-State: AA6/9Rk1j/2D0jmJjrVcnaJAdHvvx3IgkEM5TALbVRakmLwcyxvIxTveTaB2XlbfdqO+aUW5qmMlMV9Qrw1g3A== X-Received: by 10.36.93.78 with SMTP id w75mr4219721ita.110.1476976741948; Thu, 20 Oct 2016 08:19:01 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.28.206 with HTTP; Thu, 20 Oct 2016 08:19:01 -0700 (PDT) X-Originating-IP: [24.240.38.160] In-Reply-To: References: From: Dave Plonka Date: Thu, 20 Oct 2016 10:19:01 -0500 Message-ID: To: xiaohong.deng@xhdeng.com Content-Type: multipart/alternative; boundary=001a113a1cec0c1c7d053f4d7256 Archived-At: Cc: maprg@irtf.org, =?UTF-8?Q?Mirja_K=C3=BChlewind?= Subject: Re: [Maprg] Call for Contributions: IETF-97, Soul X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Oct 2016 15:19:07 -0000 --001a113a1cec0c1c7d053f4d7256 Content-Type: text/plain; charset=UTF-8 Hi Xiaohong, Mirja and I will be meeting next week to consider the set of submissions for MAPRG in Seoul. I won't be there because IETF collides with IMC (in Santa Monica) that week, but I will present a WIP on MAPRG at IMC. We haven't determined a need for a second call, but we can consider yours amongst them if there might be time available in the meeting. Thanks, Dave On Thu, Oct 20, 2016 at 4:47 AM, wrote: > Hi WG and Chairs, > > I notice the first call for contribution deadline has passed. Don't know > if there is a second round call. If so, I'd send a request in between. :) > Either way, please give a feedback. > > I'd like request 20 minutes on Maprg Soul meeting to present the following > topic (which has been presented at AusNoG Sep. 2016) > > A link to the presentation: > http://www.ausnog.net/sites/default/files/ausnog-2016/presen > tations/1.6_Xiaohong_Deng_AusNOG2016.pdf > > Abstract of the talk: > Broadband network performance is multi-faceted, dependent on factors such > as access link characteristics, speed-tier, server distance, host buffers, > ISP network dimensioning, and time-of-day. Daily or monthly aggregates, > published by content providers such as Netflix and Youtube, present a > highly simplified view that do not distinguish the impact of the above > factors, making the comparisons potentially unfair and incorrect. Our paper > revisits broadband performance using open data from M-Lab, utilizing nearly > 5 million measurements taken over a 12-month period across 19 ISPs in 3 > continents. We first develop a tool that allows a non-expert to query, > process, and visualize M-Lab data by applying various filters and > granularities via a simple web-based interface. Using this tool, we > characterize the influence of the various factors, and find that there are > significant biases affecting the averages, including disparities amongst > households in their frequency of testing and access speed-tier, that > contribute to fluctuations and biases in ISP performance comparisons. We > then apply statistical and causal inference techniques to reduce the > sampling bias, and find that the disparity amongst ISPs is lower than > current averaging methods indicate, with hourly variations giving a truer > indication of well-dimensioned ISP networks. > > Thank you, > -x > -- dave@plonka.us http://www.cs.wisc.edu/~plonka/ --001a113a1cec0c1c7d053f4d7256 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi Xiaohong,

Mirja and I will be meetin= g next week to consider the set of submissions for MAPRG in Seoul.

I won't be there because IETF collides with IMC (in Sa= nta Monica) that week, but I will present a WIP on MAPRG at IMC.
=
We haven't determined a need for a second call, but we c= an consider yours amongst them if there might be time available in the meet= ing.

Thanks,
Dave

On Thu, Oct 20, 2016 at = 4:47 AM, <xiaohong.deng@xhdeng.com> wrote:
Hi WG and Chairs,

I notice the first call for contribution deadline has passed. Don't kno= w if there is a second round call. If so, I'd send a request in between= . :) Either way, please give a feedback.

I'd like request 20 minutes on Maprg Soul meeting to present the follow= ing topic (which has been presented at AusNoG Sep. 2016)

A link to the presentation:
= http://www.ausnog.net/sites/default/files/ausnog-2016/presentatio= ns/1.6_Xiaohong_Deng_AusNOG2016.pdf

Abstract of the talk:
Broadband network performance is multi-faceted, dependent on factors such a= s access link characteristics, speed-tier, server distance, host buffers, I= SP network dimensioning, and time-of-day. Daily or monthly aggregates, publ= ished by content providers such as Netflix and Youtube, present a highly si= mplified view that do not distinguish the impact of the above factors, maki= ng the comparisons potentially unfair and incorrect. Our paper revisits bro= adband performance using open data from M-Lab, utilizing nearly 5 million m= easurements taken over a 12-month period across 19 ISPs in 3 continents. We= first develop a tool that allows a non-expert to query, process, and visua= lize M-Lab data by applying various filters and granularities via a simple = web-based interface. Using this tool, we characterize the influence of the = various factors, and find that there are significant biases affecting the a= verages, including disparities amongst households in their frequency of tes= ting and access speed-tier, that contribute to fluctuations and biases in I= SP performance comparisons. We then apply statistical and causal inference = techniques to reduce the sampling bias, and find that the disparity amongst= ISPs is lower than current averaging methods indicate, with hourly variati= ons giving a truer indication of well-dimensioned ISP networks.

Thank you,
-x



--
--001a113a1cec0c1c7d053f4d7256-- From nobody Thu Oct 20 08:27:27 2016 Return-Path: X-Original-To: maprg@ietfa.amsl.com Delivered-To: maprg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0B070129635 for ; Thu, 20 Oct 2016 08:27:26 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.6 X-Spam-Level: X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=plonka-us.20150623.gappssmtp.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id KWFnk4NYDqLF for ; Thu, 20 Oct 2016 08:27:24 -0700 (PDT) Received: from mail-pf0-x22c.google.com (mail-pf0-x22c.google.com [IPv6:2607:f8b0:400e:c00::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3301512996D for ; Thu, 20 Oct 2016 08:27:23 -0700 (PDT) Received: by mail-pf0-x22c.google.com with SMTP id 128so39263550pfz.0 for ; Thu, 20 Oct 2016 08:27:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=plonka-us.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=TnvmtdgAZ4d7r5plfwjXXD325lCUu3WfdQFvwzDfi+k=; b=yFQZVfCNPHM8SGZLHyWqnl06BHbXrIoT2KzsARkRq+UMrQA05Z7jSjXJPAtL6K2VGx gyJTiQjTrQUAnwpISQwRQk2YRwiZubmPwbLMXjkvzoglY0GTNiqzpQn1zR/D2EX1un4S X0qYbHy2IMD3AP1fdpvJzhULYi9a51dWQzE7yssQ2O26Yt8ajvJySJckPqGKfbZqLtgZ 9DJJnHHX0NcnZYk4ze+oU7v8XuBbkKDedBFXK30VUiYKrFlWiBYzZJGX9qAYIQXN1Uez eYEwoSxuYuiLpsbZChRZ7374sQrhTU2ERRDU8uAXHd1uw+A+e2Xd8AI2lXQ8I5+GgPjm bHWQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=TnvmtdgAZ4d7r5plfwjXXD325lCUu3WfdQFvwzDfi+k=; b=kqAEQ2ACWG1G+CYGHTiIUev7hLxT8HIb7JiGPDXkStN8JL3OmCDMLK4FSa6T3QzdOU TIw7L8l4VYeUVp1HxfW08tFAWgDXChWopJf2DLVjEZ1ez5kAx5G1PQFWAEHUi72xG3hN Ag/kC0BkhhNSxW6QIVPR9CFxjdj9JOD9+ECNPzXiMHmoNQrkWqkVComFbYErhlBbYiha jA0/JXP6g9oVJ3wHbrmKHzhHk548rxlFW6sAjlpLPT/1+CplFf6Gv3aUOzqMq9UVFIeD JlJTA9VYgXa0tBMp1gFHKtHcPAJdJctpNigNoirGz54OXH8Y1W8HIo1T6R9yj1du7xPe WyzQ== X-Gm-Message-State: ABUngveD5Tm1Ys9BqhX/llbaWBNcOfuEi/dsr0YbmNiCdM6AOoEETyTBhXVNupWCSzfjhV8eoW8CmzezX1+UNQ== X-Received: by 10.107.10.201 with SMTP id 70mr1640481iok.165.1476977242718; Thu, 20 Oct 2016 08:27:22 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.28.206 with HTTP; Thu, 20 Oct 2016 08:27:22 -0700 (PDT) X-Originating-IP: [24.240.38.160] In-Reply-To: References: From: Dave Plonka Date: Thu, 20 Oct 2016 10:27:22 -0500 Message-ID: To: xiaohong.deng@xhdeng.com Content-Type: multipart/alternative; boundary=001a113eeab0e4fe60053f4d8f79 Archived-At: Cc: maprg@irtf.org, =?UTF-8?Q?Mirja_K=C3=BChlewind?= Subject: Re: [Maprg] Measurement Tools and Platforms X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Oct 2016 15:27:26 -0000 --001a113eeab0e4fe60053f4d8f79 Content-Type: text/plain; charset=UTF-8 Assuming you meant to request it be added, I did so. :) https://trac.tools.ietf.org/group/irtf/trac/wiki/MeasurementTools Thanks, Dave On Thu, Oct 20, 2016 at 4:50 AM, wrote: > Hi all, > > I wonder why measurement Lab https://www.measurementlab.net/ is not > listed in Measurement Tools and Platforms, under the MAPRG wiki page? > > Any comments? > > Thanks, > -x > -- dave@plonka.us http://www.cs.wisc.edu/~plonka/ --001a113eeab0e4fe60053f4d8f79 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Assuming you meant to request it be added, I did so. :)
<= div class=3D"gmail_extra">
On Thu, Oct 20, 20= 16 at 4:50 AM, <xiaohong.deng@xhdeng.com> wrote:
=
Hi all,

I wonder why measurement Lab https://www.measurementlab.net/= is not listed in Measurement Tools and Platforms, under the MAPRG wiki pag= e?

Any comments?

Thanks,
-x



--
--001a113eeab0e4fe60053f4d8f79-- From nobody Thu Oct 20 22:22:33 2016 Return-Path: X-Original-To: maprg@ietfa.amsl.com Delivered-To: maprg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 630F51294EA for ; Thu, 20 Oct 2016 22:22:32 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.79 X-Spam-Level: X-Spam-Status: No, score=-1.79 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, T_DKIM_INVALID=0.01] autolearn=no autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=neutral reason="invalid (public key: not available)" header.d=xhdeng.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 1D23npCyV4Z4 for ; Thu, 20 Oct 2016 22:22:30 -0700 (PDT) Received: from auriel.instanthosting.com.au (auriel.instanthosting.com.au [116.0.20.231]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CF55A129483 for ; Thu, 20 Oct 2016 22:22:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xhdeng.com; s=default; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date: Content-Transfer-Encoding:Content-Type:MIME-Version:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=84hY+vADp8vKC9kiphODmh0ATo4mcKYIKvXBPhPwJU8=; b=qmEBqqUAR82Cece5ov8Ijl3L62 sS83XVm9BnSckISw2upnSVtHPe+dyPIydRNh3IWqw8byQQfU3QYOJv2bzbYTPxSE5VRePSJ8GFMes oO9UubuStqihJmecg8Q+PUQvYvZ/kwyAiyqjgFg514WgXlatnm4KMIhvG3FtpQh5ZLtg=; Received: from [::1] (port=51410 helo=xhdeng.com) by auriel.instanthosting.com.au with esmtpa (Exim 4.87) (envelope-from ) id 1bxSHU-000EFs-N3; Fri, 21 Oct 2016 16:22:12 +1100 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Fri, 21 Oct 2016 16:22:12 +1100 From: xiaohong.deng@xhdeng.com To: Dave Plonka In-Reply-To: References: Message-ID: <3f3ff16b30d2682facb9fd8f74c31638@xhdeng.com> X-Sender: xiaohong.deng@xhdeng.com User-Agent: Roundcube Webmail/1.1.4 X-cPanel-MailScanner-Information: Please contact the ISP for more information X-cPanel-MailScanner-ID: 1bxSHU-000EFs-N3 X-cPanel-MailScanner: Found to be clean X-cPanel-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-2.9, required 3, ALL_TRUSTED -1.00, BAYES_00 -1.90) X-cPanel-MailScanner-From: xiaohong.deng@xhdeng.com X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - auriel.instanthosting.com.au X-AntiAbuse: Original Domain - irtf.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - xhdeng.com X-Get-Message-Sender-Via: auriel.instanthosting.com.au: authenticated_id: xiaohong.deng@xhdeng.com X-Authenticated-Sender: auriel.instanthosting.com.au: xiaohong.deng@xhdeng.com X-Source: X-Source-Args: X-Source-Dir: Archived-At: Cc: maprg@irtf.org, =?UTF-8?Q?Mirja_K=C3=BChlewind?= Subject: Re: [Maprg] Measurement Tools and Platforms X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Oct 2016 05:22:32 -0000 Exactly. Thank you, Dave. -x 在 2016-10-21 02:27，Dave Plonka 写道： > Assuming you meant to request it be added, I did so. :) > > https://trac.tools.ietf.org/group/irtf/trac/wiki/MeasurementTools > > Thanks, > Dave > > On Thu, Oct 20, 2016 at 4:50 AM, wrote: > >> Hi all, >> >> I wonder why measurement Lab https://www.measurementlab.net/ [1] is >> not listed in Measurement Tools and Platforms, under the MAPRG wiki >> page? >> >> Any comments? >> >> Thanks, >> -x > > -- > > dave@plonka.us http://www.cs.wisc.edu/~plonka/ > > > Links: > ------ > [1] https://www.measurementlab.net/ From nobody Fri Oct 21 16:22:52 2016 Return-Path: X-Original-To: maprg@irtf.org Delivered-To: maprg@ietfa.amsl.com Received: from ietfa.amsl.com (localhost [IPv6:::1]) by ietfa.amsl.com (Postfix) with ESMTP id 05EDF1297CD; Fri, 21 Oct 2016 16:21:08 -0700 (PDT) MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit From: "\"IETF Secretariat\"" To: , X-Test-IDTracker: no X-IETF-IDTracker: 6.36.0 Auto-Submitted: auto-generated Precedence: bulk Message-ID: <147709206801.28214.14181388026460790477.idtracker@ietfa.amsl.com> Date: Fri, 21 Oct 2016 16:21:08 -0700 Archived-At: Cc: maprg@irtf.org, irtf-chair@irtf.org Subject: [Maprg] maprg - Requested session has been scheduled for IETF 97 X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Oct 2016 23:21:08 -0000 Dear Mirja Kühlewind, The session(s) that you have requested have been scheduled. Below is the scheduled session information followed by the original request. maprg Session 1 (1:30:00) Thursday, Morning Session I 0930-1100 Room Name: Grand Ballroom 2 size: 200 --------------------------------------------- Request Information: --------------------------------------------------------- Working Group Name: Measurement and Analysis for Protocols Area Name: IRTF Session Requester: Mirja Kühlewind Number of Sessions: 1 Length of Session(s): 1.5 Hours Number of Attendees: 150 Conflicts to Avoid: First Priority: alto tsvarea mptcp tcpinc ippm iccrg tcpm aqm taps rmcat tsvwg httpbis Second Priority: appsawg apparea intarea 6man dnsop v6ops uta rtcweb dispatch Third Priority: irtfopen lmap Special Requests: Also please see quic as first priority conflict if it gets chartered and is having a meeting --------------------------------------------------------- From nobody Mon Oct 24 05:55:40 2016 Return-Path: X-Original-To: maprg@ietfa.amsl.com Delivered-To: maprg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9D55612953F for ; Mon, 24 Oct 2016 05:55:38 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: 0.109 X-Spam-Level: X-Spam-Status: No, score=0.109 tagged_above=-999 required=5 tests=[BAYES_20=-0.001, DKIM_SIGNED=0.1, T_DKIM_INVALID=0.01] autolearn=no autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=neutral reason="invalid (public key: not available)" header.d=xhdeng.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6BMIti8G7MvQ for ; Mon, 24 Oct 2016 05:55:34 -0700 (PDT) Received: from auriel.instanthosting.com.au (auriel.instanthosting.com.au [116.0.20.231]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 614E412956C for ; Mon, 24 Oct 2016 05:55:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=xhdeng.com; s=default; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date: Content-Transfer-Encoding:Content-Type:MIME-Version:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=cjpX5ZHpjtxlTC1dt6RQjTSDjMdysRRIufb489VgjC0=; b=Xj6p6ptcVCEE59SMS9vefPUWj5 TwKPB6t/dTvC7XAhIWnR940kLXDYuYVDAOG5SrG2c3xLqT5Jy++ex6RBG4ZCLZDP2RbDxbvNXK2ns 1gAMnWa/rgrdVPBmAK1ATSflsoFWuJ0yqO/muiPmBSTzraWG+4LoFuAbPgHj9Nt72190=; Received: from [::1] (port=44223 helo=xhdeng.com) by auriel.instanthosting.com.au with esmtpa (Exim 4.87) (envelope-from ) id 1byemV-002Fpb-Vz; Mon, 24 Oct 2016 23:55:12 +1100 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Mon, 24 Oct 2016 23:55:11 +1100 From: xiaohong.deng@xhdeng.com To: Amreesh Phokeer In-Reply-To: References: Message-ID: <052fe9d01ba668eabcc1579e4139e99a@xhdeng.com> X-Sender: xiaohong.deng@xhdeng.com User-Agent: Roundcube Webmail/1.1.4 X-cPanel-MailScanner-Information: Please contact the ISP for more information X-cPanel-MailScanner-ID: 1byemV-002Fpb-Vz X-cPanel-MailScanner: Found to be clean X-cPanel-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-2.899, required 3, ALL_TRUSTED -1.00, BAYES_00 -1.90, URIBL_BLOCKED 0.00) X-cPanel-MailScanner-From: xiaohong.deng@xhdeng.com X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - auriel.instanthosting.com.au X-AntiAbuse: Original Domain - irtf.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - xhdeng.com X-Get-Message-Sender-Via: auriel.instanthosting.com.au: authenticated_id: xiaohong.deng@xhdeng.com X-Authenticated-Sender: auriel.instanthosting.com.au: xiaohong.deng@xhdeng.com X-Source: X-Source-Args: X-Source-Dir: Archived-At: Cc: Maprg@irtf.org, josecamacho@ugr.es Subject: Re: [Maprg] Call for Contributions: IETF-97, Soul X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Oct 2016 12:55:38 -0000 Hi Amreesh and Jose, Thank you for your interest. A paper is now under working for a Sigmetrics submission. Yet, we do have preliminary results published on this website: http://fair-isp-compari.internet-measurement.com/ You may also like to try our tool: http://vis-mlab.internet-measurement.com/ to gain some insights from visualised ISP performance and individual household performance and its correlation with impacting factors such as household Speed Tier, server client Distance and Host Buffer size, etc. The NDT data presented with our vis tool website is from Jan 2016 to Sep 2016 (last month). And we'll keep updating the data accordingly to NDT data availability. Kind Regards, Xiaohong 2016-10-20 22:34，Amreesh Phokeer ： > Hello Xiaohong, > > Interesting abstract. Do you have the full paper you could share? > > Thanks, > Amreesh > > On Thu, Oct 20, 2016 at 11:47 AM, wrote: > >> Hi WG and Chairs, >> >> I notice the first call for contribution deadline has passed. Don't >> know if there is a second round call. If so, I'd send a request in >> between. :) Either way, please give a feedback. >> >> I'd like request 20 minutes on Maprg Soul meeting to present the >> following topic (which has been presented at AusNoG Sep. 2016) >> >> A link to the presentation: >> > http://www.ausnog.net/sites/default/files/ausnog-2016/presentations/1.6_Xiaohong_Deng_AusNOG2016.pdf >> [1] >> >> Abstract of the talk: >> Broadband network performance is multi-faceted, dependent on factors >> such as access link characteristics, speed-tier, server distance, >> host buffers, ISP network dimensioning, and time-of-day. Daily or >> monthly aggregates, published by content providers such as Netflix >> and Youtube, present a highly simplified view that do not >> distinguish the impact of the above factors, making the comparisons >> potentially unfair and incorrect. Our paper revisits broadband >> performance using open data from M-Lab, utilizing nearly 5 million >> measurements taken over a 12-month period across 19 ISPs in 3 >> continents. We first develop a tool that allows a non-expert to >> query, process, and visualize M-Lab data by applying various filters >> and granularities via a simple web-based interface. Using this tool, >> we characterize the influence of the various factors, and find that >> there are significant biases affecting the averages, including >> disparities amongst households in their frequency of testing and >> access speed-tier, that contribute to fluctuations and biases in ISP >> performance comparisons. We then apply statistical and causal >> inference techniques to reduce the sampling bias, and find that the >> disparity amongst ISPs is lower than current averaging methods >> indicate, with hourly variations giving a truer indication of >> well-dimensioned ISP networks. >> >> Thank you, >> -x >> >> _______________________________________________ >> Maprg mailing list >> Maprg@irtf.org >> https://www.irtf.org/mailman/listinfo/maprg [2] > > -- > Amreesh Phokeer > > > Links: > ------ > [1] > http://www.ausnog.net/sites/default/files/ausnog-2016/presentations/1.6_Xiaohong_Deng_AusNOG2016.pdf > [2] https://www.irtf.org/mailman/listinfo/maprg From nobody Mon Oct 24 12:28:27 2016 Return-Path: X-Original-To: maprg@ietfa.amsl.com Delivered-To: maprg@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 759D01295B8 for ; Mon, 24 Oct 2016 12:28:25 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.33 X-Spam-Level: X-Spam-Status: No, score=-2.33 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RP_MATCHES_RCVD=-0.431] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 67ad8zm8mgrs for ; Mon, 24 Oct 2016 12:28:23 -0700 (PDT) Received: from gpo4.cc.swin.edu.au (gpo4.cc.swin.edu.au [136.186.1.33]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 2BD0F12959B for ; Mon, 24 Oct 2016 12:28:23 -0700 (PDT) Received: from [136.186.229.37] (garmitage.caia.swin.edu.au [136.186.229.37]) by gpo4.cc.swin.edu.au (8.14.3/8.14.3) with ESMTP id u9OJSJNo008299 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Tue, 25 Oct 2016 06:28:19 +1100 To: maprg@irtf.org From: grenville armitage Message-ID: <580E60D3.8030904@swin.edu.au> Date: Tue, 25 Oct 2016 06:28:19 +1100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.1 MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="------------020105040200080005050105" Archived-At: Subject: [Maprg] TEACUP -- a tool for local testbed TCP measurements X-BeenThere: maprg@irtf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "Measurement and Analysis for Protocols \(MAP\) \(Proposed\) RG mailing list" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Oct 2016 19:28:25 -0000 This is a multi-part message in MIME format. --------------020105040200080005050105 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit All, Here's another tool for the Wiki, http://caia.swin.edu.au/tools/teacup ("TCP Experiment Automation Controlled Using Python") We built TEACUP to automate many aspects of running TCP performance experiments in our local testbed. It enables repeatable testing of different TCP algorithms over a range of emulated network path conditions, bottleneck rate limits and bottleneck queuing disciplines. A number of different researchers/students have since replicated their own TEACUP-based testbeds, so perhaps it has wider utility. The URL above provides background, some pictures and links to tech reports for TEACUP v1.0 Public source, additional patches and docs under creative commons license are at https://sourceforge.net/projects/teacup cheers, gja --------------020105040200080005050105 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit All,

Here's another tool for the Wiki, http://caia.swin.edu.au/tools/teacup ("TCP Experiment Automation Controlled Using Python")

We built TEACUP to automate many aspects of running TCP performance experiments in our local testbed. It enables repeatable testing of different TCP algorithms over a range of emulated network path conditions, bottleneck rate limits and bottleneck queuing disciplines. A number of different researchers/students have since replicated their own TEACUP-based testbeds, so perhaps it has wider utility.

The URL above provides background, some pictures and links to tech reports for TEACUP v1.0

Public source, additional patches and docs under creative commons license are at https://sourceforge.net/projects/teacup

cheers,
gja


--------------020105040200080005050105--