From nobody Thu Aug 6 02:47:57 2015 Return-Path: X-Original-To: hops@ietfa.amsl.com Delivered-To: hops@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1C9C41B2B8B for ; Thu, 6 Aug 2015 02:47:55 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -3.91 X-Spam-Level: X-Spam-Status: No, score=-3.91 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-2.3, T_RP_MATCHES_RCVD=-0.01] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jWBcQCTS2qyD for ; Thu, 6 Aug 2015 02:47:53 -0700 (PDT) Received: from smtp.ee.ethz.ch (smtp.ee.ethz.ch [129.132.2.219]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 213F41B2B89 for ; Thu, 6 Aug 2015 02:47:53 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by smtp.ee.ethz.ch (Postfix) with ESMTP id DCAAFD9314; Thu, 6 Aug 2015 11:47:51 +0200 (MEST) X-Virus-Scanned: by amavisd-new on smtp.ee.ethz.ch Received: from smtp.ee.ethz.ch ([127.0.0.1]) by localhost (.ee.ethz.ch [127.0.0.1]) (amavisd-new, port 10024) with LMTP id KeAVAbKScuDD; Thu, 6 Aug 2015 11:47:51 +0200 (MEST) Received: from [192.168.178.33] (x5f71b0a0.dyn.telefonica.de [95.113.176.160]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: mirjak) by smtp.ee.ethz.ch (Postfix) with ESMTPSA id 25F27D930A; Thu, 6 Aug 2015 11:47:51 +0200 (MEST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2102\)) From: =?utf-8?Q?Mirja_K=C3=BChlewind?= Date: Thu, 6 Aug 2015 11:47:51 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: To: hops@ietf.org X-Mailer: Apple Mail (2.2102) Archived-At: Cc: v.bajpai@jacobs-university.de Subject: [hops] Fwd: measurement platforms and their capabilities (previously was HOPS bar bof notes) X-BeenThere: hops@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Measuring deployability of new transport protocols List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Aug 2015 09:47:55 -0000 Hi all, there was a request for an overview/survey paper on measurement = platforms in the meeting. I just realized that this pointer was already = posted on the hops list a while ago (see below). We, as chairs, will start a Wiki (soon) to collect information about = measurement platforms as well as measurement tools (and take this as a = starting point).=20 Let us as well as the group know if you have further knowledge about = this kind of overview papers or similar things by posting a pointer on = the list! Mirja > Anfang der weitergeleiteten Nachricht: >=20 > Von: "Bajpai, Vaibhav" > Betreff: [hops] measurement platforms and their capabilities = (previously was HOPS bar bof notes) > Datum: 7. April 2015 09:30:59 MESZ > An: "hops@ietf.org" > Kopie: "Bajpai, Vaibhav" , Aaron Falk = >=20 > Dear hops, >=20 >> On 23 Mar 2015, at 18:51, Aaron Falk wrote: >=20 > [...] >=20 >> Test infrastructure >> =E2=80=A2 AI: group to share on the list what measurement = (platforms) exists and what capabilities they have >=20 > Early discussions within LMAP [1] also often lead to folks asking for = feature > sets and possibilities of each contemporary performance measurement = platform. > So we started digging literature work in this space and found that = although > there were surveys on topology-based measurement platforms (such CAIDA = Ark > and DIMES); literature work on performance measurement platforms (such = RIPE > Atlas, SamKnows and BISmark) was missing. >=20 > Therefore, we started writing such a survey in 2013 to plug this gap. = This > work got published this week. Thought would share this with you. >=20 > Hope it helps. >=20 > = ----------------8<-----------------8<-----------------8<-----------------8= < > A Survey on Internet Performance Measurement Platforms and Related = Standardization Efforts > Vaibhav Bajpai, J=C3=BCrgen Sch=C3=B6nw=C3=A4lder > IEEE Communications Surveys & Tutorials > April, 2015 >=20 > A number of Internet measurement platforms have emerged in the last = few years. > These platforms have deployed thousands of probes at strategic = locations > within access and backbone networks and behind residential gateways. = In this > paper we provide a taxonomy of these measurement platforms on the = basis of > their deployment use-case. We describe these platforms in detail by = exploring > their coverage, scale, lifetime, deployed metrics and measurement = tools, > architecture and overall research impact. We conclude the survey by = describing > current standardization efforts to make large-scale performance = measurement > platforms interoperable. >=20 > DOI: http://dx.doi.org/10.1109/COMST.2015.2418435 > Author Copy: = http://vaibhavbajpai.com/documents/papers/proceedings/lsmp-comst-2015.pdf > = ----------------8<-----------------8<-----------------8<-----------------8= < >=20 > Thanks! >=20 > [1] https://datatracker.ietf.org/wg/lmap >=20 > Best, Vaibhav >=20 > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D > Vaibhav Bajpai >=20 > Research I, Room 91 > Computer Networks and Distributed Systems (CNDS) Lab > School of Engineering and Sciences > Jacobs University Bremen, Germany >=20 > www.vaibhavbajpai.com > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D > _______________________________________________ > hops mailing list > hops@ietf.org > https://www.ietf.org/mailman/listinfo/hops From nobody Thu Aug 6 03:14:12 2015 Return-Path: X-Original-To: hops@ietfa.amsl.com Delivered-To: hops@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B1CD91B2C04 for ; Thu, 6 Aug 2015 03:14:10 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.961 X-Spam-Level: X-Spam-Status: No, score=-1.961 tagged_above=-999 required=5 tests=[BAYES_20=-0.001, HELO_EQ_DE=0.35, RCVD_IN_DNSWL_MED=-2.3, T_RP_MATCHES_RCVD=-0.01] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id TjAzepXRk6ss for ; Thu, 6 Aug 2015 03:14:08 -0700 (PDT) Received: from atlas3.jacobs-university.de (atlas3.jacobs-university.de [212.201.44.18]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id ED6DB1B2C0B for ; Thu, 6 Aug 2015 03:14:07 -0700 (PDT) Received: from localhost (demetrius5.irc-it.jacobs-university.de [10.70.0.222]) by atlas3.jacobs-university.de (Postfix) with ESMTP id C96BEEA3 for ; Thu, 6 Aug 2015 12:14:05 +0200 (CEST) X-Virus-Scanned: amavisd-new at jacobs-university.de Received: from atlas3.jacobs-university.de ([10.70.0.220]) by localhost (demetrius5.jacobs-university.de [10.70.0.222]) (amavisd-new, port 10030) with ESMTP id Sy8k-0oEvIF8 for ; Thu, 6 Aug 2015 12:14:04 +0200 (CEST) Received: from hermes.jacobs-university.de (hermes.jacobs-university.de [212.201.44.23]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hermes.jacobs-university.de", Issuer "Jacobs University CA - G01" (verified OK)) by atlas3.jacobs-university.de (Postfix) with ESMTPS for ; Thu, 6 Aug 2015 12:14:04 +0200 (CEST) Received: from localhost (demetrius2.jacobs-university.de [212.201.44.47]) by hermes.jacobs-university.de (Postfix) with ESMTP id 7C52420048 for ; Thu, 6 Aug 2015 12:14:04 +0200 (CEST) X-Virus-Scanned: amavisd-new at jacobs-university.de Received: from hermes.jacobs-university.de ([212.201.44.23]) by localhost (demetrius2.jacobs-university.de [212.201.44.32]) (amavisd-new, port 10024) with ESMTP id 3IzEFOCTlhUO for ; Thu, 6 Aug 2015 12:14:03 +0200 (CEST) Received: from exchange.jacobs-university.de (shubcas02.jacobs.jacobs-university.de [10.70.0.123]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client CN "exchange.jacobs-university.de", Issuer "Jacobs University CA - G01" (verified OK)) by hermes.jacobs-university.de (Postfix) with ESMTPS id 28F1A2004E for ; Thu, 6 Aug 2015 12:14:03 +0200 (CEST) Received: from SXCHMB01.jacobs.jacobs-university.de ([fe80::c1f:c30f:99ac:df0c]) by SHUBCAS02.jacobs.jacobs-university.de ([::1]) with mapi id 14.03.0248.002; Thu, 6 Aug 2015 12:14:02 +0200 From: "Bajpai, Vaibhav" To: "hops@ietf.org" Thread-Topic: lessons learned from using ripe atlas Thread-Index: AQHQ0DCe9VgjkWLOHEaGCiewW0aaUg== Date: Thu, 6 Aug 2015 10:14:02 +0000 Message-ID: <23F04F25-026F-4538-A9A5-E37703EA0072@jacobs-university.de> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [10.50.203.30] Content-Type: multipart/signed; boundary="Apple-Mail=_CDA61337-F2E9-4C8C-94E4-B4A7CC6E53C9"; protocol="application/pgp-signature"; micalg=pgp-sha512 MIME-Version: 1.0 Archived-At: Cc: "Bajpai, Vaibhav" Subject: [hops] lessons learned from using ripe atlas X-BeenThere: hops@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Measuring deployability of new transport protocols List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Aug 2015 10:14:10 -0000 --Apple-Mail=_CDA61337-F2E9-4C8C-94E4-B4A7CC6E53C9 X-Clacks-Overhead: GNU Terry Pratchett Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Dear hops, [...] > We, as chairs, will start a Wiki (soon) to collect information = about > measurement platforms as well as measurement tools (and take this = as a > starting point). Let us as well as the group know if you have = further > knowledge about this kind of overview papers or similar things by = posting a > pointer on the list! Perhaps one more that might interest folks: As you know RIPE Atlas was initially designed to measure reachability = and connectivity of the Internet. With the deployment of 14K probes, there = is seen trend to use the platform for performance-based measurements (such as comparing v4/v6 latency on the Internet). Given, we have been in a position to have close collaboration (through the LEONE project) with SamKnows (a dedicated performance-measurement platform), we decided to share our experiences in using the RIPE Atlas platform from this lens. This work recently got accepted to ACM CCR July 2015 issue and came online (PDF link below) today. Thought folks might find it interesting so sharing it along: = ----------------8<-----------------8<-----------------8<-----------------8= < Lessons Learned from using the RIPE Atlas Platform for Measurement = Research Vaibhav Bajpai, Steffie Jacob Eravuchira, J=C3=BCrgen Sch=C3=B6nw=C3=A4lde= r ACM Computer Communication Review (CCR), July, 2015 We reflect upon our experience in using the RIPE Atlas platform for measurement-based research. We show how in addition to credits, control = checks using rate limits are in place to ensure that the platform does not get overloaded with measurements. We show how the Autonomous System = (AS)-based distribution of RIPE Atlas probes is heavily skewed which limits = possibilities of measurements sourced from a specific origin-AS. We discuss the = significance of probe calibration and how we leverage it to identify load issues in = older hardware versions (38.6% overall as of Sep 2014) of probes. We show how performance measurement platforms (such as RIPE Atlas, SamKnows, BISmark = and Dasu) can benefit from each other by demonstrating two example = use-cases. We also open discussion on how RIPE Atlas deployment can be made more = useful by relaying more probe metadata information back to the scientific = community and by strategically deploying probes to reduce the inherent sampling bias embedded in probe-based measurement platforms. Paper: http://dx.doi.org/10.1145/2805789.2805796 Mirror: = http://vaibhavbajpai.com/documents/papers/proceedings/ripeatlas-ccr-2015.p= df = ----------------8<-----------------8<-----------------8<-----------------8= < Best, Vaibhav =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D Vaibhav Bajpai Room 91, Research I School of Engineering and Sciences Jacobs University Bremen, Germany www.vaibhavbajpai.com =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D --Apple-Mail=_CDA61337-F2E9-4C8C-94E4-B4A7CC6E53C9 X-Clacks-Overhead: GNU Terry Pratchett Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJVwzNqAAoJEHR3XKwTWKOZdJ8H/0RmmRbTIu+0Lhpx1YbJCXFj xB+nBl0M7ZwsbeYHQ4K0vePkQEAOLdwbOFKBWw97rksCEweMpQ1i+5GODghXDr0h AedE/6PAjzQwQwErE3MS/1DGapC6d8aza6783ddhChJDhrJb8iz5DdGpKoJovgzY Nl6SQhN/loR+v5tnUyK5L82vpiohS/lBa7oMhdfenMQxqQisOJyQVWPTwRgcJBzd SdDDFrDTy38+X4wWENlLhL01h4Yb7mkTN6+LX/cmbQ6xkuKko3k+XZuQfoqYfFDy 28Hi3qh3I4LUJoYXSbJFam8y513SvfVEyCobA0XTWHPTYU2b2x/wsAiopwvh+5M= =DmTc -----END PGP SIGNATURE----- --Apple-Mail=_CDA61337-F2E9-4C8C-94E4-B4A7CC6E53C9-- From nobody Thu Aug 6 05:16:59 2015 Return-Path: X-Original-To: hops@ietfa.amsl.com Delivered-To: hops@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3C5521B2E4A for ; Thu, 6 Aug 2015 05:16:58 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -3.041 X-Spam-Level: X-Spam-Status: No, score=-3.041 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, HELO_EQ_AT=0.424, HOST_EQ_AT=0.745, RCVD_IN_DNSWL_MED=-2.3, T_RP_MATCHES_RCVD=-0.01] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZRrSeMdpSuwi for ; Thu, 6 Aug 2015 05:16:55 -0700 (PDT) Received: from mail1.zserv.tuwien.ac.at (mail1.zserv.tuwien.ac.at [128.130.35.37]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 013841B2E49 for ; Thu, 6 Aug 2015 05:16:54 -0700 (PDT) Received: from [128.131.67.239] (jason.nt.tuwien.ac.at [128.131.67.239]) (authenticated bits=0) by mail1.zserv.tuwien.ac.at (8.13.8/8.13.8) with ESMTP id t76CGqZU013052 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Thu, 6 Aug 2015 14:16:52 +0200 To: hops@ietf.org References: From: Joachim Fabini X-Enigmail-Draft-Status: N1110 Message-ID: <55C35019.3010306@tuwien.ac.at> Date: Thu, 6 Aug 2015 14:16:25 +0200 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.1.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Archived-At: Subject: Re: [hops] Fwd: measurement platforms and their capabilities (previously was HOPS bar bof notes) X-BeenThere: hops@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Measuring deployability of new transport protocols List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Aug 2015 12:16:58 -0000 Hi Mirja, all we can contribute some methodological findings and advances in one-way delay measurements. Background: Today's networks have evolved to complex, stateful systems (at layers below IP). It's time to question the stateless copper wire model, the main abstraction on which our algorithms, applications, and measurements rely. We can improve measurement methodologies to better capture the behavior of networks and to find out where the limits of measurements are. Concerning the hops charter: from an end-to-end perspective it's very hard to differentiate if systematic impairments have been caused by a) network operation and coding at lower layers and b) middlebox actions (unless these middleboxes modify network, transport- or application header values). In other words, it is difficult to draw a line between network scheduling, policing and middlebox behavior that directly affects the extensibility of the Internet. Aggregation and interaction of subsequent links in a path complicate matters even more. The main point is that accurate delay measurements can detect (some?) network elements on the path that maintain state. And these are potential/ideal candidates for substantially touching other layers, too. If there is interest in hops I can present some slides at the next meeting @ IETF94 (online or offline, depending on travel/time budget). My feeling is that the findings can support some of the ongoing projects (RIPE, Monroe). Some related publications (please drop me a note if you need a personal copy): http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6553584 http://dl.acm.org/citation.cfm?id=2747654 http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7151564 and, of course: https://tools.ietf.org/html/rfc7312 Joachim On 06.08.2015 11:47, Mirja Kühlewind wrote: > Hi all, > > there was a request for an overview/survey paper on measurement platforms in the meeting. I just realized that this pointer was already posted on the hops list a while ago (see below). > > We, as chairs, will start a Wiki (soon) to collect information about measurement platforms as well as measurement tools (and take this as a starting point). > > Let us as well as the group know if you have further knowledge about this kind of overview papers or similar things by posting a pointer on the list! > > Mirja > > >> Anfang der weitergeleiteten Nachricht: >> >> Von: "Bajpai, Vaibhav" >> Betreff: [hops] measurement platforms and their capabilities (previously was HOPS bar bof notes) >> Datum: 7. April 2015 09:30:59 MESZ >> An: "hops@ietf.org" >> Kopie: "Bajpai, Vaibhav" , Aaron Falk >> >> Dear hops, >> >>> On 23 Mar 2015, at 18:51, Aaron Falk wrote: >> >> [...] >> >>> Test infrastructure >>> • AI: group to share on the list what measurement (platforms) exists and what capabilities they have >> >> Early discussions within LMAP [1] also often lead to folks asking for feature >> sets and possibilities of each contemporary performance measurement platform. >> So we started digging literature work in this space and found that although >> there were surveys on topology-based measurement platforms (such CAIDA Ark >> and DIMES); literature work on performance measurement platforms (such RIPE >> Atlas, SamKnows and BISmark) was missing. >> >> Therefore, we started writing such a survey in 2013 to plug this gap. This >> work got published this week. Thought would share this with you. >> >> Hope it helps. >> >> ----------------8<-----------------8<-----------------8<-----------------8< >> A Survey on Internet Performance Measurement Platforms and Related Standardization Efforts >> Vaibhav Bajpai, Jürgen Schönwälder >> IEEE Communications Surveys & Tutorials >> April, 2015 >> >> A number of Internet measurement platforms have emerged in the last few years. >> These platforms have deployed thousands of probes at strategic locations >> within access and backbone networks and behind residential gateways. In this >> paper we provide a taxonomy of these measurement platforms on the basis of >> their deployment use-case. We describe these platforms in detail by exploring >> their coverage, scale, lifetime, deployed metrics and measurement tools, >> architecture and overall research impact. We conclude the survey by describing >> current standardization efforts to make large-scale performance measurement >> platforms interoperable. >> >> DOI: http://dx.doi.org/10.1109/COMST.2015.2418435 >> Author Copy: http://vaibhavbajpai.com/documents/papers/proceedings/lsmp-comst-2015.pdf >> ----------------8<-----------------8<-----------------8<-----------------8< >> >> Thanks! >> >> [1] https://datatracker.ietf.org/wg/lmap >> >> Best, Vaibhav >> >> ===================================================== >> Vaibhav Bajpai >> >> Research I, Room 91 >> Computer Networks and Distributed Systems (CNDS) Lab >> School of Engineering and Sciences >> Jacobs University Bremen, Germany >> >> www.vaibhavbajpai.com >> ===================================================== >> _______________________________________________ >> hops mailing list >> hops@ietf.org >> https://www.ietf.org/mailman/listinfo/hops > > _______________________________________________ > hops mailing list > hops@ietf.org > https://www.ietf.org/mailman/listinfo/hops > > From nobody Thu Aug 6 06:09:32 2015 Return-Path: X-Original-To: hops@ietfa.amsl.com Delivered-To: hops@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A38051B2F01 for ; Thu, 6 Aug 2015 06:09:30 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -3.91 X-Spam-Level: X-Spam-Status: No, score=-3.91 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, MIME_8BIT_HEADER=0.3, RCVD_IN_DNSWL_MED=-2.3, T_RP_MATCHES_RCVD=-0.01] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id p-rarG_SL_qr for ; Thu, 6 Aug 2015 06:09:27 -0700 (PDT) Received: from smtp.ee.ethz.ch (smtp.ee.ethz.ch [129.132.2.219]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BF7D11B2EFF for ; Thu, 6 Aug 2015 06:09:20 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by smtp.ee.ethz.ch (Postfix) with ESMTP id 6103DD930B; Thu, 6 Aug 2015 15:09:19 +0200 (MEST) X-Virus-Scanned: by amavisd-new on smtp.ee.ethz.ch Received: from smtp.ee.ethz.ch ([127.0.0.1]) by localhost (.ee.ethz.ch [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 4j0uCKo1g4vR; Thu, 6 Aug 2015 15:09:19 +0200 (MEST) Received: from vpn-global-253-dhcp.ethz.ch (vpn-global-253-dhcp.ethz.ch [129.132.211.253]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: mirjak) by smtp.ee.ethz.ch (Postfix) with ESMTPSA id 7EF70D930A; Thu, 6 Aug 2015 15:09:18 +0200 (MEST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2102\)) From: =?utf-8?Q?Mirja_K=C3=BChlewind?= In-Reply-To: <55C35019.3010306@tuwien.ac.at> Date: Thu, 6 Aug 2015 15:09:16 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <930E6334-717D-43EF-B570-759D9D7C91EE@tik.ee.ethz.ch> References: <55C35019.3010306@tuwien.ac.at> To: Joachim Fabini X-Mailer: Apple Mail (2.2102) Archived-At: Cc: hops@ietf.org Subject: Re: [hops] measurement platforms and their capabilities (previously was HOPS bar bof notes) X-BeenThere: hops@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Measuring deployability of new transport protocols List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Aug 2015 13:09:30 -0000 Hi Joachim, this certainly sounds interesting and thanks for sending the pointers. = We will keep you in mind for the next meeting. We will probably send out = an email a couple weeks before the meeting to ask for additional agenda = requests. Just in case we didn=E2=80=99t contact you again at this point = of time, please reply to that mail and request a presentation (again). It seems like this is in scope and if you have data to share that=E2=80=99= s great! Mirja > Am 06.08.2015 um 14:16 schrieb Joachim Fabini = : >=20 > Hi Mirja, all >=20 > we can contribute some methodological findings and advances in one-way > delay measurements. >=20 > Background: Today's networks have evolved to complex, stateful systems > (at layers below IP). It's time to question the stateless copper wire > model, the main abstraction on which our algorithms, applications, and > measurements rely. We can improve measurement methodologies to better > capture the behavior of networks and to find out where the limits of > measurements are. >=20 > Concerning the hops charter: from an end-to-end perspective it's very > hard to differentiate if systematic impairments have been caused by a) > network operation and coding at lower layers and b) middlebox actions > (unless these middleboxes modify network, transport- or application > header values). In other words, it is difficult to draw a line between > network scheduling, policing and middlebox behavior that directly > affects the extensibility of the Internet. Aggregation and interaction > of subsequent links in a path complicate matters even more. > The main point is that accurate delay measurements can detect (some?) > network elements on the path that maintain state. And these are > potential/ideal candidates for substantially touching other layers, = too. >=20 > If there is interest in hops I can present some slides at the next > meeting @ IETF94 (online or offline, depending on travel/time budget). > My feeling is that the findings can support some of the ongoing = projects > (RIPE, Monroe). >=20 > Some related publications (please drop me a note if you need a = personal > copy): > http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=3D6553584 > http://dl.acm.org/citation.cfm?id=3D2747654 > http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=3D7151564 > and, of course: https://tools.ietf.org/html/rfc7312 >=20 > Joachim >=20 > On 06.08.2015 11:47, Mirja K=C3=BChlewind wrote: >> Hi all, >>=20 >> there was a request for an overview/survey paper on measurement = platforms in the meeting. I just realized that this pointer was already = posted on the hops list a while ago (see below). >>=20 >> We, as chairs, will start a Wiki (soon) to collect information about = measurement platforms as well as measurement tools (and take this as a = starting point).=20 >>=20 >> Let us as well as the group know if you have further knowledge about = this kind of overview papers or similar things by posting a pointer on = the list! >>=20 >> Mirja >>=20 >>=20 >>> Anfang der weitergeleiteten Nachricht: >>>=20 >>> Von: "Bajpai, Vaibhav" >>> Betreff: [hops] measurement platforms and their capabilities = (previously was HOPS bar bof notes) >>> Datum: 7. April 2015 09:30:59 MESZ >>> An: "hops@ietf.org" >>> Kopie: "Bajpai, Vaibhav" , Aaron Falk = >>>=20 >>> Dear hops, >>>=20 >>>> On 23 Mar 2015, at 18:51, Aaron Falk wrote: >>>=20 >>> [...] >>>=20 >>>> Test infrastructure >>>> =E2=80=A2 AI: group to share on the list what measurement = (platforms) exists and what capabilities they have >>>=20 >>> Early discussions within LMAP [1] also often lead to folks asking = for feature >>> sets and possibilities of each contemporary performance measurement = platform. >>> So we started digging literature work in this space and found that = although >>> there were surveys on topology-based measurement platforms (such = CAIDA Ark >>> and DIMES); literature work on performance measurement platforms = (such RIPE >>> Atlas, SamKnows and BISmark) was missing. >>>=20 >>> Therefore, we started writing such a survey in 2013 to plug this = gap. This >>> work got published this week. Thought would share this with you. >>>=20 >>> Hope it helps. >>>=20 >>> = ----------------8<-----------------8<-----------------8<-----------------8= < >>> A Survey on Internet Performance Measurement Platforms and Related = Standardization Efforts >>> Vaibhav Bajpai, J=C3=BCrgen Sch=C3=B6nw=C3=A4lder >>> IEEE Communications Surveys & Tutorials >>> April, 2015 >>>=20 >>> A number of Internet measurement platforms have emerged in the last = few years. >>> These platforms have deployed thousands of probes at strategic = locations >>> within access and backbone networks and behind residential gateways. = In this >>> paper we provide a taxonomy of these measurement platforms on the = basis of >>> their deployment use-case. We describe these platforms in detail by = exploring >>> their coverage, scale, lifetime, deployed metrics and measurement = tools, >>> architecture and overall research impact. We conclude the survey by = describing >>> current standardization efforts to make large-scale performance = measurement >>> platforms interoperable. >>>=20 >>> DOI: http://dx.doi.org/10.1109/COMST.2015.2418435 >>> Author Copy: = http://vaibhavbajpai.com/documents/papers/proceedings/lsmp-comst-2015.pdf >>> = ----------------8<-----------------8<-----------------8<-----------------8= < >>>=20 >>> Thanks! >>>=20 >>> [1] https://datatracker.ietf.org/wg/lmap >>>=20 >>> Best, Vaibhav >>>=20 >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >>> Vaibhav Bajpai >>>=20 >>> Research I, Room 91 >>> Computer Networks and Distributed Systems (CNDS) Lab >>> School of Engineering and Sciences >>> Jacobs University Bremen, Germany >>>=20 >>> www.vaibhavbajpai.com >>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D >>> _______________________________________________ >>> hops mailing list >>> hops@ietf.org >>> https://www.ietf.org/mailman/listinfo/hops >>=20 >> _______________________________________________ >> hops mailing list >> hops@ietf.org >> https://www.ietf.org/mailman/listinfo/hops >>=20 >>=20 >=20 > _______________________________________________ > hops mailing list > hops@ietf.org > https://www.ietf.org/mailman/listinfo/hops