From nobody Fri Mar 4 06:39:50 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id E7A641A0397 for ; Fri, 4 Mar 2016 06:39:49 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.5 X-Spam-Level: X-Spam-Status: No, score=-1.5 tagged_above=-999 required=5 tests=[BAYES_50=0.8, RCVD_IN_DNSWL_MED=-2.3] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id obRN-vvpsWj4 for ; Fri, 4 Mar 2016 06:39:49 -0800 (PST) Received: from sbh17.songbird.com (sbh17.songbird.com [72.52.113.17]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id E38BB1A0854 for ; Fri, 4 Mar 2016 06:39:48 -0800 (PST) Received: from [192.168.1.168] (76-218-10-206.lightspeed.sntcca.sbcglobal.net [76.218.10.206]) (authenticated bits=0) by sbh17.songbird.com (8.13.8/8.13.8) with ESMTP id u24EdjS9023089 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT) for ; Fri, 4 Mar 2016 06:39:48 -0800 To: "tools-discuss@ietf.org" From: Dave Crocker Organization: Brandenburg InternetWorking Message-ID: <56D99E2F.1040908@dcrocker.net> Date: Fri, 4 Mar 2016 06:39:43 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0 (sbh17.songbird.com [72.52.113.66]); Fri, 04 Mar 2016 06:39:48 -0800 (PST) Archived-At: Subject: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: dcrocker@bbiw.net List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 14:39:50 -0000 G'day. The IMAP interface to IETF email archives is wonderful. Very, very large kudos for providing this. However... The structure of it creates a challenge that is worth discussing: Some of these archives are quite large and IMAP interaction with them is cumbersome and bloated. For example, every time I want to use the interface to look at the ietf mailing list archive, my system spins for a very long time, building an index for -- and, I believe, downloading -- the 110K+ messages in the archive. It's possible that the nature of IMAP leaves no good choices for better interaction, but I thought I'd raise the topic to see if others are reacting to this and possibly have suggestions. d/ -- Dave Crocker Brandenburg InternetWorking bbiw.net From nobody Fri Mar 4 08:28:57 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 83D371A0235 for ; Fri, 4 Mar 2016 08:28:56 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.235 X-Spam-Level: X-Spam-Status: No, score=-1.235 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.665] autolearn=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6Flw2qoKEunT for ; Fri, 4 Mar 2016 08:28:55 -0800 (PST) Received: from trial.insidesales.com (trial.insidesales.com [173.239.64.131]) by ietfa.amsl.com (Postfix) with ESMTP id B29191A01F0 for ; Fri, 4 Mar 2016 08:28:55 -0800 (PST) Received: from mail pickup service by aws.ihance.com with Microsoft SMTPSVC; Fri, 4 Mar 2016 08:29:04 -0800 thread-index: AdF2MvdCsJTTV/bBTd26k23ddrUxcw== Content-Class: urn:content-classes:message Importance: normal Priority: normal X-MimeOLE: Produced By Microsoft MimeOLE V6.3.9600.17905 X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=rWv83vmlu84d7wdPB/KCqGWxOeDx9fofUyWU834n7Ic=; b=XX+BqFwg/afuDj1P7QD9KqFhBrha8xLlWSYgQHKl0c7p2vbsWThC0eWbFr39kdZpbd y3akM7JTpASzi8WbZrPDml3XdTPaZ8i840hcVFHHVMNjmUJV5amLv2hNA+v2GKZUVKeW pFlTwH/zjNUpf2aFDs4w/gfQ8q1EZKZqPBS6dilv9WKTmcnxxLcrHyCcAJQtodp540OY f296zMPexzG3byX9RHYSaH9/0rvmt+w3ptgUnEpbWM4oIkpD2oAhUmg7cLkcTKYchz9w cdvdncg4ziAgGIq5ZIayXoAdxSDFSU2eQ9e1O1Yr7z0UbW0IkujUPe65eGbSBbGuG5J+ CcDw== X-Gm-Message-State: AD7BkJJ2YUApSOoCLR2VhuAf30e9XsVZ9NMNob+BTX/tVJxam2h2QcFjvGiPpweESlsEp2syGtgT+y4Ud7Evr1Dc+GC1ueLfw1nmJdCw1B1B13ist8OILd4hsenyKYSvd623nCYpvlUdx/cZgA== X-Received: by 10.66.234.104 with SMTP id ud8mr13296273pac.143.1457108934878; Fri, 04 Mar 2016 08:28:54 -0800 (PST) X-Received: by 10.66.234.104 with SMTP id ud8mr13296255pac.143.1457108934690; Fri, 04 Mar 2016 08:28:54 -0800 (PST) To: , "tools-discuss@ietf.org" References: <56D99E2F.1040908@dcrocker.net> From: "Simon Perreault" Message-ID: <56D9B7C4.2000807@jive.com> Date: Fri, 4 Mar 2016 11:28:52 -0500 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <56D99E2F.1040908@dcrocker.net> Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: 8bit X-OriginalArrivalTime: 04 Mar 2016 16:29:03.0923 (UTC) FILETIME=[F7428830:01D17632] X-Delivery-MTA: 10.0.1.3:trial.insidesales.com Archived-At: Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 16:28:56 -0000 Le 2016-03-04 09:39, Dave Crocker a écrit : > For example, every time I want to use the interface to look at the ietf > mailing list archive, my system spins for a very long time, building an > index for -- and, I believe, downloading -- the 110K+ messages in the > archive. > > It's possible that the nature of IMAP leaves no good choices for better > interaction, but I thought I'd raise the topic to see if others are > reacting to this and possibly have suggestions. Can't you disable local copying? On Thunderbird at least there is such an option. Anyway, the point is that IMAP does not require the client to download everything and build a local index, it's an implementation-specific "feature". Simon From nobody Fri Mar 4 08:45:43 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 7313A1A1A5F for ; Fri, 4 Mar 2016 08:45:41 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -4.2 X-Spam-Level: X-Spam-Status: No, score=-4.2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id annYNAoIH90X for ; Fri, 4 Mar 2016 08:45:38 -0800 (PST) Received: from sbh17.songbird.com (sbh17.songbird.com [72.52.113.17]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C20F61A1A4D for ; Fri, 4 Mar 2016 08:45:38 -0800 (PST) Received: from [192.168.1.168] (76-218-10-206.lightspeed.sntcca.sbcglobal.net [76.218.10.206]) (authenticated bits=0) by sbh17.songbird.com (8.13.8/8.13.8) with ESMTP id u24GjWMi024817 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Fri, 4 Mar 2016 08:45:38 -0800 To: Simon Perreault , "tools-discuss@ietf.org" References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> From: Dave Crocker Organization: Brandenburg InternetWorking Message-ID: <56D9BBAB.3050600@dcrocker.net> Date: Fri, 4 Mar 2016 08:45:31 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <56D9B7C4.2000807@jive.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0 (sbh17.songbird.com [72.52.113.66]); Fri, 04 Mar 2016 08:45:38 -0800 (PST) Archived-At: Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: dcrocker@bbiw.net List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 16:45:41 -0000 On 3/4/2016 8:28 AM, Simon Perreault wrote: > Can't you disable local copying? On Thunderbird at least there is such > an option. Anyway, the point is that IMAP does not require the client to > download everything and build a local index, it's an > implementation-specific "feature". First, a common default is to download an entire copy. Second is that it at least has to download the index, and IMAP is transaction-heavy. This makes at least startup with a large folder expensive in time and wasteful in storage. d/ -- Dave Crocker Brandenburg InternetWorking bbiw.net From nobody Fri Mar 4 08:56:51 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9F2751A1AA7 for ; Fri, 4 Mar 2016 08:56:49 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.902 X-Spam-Level: X-Spam-Status: No, score=-1.902 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RljD71ZhUPV0 for ; Fri, 4 Mar 2016 08:56:48 -0800 (PST) Received: from jazz.viagenie.ca (jazz.viagenie.ca [IPv6:2620:0:230:8000::2]) by ietfa.amsl.com (Postfix) with ESMTP id 05A1E1A1A9F for ; Fri, 4 Mar 2016 08:56:48 -0800 (PST) Received: from [206.123.31.198] (h198.viagenie.ca [206.123.31.198]) by jazz.viagenie.ca (Postfix) with ESMTPSA id 73EF74690F; Fri, 4 Mar 2016 11:56:47 -0500 (EST) From: "Marc Blanchet" To: "Simon Perreault" , dcrocker@bbiw.net Date: Fri, 04 Mar 2016 11:56:45 -0500 Message-ID: <54AC5833-E442-4AB1-918C-50123D39F8B1@viagenie.ca> In-Reply-To: <56D9B7C4.2000807@jive.com> References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Mailer: MailMate (1.9.3r5187) Archived-At: Cc: "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 16:56:49 -0000 On 4 Mar 2016, at 11:28, Simon Perreault wrote: > Le 2016-03-04 09:39, Dave Crocker a écrit : >> For example, every time I want to use the interface to look at the >> ietf >> mailing list archive, my system spins for a very long time, building >> an >> index for -- and, I believe, downloading -- the 110K+ messages in the >> archive. >> >> It's possible that the nature of IMAP leaves no good choices for >> better >> interaction, but I thought I'd raise the topic to see if others are >> reacting to this and possibly have suggestions. > > Can't you disable local copying? On Thunderbird at least there is such > an option. Anyway, the point is that IMAP does not require the client > to > download everything and build a local index, it's an > implementation-specific "feature". good point. While not wanting to start discussion on specific IMAP implementations, Apple Mail is not really good at large folders. This is a reason that I moved to another client. Dave, if you have Apple Mail, consider testing Thunderbird or another client, you may see a big difference. Marc. > > Simon > > -- > Tools-discuss mailing list > Tools-discuss@ietf.org > https://www.ietf.org/mailman/listinfo/tools-discuss > > Please report datatracker.ietf.org bugs at > http://tools.ietf.org/tools/ietfdb > Please report tools.ietf.org bugs at > http://tools.ietf.org/tools/issues or > send email to webmaster@tools.ietf.org From nobody Fri Mar 4 09:11:32 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1E1881A1B43 for ; Fri, 4 Mar 2016 09:11:32 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -4.2 X-Spam-Level: X-Spam-Status: No, score=-4.2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Bf1qzEqHMFx8 for ; Fri, 4 Mar 2016 09:11:30 -0800 (PST) Received: from sbh17.songbird.com (sbh17.songbird.com [72.52.113.17]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 972321A1B34 for ; Fri, 4 Mar 2016 09:11:30 -0800 (PST) Received: from [192.168.1.168] (76-218-10-206.lightspeed.sntcca.sbcglobal.net [76.218.10.206]) (authenticated bits=0) by sbh17.songbird.com (8.13.8/8.13.8) with ESMTP id u24HBP37003780 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Fri, 4 Mar 2016 09:11:29 -0800 To: Marc Blanchet , Simon Perreault References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> <54AC5833-E442-4AB1-918C-50123D39F8B1@viagenie.ca> From: Dave Crocker Organization: Brandenburg InternetWorking Message-ID: <56D9C1BC.8070107@dcrocker.net> Date: Fri, 4 Mar 2016 09:11:24 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <54AC5833-E442-4AB1-918C-50123D39F8B1@viagenie.ca> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0 (sbh17.songbird.com [72.52.113.66]); Fri, 04 Mar 2016 09:11:29 -0800 (PST) Archived-At: Cc: "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: dcrocker@bbiw.net List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 17:11:32 -0000 On 3/4/2016 8:56 AM, Marc Blanchet wrote: > Dave, if you have Apple Mail, consider testing Thunderbird or another > client, you may see a big difference. Should have mentioned that I already use Thunderbird. My concerns are based on that usage. d/ -- Dave Crocker Brandenburg InternetWorking bbiw.net From nobody Fri Mar 4 09:16:01 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id EC2111A1B8F for ; Fri, 4 Mar 2016 09:15:58 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2 X-Spam-Level: X-Spam-Status: No, score=-2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, SPF_PASS=-0.001] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id OG64JQ7vPgqO for ; Fri, 4 Mar 2016 09:15:57 -0800 (PST) Received: from mail-ob0-x232.google.com (mail-ob0-x232.google.com [IPv6:2607:f8b0:4003:c01::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 5684F1A1B76 for ; Fri, 4 Mar 2016 09:15:46 -0800 (PST) Received: by mail-ob0-x232.google.com with SMTP id fz5so56010425obc.0 for ; Fri, 04 Mar 2016 09:15:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:mime-version:from:in-reply-to:date:cc:message-id:references :to; bh=zEd9aHynBfWoUTCuruI+GtCJDUxWXm0d6fMYAwGIvKY=; b=s75Y0WEb19YBptJsPx/QhGJ+RD2MYR6bcND1iyaPCz1G98T2wIDoAz4ZzlUbFm7dSR nf9aWQL9rc0BD638Y6ty98nkW6dTBi6gvGtIgawPcbPlY+QZCAFeksfW1XKiZkxlD6Xz wxuuQqeTaxrdmU1xs9TPrXz7ooKUwJ33vwgIVXEmW1jQMNzpCLx9sa8zIIQseainPtXt HwIsSIXBAgmVq/WY9GEFCWh7jReaBq2StKvbVPI4AE9/hBBUHWsjbETrBZQOACDwE5j2 jU5R+etVM2kH2EEybYNxSQDUeAUEQ64pdUZVcPC5SaAu7+tYswdSiFRJMSCFE6SZ1lFn Xz6Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:mime-version:from:in-reply-to:date:cc :message-id:references:to; bh=zEd9aHynBfWoUTCuruI+GtCJDUxWXm0d6fMYAwGIvKY=; b=Y0vo4vxfGyKBDsLo+BNv4hZhU2wwespHuOQMnCF/brkZxpWujADoL21ZECCG2Bx/B7 11+/+7jKS1k204JhEXzn5C7oZ28u3ZOFivDCOrkrSYvmZnyEbyFFRXBzYMIIIDILNn2L D/UA21cFgNKKxC3+anx+ppiN0raLsVVazkyNdPCjGfGyvteYC8Yryh0xd/Jg+nFp9ghq bc/zhGbeYqSZHAlSpKcVVDjkiywaaS2I99xNnBc/DOh6ZmKzwFB7QpljVCUIIRUzFPNN YPKCsRlO1TBTDCaH6UcmovA6hjizVWuqyf8HSmCIni1QdcijojzcDWEAFJMJiyiUvh76 Tviw== X-Gm-Message-State: AD7BkJKRc3iJ+gi70L9qMNJH2ueDvSQplnAhPrxPefUeFeSpFIoKFWql+Fo0o4t1YvaX/Q== X-Received: by 10.60.155.97 with SMTP id vv1mr6696789oeb.60.1457111745680; Fri, 04 Mar 2016 09:15:45 -0800 (PST) Received: from [10.0.0.24] (c-71-202-19-53.hsd1.ca.comcast.net. [71.202.19.53]) by smtp.gmail.com with ESMTPSA id f3sm2638522oek.11.2016.03.04.09.15.43 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Fri, 04 Mar 2016 09:15:44 -0800 (PST) Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Content-Type: multipart/signed; boundary="Apple-Mail=_12EE9587-E638-4D68-9738-70C912CC7398"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail 2.5.2 From: Bob Hinden In-Reply-To: <54AC5833-E442-4AB1-918C-50123D39F8B1@viagenie.ca> Date: Fri, 4 Mar 2016 09:15:42 -0800 Message-Id: <3CA67963-D348-47B3-8E82-7C2166F86F7C@gmail.com> References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> <54AC5833-E442-4AB1-918C-50123D39F8B1@viagenie.ca> To: Marc Blanchet X-Mailer: Apple Mail (2.2104) Archived-At: Cc: Dave Crocker , "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 17:15:59 -0000 --Apple-Mail=_12EE9587-E638-4D68-9738-70C912CC7398 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Marc, >>=20 > good point. While not wanting to start discussion on specific IMAP = implementations, Apple Mail is not really good at large folders. This is = a reason that I moved to another client. Dave, if you have Apple Mail, = consider testing Thunderbird or another client, you may see a big = difference. I think it=E2=80=99s a problem if IMAP access to email archives is only = useful on a subset of IMAP clients. Bob --Apple-Mail=_12EE9587-E638-4D68-9738-70C912CC7398 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJW2cK+AAoJEK7rdBF357uohBYH/jXAnE6H5t7iFkBsP9Nd/HN3 UEy2sqaPfBagL5/9Q6JWviUPwXx6kyN8xFIqas+JvJqsRQKLXGioRaGlY69kec81 JIHEoPTPSi/xzQ/3gf6VjYC4P1LbsHNvYeJjdNt6KMCI4Rj7079rDSmT1y5vOk0x htjJVJVuMgZkXAmmBgNmJ/wIItadWaYEEOIvvIbUH/+TRvZnHbI3GRaVaIKLgSdw /KcwIUvzvSiUBaJ5S9UKGUNwQLlVT7MY6KdUWxR+CqgIYNIdGeW3qGlbHWv1KfoA qKFvyII0OoTFxJ9B1aWswJ7nVwKoU1+fKV3BbmYNb4xfo8heCC2//MFu/ylwwwI= =85uc -----END PGP SIGNATURE----- --Apple-Mail=_12EE9587-E638-4D68-9738-70C912CC7398-- From nobody Fri Mar 4 10:57:37 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 71C161A87BB for ; Fri, 4 Mar 2016 10:57:36 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.902 X-Spam-Level: X-Spam-Status: No, score=-1.902 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id FdVaA1-DI33O for ; Fri, 4 Mar 2016 10:57:34 -0800 (PST) Received: from tuna.sandelman.ca (tuna.sandelman.ca [209.87.249.19]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9C2DF1A87A2 for ; Fri, 4 Mar 2016 10:57:34 -0800 (PST) Received: from sandelman.ca (obiwan.sandelman.ca [209.87.249.21]) by tuna.sandelman.ca (Postfix) with ESMTP id 819F92009E; Fri, 4 Mar 2016 13:59:11 -0500 (EST) Received: from obiwan.sandelman.ca (localhost [IPv6:::1]) by sandelman.ca (Postfix) with ESMTP id 88B0D63755; Fri, 4 Mar 2016 13:57:33 -0500 (EST) From: Michael Richardson To: "Simon Perreault" In-Reply-To: <56D9B7C4.2000807@jive.com> References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> X-Mailer: MH-E 8.6; nmh 1.6+dev; GNU Emacs 24.4.2 X-Face: $\n1pF)h^`}$H>Hk{L"x@)JS7<%Az}5RyS@k9X%29-lHB$Ti.V>2bi.~ehC0; <'$9xN5Ub# z!G,p`nR&p7Fz@^UXIn156S8.~^@MJ*mMsD7=QFeq%AL4m Archived-At: Cc: dcrocker@bbiw.net, "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 18:57:36 -0000 --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Simon Perreault wrote: > Le 2016-03-04 09:39, Dave Crocker a =C3=A9crit : >> For example, every time I want to use the interface to look at the >> ietf mailing list archive, my system spins for a very long time, >> building an index for -- and, I believe, downloading -- the 110K+ >> messages in the archive. >> >> It's possible that the nature of IMAP leaves no good choices for >> better interaction, but I thought I'd raise the topic to see if othe= rs >> are reacting to this and possibly have suggestions. > Can't you disable local copying? On Thunderbird at least there is such > an option. Anyway, the point is that IMAP does not require the client > to download everything and build a local index, it's an > implementation-specific "feature". I have the same problem as Dave, using Thunderbird (icedove). I haven't found "disable local copying" can you tell me where that is? I already noted that one should pick a local folder as the Sent folder. =2D- Michael Richardson , Sandelman Software Works -=3D IPv6 IoT consulting =3D- --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVtnamoCLcPvd0N1lAQJDsgf/cT05zgZWL8xQ69I3nWK7UPZVBNjZh6bv XfVZcdLyaNGmuWLaMcLU53XtEkw0Yn7fVVHDXzCr9C7U8C5iZ2xAfJitN56UcDLX 1+XBM2fZjgQdhpRQesHe2QuxvzGbUj35kx5K1iWmwYvYrmSDC64YW8C5+OmIo1lx 5C38HAqRvFIayjjAT4zuPcCZmtHfsiTJzZ/Yc8yxHL78iXSu222BKAOkSEvwVne0 8GNcxQH/J3VASPyrKeGQyr5w8S5iHlleMlKTtkQUkttt8MPtZaOgFRnGRr+41cfo vT33dbI1EC6clhM3g7qBFXU1FW50wY4JKHPZFOY8EFt1jFytmc8zSQ== =rjkj -----END PGP SIGNATURE----- --=-=-=-- From nobody Fri Mar 4 10:59:31 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 971961A87BA for ; Fri, 4 Mar 2016 10:59:29 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.902 X-Spam-Level: X-Spam-Status: No, score=-1.902 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id i5jWtGX4w0RV for ; Fri, 4 Mar 2016 10:59:28 -0800 (PST) Received: from tuna.sandelman.ca (tuna.sandelman.ca [209.87.249.19]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 910361A87A2 for ; Fri, 4 Mar 2016 10:59:28 -0800 (PST) Received: from sandelman.ca (obiwan.sandelman.ca [IPv6:2607:f0b0:f:2::247]) by tuna.sandelman.ca (Postfix) with ESMTP id B86BB203B1; Fri, 4 Mar 2016 14:01:05 -0500 (EST) Received: from obiwan.sandelman.ca (localhost [IPv6:::1]) by sandelman.ca (Postfix) with ESMTP id B9B7063755; Fri, 4 Mar 2016 13:59:27 -0500 (EST) From: Michael Richardson To: "Simon Perreault" In-Reply-To: <56D9B7C4.2000807@jive.com> References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> X-Mailer: MH-E 8.6; nmh 1.6+dev; GNU Emacs 24.4.2 X-Face: $\n1pF)h^`}$H>Hk{L"x@)JS7<%Az}5RyS@k9X%29-lHB$Ti.V>2bi.~ehC0; <'$9xN5Ub# z!G,p`nR&p7Fz@^UXIn156S8.~^@MJ*mMsD7=QFeq%AL4m Archived-At: Cc: dcrocker@bbiw.net, "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 18:59:30 -0000 --=-=-= Content-Type: text/plain Simon Perreault wrote: > Can't you disable local copying? On Thunderbird at least there is such > an option. Anyway, the point is that IMAP does not require the client Under the account settings/preferences, under Synchronization&Storage, I found "Keep message for this account on this computer" and it was checked, and I unchecked it. Do you think that's it? There is also an option to sync only some number of days. -- Michael Richardson , Sandelman Software Works -= IPv6 IoT consulting =- --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVtnbDICLcPvd0N1lAQKHTwgAst4Z3uBK9RDioC36WptIIqEm1VZ9kZ7l XGx8MoSPaS+Ino/yrRmjJra8RoKoLfTwVXw+5/HF9A7sIh7eYQ1omdjSVy4vALpK atfwBYJLWBiJ5iBr/ijNFXEoKvWWRpXpzeMpDj1mLLWUYBk1hnoMiAi5PNckPTCL edtw6zVcZUlspzGJjjznx6J289poTJgolAgr6bCaSg21/ktoNEs6+YAwhx5xRDMn 4uTcx7ojBuuHueJHoh+0t+m+4mbMoqf2VbxdD5oLJa83ibm8lvlDQpgOpHlM41Dp 2zstgj+DJwYWaPDL/+WmhcWtdKMtTeQRDgAV7EhxqnjgyFWlhz+8aQ== =DQAP -----END PGP SIGNATURE----- --=-=-=-- From nobody Fri Mar 4 11:04:10 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 76AA71A87C1 for ; Fri, 4 Mar 2016 11:04:09 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.235 X-Spam-Level: X-Spam-Status: No, score=-1.235 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.665] autolearn=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sdZ5uesPv9G9 for ; Fri, 4 Mar 2016 11:04:08 -0800 (PST) Received: from trial.insidesales.com (trial.insidesales.com [173.239.64.131]) by ietfa.amsl.com (Postfix) with ESMTP id A20301A87BE for ; Fri, 4 Mar 2016 11:04:08 -0800 (PST) Received: from mail pickup service by aws.ihance.com with Microsoft SMTPSVC; Fri, 4 Mar 2016 11:04:17 -0800 thread-index: AdF2SKY53am61ojCRHOnzGluepHy8A== Content-Class: urn:content-classes:message Importance: normal Priority: normal X-MimeOLE: Produced By Microsoft MimeOLE V6.3.9600.17905 X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=sl3DI+ihnzJYOl1hCkOmdjq7CV6ooq0IgMdrkjxPaww=; b=T2A321iTyhjmbAyCsIElxNuEEve9lEaUPqDC6TVq+2rFoHwJn1MJrR2ft1cKYRX004 irpir5Jbo5fyZ4kAXh6dtTrLzwXThYez56yFt5AHEH37h+oRI9Kt3kT24cO2qkPz9S1Q NPVdhZoXQvuceT1snrDp1uf7TDSzGseuSGUhHbigPFRRJ6Yhp0cf5iH3P26guD/gFAXP WKLHTkvkgpZbgqf8Xb/iFPmqpzlqxA0CsaoCw0nTAcbQxeH0JhtO5cx7dV8EgiqL9kDR DHc1uFJXPiBzG5juxECdOVfkRkcGcEGdXDrqJSTNgUyUr7Bb9J9ufT4jgnKTHaoaP2G9 v58Q== X-Gm-Message-State: AD7BkJKAWFEci1azOpZHchVpsvHrhxYU6ftC/GheGfmsk7RcW1C3rINHxcNmsMmaFIny7rPwND/4qw6+kTu01CFIlqFFh0naNtTIXtj+/mgWZztSEUxlURdUkF0zr2iP5idVjCCWS7XQUWFO2g== X-Received: by 10.66.163.40 with SMTP id yf8mr14346268pab.148.1457118247630; Fri, 04 Mar 2016 11:04:07 -0800 (PST) X-Received: by 10.66.163.40 with SMTP id yf8mr14346241pab.148.1457118247437; Fri, 04 Mar 2016 11:04:07 -0800 (PST) To: "Michael Richardson" References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> <31449.1457117967@obiwan.sandelman.ca> From: "Simon Perreault" Message-ID: <56D9DC24.5000201@jive.com> Date: Fri, 4 Mar 2016 14:04:04 -0500 user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <31449.1457117967@obiwan.sandelman.ca> Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: 8bit X-OriginalArrivalTime: 04 Mar 2016 19:04:16.0897 (UTC) FILETIME=[A6399710:01D17648] X-Delivery-MTA: 10.0.1.3:trial.insidesales.com Archived-At: Cc: dcrocker@bbiw.net, "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 19:04:09 -0000 Le 2016-03-04 13:59, Michael Richardson a écrit : > Under the account settings/preferences, under Synchronization&Storage, > I found "Keep message for this account on this computer" and it was checked, > and I unchecked it. > Do you think that's it? Yes, that's exactly it. Unchecking doesn't delete the cache AFAICT, you have to re-create the account for that to happen. Simon From nobody Fri Mar 4 11:22:45 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A39931A885B for ; Fri, 4 Mar 2016 11:22:44 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -4.2 X-Spam-Level: X-Spam-Status: No, score=-4.2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id AY7bO7E1upLp for ; Fri, 4 Mar 2016 11:22:43 -0800 (PST) Received: from sbh17.songbird.com (sbh17.songbird.com [72.52.113.17]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id A1DB11A8859 for ; Fri, 4 Mar 2016 11:22:43 -0800 (PST) Received: from [192.168.1.168] (76-218-10-206.lightspeed.sntcca.sbcglobal.net [76.218.10.206]) (authenticated bits=0) by sbh17.songbird.com (8.13.8/8.13.8) with ESMTP id u24JMdHS025640 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Fri, 4 Mar 2016 11:22:43 -0800 To: Michael Richardson , Simon Perreault References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> <31048.1457117853@obiwan.sandelman.ca> From: Dave Crocker Organization: Brandenburg InternetWorking Message-ID: <56D9E07E.4060001@dcrocker.net> Date: Fri, 4 Mar 2016 11:22:38 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <31048.1457117853@obiwan.sandelman.ca> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0 (sbh17.songbird.com [72.52.113.66]); Fri, 04 Mar 2016 11:22:43 -0800 (PST) Archived-At: Cc: "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: dcrocker@bbiw.net List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 19:22:44 -0000 On 3/4/2016 10:57 AM, Michael Richardson wrote: > I haven't found "disable local copying" can you tell me where that is? Tools > Account Settings > [account] > Synchronization & Storage > Advanced Turn off all of the ietf ones. d/ -- Dave Crocker Brandenburg InternetWorking bbiw.net From nobody Fri Mar 4 11:25:33 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (ietfa.amsl.com [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 93AF81A885D for ; Fri, 4 Mar 2016 11:25:32 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -4.2 X-Spam-Level: X-Spam-Status: No, score=-4.2 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3] autolearn=ham Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WMl9MvRnxOAr for ; Fri, 4 Mar 2016 11:25:31 -0800 (PST) Received: from sbh17.songbird.com (sbh17.songbird.com [72.52.113.17]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 9A4861A8859 for ; Fri, 4 Mar 2016 11:25:31 -0800 (PST) Received: from [192.168.1.168] (76-218-10-206.lightspeed.sntcca.sbcglobal.net [76.218.10.206]) (authenticated bits=0) by sbh17.songbird.com (8.13.8/8.13.8) with ESMTP id u24JPRe8025933 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT) for ; Fri, 4 Mar 2016 11:25:31 -0800 References: <56D99E2F.1040908@dcrocker.net> <56D9B7C4.2000807@jive.com> <31449.1457117967@obiwan.sandelman.ca> To: "tools-discuss@ietf.org" From: Dave Crocker Organization: Brandenburg InternetWorking Message-ID: <56D9E126.7080502@dcrocker.net> Date: Fri, 4 Mar 2016 11:25:26 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <31449.1457117967@obiwan.sandelman.ca> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0 (sbh17.songbird.com [72.52.113.66]); Fri, 04 Mar 2016 11:25:31 -0800 (PST) Archived-At: Subject: Re: [Tools-discuss] IMAP access to large archives X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: dcrocker@bbiw.net List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2016 19:25:32 -0000 By way of trying to make a specific suggestion to deal with the specific issue of very large archives, what about: For any archive that is active and has messages dating back for more than a year: Also supply a "Latest 12 months" copy. d/ -- Dave Crocker Brandenburg InternetWorking bbiw.net From nobody Tue Mar 8 01:47:20 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F2AEE12D5CF for ; Tue, 8 Mar 2016 01:47:19 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -6.922 X-Spam-Level: X-Spam-Status: No, score=-6.922 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([127.0.0.1]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id wPJPGSZRaAgj for ; Tue, 8 Mar 2016 01:47:18 -0800 (PST) Received: from mx141.netapp.com (mx141.netapp.com [216.240.21.12]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 94FD312D5CA for ; Tue, 8 Mar 2016 01:47:14 -0800 (PST) X-IronPort-AV: E=Sophos;i="5.22,556,1449561600"; d="asc'?scan'208";a="104943875" Received: from hioexcmbx05-prd.hq.netapp.com ([10.122.105.38]) by mx141-out.netapp.com with ESMTP; 08 Mar 2016 01:42:14 -0800 Received: from HIOEXCMBX07-PRD.hq.netapp.com (10.122.105.40) by hioexcmbx05-prd.hq.netapp.com (10.122.105.38) with Microsoft SMTP Server (TLS) id 15.0.1156.6; Tue, 8 Mar 2016 01:42:14 -0800 Received: from HIOEXCMBX07-PRD.hq.netapp.com ([::1]) by hioexcmbx07-prd.hq.netapp.com ([fe80::2562:be45:d6a5:1743%21]) with mapi id 15.00.1156.000; Tue, 8 Mar 2016 01:42:14 -0800 From: "Eggert, Lars" To: "tools-discuss@ietf.org" Thread-Topic: svn.tools.ietf.org down? Thread-Index: AQHReR7L+xWh28OO90mO+tH6qrWhkg== Date: Tue, 8 Mar 2016 09:42:13 +0000 Message-ID: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3112) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.120.60.35] Content-Type: multipart/signed; boundary="Apple-Mail=_7FE96A49-25C0-4D18-A90F-E737F78C6CE3"; protocol="application/pgp-signature"; micalg=pgp-sha256 MIME-Version: 1.0 Archived-At: Subject: [Tools-discuss] svn.tools.ietf.org down? X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Mar 2016 09:47:20 -0000 --Apple-Mail=_7FE96A49-25C0-4D18-A90F-E737F78C6CE3 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Anyone else having issues? #=EE=82=B0 svn up Updating '.': svn: E170013: Unable to connect to a repository at URL = 'http://svn.tools.ietf.org/svn/group/irtf/www' svn: E120108: Error running context: The server unexpectedly closed the = connection. # =EE=82=B0 wget http://svn.tools.ietf.org/svn/group/irtf/www --2016-03-08 10:40:52-- http://svn.tools.ietf.org/svn/group/irtf/www Resolving svn.tools.ietf.org... 2001:1890:123a::1:2a, 64.170.98.42 Connecting to svn.tools.ietf.org|2001:1890:123a::1:2a|:80... failed: = Connection refused. Connecting to svn.tools.ietf.org|64.170.98.42|:80... failed: Connection = refused. Lars --Apple-Mail=_7FE96A49-25C0-4D18-A90F-E737F78C6CE3 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJW3p51AAoJEFS1wwm/cMFX40QQAKzfddHl+OiBF36aYBvMqUXI oujncPS2TYppnd9AxuaFhzNcmC2zGPlwHt15AeedIBUi/KObVysiWx7vBytuwBXZ iThMM6Q8JwVADZPs5vtKSsPzMtzuXCn2N5sMiR/iKB9Mihf08N8c2cUhUGd0Zh+l rg0Nex42JohmHk6t2BYmxNR/i6WW1s+NJbphl/1ijS89uXegYvF3XFJ9NMcg2bIv axrZMZQqxumTi55prbrmxCb1ESjsx/P06HENfIC4o6gtXKlVvr+Wi2gMPcO1o3wc dXT8CBeHJcXHU3y32nAs0TDqIKFhzgc7VsWVtyfCmm80vo4+XkuTpMZE1GabLndG QoEnulDAWxp7+apXNGni+h0kBWJsVmLgcW/GKqu55IJQr5CaD8xN+SU+jyKtitiG 5hXUpDNGhrbW4bjIODb9sqhRUrhQ29N0ZqUVKryP9sGbck+G+N0UXEHhR3NEHDnz HXZtqjgJJbsU/8eWI3bJO4ToXUghnW2ItPQHoQGaoyNqDHx6bYlbK0b9/VRYCPny wo8w61vXTrwUVVQY6gQJEFB5W6IOv2aguvdjf+4WlQg4CrHqTEfdF8lmjhrFevpK qu3iSvux84QBk227HznAxyXFL5cCmPZaOadNZQGdJHeACFTezSkmcjxVgUsLMBIK LPqG1KZ3wVivBgM8ulMj =AyCM -----END PGP SIGNATURE----- --Apple-Mail=_7FE96A49-25C0-4D18-A90F-E737F78C6CE3-- From nobody Tue Mar 8 02:15:11 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id B7A5A12D5E6 for ; Tue, 8 Mar 2016 02:15:09 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.62 X-Spam-Level: X-Spam-Status: No, score=-2.62 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([127.0.0.1]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Ku-2iASeCYGT for ; Tue, 8 Mar 2016 02:15:07 -0800 (PST) Received: from slow1-d.mail.gandi.net (slow1-d.mail.gandi.net [217.70.178.86]) by ietfa.amsl.com (Postfix) with ESMTP id A8A1412D5E7 for ; Tue, 8 Mar 2016 02:15:07 -0800 (PST) Received: from relay5-d.mail.gandi.net (relay5-d.mail.gandi.net [217.70.183.197]) by slow1-d.mail.gandi.net (Postfix) with ESMTP id 161CB4B766F; Tue, 8 Mar 2016 11:04:30 +0100 (CET) X-Originating-IP: 93.204.214.47 Received: from nar.local (p5DCCD62F.dip0.t-ipconnect.de [93.204.214.47]) (Authenticated sender: cabo@cabo.im) by relay5-d.mail.gandi.net (Postfix) with ESMTPSA id E4F6441C0C3; Tue, 8 Mar 2016 11:03:22 +0100 (CET) Message-ID: <56DEA369.10708@tzi.org> Date: Tue, 08 Mar 2016 11:03:21 +0100 From: Carsten Bormann User-Agent: Postbox 4.0.8 (Macintosh/20151105) MIME-Version: 1.0 To: "Eggert, Lars" References: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> In-Reply-To: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> X-Enigmail-Version: 1.2.3 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Archived-At: Cc: "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] svn.tools.ietf.org down? X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Mar 2016 10:15:09 -0000 May be unrelated, but I get gateway timeouts and lovely cloudflare 522 errors on most things IETF right now. Grüße, Carsten Eggert, Lars wrote: > Anyone else having issues? > > #î‚° svn up > Updating '.': > svn: E170013: Unable to connect to a repository at URL 'http://svn.tools.ietf.org/svn/group/irtf/www' > svn: E120108: Error running context: The server unexpectedly closed the connection. > > # î‚° wget http://svn.tools.ietf.org/svn/group/irtf/www > --2016-03-08 10:40:52-- http://svn.tools.ietf.org/svn/group/irtf/www > Resolving svn.tools.ietf.org... 2001:1890:123a::1:2a, 64.170.98.42 > Connecting to svn.tools.ietf.org|2001:1890:123a::1:2a|:80... failed: Connection refused. > Connecting to svn.tools.ietf.org|64.170.98.42|:80... failed: Connection refused. > > Lars > From nobody Tue Mar 8 04:09:18 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4E5D912D691 for ; Tue, 8 Mar 2016 04:09:17 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.019 X-Spam-Level: X-Spam-Status: No, score=-1.019 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RDNS_DYNAMIC=0.982, SPF_PASS=-0.001] autolearn=no autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=greenbytes.de header.b=mleBe1of; dkim=pass (1024-bit key) header.d=greenbytes.de header.b=mleBe1of Received: from mail.ietf.org ([127.0.0.1]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id JLJmg6Rk1e7l for ; Tue, 8 Mar 2016 04:09:15 -0800 (PST) Received: from mail.greenbytes.de (b2b-5-10-171-186.unitymedia.biz [5.10.171.186]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 8BFAD12D68F for ; Tue, 8 Mar 2016 04:09:15 -0800 (PST) Received: by mail.greenbytes.de (Postfix, from userid 117) id CCC0D15A0ACB; Tue, 8 Mar 2016 13:09:13 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=greenbytes.de; s=mail; t=1457438953; bh=2TNOnWQAFiQ6Z7WSe7wW0P78bnj8P90I+0PJ2bVj+XE=; h=Subject:To:References:From:Date:In-Reply-To:From; b=mleBe1of8pWaIjJDdVTt3s5v9LPN2WC/zuNkybaVlCKLv0+Kf4DGe6FuPMz3Me4uR kV7fgl58Gs+ayu5dIIQYd+SUCwbIcbBuHhuiEhK4hHWgo3QBFhG4Qz3dArvfISbHBc B7aWI0IIoCMam4NfzIFBDW/hJQOMVMoDOFCZcRcw= Received: from [192.168.1.123] (unknown [192.168.1.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mail.greenbytes.de (Postfix) with ESMTPSA id 0A59415A0361; Tue, 8 Mar 2016 13:09:12 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=greenbytes.de; s=mail; t=1457438953; bh=2TNOnWQAFiQ6Z7WSe7wW0P78bnj8P90I+0PJ2bVj+XE=; h=Subject:To:References:From:Date:In-Reply-To:From; b=mleBe1of8pWaIjJDdVTt3s5v9LPN2WC/zuNkybaVlCKLv0+Kf4DGe6FuPMz3Me4uR kV7fgl58Gs+ayu5dIIQYd+SUCwbIcbBuHhuiEhK4hHWgo3QBFhG4Qz3dArvfISbHBc B7aWI0IIoCMam4NfzIFBDW/hJQOMVMoDOFCZcRcw= To: "Eggert, Lars" , "tools-discuss@ietf.org" References: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> From: Julian Reschke Message-ID: <56DEC0EE.30705@greenbytes.de> Date: Tue, 8 Mar 2016 13:09:18 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Archived-At: Subject: Re: [Tools-discuss] svn.tools.ietf.org down? X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Mar 2016 12:09:17 -0000 On 2016-03-08 10:42, Eggert, Lars wrote: > Anyone else having issues? > > #î‚° svn up > Updating '.': > svn: E170013: Unable to connect to a repository at URL 'http://svn.tools.ietf.org/svn/group/irtf/www' > svn: E120108: Error running context: The server unexpectedly closed the connection. > > # î‚° wget http://svn.tools.ietf.org/svn/group/irtf/www > --2016-03-08 10:40:52-- http://svn.tools.ietf.org/svn/group/irtf/www > Resolving svn.tools.ietf.org... 2001:1890:123a::1:2a, 64.170.98.42 > Connecting to svn.tools.ietf.org|2001:1890:123a::1:2a|:80... failed: Connection refused. > Connecting to svn.tools.ietf.org|64.170.98.42|:80... failed: Connection refused. > > Lars Same here. Best regards, Julian (Mail to both webmaster and Henrik sent) From nobody Tue Mar 8 10:36:47 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 61FD912D992 for ; Tue, 8 Mar 2016 10:36:43 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -106.9 X-Spam-Level: X-Spam-Status: No, score=-106.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([127.0.0.1]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NL2Mv332_X-w for ; Tue, 8 Mar 2016 10:36:40 -0800 (PST) Received: from zinfandel.tools.ietf.org (zinfandel.tools.ietf.org [IPv6:2001:1890:123a::1:2a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3088C12D98C for ; Tue, 8 Mar 2016 10:36:40 -0800 (PST) Received: from 81-235-150-134-no105.tbcn.telia.com ([81.235.150.134]:64630 helo=[192.168.1.120]) by zinfandel.tools.ietf.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1adMUk-0002HI-6Y; Tue, 08 Mar 2016 10:36:36 -0800 Message-ID: <56DF1BAA.6070709@levkowetz.com> Date: Tue, 08 Mar 2016 19:36:26 +0100 From: Henrik Levkowetz User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:31.0) Gecko/20100101 Thunderbird/31.8.0 MIME-Version: 1.0 To: Julian Reschke , "Eggert, Lars" , "tools-discuss@ietf.org" References: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> <56DEC0EE.30705@greenbytes.de> In-Reply-To: <56DEC0EE.30705@greenbytes.de> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="FDd616HXkugOTDjxSPm7hdoCLuc8WARkC" X-SA-Exim-Connect-IP: 81.235.150.134 X-SA-Exim-Rcpt-To: Tools-discuss@ietf.org, lars@netapp.com, julian.reschke@greenbytes.de X-SA-Exim-Mail-From: henrik@levkowetz.com X-SA-Exim-Version: 4.2.1 (built Mon, 26 Dec 2011 16:24:06 +0000) X-SA-Exim-Scanned: No (on zinfandel.tools.ietf.org); Unknown failure Archived-At: Subject: Re: [Tools-discuss] svn.tools.ietf.org down? X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Mar 2016 18:36:43 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --FDd616HXkugOTDjxSPm7hdoCLuc8WARkC Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi, The servers themselves haven't been down; and I can't repeat the observation below now; also, my smokeping checks against each of the tools servers show no breaks from here (Stockholm). I thinking this could have been an issue with the DNS delegation of tools from ietf.org, related to the ietf server changeover issues we've had, or possibly some temporary network issue which has hit some people, but not everyone. Are anybody still seeing issues? Best regards, Henrik On 2016-03-08 13:09, Julian Reschke wrote: > On 2016-03-08 10:42, Eggert, Lars wrote: >> Anyone else having issues? >> >> #=C3=AE=E2=80=9A=C2=B0 svn up >> Updating '.': >> svn: E170013: Unable to connect to a repository at URL 'http://svn.too= ls.ietf.org/svn/group/irtf/www' >> svn: E120108: Error running context: The server unexpectedly closed th= e connection. >> >> # =C3=AE=E2=80=9A=C2=B0 wget http://svn.tools.ietf.org/svn/group/irtf/= www >> --2016-03-08 10:40:52-- http://svn.tools.ietf.org/svn/group/irtf/www >> Resolving svn.tools.ietf.org... 2001:1890:123a::1:2a, 64.170.98.42 >> Connecting to svn.tools.ietf.org|2001:1890:123a::1:2a|:80... failed: C= onnection refused. >> Connecting to svn.tools.ietf.org|64.170.98.42|:80... failed: Connectio= n refused. >> >> Lars >=20 > Same here. >=20 > Best regards, Julian (Mail to both webmaster and Henrik sent) >=20 --FDd616HXkugOTDjxSPm7hdoCLuc8WARkC Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJW3xurAAoJEE6bV0uPuxca92wP/2154q8Rm47i4bQWwEOnvXQW ikVfhpH31eQSlFeXvLN1G+fXvJa8XqBmvydt4wt9y7uEN/Ric02e1JXMK11eND3C 6xuCwGd1bB6Yw4Y23YpbGrztoX32gt2D2Q0HHYW6eIs052gyS4UkwTrhVLqcPmr5 Ypfbd4Etd/cRGK1F7ZOELvNQLzubg45S86X6drblu6KgTBY8nvjRMPgF8DK+5r+D /djCY94afugBop2+SVd6MypIaO78omzjKQajFJi4ZKaKP1sakJysP50i2LwqttDu j28MR4avEwLTeevUpFiWkTWCKNBtWjHkJfA6+O884o8Iv0RRibUOZqW5lMJz81Sh qay6w80nYk2B2m7HlKVMJMEkvLKljWFhpW0p++sKV6sWD3TlMh4T3WP7efMj21fd GmYRQc86eMyv24rjFA9m1GvHj7fSgCSURiA9iY4V5vsbLy40gb7gew/9o1fcstBv 77V/20yRxZkJDNTPfE3icX+NY1lvQW+i/P/91I3ZzvluLSQbiBX2lL9hEi8CEpg7 V5uLA9o1icpl4enWlnNUPTVzti51lKoMsAm6HrvJ6yrTpekBXjDtgQwu+CTGAA+1 9OWQshMNT0lEANc47QxqDcRRZO7qJ9S+AvhyWgpXqDVXIkioFwfxD+M/YnzvRNln jBdGQpw5vtdk27Mrl0My =cVol -----END PGP SIGNATURE----- --FDd616HXkugOTDjxSPm7hdoCLuc8WARkC-- From nobody Tue Mar 8 10:48:22 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8288512D9BF for ; Tue, 8 Mar 2016 10:48:19 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -4.222 X-Spam-Level: X-Spam-Status: No, score=-4.222 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([127.0.0.1]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id T5qgY-HAZe8W for ; Tue, 8 Mar 2016 10:48:08 -0800 (PST) Received: from mail.amsl.com (c8a.amsl.com [4.31.198.40]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 06A3612D9B2 for ; Tue, 8 Mar 2016 10:48:07 -0800 (PST) Received: from localhost (localhost [127.0.0.1]) by c8a.amsl.com (Postfix) with ESMTP id B684C1E5D5D; Tue, 8 Mar 2016 10:47:58 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com Received: from c8a.amsl.com ([127.0.0.1]) by localhost (c8a.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id V8P4Jgs6INsu; Tue, 8 Mar 2016 10:47:58 -0800 (PST) Received: from [192.168.0.2] (68-204-56-146.res.bhn.net [68.204.56.146]) by c8a.amsl.com (Postfix) with ESMTPA id 3C20B1E5D5A; Tue, 8 Mar 2016 10:47:58 -0800 (PST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\)) From: Matt Larson In-Reply-To: <56DF1BAA.6070709@levkowetz.com> Date: Tue, 8 Mar 2016 13:48:05 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: References: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> <56DEC0EE.30705@greenbytes.de> <56DF1BAA.6070709@levkowetz.com> To: Henrik Levkowetz X-Mailer: Apple Mail (2.3112) Archived-At: Cc: "tools-discuss@ietf.org" , Julian Reschke Subject: Re: [Tools-discuss] svn.tools.ietf.org down? X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Mar 2016 18:48:19 -0000 Hi Henrik, I see xml2rfc.ietf.org responding now, which it was not doing before. During the time it was unresponsive to http requests, I was able to ping = it, and dig resolved properly (over IPv4 - my ISP doesn't comprehend = IPv6). For what it's worth. It is, of course, up for me now. Matt > On Mar 8, 2016, at 1:36 PM, Henrik Levkowetz = wrote: >=20 > Hi, >=20 > The servers themselves haven't been down; and I can't repeat the > observation below now; also, my smokeping checks against each of the > tools servers show no breaks from here (Stockholm). >=20 > I thinking this could have been an issue with the DNS delegation > of tools from ietf.org, related to the ietf server changeover issues > we've had, or possibly some temporary network issue which has hit > some people, but not everyone. Are anybody still seeing issues? >=20 > Best regards, >=20 > Henrik >=20 >=20 > On 2016-03-08 13:09, Julian Reschke wrote: >> On 2016-03-08 10:42, Eggert, Lars wrote: >>> Anyone else having issues? >>>=20 >>> #=C3=AE=E2=80=9A=C2=B0 svn up >>> Updating '.': >>> svn: E170013: Unable to connect to a repository at URL = 'http://svn.tools.ietf.org/svn/group/irtf/www' >>> svn: E120108: Error running context: The server unexpectedly closed = the connection. >>>=20 >>> # =C3=AE=E2=80=9A=C2=B0 wget = http://svn.tools.ietf.org/svn/group/irtf/www >>> --2016-03-08 10:40:52-- = http://svn.tools.ietf.org/svn/group/irtf/www >>> Resolving svn.tools.ietf.org... 2001:1890:123a::1:2a, 64.170.98.42 >>> Connecting to svn.tools.ietf.org|2001:1890:123a::1:2a|:80... failed: = Connection refused. >>> Connecting to svn.tools.ietf.org|64.170.98.42|:80... failed: = Connection refused. >>>=20 >>> Lars >>=20 >> Same here. >>=20 >> Best regards, Julian (Mail to both webmaster and Henrik sent) >>=20 >=20 > --=20 > Tools-discuss mailing list > Tools-discuss@ietf.org > https://www.ietf.org/mailman/listinfo/tools-discuss >=20 > Please report datatracker.ietf.org bugs at = http://tools.ietf.org/tools/ietfdb > Please report tools.ietf.org bugs at = http://tools.ietf.org/tools/issues or > send email to webmaster@tools.ietf.org ------------------------------------------- Matthew Larson, Software Engineer Association Management Solutions Forum Management, Meeting and Event Planning 48377 Fremont Blvd., Suite 117, Fremont, CA 94538 http://www.amsl.com From nobody Tue Mar 8 10:51:37 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5D5B312D9BD for ; Tue, 8 Mar 2016 10:51:35 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.6 X-Spam-Level: X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([127.0.0.1]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id dSrt28soGdwi for ; Tue, 8 Mar 2016 10:51:33 -0800 (PST) Received: from relay3-d.mail.gandi.net (relay3-d.mail.gandi.net [IPv6:2001:4b98:c:538::195]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 921E412D9C2 for ; Tue, 8 Mar 2016 10:51:33 -0800 (PST) Received: from mfilter31-d.gandi.net (mfilter31-d.gandi.net [217.70.178.162]) by relay3-d.mail.gandi.net (Postfix) with ESMTP id 86CDBA809B; Tue, 8 Mar 2016 19:51:31 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at mfilter31-d.gandi.net Received: from relay3-d.mail.gandi.net ([IPv6:::ffff:217.70.183.195]) by mfilter31-d.gandi.net (mfilter31-d.gandi.net [::ffff:10.0.15.180]) (amavisd-new, port 10024) with ESMTP id p5Sg0dZzjQtN; Tue, 8 Mar 2016 19:51:30 +0100 (CET) X-Originating-IP: 93.204.214.47 Received: from nar.local (p5DCCD62F.dip0.t-ipconnect.de [93.204.214.47]) (Authenticated sender: cabo@cabo.im) by relay3-d.mail.gandi.net (Postfix) with ESMTPSA id 91661A80BF; Tue, 8 Mar 2016 19:51:28 +0100 (CET) Message-ID: <56DF1F2E.6030501@tzi.org> Date: Tue, 08 Mar 2016 19:51:26 +0100 From: Carsten Bormann User-Agent: Postbox 4.0.8 (Macintosh/20151105) MIME-Version: 1.0 To: Henrik Levkowetz References: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> <56DEC0EE.30705@greenbytes.de> <56DF1BAA.6070709@levkowetz.com> In-Reply-To: <56DF1BAA.6070709@levkowetz.com> X-Enigmail-Version: 1.2.3 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Archived-At: Cc: "tools-discuss@ietf.org" , Julian Reschke Subject: Re: [Tools-discuss] svn.tools.ietf.org down? X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Mar 2016 18:51:35 -0000 Works for me now. (I-D lookup is still slow, but that is not a change.) Grüße, Carsten Henrik Levkowetz wrote: > Are anybody still seeing issues? From nobody Tue Mar 8 10:55:35 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0489312D9D2 for ; Tue, 8 Mar 2016 10:55:32 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.7 X-Spam-Level: X-Spam-Status: No, score=-2.7 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mail.ietf.org ([127.0.0.1]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 32CIDzSC_kDK for ; Tue, 8 Mar 2016 10:55:31 -0800 (PST) Received: from mail-pf0-x22f.google.com (mail-pf0-x22f.google.com [IPv6:2607:f8b0:400e:c00::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3EA3D12D849 for ; Tue, 8 Mar 2016 10:55:24 -0800 (PST) Received: by mail-pf0-x22f.google.com with SMTP id 63so18975925pfe.3 for ; Tue, 08 Mar 2016 10:55:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:to:references:cc:from:organization:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=T+gNXCovDfI7VyeXxpx6H06NNXeoGi1qDuW5EoYxa4s=; b=yJzn3Bp9EpvPBesad9x+zKWFXDQneDpjYCceDC0hQmyHH5zUL/BEiAs9nyYzzW0doA 9EcXIx0+V541/HkGEO2Zt8cNUED5dv6lU3tPonQnyzvoArfyb3P4SY4jmTGBuMsH0Mvk gsEUX1u/IWrMZKlgJycVDrFoFLjJ9wMzsSUIVl81apqzJjJNBe/N0L+LzJCYtHeAQp6t VdvlJM6zNseQsRNdVHggs+c9RWQdIMEVrlU3X+klZs6d/Xm26Y2KlXFu6brLKdnpBENl YkZ4lSnemo56sVKiCGz0HkgAHla4xPywj7ojxUwoS617eFDN0zMmbMmCNYMisW80Q5WK DUzg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding; bh=T+gNXCovDfI7VyeXxpx6H06NNXeoGi1qDuW5EoYxa4s=; b=XygJFXu/PPsSLQhXXy88PBw6/D7B0uDUmeOyZ95zTQUmNgcZX6hJPqbITRVf0LfwSU 4LUjf6fLWsxh6zVCdp5E+UMeChOO2D0PDVqOUtk0nwzy41962EqSBSQipnGSQ/mqIlG8 qXp2buDNxKDJWibdtyaa89c9bUPZuEA2VxTe2rxaYbaPBrNDuWdBaX4evEsNfZAvC5pv XirzILIJGyu3XMMdf/OUCJCeUL4r+I4xNdV7Ntv7/7PN2ZLe99LabtVGbOzw9X3PI7QD AE3wSEqZ2h2vn9lVuR03oVJAUDMEaoFhsh64/Q3+nF+MedOoQsKVOSBiKM/sZb9XVyDz mLFQ== X-Gm-Message-State: AD7BkJJOf8wfS0+RdQELHDxhi4UaYrFwexpXSdhaS2efrdFHBidzw0RZOval//kI+CRosg== X-Received: by 10.98.0.148 with SMTP id 142mr44427314pfa.84.1457463323819; Tue, 08 Mar 2016 10:55:23 -0800 (PST) Received: from ?IPv6:2406:e007:4d26:1:28cc:dc4c:9703:6781? ([2406:e007:4d26:1:28cc:dc4c:9703:6781]) by smtp.gmail.com with ESMTPSA id n11sm6629849pfb.74.2016.03.08.10.55.20 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 08 Mar 2016 10:55:22 -0800 (PST) To: Carsten Bormann , Henrik Levkowetz References: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> <56DEC0EE.30705@greenbytes.de> <56DF1BAA.6070709@levkowetz.com> <56DF1F2E.6030501@tzi.org> From: Brian E Carpenter Organization: University of Auckland Message-ID: <56DF201B.5070403@gmail.com> Date: Wed, 9 Mar 2016 07:55:23 +1300 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 In-Reply-To: <56DF1F2E.6030501@tzi.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Archived-At: Cc: "tools-discuss@ietf.org" , Julian Reschke Subject: Re: [Tools-discuss] svn.tools.ietf.org down? X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Mar 2016 18:55:33 -0000 So was this a DNS TTL non-expiry issue? Brian On 09/03/2016 07:51, Carsten Bormann wrote: > Works for me now. >=20 > (I-D lookup is still slow, but that is not a change.) >=20 > Gr=C3=BC=C3=9Fe, Carsten >=20 >=20 > Henrik Levkowetz wrote: >> Are anybody still seeing issues? >=20 From nobody Tue Mar 8 23:25:34 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 1271412DF29 for ; Tue, 8 Mar 2016 23:25:33 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -6.922 X-Spam-Level: X-Spam-Status: No, score=-6.922 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([127.0.0.1]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id pChfKU3K53YV for ; Tue, 8 Mar 2016 23:25:31 -0800 (PST) Received: from mx144.netapp.com (mx144.netapp.com [216.240.21.25]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id CABDE12DF26 for ; Tue, 8 Mar 2016 23:25:31 -0800 (PST) X-IronPort-AV: E=Sophos;i="5.24,310,1455004800"; d="asc'?scan'208";a="102863868" Received: from hioexcmbx03-prd.hq.netapp.com ([10.122.105.36]) by mx144-out.netapp.com with ESMTP; 08 Mar 2016 23:24:54 -0800 Received: from HIOEXCMBX07-PRD.hq.netapp.com (10.122.105.40) by hioexcmbx03-prd.hq.netapp.com (10.122.105.36) with Microsoft SMTP Server (TLS) id 15.0.1156.6; Tue, 8 Mar 2016 23:24:54 -0800 Received: from HIOEXCMBX07-PRD.hq.netapp.com ([::1]) by hioexcmbx07-prd.hq.netapp.com ([fe80::2562:be45:d6a5:1743%21]) with mapi id 15.00.1156.000; Tue, 8 Mar 2016 23:24:54 -0800 From: "Eggert, Lars" To: Carsten Bormann Thread-Topic: [Tools-discuss] svn.tools.ietf.org down? Thread-Index: AQHReR7L58kCGAQjwEaAAn1R9qVsHp9P+owAgABsKgCAAAQxAIAA0oGA Date: Wed, 9 Mar 2016 07:24:53 +0000 Message-ID: <077288C0-232B-4276-8729-3E7885F7723F@netapp.com> References: <5B58260D-C462-4F5C-8DF0-0754CF257F68@netapp.com> <56DEC0EE.30705@greenbytes.de> <56DF1BAA.6070709@levkowetz.com> <56DF1F2E.6030501@tzi.org> In-Reply-To: <56DF1F2E.6030501@tzi.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3112) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.120.60.37] Content-Type: multipart/signed; boundary="Apple-Mail=_2AC1BDCF-1EA8-4024-9AB8-062B2B5C960E"; protocol="application/pgp-signature"; micalg=pgp-sha256 MIME-Version: 1.0 Archived-At: Cc: Henrik Levkowetz , "tools-discuss@ietf.org" , Julian Reschke Subject: Re: [Tools-discuss] svn.tools.ietf.org down? X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2016 07:25:33 -0000 --Apple-Mail=_2AC1BDCF-1EA8-4024-9AB8-062B2B5C960E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 2016-03-08, at 19:51, Carsten Bormann wrote: > Works for me now. +1 However, I still get these messages for some slow-loading datatracker = URLS: "Gateway Timeout: The gateway did not receive a timely response = from the upstream server or application." For example: https://datatracker.ietf.org/meeting/requests https://datatracker.ietf.org/group/ Lars --Apple-Mail=_2AC1BDCF-1EA8-4024-9AB8-062B2B5C960E Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJW38/EAAoJEFS1wwm/cMFXPykP/07IEFnNCRSlnMS7TPWUm27/ /6w969RbFqIZlZB3xO+X86RYT8UVfPvMhoRB9sZyo2Zal2DcbxoV1lzZPhOVoVTI b+kUK+YhRSgLRNn0i/LlCBVNHSUfdlHPYwyArb+lf5rZ9cLnH4GXJPm442H11RhD L8V/rr5PkBDPauCGvR+3z3F7ORoW69yRbTbPwiGmmRo9CLdvabT9Y5o7Bss92Aw9 mjqQGJx4YS4wikDzNMP0a4oJOgm7S/phM8em+otPGPDjzrnAK26bHDPa9ZzOiK+Y 2BDrIXmZtFOs7P3VJNJnPR09btOryt4de+Ns8a7zxdpnJPA9hEPrJ99dX8DU9JTe yXubP7lGHLFhV5fW1ioJYHRYAPZDczq4l3VA9XT48yPuDAejErf7Ix+semPBU2KM 4eDEnjHWvR3T/e5S7uq14VqQu6aCChWoV0MwDI78/5yjewn7n1/qkp6vqiqcVE/O XubggagGi/f1MaYwHyUxhu3kSsKk/+/ls0phq/kUK3u5v82oPYmqcyd5sH6zgTP9 iZZ2IreianysZiez0uhjm0rlncaXIp3g1uhTjx/0r4LAeHhlyA+tHI+2afLSI/4D LUvvxfgomQFI/HeP9OZC7XxvZPPDFaLiLUh1QP96555Bk748eJw5tsVgKlZhUCpZ kk68fKUEAVX+IuThRqPw =ZPxb -----END PGP SIGNATURE----- --Apple-Mail=_2AC1BDCF-1EA8-4024-9AB8-062B2B5C960E-- From nobody Thu Mar 10 05:32:55 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 0A20712D7DC for ; Thu, 10 Mar 2016 05:32:54 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: 0.279 X-Spam-Level: X-Spam-Status: No, score=0.279 tagged_above=-999 required=5 tests=[BAYES_05=-0.5, SPF_NEUTRAL=0.779] autolearn=no autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 8pVeauEEoD54 for ; Thu, 10 Mar 2016 05:32:48 -0800 (PST) Received: from mail.kivinen.iki.fi (fireball.acr.fi [83.145.195.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id B637D12D7A0 for ; Thu, 10 Mar 2016 05:31:52 -0800 (PST) Received: from fireball.acr.fi (localhost [127.0.0.1]) by mail.kivinen.iki.fi (8.15.2/8.15.2) with ESMTPS id u2ADVntn001473 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Thu, 10 Mar 2016 15:31:49 +0200 (EET) Received: (from kivinen@localhost) by fireball.acr.fi (8.15.2/8.14.8/Submit) id u2ADVnhn010395; Thu, 10 Mar 2016 15:31:49 +0200 (EET) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <22241.30532.972093.128187@fireball.acr.fi> Date: Thu, 10 Mar 2016 15:31:48 +0200 From: Tero Kivinen To: tools-discuss@ietf.org X-Mailer: VM 8.2.0b under 24.5.1 (x86_64--netbsd) X-Edit-Time: 3 min X-Total-Time: 3 min Archived-At: Subject: [Tools-discuss] gamay.tools.ietf.org / art.tools.ietf.org DNS X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2016 13:32:54 -0000 I am trying to do the secdir area review team assignments, but the bind/named in the gamay has died, and the machine does not know how to resolve names like datatracker.ietf.org, which means the review tool cannot fetch iesg agenda etc files. Any hope of getting the bind/named restarted on the machine, so I can do my assignments: gamay (12:00) ~>dig datatracker.ietf.org ; <<>> DiG 9.6.1-P1 <<>> datatracker.ietf.org ;; global options: +cmd ;; connection timed out; no servers could be reached [2] 7540 exit 9 dig datatracker.ietf.org gamay (13:05) ~> -- kivinen@iki.fi From nobody Thu Mar 10 06:53:18 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 743D812D9C6 for ; Thu, 10 Mar 2016 06:53:16 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -106.9 X-Spam-Level: X-Spam-Status: No, score=-106.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ZVSzIeuOnTYJ for ; Thu, 10 Mar 2016 06:53:15 -0800 (PST) Received: from zinfandel.tools.ietf.org (zinfandel.tools.ietf.org [IPv6:2001:1890:123a::1:2a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id D074E12DA56 for ; Thu, 10 Mar 2016 06:44:38 -0800 (PST) Received: from 81-235-150-134-no105.tbcn.telia.com ([81.235.150.134]:58908 helo=[192.168.1.120]) by zinfandel.tools.ietf.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1ae1pK-0004vd-Vd; Thu, 10 Mar 2016 06:44:37 -0800 Message-ID: <56E1883C.6030408@levkowetz.com> Date: Thu, 10 Mar 2016 15:44:12 +0100 From: Henrik Levkowetz User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:31.0) Gecko/20100101 Thunderbird/31.8.0 MIME-Version: 1.0 To: Tero Kivinen , tools-discuss@ietf.org References: <22241.30532.972093.128187@fireball.acr.fi> In-Reply-To: <22241.30532.972093.128187@fireball.acr.fi> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="8Ggk3PN8HtHI9Q4XXAHcmHdVcklqKJFDp" X-SA-Exim-Connect-IP: 81.235.150.134 X-SA-Exim-Rcpt-To: tools-discuss@ietf.org, kivinen@iki.fi X-SA-Exim-Mail-From: henrik@levkowetz.com X-SA-Exim-Version: 4.2.1 (built Mon, 26 Dec 2011 16:24:06 +0000) X-SA-Exim-Scanned: No (on zinfandel.tools.ietf.org); Unknown failure Archived-At: Subject: Re: [Tools-discuss] gamay.tools.ietf.org / art.tools.ietf.org DNS X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2016 14:53:17 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --8Ggk3PN8HtHI9Q4XXAHcmHdVcklqKJFDp Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Tero, On 2016-03-10 14:31, Tero Kivinen wrote: > I am trying to do the secdir area review team assignments, but the > bind/named in the gamay has died, and the machine does not know how to > resolve names like datatracker.ietf.org, which means the review tool > cannot fetch iesg agenda etc files. Ugh! Bind restarted. Sorry for the delay; in bed with a cold. Will you let me know if this fixes the issue, please? Best regards, Henrik --8Ggk3PN8HtHI9Q4XXAHcmHdVcklqKJFDp Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJW4YhLAAoJEE6bV0uPuxcajHcP/i3A9Pw/cEB6R3nC2VD0lieD 7x4NTpI6W72tmBXawciR2TCzIF0aLGSYRuSaS5m3wh6rnbjbSulAx0ZWlPDIFeV5 mPLrHEGJUDATdbE6kX+9t7zC4J66xMoU6tXbLGOz5neE/wl51dy6RMdX3Q/aL0yj csfrEuTkvrZsuvV+FwqUDOj79CNVKgLmzMJMdTUZgk4UfkBGubJA+ecvcQ8UbsfL 04SgukelOjM1nHihHc/qlrqpCdt9gGbJLSoJ3DZk3nEGAtyD41Vywe4MO9uBsjw7 T1I7cDu4T+8pAOAhet0EVS/nHJjYVr2s8N4HRXhzBFibFnlM8DKUl9sAXMGxliof N3YElTk7rJkwCgUNV+/bpuKNAb7cyp/NEKlq2hkuLS94Ukp84zi38stD5acAFGm/ MEJRLZx0nXm8rRaq7x4X07Qks+7zqJDYNhsBaVwz4til90pUmbMwh4u8jFMp+a89 H/v57JWUaobSSfiALliSsyQWP0Fv9y7K1Al+UvtXzOCCYNowc9MBFJCSO3T2bHWB P/2IE9fK9Qu1Lxu+vGvhvit8MJwouSjd5XngDBzpXQ3Yp+VXPVPYrqbLFTlijXoD NQQYr04i+lKF5+9Lgj2rcZOvV0K9ewzc6pEEnv/IfdFnTxlaHK4nGpPC1MGwwKN2 RrR6L0cttOmLQ9IrzAdJ =x/Cg -----END PGP SIGNATURE----- --8Ggk3PN8HtHI9Q4XXAHcmHdVcklqKJFDp-- From nobody Thu Mar 10 11:11:21 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id A99DF12DBF4 for ; Thu, 10 Mar 2016 11:11:19 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -1.121 X-Spam-Level: X-Spam-Status: No, score=-1.121 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, SPF_NEUTRAL=0.779] autolearn=no autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 6n4IAakNupQu for ; Thu, 10 Mar 2016 11:11:18 -0800 (PST) Received: from mail.kivinen.iki.fi (fireball.acr.fi [83.145.195.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 56A9212DBF7 for ; Thu, 10 Mar 2016 11:11:18 -0800 (PST) Received: from fireball.acr.fi (localhost [127.0.0.1]) by mail.kivinen.iki.fi (8.15.2/8.15.2) with ESMTPS id u2AJBGYc013129 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 10 Mar 2016 21:11:16 +0200 (EET) Received: (from kivinen@localhost) by fireball.acr.fi (8.15.2/8.14.8/Submit) id u2AJBGC2021484; Thu, 10 Mar 2016 21:11:16 +0200 (EET) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <22241.50900.146543.522029@fireball.acr.fi> Date: Thu, 10 Mar 2016 21:11:16 +0200 From: Tero Kivinen To: Henrik Levkowetz In-Reply-To: <56E1883C.6030408@levkowetz.com> References: <22241.30532.972093.128187@fireball.acr.fi> <56E1883C.6030408@levkowetz.com> X-Mailer: VM 8.2.0b under 24.5.1 (x86_64--netbsd) X-Edit-Time: 4 min X-Total-Time: 3 min Archived-At: Cc: tools-discuss@ietf.org Subject: Re: [Tools-discuss] gamay.tools.ietf.org / art.tools.ietf.org DNS X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2016 19:11:19 -0000 Henrik Levkowetz writes: > On 2016-03-10 14:31, Tero Kivinen wrote: > > I am trying to do the secdir area review team assignments, but the > > bind/named in the gamay has died, and the machine does not know how to > > resolve names like datatracker.ietf.org, which means the review tool > > cannot fetch iesg agenda etc files. > > Ugh! Bind restarted. > > Sorry for the delay; in bed with a cold. > > Will you let me know if this fixes the issue, please? Yep, fixed the issue, did my assignments now. Thanks. Btw, I think bind have had several denial of service bugs lately (last one yesterday or something), is the tools.ietf.org machine updated with the latest versions? -- kivinen@iki.fi From nobody Thu Mar 10 12:29:16 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8A48812DD0B for ; Thu, 10 Mar 2016 12:29:15 -0800 (PST) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -106.9 X-Spam-Level: X-Spam-Status: No, score=-106.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NUnRf1zMDKaz for ; Thu, 10 Mar 2016 12:29:14 -0800 (PST) Received: from zinfandel.tools.ietf.org (zinfandel.tools.ietf.org [IPv6:2001:1890:123a::1:2a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 1E0C112DD15 for ; Thu, 10 Mar 2016 12:29:13 -0800 (PST) Received: from 81-235-150-134-no105.tbcn.telia.com ([81.235.150.134]:63688 helo=[192.168.1.120]) by zinfandel.tools.ietf.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1ae7Cp-0006vD-3k; Thu, 10 Mar 2016 12:29:11 -0800 Message-ID: <56E1D90E.10109@levkowetz.com> Date: Thu, 10 Mar 2016 21:29:02 +0100 From: Henrik Levkowetz User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:31.0) Gecko/20100101 Thunderbird/31.8.0 MIME-Version: 1.0 To: Tero Kivinen References: <22241.30532.972093.128187@fireball.acr.fi> <56E1883C.6030408@levkowetz.com> <22241.50900.146543.522029@fireball.acr.fi> In-Reply-To: <22241.50900.146543.522029@fireball.acr.fi> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="gtUL0hsMAB3h6j0840604dccpPa30r5G9" X-SA-Exim-Connect-IP: 81.235.150.134 X-SA-Exim-Rcpt-To: tools-discuss@ietf.org, kivinen@iki.fi X-SA-Exim-Mail-From: henrik@levkowetz.com X-SA-Exim-Version: 4.2.1 (built Mon, 26 Dec 2011 16:24:06 +0000) X-SA-Exim-Scanned: Yes (on zinfandel.tools.ietf.org) Archived-At: Cc: tools-discuss@ietf.org Subject: Re: [Tools-discuss] gamay.tools.ietf.org / art.tools.ietf.org DNS X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2016 20:29:15 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --gtUL0hsMAB3h6j0840604dccpPa30r5G9 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Tero, On 2016-03-10 20:11, Tero Kivinen wrote: > Henrik Levkowetz writes: >> On 2016-03-10 14:31, Tero Kivinen wrote: >> > I am trying to do the secdir area review team assignments, but the >> > bind/named in the gamay has died, and the machine does not know how = to >> > resolve names like datatracker.ietf.org, which means the review tool= >> > cannot fetch iesg agenda etc files. >>=20 >> Ugh! Bind restarted. >>=20 >> Sorry for the delay; in bed with a cold. >>=20 >> Will you let me know if this fixes the issue, please? >=20 > Yep, fixed the issue, did my assignments now. Thanks. >=20 > Btw, I think bind have had several denial of service bugs lately (last > one yesterday or something), is the tools.ietf.org machine updated > with the latest versions? Gamay wasn't when bind died on us, but it is now. Best regards, Henrik --gtUL0hsMAB3h6j0840604dccpPa30r5G9 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJW4dkOAAoJEE6bV0uPuxcaV0cP/3zh8vBcd6QSSAVZmqwW6/YP cGRQVZMTEiMqo622vhqwB+4sX8L/xjHThe/pJavO2qkAubEiQELjmPVBvECCoN4m RFu9ahPYjK78CAck8dw+iwDbX+c2SvadigsTcKUpvkFppEZ+SDgQRQreoy2UjEvu SLohjBtKXvAdYKjaq8wIM0UUdwAZOxYznATxw5ila9XArh5bAuXeIyBgxvYApBKT B1Zmm/Q3Wsdbv3riRawU+jUjxzkIWnvIVJX+yLW1H6UixfKSbLX+/LYMIcM3RhYv 0BMicMJ1xtyiKKpU949LVHdNtlIwDi3ai4NWsN83kyba0e6uJBIZh1fn09yNiZzF 0oKKTQUZ5+rVb8K+G7h+waNrGZYKo1D8CrTgfTXx/i06PcXBEsLDJqn6s3a0nRW5 hRjVqxHMLFq2uQfAnFQyXST3j/bDxLacZvJr38xVRjeoto/M1vobMpke/EjDNKP8 G3mrx52FUZmQPL16EOccQuX18xD9mPBH9leYNLq64w4SRd5T4lWmK++p8DQHnanm I2mVTM3iBSs/aPwU/R+9x6uvWPsBs1QfD32TT6pFCrMv46wZJwm7GZK62zPlVEgX 0oh56jzBSWyH94Hz7Kb5u/3jQk3Lt+dUdnJtHY8bK14RcKccWusnrnHdPX2+dzlI Jgb7X1enpwAPTqsf8yWq =yzbd -----END PGP SIGNATURE----- --gtUL0hsMAB3h6j0840604dccpPa30r5G9-- From nobody Mon Mar 14 08:07:53 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2AFEB12DC02; Mon, 14 Mar 2016 08:07:52 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -114.522 X-Spam-Level: X-Spam-Status: No, score=-114.522 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Txjj6wyqtUCL; Mon, 14 Mar 2016 08:07:48 -0700 (PDT) Received: from alln-iport-1.cisco.com (alln-iport-1.cisco.com [173.37.142.88]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C41E612DC1F; Mon, 14 Mar 2016 07:59:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=12072; q=dns/txt; s=iport; t=1457967542; x=1459177142; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=CqEBkwpcxUWGEsEsUYorwithJeTYbfk6w0qv5S2gJoI=; b=DbdU7lyiiia5XjlEFUhpssR/+1HXegOcfKhJNpyo5O9C2XCQBY3ATLjg 1SYEJkJR5+nMekwPLi6sE0/njNOvPctmLeCOnKQhLlwjLXXlzxlZwAo6C 2N58nEUBIxz8YbP27e6LP5RF7VQNTalw5XlU4DYS2NjgGKqDcSNOXNUhS s=; X-Files: signature.asc : 833 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0C/AgDF0OZW/5ldJa1dg0ZSbQa6Lw6Bc?= =?us-ascii?q?COFagKBLTgUAQEBAQEBAWQcC4RBAQEBAwFJMAULAgEIGC4yJQIEDgUJBYgOCA6?= =?us-ascii?q?7OQEBAQEBAQEBAQEBAQEBAQEBAQEBAQ0IiAsIgkeBN3yBTQoLBgEGBh0hEoJtg?= =?us-ascii?q?Q8Fh2uFTooSAYMagWZtbYRugjeBZRY1g36CRmCFMYc9hz8BHgFDgX4FDQwUgTR?= =?us-ascii?q?qAQEBiSYIFx1+AQEB?= X-IronPort-AV: E=Sophos;i="5.24,335,1454976000"; d="asc'?scan'208,217";a="249294782" Received: from rcdn-core-2.cisco.com ([173.37.93.153]) by alln-iport-1.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 14 Mar 2016 14:59:01 +0000 Received: from XCH-ALN-015.cisco.com (xch-aln-015.cisco.com [173.36.7.25]) by rcdn-core-2.cisco.com (8.14.5/8.14.5) with ESMTP id u2EEx1nI011069 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=FAIL); Mon, 14 Mar 2016 14:59:01 GMT Received: from xch-rcd-013.cisco.com (173.37.102.23) by XCH-ALN-015.cisco.com (173.36.7.25) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Mon, 14 Mar 2016 09:59:00 -0500 Received: from xch-rcd-013.cisco.com ([173.37.102.23]) by XCH-RCD-013.cisco.com ([173.37.102.23]) with mapi id 15.00.1104.009; Mon, 14 Mar 2016 09:59:00 -0500 From: "Fred Baker (fred)" To: "ietf-action@ietf.org" Thread-Topic: [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' Thread-Index: AQHRecsx1UhT4wNRQkCftWl5ULm1LJ9TEJwAgABJWgD//8THI4AAc7UAgAXR2wA= Date: Mon, 14 Mar 2016 14:59:00 +0000 Message-ID: References: <990C21F7-2B71-4283-B129-C4089655DF16@cisco.com> <01A83A34-BF3F-4044-8FDA-F1197443BE56@cisco.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3112) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.19.64.117] Content-Type: multipart/signed; boundary="Apple-Mail=_40F745B9-D7DD-481C-A6DF-8372C549311D"; protocol="application/pgp-signature"; micalg=pgp-sha1 MIME-Version: 1.0 Archived-At: Cc: "henrik@levkowetz.com" , "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Mar 2016 15:07:52 -0000 --Apple-Mail=_40F745B9-D7DD-481C-A6DF-8372C549311D Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii The API to IETF data is still failing, just like it was a week ago. What = is the plan for getting this fixed? 104:fred@irp-lnx1% date;curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' Mon Mar 14 07:56:14 PDT 2016 504 Gateway Timeout

Gateway Timeout

The gateway did not receive a timely response from the upstream server or application.

> On Mar 10, 2016, at 1:06 PM, Fred Baker (fred) wrote: >=20 > Would it help if I sent my script, perhaps? See attached. My model = command is: >=20 > perl -w json-cisco-work.pl --wg --individual --debug test current > = cisco-drafts.txt >=20 > You will need to change one access, which seeks to read = http://wwwin-people.cisco.com/fred/cisco_exceptions; you can't get to it = from outside Cisco. I have attached it as a file. >=20 > The debug option has it say what it is trying to read, giving you the = option of repeating the access. In the output following, you will notice = that it correctly accessed >=20 > "current" is a list of active internet drafts, derived from = 1id-index.txt. >=20 > I ran the script twice, and got different results - something that has = been an issue all through this. It seems to be able to correctly access = a random number of json files, and then has some issue (in this case, = "404 no such file", in other cases a gateway failure or an internal = error) on which it chokes. >=20 > Note that this all worked until recently. This is not new code. >=20 > 119:fred@irp-lnx1% !nice > nice csh /users/fred/WWW/json/new-work.sh 2015-10-20 2015-11-01 = 2016-03-27 November-March-2016 > accessing http://wwwin-people.cisco.com/fred/cisco_exceptions > accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-rfceditor' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ise' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-iesg' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ietf' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dietf' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Darea' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' 2> /dev/null > malformed JSON string, neither array, object, number, string or atom, = at character offset 0 [" accessing http://wwwin-people.cisco.com/fred/cisco_exceptions > accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-rfceditor' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ise' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-iesg' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ietf' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dietf' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Darea' 2> /dev/null > accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' 2> /dev/null > malformed JSON string, neither array, object, number, string or atom, = at character offset 0 [" 120:fred@irp-lnx1% date;curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' > Thu Mar 10 12:23:27 PST 2016 >=20 > >=20 >=20 >=20 > > > > > 404 Not Found > >=20 > > > >=20 > ... >=20 >=20 >> On Mar 10, 2016, at 12:12 PM, Matt Larson via RT = wrote: >>=20 >> Hi Fred, >>=20 >> We've done some further tuning, and believe that this is resolved. = Please let >> me know if you have any further issues. >>=20 >> Matt >>=20 >> On Thu Mar 10 09:44:29 2016, fred@cisco.com wrote: >>>=20 >>>> On Mar 10, 2016, at 5:21 AM, Matt Larson via RT >> action@ietf.org> wrote: >>>>=20 >>>> Greetings, >>>>=20 >>>> I believe this has stabilized now that the server move is = completed. >>> I did some >>>> testing and have been able to consistently pull that URL, along = with >>> a sampling >>>> of the others. >>>>=20 >>>> I am going to resolve out this ticket, but please let us know if >>> there are any >>>> further issues. Replying to this email will re-open the ticket. >>>>=20 >>>> Matt >>>=20 >>> 105:fred@irp-lnx1% nice perl -w /users/fred/WWW/json/json-cisco- >>> work.pl --wg --individual --debug test /users/fred/draft/.current > >>> /users/fred/WWW/json/cisco-drafts.txt >>> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >>> accessing curl >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>> rfceditor' 2> /dev/null >>> accessing curl >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>> stream-ise' 2> /dev/null >>> accessing curl >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>> iesg' 2> /dev/null >>> accessing curl >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>> stream-ietf' 2> /dev/null >>> accessing curl >>>=20 >> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dietf' >>> 2> /dev/null >>> accessing curl >>>=20 >> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Darea' >>> 2> /dev/null >>> accessing curl >>>=20 >> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' >>> 2> /dev/null >>> malformed JSON string, neither array, object, number, string or = atom, >>> at character offset 0 [">> /users/fred/WWW/json/json-cisco-work.pl line 177 >>> 106:fred@irp-lnx1% date;curl >>>=20 >> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' >>> Thu Mar 10 09:43:38 PST 2016 >>> >>> >>> 504 Gateway Timeout >>> >>>

Gateway Timeout

>>>

The gateway did not receive a timely response >>> from the upstream server or application.

>>> >>>=20 >>>=20 >>>=20 >>>=20 >>>=20 >>>=20 >>>=20 >>>> On Tue Mar 08 22:16:23 2016, fred@cisco.com wrote: >>>>> Over the past few days (at least, I'm not sure when it started >>>>> happening) I am randomly getting errors that look like this. Often >>>>> several - tens or hundreds - of transactions will work and then = one >>>>> fail. >>>>>=20 >>>>> Suggestions? >>>>>=20 >>>>> 144:fred@irp-lnx1% curl >>>>>=20 >>>>=20 >>>=20 >> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' >>>>> >>>>> >>>>> 500 Internal Server Error >>>>> >>>>>

Internal Server Error

>>>>>

The server encountered an internal error or >>>>> misconfiguration and was unable to complete >>>>> your request.

>>>>>

Please contact the server administrator at >>>>> ietf-action@ietf.org to inform them of the time this error >>> occurred, >>>>> and the actions you performed just before this error.

>>>>>

More information about this error may be available >>>>> in the server error log.

>>>>>

Additionally, a 403 Forbidden >>>>> error was encountered while trying to use an ErrorDocument to >>> handle >>>>> the request.

>>>>> >>>>>=20 >>>>>=20 >>>>> My models, in case this is relevant: >>>>>=20 >>>>> 145:fred@irp-lnx1% fgrep datatracker.ietf.org >>>>> /users/fred/WWW/json/json-cisco-work.pl >>>>> "curl >>>>>=20 >>>>=20 >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>> stream-ietf' 2> /dev/null"; >>>>> "curl >>>>>=20 >>>>=20 >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>> iesg' 2> /dev/null"; >>>>> "curl >>>>>=20 >>>>=20 >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>> rfceditor' 2> /dev/null"; >>>>> $curl_ise_rev =3D "curl >>>>>=20 >>>>=20 >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>> stream-ise' 2> /dev/null"; >>>>> "curl >>>>>=20 >>>>=20 >>>=20 >> = 'https://datatracker.ietf.org/api/v1/group/group/\?format=3Djson&limit=3D0= &type__slug__in=3D%s' >>>>> 2> /dev/null"; >>>>> my $curl =3D "curl 'https://datatracker.ietf.org%s?format=3Djson' = 2> >>>>> /dev/null"; >>>>> "curl >>>>>=20 >>>>=20 >>>=20 >> = 'https://datatracker.ietf.org/api/v1/doc/document/\?format=3Djson\&name__c= ontains=3D%s\&limit=3D0' >>>>> 2> /dev/null"; >>>>> "curl 'https://datatracker.ietf.org%s\?format=3Djson' 2> >>>>> /dev/null"; >=20 > --Apple-Mail=_40F745B9-D7DD-481C-A6DF-8372C549311D Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQIVAwUBVubRs0ayAOS/EQ8MAQKjdA//YgWsdMsaDS+QIHQ85lJwbNcGalpW0VOP aKohrBMTLpJRsTzZ688N5EclIn5+DMDnlp70iH4/+zQZlp3+tQB02q4wfVh3tqkX 2+HrlTnu316MloGQQ+oq56ItLFXcblLrWr09H4rhu3vfX11B/5eLizBxHhZ+qLCv S6mGwooBFwWan3iTy8SZ9YENzrAOBEwUWTD8vb0HA9MY8FDN36DOWaaqNoMOTF2F /ipP8Jl5VY/1SAJxmBZV76Y69WDanEC4dcBtuCcCELmq0n74eYr2C6huknAv57Ev Zusjvy3SSQiQPYnAsH9HYryNNOvXOxJMX1EWopMk9KMfqyq7tbrIz8Ek4+4kLSTO S5mXOdmYahnKsIyr0+IKP5mXAEC4DzyFB/n0sptnZ6ad1o9eRssAgeqEtDM2NS3q cWmJxs3Fh3yhQgkusLiIhra7X1Yu3ZpUDerS8N5EuH2RQhorQv9aDG40xNQkObMt GcGpHOmFuc0JLY6YNwE1EOrOQLHsp31ApUaXkdVmXVqGAcdJ2IFWHSq02cnx1ziv YoBzChMkauVsQXxLhOEMbXl24P4zyMvcVJK31F4GQjOrm90WehsmwV/37i4Gk2Ja 53VRFwEaAToUy7voVKyk5wqTtsnlHVvKwL8TK1DJlOIV6pErVI8d6qL/JoZFQ+AS QmhdIK21ZEw= =nALm -----END PGP SIGNATURE----- --Apple-Mail=_40F745B9-D7DD-481C-A6DF-8372C549311D-- From nobody Wed Mar 16 09:12:03 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 52C2B12D626 for ; Wed, 16 Mar 2016 09:12:02 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -2.6 X-Spam-Level: X-Spam-Status: No, score=-2.6 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_LOW=-0.7] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YC8LU-vW3aYD for ; Wed, 16 Mar 2016 09:12:00 -0700 (PDT) Received: from b.painless.aa.net.uk (b.painless.aa.net.uk [IPv6:2001:8b0:0:30:5054:ff:fe5e:1643]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 42DFA12D620 for ; Wed, 16 Mar 2016 09:12:00 -0700 (PDT) Received: from brdgfw.folly.org.uk ([81.187.254.242] helo=[192.168.0.128]) by b.painless.aa.net.uk with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1agE3C-00067I-Gq for tools-discuss@ietf.org; Wed, 16 Mar 2016 16:11:58 +0000 To: tools-discuss@ietf.org From: Elwyn Davies Message-ID: <56E985BF.7070604@folly.org.uk> Date: Wed, 16 Mar 2016 16:11:43 +0000 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.6.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Archived-At: Subject: [Tools-discuss] Aesthetic nit/corner case in draft footers X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Mar 2016 16:12:02 -0000 I don't think I have seen this before: The first author of draft-ietf-aqm-fq-codel has a very long, double-barrelled surname, such that there isn't enough space for "Hoeiland-Joergensen, et al" in the left hand part of the footer and it collides with "Expires..." The footer of the upcoming -06 version (not in the repository yet) ends up with: Hoeiland-Joergensen, etExpires September 17, 2016 [Page 15] I'll record it in the tickets for the record. Regards, Elwyn From nobody Wed Mar 16 10:49:46 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3690212D748; Wed, 16 Mar 2016 10:49:44 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -106.9 X-Spam-Level: X-Spam-Status: No, score=-106.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id X3VCdD28E1Wv; Wed, 16 Mar 2016 10:49:41 -0700 (PDT) Received: from zinfandel.tools.ietf.org (zinfandel.tools.ietf.org [IPv6:2001:1890:123a::1:2a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 8A37812D52D; Wed, 16 Mar 2016 10:49:41 -0700 (PDT) Received: from 81-235-150-134-no105.tbcn.telia.com ([81.235.150.134]:50417 helo=[192.168.1.120]) by zinfandel.tools.ietf.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1agFZi-0007nl-Hb; Wed, 16 Mar 2016 10:49:41 -0700 Message-ID: <56E99CAA.1020205@levkowetz.com> Date: Wed, 16 Mar 2016 18:49:30 +0100 From: Henrik Levkowetz User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:31.0) Gecko/20100101 Thunderbird/31.8.0 MIME-Version: 1.0 To: "Fred Baker (fred)" , "ietf-action@ietf.org" References: <990C21F7-2B71-4283-B129-C4089655DF16@cisco.com> <01A83A34-BF3F-4044-8FDA-F1197443BE56@cisco.com> In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="4LO2OLTTiqdN2CwQtlnGIK1KSLSk07sNL" X-SA-Exim-Connect-IP: 81.235.150.134 X-SA-Exim-Rcpt-To: tools-discuss@ietf.org, ietf-action@ietf.org, fred@cisco.com X-SA-Exim-Mail-From: henrik@levkowetz.com X-SA-Exim-Version: 4.2.1 (built Mon, 26 Dec 2011 16:24:06 +0000) X-SA-Exim-Scanned: Yes (on zinfandel.tools.ietf.org) Archived-At: Cc: "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Mar 2016 17:49:44 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --4LO2OLTTiqdN2CwQtlnGIK1KSLSk07sNL Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Fred, You may already have seen the blurb for the latest datatracker release, but in case not, I've introduced some caching which should reduce the time it takes to produce REST API responses: https://datatracker.ietf.org/release/6.17.0/ It turns out that the API framework we are using has a weakness in how it deals with related objects, and this caused a doubling (approximately)= of the response time for the groups query, even if the new related object= s were 2 relationships away. The caching I've coded up should deal with th= is, and my tests indicate an improvement with about a factor 4, or a factor 2= better than before 6.16.0. If, however, things still aren't working out for you, please let Glen, Robert and me know. Best regards, Henrik On 2016-03-14 15:59, Fred Baker (fred) wrote: > The API to IETF data is still failing, just like it was a week ago. Wha= t is the plan for getting this fixed? >=20 > 104:fred@irp-lnx1% date;curl 'https://datatracker.ietf.org/api/v1/group= /group/?format=3Djson&limit=3D0&type__slug__in=3Dwg' > Mon Mar 14 07:56:14 PDT 2016 > > > 504 Gateway Timeout > >

Gateway Timeout

>

The gateway did not receive a timely response > from the upstream server or application.

> >=20 >=20 >> On Mar 10, 2016, at 1:06 PM, Fred Baker (fred) wrote:= >>=20 >> Would it help if I sent my script, perhaps? See attached. My model com= mand is: >>=20 >> perl -w json-cisco-work.pl --wg --individual --debug test current > ci= sco-drafts.txt >>=20 >> You will need to change one access, which seeks to read http://wwwin-p= eople.cisco.com/fred/cisco_exceptions; you can't get to it from outside C= isco. I have attached it as a file. >>=20 >> The debug option has it say what it is trying to read, giving you the = option of repeating the access. In the output following, you will notice = that it correctly accessed >>=20 >> "current" is a list of active internet drafts, derived from 1id-index.= txt. >>=20 >> I ran the script twice, and got different results - something that has= been an issue all through this. It seems to be able to correctly access = a random number of json files, and then has some issue (in this case, "40= 4 no such file", in other cases a gateway failure or an internal error) o= n which it chokes. >>=20 >> Note that this all worked until recently. This is not new code. >>=20 >> 119:fred@irp-lnx1% !nice >> nice csh /users/fred/WWW/json/new-work.sh 2015-10-20 2015-11-01 2016-0= 3-27 November-March-2016 >> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3D= json&limit=3D0&type__slug__in=3Ddraft-rfceditor' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3D= json&limit=3D0&type__slug__in=3Ddraft-stream-ise' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3D= json&limit=3D0&type__slug__in=3Ddraft-iesg' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3D= json&limit=3D0&type__slug__in=3Ddraft-stream-ietf' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Dietf' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Darea' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Dwg' 2> /dev/null >> malformed JSON string, neither array, object, number, string or atom, = at character offset 0 ["> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3D= json&limit=3D0&type__slug__in=3Ddraft-rfceditor' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3D= json&limit=3D0&type__slug__in=3Ddraft-stream-ise' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3D= json&limit=3D0&type__slug__in=3Ddraft-iesg' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3D= json&limit=3D0&type__slug__in=3Ddraft-stream-ietf' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Dietf' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Darea' 2> /dev/null >> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Dwg' 2> /dev/null >> malformed JSON string, neither array, object, number, string or atom, = at character offset 0 ["> 120:fred@irp-lnx1% date;curl 'https://datatracker.ietf.org/api/v1/grou= p/group/?format=3Djson&limit=3D0&type__slug__in=3Dwg' >> Thu Mar 10 12:23:27 PST 2016 >>=20 >> >>=20 >>=20 >>=20 >> >> >> >> >> 404 Not Found >> >>=20 >> >> >> >>=20 >> ... >>=20 >>=20 >>> On Mar 10, 2016, at 12:12 PM, Matt Larson via RT wrote: >>>=20 >>> Hi Fred, >>>=20 >>> We've done some further tuning, and believe that this is resolved. Pl= ease let >>> me know if you have any further issues. >>>=20 >>> Matt >>>=20 >>> On Thu Mar 10 09:44:29 2016, fred@cisco.com wrote: >>>>=20 >>>>> On Mar 10, 2016, at 5:21 AM, Matt Larson via RT >>> action@ietf.org> wrote: >>>>>=20 >>>>> Greetings, >>>>>=20 >>>>> I believe this has stabilized now that the server move is completed= =2E >>>> I did some >>>>> testing and have been able to consistently pull that URL, along wit= h >>>> a sampling >>>>> of the others. >>>>>=20 >>>>> I am going to resolve out this ticket, but please let us know if >>>> there are any >>>>> further issues. Replying to this email will re-open the ticket. >>>>>=20 >>>>> Matt >>>>=20 >>>> 105:fred@irp-lnx1% nice perl -w /users/fred/WWW/json/json-cisco- >>>> work.pl --wg --individual --debug test /users/fred/draft/.current > >>>> /users/fred/WWW/json/cisco-drafts.txt >>>> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >>>> accessing curl >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D= 0&type__slug__in=3Ddraft- >>>> rfceditor' 2> /dev/null >>>> accessing curl >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D= 0&type__slug__in=3Ddraft- >>>> stream-ise' 2> /dev/null >>>> accessing curl >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D= 0&type__slug__in=3Ddraft- >>>> iesg' 2> /dev/null >>>> accessing curl >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D= 0&type__slug__in=3Ddraft- >>>> stream-ietf' 2> /dev/null >>>> accessing curl >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Dietf' >>>> 2> /dev/null >>>> accessing curl >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Darea' >>>> 2> /dev/null >>>> accessing curl >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Dwg' >>>> 2> /dev/null >>>> malformed JSON string, neither array, object, number, string or atom= , >>>> at character offset 0 [">>> /users/fred/WWW/json/json-cisco-work.pl line 177 >>>> 106:fred@irp-lnx1% date;curl >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Dwg' >>>> Thu Mar 10 09:43:38 PST 2016 >>>> >>>> >>>> 504 Gateway Timeout >>>> >>>>

Gateway Timeout

>>>>

The gateway did not receive a timely response >>>> from the upstream server or application.

>>>> >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>>=20 >>>>> On Tue Mar 08 22:16:23 2016, fred@cisco.com wrote: >>>>>> Over the past few days (at least, I'm not sure when it started >>>>>> happening) I am randomly getting errors that look like this. Often= >>>>>> several - tens or hundreds - of transactions will work and then on= e >>>>>> fail. >>>>>>=20 >>>>>> Suggestions? >>>>>>=20 >>>>>> 144:fred@irp-lnx1% curl >>>>>>=20 >>>>>=20 >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Dwg' >>>>>> >>>>>> >>>>>> 500 Internal Server Error >>>>>> >>>>>>

Internal Server Error

>>>>>>

The server encountered an internal error or >>>>>> misconfiguration and was unable to complete >>>>>> your request.

>>>>>>

Please contact the server administrator at >>>>>> ietf-action@ietf.org to inform them of the time this error >>>> occurred, >>>>>> and the actions you performed just before this error.

>>>>>>

More information about this error may be available >>>>>> in the server error log.

>>>>>>

Additionally, a 403 Forbidden >>>>>> error was encountered while trying to use an ErrorDocument to >>>> handle >>>>>> the request.

>>>>>> >>>>>>=20 >>>>>>=20 >>>>>> My models, in case this is relevant: >>>>>>=20 >>>>>> 145:fred@irp-lnx1% fgrep datatracker.ietf.org >>>>>> /users/fred/WWW/json/json-cisco-work.pl >>>>>> "curl >>>>>>=20 >>>>>=20 >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D= 0&type__slug__in=3Ddraft- >>>>>> stream-ietf' 2> /dev/null"; >>>>>> "curl >>>>>>=20 >>>>>=20 >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D= 0&type__slug__in=3Ddraft- >>>>>> iesg' 2> /dev/null"; >>>>>> "curl >>>>>>=20 >>>>>=20 >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D= 0&type__slug__in=3Ddraft- >>>>>> rfceditor' 2> /dev/null"; >>>>>> $curl_ise_rev =3D "curl >>>>>>=20 >>>>>=20 >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D= 0&type__slug__in=3Ddraft- >>>>>> stream-ise' 2> /dev/null"; >>>>>> "curl >>>>>>=20 >>>>>=20 >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/group/group/\?format=3Djson&limi= t=3D0&type__slug__in=3D%s' >>>>>> 2> /dev/null"; >>>>>> my $curl =3D "curl 'https://datatracker.ietf.org%s?format=3Djson' = 2> >>>>>> /dev/null"; >>>>>> "curl >>>>>>=20 >>>>>=20 >>>>=20 >>> 'https://datatracker.ietf.org/api/v1/doc/document/\?format=3Djson\&na= me__contains=3D%s\&limit=3D0' >>>>>> 2> /dev/null"; >>>>>> "curl 'https://datatracker.ietf.org%s\?format=3Djson' 2> >>>>>> /dev/null"; >>=20 >> >=20 >=20 >=20 --4LO2OLTTiqdN2CwQtlnGIK1KSLSk07sNL Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJW6ZyrAAoJEE6bV0uPuxcaJdQQAMxffcN+mHrC3CnB6efop7mg b7B98Du8WvGG4ZTv9yIe9KAFYkO8w6z+taCn0Ps5/jMD4mO0fkiuqSLBZu/rwu2I TyfvHnGFfWJkOhP4PZ/uvyJgtlvp5IuJLTUxgRIbWcJyrfVJgOdHJlN+iWxvT2Ei Y7nGtQhugzJ/2YyzWBqr4ZgJ/NZg3xh6QdcZm1dklymJwggp4BnnhACjdgbA3sYq /1sIh8twe+QM/lpyp5BnoV/HritBBXaC3w9qEsf+Epl0lJuQvfaUXDEmA1XGFMKC 2kWL29gDV3YGR/hJJaGid/BWDUMAtvFRKERgbfYiDZwPF7pXnJ5ujVcRphlqVPgK 0Jnb9EwS5ECCVjA5KOU0YxlACohYIhCbLF1jI1d1fLErhxCeF0l+5PY3x5yEC9wK LJVEUKYu6V6JMF3YMAOOWQnZjkNTexKTS6yuzEwmcTMHCu4x8DjXcTWxAr/RymfT RbwPMW+oNkpTJHW0R+sFjIx0W695u7XiMSss9GKqQEil/2czbiPKTJ88ZW6YLlLL Yqk7CeZxjzDGwcRA8ULsOKkQomwNPJFZAQTH1bQwSkb4RcD8VciNnCkoESiq0haS AHLUfERTAXRuqh5jN5YmKDPAYjyLlAiS9veD7GLqEUlxFxX1TnJXw9E7ibB0zjkn WDQFj8GrFClAyRKGlZiK =ecw1 -----END PGP SIGNATURE----- --4LO2OLTTiqdN2CwQtlnGIK1KSLSk07sNL-- From nobody Wed Mar 16 11:46:30 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id BF3FA12D673; Wed, 16 Mar 2016 11:46:28 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -114.522 X-Spam-Level: X-Spam-Status: No, score=-114.522 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id y25I1hNqbBtC; Wed, 16 Mar 2016 11:46:25 -0700 (PDT) Received: from alln-iport-2.cisco.com (alln-iport-2.cisco.com [173.37.142.89]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id EFE9D12D610; Wed, 16 Mar 2016 11:46:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=21688; q=dns/txt; s=iport; t=1458153985; x=1459363585; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=NsEjmeEXDVAYRsyz+WtOmp+xb2/EFSfAUET5NhxNRMo=; b=aX5MNHfYLs7Rz003qt5mk5twk0h3U6vwIMHRhAlEhu1qoY8cDuCkh4LL PGyzuN65z/ZCti5yKHUe8L6OFhoNk0EEhNCHpurBRQxqwGrF56xVhruWd J/9jXSBzthgxeUxMrm++6EHjGYCkU2wb78f2CeoRJcSoczAo1m8B7Q6fi M=; X-Files: signature.asc : 833 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0DGAgBjqelW/4cNJK1eg0ZTbga6Aw6Bb?= =?us-ascii?q?yWFaAKBQjgUAQEBAQEBAWQnhEEBAQEDAUkpBwULAgEIGCMLMiUCBAENBQkFiBE?= =?us-ascii?q?IDsAnAQEBAQEBAQEBAQEBAQEBAQEBAQEBDQiIEQiBSn+BN32BTgoLBgEGBh0hE?= =?us-ascii?q?oJtgQ8Fh2yFToVKhE0BgxuBZm1tggWCaYI3gWUWNYN+gkZghTGHP4c/AR4BQ4F?= =?us-ascii?q?+BAENDBSBNWoBAQGJJggXHX4BAQE?= X-IronPort-AV: E=Sophos;i="5.24,346,1454976000"; d="asc'?scan'208";a="248634436" Received: from alln-core-2.cisco.com ([173.36.13.135]) by alln-iport-2.cisco.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 16 Mar 2016 18:46:22 +0000 Received: from XCH-ALN-013.cisco.com (xch-aln-013.cisco.com [173.36.7.23]) by alln-core-2.cisco.com (8.14.5/8.14.5) with ESMTP id u2GIkMhT018757 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=FAIL); Wed, 16 Mar 2016 18:46:22 GMT Received: from xch-rcd-013.cisco.com (173.37.102.23) by XCH-ALN-013.cisco.com (173.36.7.23) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 16 Mar 2016 13:46:21 -0500 Received: from xch-rcd-013.cisco.com ([173.37.102.23]) by XCH-RCD-013.cisco.com ([173.37.102.23]) with mapi id 15.00.1104.009; Wed, 16 Mar 2016 13:46:21 -0500 From: "Fred Baker (fred)" To: Henrik Levkowetz , "glen@amsl.com" Thread-Topic: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' Thread-Index: AQHRecsx1UhT4wNRQkCftWl5ULm1LJ9TEJwAgABJWgD//8THI4AAc7UAgAXR2wCAA1RPAIAAD+CA Date: Wed, 16 Mar 2016 18:46:21 +0000 Message-ID: References: <990C21F7-2B71-4283-B129-C4089655DF16@cisco.com> <01A83A34-BF3F-4044-8FDA-F1197443BE56@cisco.com> <56E99CAA.1020205@levkowetz.com> In-Reply-To: <56E99CAA.1020205@levkowetz.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3112) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.19.64.117] Content-Type: multipart/signed; boundary="Apple-Mail=_9AFBD214-8754-4168-B0AA-EAF80FB4F6E8"; protocol="application/pgp-signature"; micalg=pgp-sha1 MIME-Version: 1.0 Archived-At: Cc: "ietf-action@ietf.org" , "tools-discuss@ietf.org" Subject: Re: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Mar 2016 18:46:29 -0000 --Apple-Mail=_9AFBD214-8754-4168-B0AA-EAF80FB4F6E8 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Thanks. Copying Glen, who has been working on this. Last week, there were a = number of more-or-less-random failures, including server errors, = gateways that were unreachable, and files not found. In the past couple = of days, Glen has taken a look at it, and appears to have mostly = resolved the issues. I have one remaining issue, which I'm tracking down = as we speak so I can describe it to Glen. It goes something like this. I have two scripts that I'm looking at. One wonders what drafts Cisco = employees have in the pipeline (so we can inform various communities = inside the company); the other wonders what subset of those have been = updated since the past IETF meeting and are specifically working group = draft, or are specifically individual submissions (because we get = asked). Note that one of the two seems to invariably work, and is = accessing essentially the same data. The script that asks about the more = general set of drafts seems to mostly work, downloading state = information etc and then moving on to downloading relevant draft = metadata (I'd download the entire set of drafts in one swell foop, but = there are more than 1000 drafts at any given time). I see this: First, quite a number of perfectly normal and successful accesses (I'm = showing you my debug output, which says what command I'm executing): perl -w /users/fred/WWW/json/json-cisco-work.pl --wg --debug test = --individual /users/fred/draft/.current > = /users/fred/WWW/json/cisco-drafts.txt accessing http://wwwin-people.cisco.com/fred/cisco_exceptions accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-rfceditor' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ise' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-iesg' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ietf' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dietf' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Darea' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dirtf' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Drg' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dag' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Diab' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Ddir' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name__con= tains=3Ddraft-ietf-insipid-logme-reqs&limit=3D0' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/1/?format=3Djson' 2> = /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name__con= tains=3Ddraft-li-pce-tunnel-segment&limit=3D0' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name__con= tains=3Ddraft-urien-core-racs&limit=3D0' 2> /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name__con= tains=3Ddraft-ietf-avtcore-rtp-multi-stream-optimisation&limit=3D0' 2> = /dev/null accessing curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name__con= tains=3Ddraft-ietf-tcpm-accurate-ecn&limit=3D0' 2> /dev/null I see probably 500 or more accesses for internet draft metadata similar = to that last line, but for various drafts. And then I see: accessing curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name__con= tains=3Ddraft-irtf-cfrg-xmss-hash-based-signatures&limit=3D0' 2> = /dev/null JSON text must be an object or array (but found number, string, true, = false or null, use allow_nonref to allow this) at = /users/fred/WWW/json/json-cisco-work.pl line 256 Note that this doesn't happen on any specific draft, just on some draft = whose metadata I access. When I get curious about what it accessed, I = get: 121:fred@irp-lnx1% curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name__con= tains=3Ddraft-irtf-cfrg-xmss-hash-based-signatures&limit=3D0' % Total % Received % Xferd Average Speed Time Time Time = Current Dload Upload Total Spent Left = Speed {"meta": {"limit": 1000, "next": null, "offset": 0, "previous": null, = "total_count": 1}, "objects": [{"abstract": " This note describes the = eXtended Merkle Signature Scheme (XMSS), a\n hash-based digital = signature system. It follows existing\n descriptions in scientific = literature. The note specifies the WOTS+\n one-time signature scheme, = a single-tree (XMSS) and a multi-tree\n variant (XMSS^MT) of XMSS. = Both variants use WOTS+ as a main\n building block. XMSS provides = cryptographic digital signatures\n without relying on the conjectured = hardness of mathematical problems.\n Instead, it is proven that it = only relies on the properties of\n cryptographic hash functions. XMSS = provides strong security\n guarantees and, besides some special = instantiations, is even secure\n when the collision resistance of the = underlying hash function is\n broken. It is suitable for compact = implementations, relatively\n simple to implement, and naturally = resists side-channel attacks.\n Unlike most o105 1997 105 1997 0 = 0 142 0 0:00:14 0:00:13 0:00:01 410 ther signature systems, hash-based signatures withstand\n attacks = using quantum computers.\n", "ad": null, "authors": = ["/api/v1/person/email/dbutin%40cdc.informatik.tu-darmstadt.de/", = "/api/v1/person/email/stefan-lukas_gazdag%40genua.eu/", = "/api/v1/person/email/ietf%40huelsing.net/", = "/api/v1/person/email/mohaisen%40buffalo.edu/"], "expires": = "2016-08-18T03:54:01", "external_url": "", "group": = "/api/v1/group/group/1969/", "intended_std_level": null, = "internal_comments": "", "name": = "draft-irtf-cfrg-xmss-hash-based-signatures", "note": "", "notify": "", = "order": 1, "pages": 56, "resource_uri": = "/api/v1/doc/document/draft-irtf-cfrg-xmss-hash-based-signatures/", = "rev": "03", "rfc": null, "shepherd": null, "states": = ["/api/v1/doc/state/1/", "/api/v1/doc/state/58/"], "std_level": null, = "stream": "/api/v1/name/streamname/ietf/", "tags": [], "time": = "2016-02-15T03:54:01", "title": "XMSS: Extended Hash-Based Signatures", = "type": "/api/v1/name/doctypename/draft/"}]}122:fred@irp-lnx1% Which is to say that the json response is just fine, thank you very = much. What I conclude (what I think I am forced to conclude) is that = SOMETIMES, for reasons that I haven't been able to nail down, I get a = bogus json response. It's intermittent and not very repeatable for any = given file, but its very repeatable at some point in a list as I walk = through a long list of files. The other script (one being derived from = the other, and very similar) accesses metadata for a shorter list of = files (only the WG docs, or only the individual submissions, and only if = it has been updated since November), so the issue might even be the = length of the list of files for all I know. If you have a clue as to how I might debug this or what information = might be helpful to you or Glen, please advise. > On Mar 16, 2016, at 10:49 AM, Henrik Levkowetz = wrote: >=20 > Hi Fred, >=20 > You may already have seen the blurb for the latest datatracker = release, > but in case not, I've introduced some caching which should reduce the > time it takes to produce REST API responses: >=20 > https://datatracker.ietf.org/release/6.17.0/ >=20 > It turns out that the API framework we are using has a weakness in how > it deals with related objects, and this caused a doubling = (approximately) > of the response time for the groups query, even if the new related = objects > were 2 relationships away. The caching I've coded up should deal with = this, > and my tests indicate an improvement with about a factor 4, or a = factor 2 > better than before 6.16.0. >=20 > If, however, things still aren't working out for you, please let Glen, > Robert and me know. >=20 >=20 > Best regards, >=20 > Henrik >=20 >=20 > On 2016-03-14 15:59, Fred Baker (fred) wrote: >> The API to IETF data is still failing, just like it was a week ago. = What is the plan for getting this fixed? >>=20 >> 104:fred@irp-lnx1% date;curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' >> Mon Mar 14 07:56:14 PDT 2016 >> >> >> 504 Gateway Timeout >> >>

Gateway Timeout

>>

The gateway did not receive a timely response >> from the upstream server or application.

>> >>=20 >>=20 >>> On Mar 10, 2016, at 1:06 PM, Fred Baker (fred) = wrote: >>>=20 >>> Would it help if I sent my script, perhaps? See attached. My model = command is: >>>=20 >>> perl -w json-cisco-work.pl --wg --individual --debug test current > = cisco-drafts.txt >>>=20 >>> You will need to change one access, which seeks to read = http://wwwin-people.cisco.com/fred/cisco_exceptions; you can't get to it = from outside Cisco. I have attached it as a file. >>>=20 >>> The debug option has it say what it is trying to read, giving you = the option of repeating the access. In the output following, you will = notice that it correctly accessed >>>=20 >>> "current" is a list of active internet drafts, derived from = 1id-index.txt. >>>=20 >>> I ran the script twice, and got different results - something that = has been an issue all through this. It seems to be able to correctly = access a random number of json files, and then has some issue (in this = case, "404 no such file", in other cases a gateway failure or an = internal error) on which it chokes. >>>=20 >>> Note that this all worked until recently. This is not new code. >>>=20 >>> 119:fred@irp-lnx1% !nice >>> nice csh /users/fred/WWW/json/new-work.sh 2015-10-20 2015-11-01 = 2016-03-27 November-March-2016 >>> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >>> accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-rfceditor' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ise' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-iesg' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ietf' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dietf' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Darea' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' 2> /dev/null >>> malformed JSON string, neither array, object, number, string or = atom, at character offset 0 [">> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >>> accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-rfceditor' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ise' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-iesg' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft-stream-ietf' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dietf' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Darea' 2> /dev/null >>> accessing curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' 2> /dev/null >>> malformed JSON string, neither array, object, number, string or = atom, at character offset 0 [">> 120:fred@irp-lnx1% date;curl = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' >>> Thu Mar 10 12:23:27 PST 2016 >>>=20 >>> >>>=20 >>>=20 >>>=20 >>> >>> >>> >>> >>> 404 Not Found >>> >>>=20 >>> >>> >>> >>>=20 >>> ... >>>=20 >>>=20 >>>> On Mar 10, 2016, at 12:12 PM, Matt Larson via RT = wrote: >>>>=20 >>>> Hi Fred, >>>>=20 >>>> We've done some further tuning, and believe that this is resolved. = Please let >>>> me know if you have any further issues. >>>>=20 >>>> Matt >>>>=20 >>>> On Thu Mar 10 09:44:29 2016, fred@cisco.com wrote: >>>>>=20 >>>>>> On Mar 10, 2016, at 5:21 AM, Matt Larson via RT >>>> action@ietf.org> wrote: >>>>>>=20 >>>>>> Greetings, >>>>>>=20 >>>>>> I believe this has stabilized now that the server move is = completed. >>>>> I did some >>>>>> testing and have been able to consistently pull that URL, along = with >>>>> a sampling >>>>>> of the others. >>>>>>=20 >>>>>> I am going to resolve out this ticket, but please let us know if >>>>> there are any >>>>>> further issues. Replying to this email will re-open the ticket. >>>>>>=20 >>>>>> Matt >>>>>=20 >>>>> 105:fred@irp-lnx1% nice perl -w /users/fred/WWW/json/json-cisco- >>>>> work.pl --wg --individual --debug test /users/fred/draft/.current = > >>>>> /users/fred/WWW/json/cisco-drafts.txt >>>>> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >>>>> accessing curl >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>> rfceditor' 2> /dev/null >>>>> accessing curl >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>> stream-ise' 2> /dev/null >>>>> accessing curl >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>> iesg' 2> /dev/null >>>>> accessing curl >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>> stream-ietf' 2> /dev/null >>>>> accessing curl >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dietf' >>>>> 2> /dev/null >>>>> accessing curl >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Darea' >>>>> 2> /dev/null >>>>> accessing curl >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' >>>>> 2> /dev/null >>>>> malformed JSON string, neither array, object, number, string or = atom, >>>>> at character offset 0 [">>>> /users/fred/WWW/json/json-cisco-work.pl line 177 >>>>> 106:fred@irp-lnx1% date;curl >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' >>>>> Thu Mar 10 09:43:38 PST 2016 >>>>> >>>>> >>>>> 504 Gateway Timeout >>>>> >>>>>

Gateway Timeout

>>>>>

The gateway did not receive a timely response >>>>> from the upstream server or application.

>>>>> >>>>>=20 >>>>>=20 >>>>>=20 >>>>>=20 >>>>>=20 >>>>>=20 >>>>>=20 >>>>>> On Tue Mar 08 22:16:23 2016, fred@cisco.com wrote: >>>>>>> Over the past few days (at least, I'm not sure when it started >>>>>>> happening) I am randomly getting errors that look like this. = Often >>>>>>> several - tens or hundreds - of transactions will work and then = one >>>>>>> fail. >>>>>>>=20 >>>>>>> Suggestions? >>>>>>>=20 >>>>>>> 144:fred@irp-lnx1% curl >>>>>>>=20 >>>>>>=20 >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit=3D0&= type__slug__in=3Dwg' >>>>>>> >>>>>>> >>>>>>> 500 Internal Server Error >>>>>>> >>>>>>>

Internal Server Error

>>>>>>>

The server encountered an internal error or >>>>>>> misconfiguration and was unable to complete >>>>>>> your request.

>>>>>>>

Please contact the server administrator at >>>>>>> ietf-action@ietf.org to inform them of the time this error >>>>> occurred, >>>>>>> and the actions you performed just before this error.

>>>>>>>

More information about this error may be available >>>>>>> in the server error log.

>>>>>>>

Additionally, a 403 Forbidden >>>>>>> error was encountered while trying to use an ErrorDocument to >>>>> handle >>>>>>> the request.

>>>>>>> >>>>>>>=20 >>>>>>>=20 >>>>>>> My models, in case this is relevant: >>>>>>>=20 >>>>>>> 145:fred@irp-lnx1% fgrep datatracker.ietf.org >>>>>>> /users/fred/WWW/json/json-cisco-work.pl >>>>>>> "curl >>>>>>>=20 >>>>>>=20 >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>>>> stream-ietf' 2> /dev/null"; >>>>>>> "curl >>>>>>>=20 >>>>>>=20 >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>>>> iesg' 2> /dev/null"; >>>>>>> "curl >>>>>>>=20 >>>>>>=20 >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>>>> rfceditor' 2> /dev/null"; >>>>>>> $curl_ise_rev =3D "curl >>>>>>>=20 >>>>>>=20 >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit=3D0&ty= pe__slug__in=3Ddraft- >>>>>>> stream-ise' 2> /dev/null"; >>>>>>> "curl >>>>>>>=20 >>>>>>=20 >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/group/group/\?format=3Djson&limit=3D0= &type__slug__in=3D%s' >>>>>>> 2> /dev/null"; >>>>>>> my $curl =3D "curl 'https://datatracker.ietf.org%s?format=3Djson' = 2> >>>>>>> /dev/null"; >>>>>>> "curl >>>>>>>=20 >>>>>>=20 >>>>>=20 >>>> = 'https://datatracker.ietf.org/api/v1/doc/document/\?format=3Djson\&name__c= ontains=3D%s\&limit=3D0' >>>>>>> 2> /dev/null"; >>>>>>> "curl 'https://datatracker.ietf.org%s\?format=3Djson' 2> >>>>>>> /dev/null"; >>>=20 >>> >>=20 >>=20 >>=20 >=20 --Apple-Mail=_9AFBD214-8754-4168-B0AA-EAF80FB4F6E8 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQIVAwUBVump/EayAOS/EQ8MAQIx/BAAqO0tICnttG6LitROZpY6PhpD6ChJtfiu 3stLMBTHWkzVlP+7/BUAqtFe25Q3vsk8JlSP4S5MpPnVq0jOQwStXuQn1ftSTdT0 0fWaOKvfq29YRSTgjFw4cp7RmBUaRj3Mzuake5Jnuz07OVq9i2RCK7Qf6KC+0W0S M85VPk47sUfe5T+niycuWJnUsoBdim5L6uRI9PvRp8OcJ0mzzC5WA1h30rIQ5wMD oBabPHgRzDWhBJ2k4zGwccBaUEDRY8TWrgGtd8gtqZUyhCQFIBBdWRfadpRhfcpb G3Ol90AkRBSmToJiPkI4freK5m7/FRpNVMo1t0jF9FDibZ8tMFJswXFEMO07i3p2 BKI94lRiJmGTN3/cKeXgdEO1lLSWXXslwlWpMsJ2t3IJlniFU87SyFUUrizAxgIr pRxA0nvUscxXEKsW5OMvqjWKXWhJZrjrxCV7xaxnWDQIZ3PI/mO9L9Y+KXvudRQG 9zrZkiCHqrbaZiNbxe/gN0AnnB7NNen6hZEv1vzfxV47CUxGGxvpDSRy7pbkhEsn 2wlxcVMqTvPKAcDcpranCOQpJIs3SICQGTV0ba/uQZ1Dky5LlhVAL/0JdjS/Cks3 598y7qrcd7mdWRbA4D3sKLdef/XLEd6m+ntdk3WUJTgkfRtWgWrz1QkRxqLdlRof AzZJRMq0yKg= =TJc2 -----END PGP SIGNATURE----- --Apple-Mail=_9AFBD214-8754-4168-B0AA-EAF80FB4F6E8-- From nobody Wed Mar 16 11:56:33 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 8967012DA8F for ; Wed, 16 Mar 2016 11:56:31 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -104.202 X-Spam-Level: X-Spam-Status: No, score=-104.202 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id UVF5SIy4uqHO for ; Wed, 16 Mar 2016 11:56:28 -0700 (PDT) Received: from mail.amsl.com (c8a.amsl.com [IPv6:2001:1900:3001:11::28]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 6289412DAA7 for ; Wed, 16 Mar 2016 11:56:28 -0700 (PDT) Received: from mail.amsl.com (localhost [127.0.0.1]) by c8a.amsl.com (Postfix) with ESMTPS id C22341E5D65 for ; Wed, 16 Mar 2016 11:55:48 -0700 (PDT) Received: from mail-oi0-f48.google.com (mail-oi0-f48.google.com [209.85.218.48]) by c8a.amsl.com (Postfix) with ESMTPSA id 8FB991E5D66 for ; Wed, 16 Mar 2016 11:55:48 -0700 (PDT) Received: by mail-oi0-f48.google.com with SMTP id m82so45931680oif.1 for ; Wed, 16 Mar 2016 11:56:28 -0700 (PDT) X-Gm-Message-State: AD7BkJJIta9qrppYIwc4iySCbXTi9U/G6kZiR3Uwko4r77MMK/esJbZXt7kbNNW1QZd95lMPBawycgXedBS7WQ== X-Received: by 10.202.0.68 with SMTP id 65mr3368994oia.134.1458154587555; Wed, 16 Mar 2016 11:56:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.202.178.213 with HTTP; Wed, 16 Mar 2016 11:56:08 -0700 (PDT) In-Reply-To: References: <990C21F7-2B71-4283-B129-C4089655DF16@cisco.com> <01A83A34-BF3F-4044-8FDA-F1197443BE56@cisco.com> <56E99CAA.1020205@levkowetz.com> From: Glen Date: Wed, 16 Mar 2016 11:56:08 -0700 X-Gmail-Original-Message-ID: Message-ID: To: "Fred Baker (fred)" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Archived-At: Cc: Henrik Levkowetz , "tools-discuss@ietf.org" , Robert Sparks Subject: Re: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list Reply-To: glen@amsl.com List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Mar 2016 18:56:31 -0000 Hi Fred - In this case, I would just me the middle-man, reporting this onward to Henrik, Robert and the Tools Team. So you did the right thing by including them, and you don't need to compile a separate report for me. :-) I'm sure Henrik, Robert or others may have questions, so I've included Robert (and removed IETF-ACTION) here. :-) Would everyone use this address group for replies please? Thanks so much! Glen On Wed, Mar 16, 2016 at 11:46 AM, Fred Baker (fred) wrote: > Thanks. > > Copying Glen, who has been working on this. Last week, there were a numbe= r of more-or-less-random failures, including server errors, gateways that w= ere unreachable, and files not found. In the past couple of days, Glen has = taken a look at it, and appears to have mostly resolved the issues. I have = one remaining issue, which I'm tracking down as we speak so I can describe = it to Glen. It goes something like this. > > I have two scripts that I'm looking at. One wonders what drafts Cisco emp= loyees have in the pipeline (so we can inform various communities inside th= e company); the other wonders what subset of those have been updated since = the past IETF meeting and are specifically working group draft, or are spec= ifically individual submissions (because we get asked). Note that one of th= e two seems to invariably work, and is accessing essentially the same data.= The script that asks about the more general set of drafts seems to mostly = work, downloading state information etc and then moving on to downloading r= elevant draft metadata (I'd download the entire set of drafts in one swell = foop, but there are more than 1000 drafts at any given time). I see this: > > First, quite a number of perfectly normal and successful accesses (I'm sh= owing you my debug output, which says what command I'm executing): > > perl -w /users/fred/WWW/json/json-cisco-work.pl --wg --debug test --indiv= idual /users/fred/draft/.current > /users/fred/WWW/json/cisco-drafts.txt > accessing http://wwwin-people.cisco.com/fred/cisco_exceptions > accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Dj= son&limit=3D0&type__slug__in=3Ddraft-rfceditor' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Dj= son&limit=3D0&type__slug__in=3Ddraft-stream-ise' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Dj= son&limit=3D0&type__slug__in=3Ddraft-iesg' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Dj= son&limit=3D0&type__slug__in=3Ddraft-stream-ietf' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?format= =3Djson&limit=3D0&type__slug__in=3Dietf' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?format= =3Djson&limit=3D0&type__slug__in=3Darea' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?format= =3Djson&limit=3D0&type__slug__in=3Dwg' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?format= =3Djson&limit=3D0&type__slug__in=3Dirtf' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?format= =3Djson&limit=3D0&type__slug__in=3Drg' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?format= =3Djson&limit=3D0&type__slug__in=3Dag' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?format= =3Djson&limit=3D0&type__slug__in=3Diab' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?format= =3Djson&limit=3D0&type__slug__in=3Ddir' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/doc/document/?format= =3Djson&name__contains=3Ddraft-ietf-insipid-logme-reqs&limit=3D0' 2> /dev/n= ull > accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/1/?format= =3Djson' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/doc/document/?format= =3Djson&name__contains=3Ddraft-li-pce-tunnel-segment&limit=3D0' 2> /dev/nul= l > accessing curl 'https://datatracker.ietf.org/api/v1/doc/document/?format= =3Djson&name__contains=3Ddraft-urien-core-racs&limit=3D0' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/doc/document/?format= =3Djson&name__contains=3Ddraft-ietf-avtcore-rtp-multi-stream-optimisation&l= imit=3D0' 2> /dev/null > accessing curl 'https://datatracker.ietf.org/api/v1/doc/document/?format= =3Djson&name__contains=3Ddraft-ietf-tcpm-accurate-ecn&limit=3D0' 2> /dev/nu= ll > > I see probably 500 or more accesses for internet draft metadata similar t= o that last line, but for various drafts. And then I see: > > accessing curl 'https://datatracker.ietf.org/api/v1/doc/document/?format= =3Djson&name__contains=3Ddraft-irtf-cfrg-xmss-hash-based-signatures&limit= =3D0' 2> /dev/null > JSON text must be an object or array (but found number, string, true, fal= se or null, use allow_nonref to allow this) at /users/fred/WWW/json/json-ci= sco-work.pl line 256 > > Note that this doesn't happen on any specific draft, just on some draft w= hose metadata I access. When I get curious about what it accessed, I get: > > 121:fred@irp-lnx1% curl 'https://datatracker.ietf.org/api/v1/doc/document= /?format=3Djson&name__contains=3Ddraft-irtf-cfrg-xmss-hash-based-signatures= &limit=3D0' > % Total % Received % Xferd Average Speed Time Time Time C= urrent > Dload Upload Total Spent Left S= peed > {"meta": {"limit": 1000, "next": null, "offset": 0, "previous": null, "to= tal_count": 1}, "objects": [{"abstract": " This note describes the eXtend= ed Merkle Signature Scheme (XMSS), a\n hash-based digital signature syste= m. It follows existing\n descriptions in scientific literature. The not= e specifies the WOTS+\n one-time signature scheme, a single-tree (XMSS) a= nd a multi-tree\n variant (XMSS^MT) of XMSS. Both variants use WOTS+ as = a main\n building block. XMSS provides cryptographic digital signatures\= n without relying on the conjectured hardness of mathematical problems.\n= Instead, it is proven that it only relies on the properties of\n crypt= ographic hash functions. XMSS provides strong security\n guarantees and,= besides some special instantiations, is even secure\n when the collision= resistance of the underlying hash function is\n broken. It is suitable = for compact implementations, relatively\n simple to implement, and natura= lly resists side-channel attacks.\n Unlike most o105 1997 105 1997 = 0 0 142 0 0:00:14 0:00:13 0:00:01 410 > ther signature systems, hash-based signatures withstand\n attacks using= quantum computers.\n", "ad": null, "authors": ["/api/v1/person/email/dbuti= n%40cdc.informatik.tu-darmstadt.de/", "/api/v1/person/email/stefan-lukas_ga= zdag%40genua.eu/", "/api/v1/person/email/ietf%40huelsing.net/", "/api/v1/pe= rson/email/mohaisen%40buffalo.edu/"], "expires": "2016-08-18T03:54:01", "ex= ternal_url": "", "group": "/api/v1/group/group/1969/", "intended_std_level"= : null, "internal_comments": "", "name": "draft-irtf-cfrg-xmss-hash-based-s= ignatures", "note": "", "notify": "", "order": 1, "pages": 56, "resource_ur= i": "/api/v1/doc/document/draft-irtf-cfrg-xmss-hash-based-signatures/", "re= v": "03", "rfc": null, "shepherd": null, "states": ["/api/v1/doc/state/1/",= "/api/v1/doc/state/58/"], "std_level": null, "stream": "/api/v1/name/strea= mname/ietf/", "tags": [], "time": "2016-02-15T03:54:01", "title": "XMSS: Ex= tended Hash-Based Signatures", "type": "/api/v1/name/doctypename/draft/"}]}= 122:fred@irp-lnx1% > > Which is to say that the json response is just fine, thank you very much. > > What I conclude (what I think I am forced to conclude) is that SOMETIMES,= for reasons that I haven't been able to nail down, I get a bogus json resp= onse. It's intermittent and not very repeatable for any given file, but its= very repeatable at some point in a list as I walk through a long list of f= iles. The other script (one being derived from the other, and very similar)= accesses metadata for a shorter list of files (only the WG docs, or only t= he individual submissions, and only if it has been updated since November),= so the issue might even be the length of the list of files for all I know. > > If you have a clue as to how I might debug this or what information might= be helpful to you or Glen, please advise. > >> On Mar 16, 2016, at 10:49 AM, Henrik Levkowetz wr= ote: >> >> Hi Fred, >> >> You may already have seen the blurb for the latest datatracker release, >> but in case not, I've introduced some caching which should reduce the >> time it takes to produce REST API responses: >> >> https://datatracker.ietf.org/release/6.17.0/ >> >> It turns out that the API framework we are using has a weakness in how >> it deals with related objects, and this caused a doubling (approximately= ) >> of the response time for the groups query, even if the new related objec= ts >> were 2 relationships away. The caching I've coded up should deal with t= his, >> and my tests indicate an improvement with about a factor 4, or a factor = 2 >> better than before 6.16.0. >> >> If, however, things still aren't working out for you, please let Glen, >> Robert and me know. >> >> >> Best regards, >> >> Henrik >> >> >> On 2016-03-14 15:59, Fred Baker (fred) wrote: >>> The API to IETF data is still failing, just like it was a week ago. Wha= t is the plan for getting this fixed? >>> >>> 104:fred@irp-lnx1% date;curl 'https://datatracker.ietf.org/api/v1/group= /group/?format=3Djson&limit=3D0&type__slug__in=3Dwg' >>> Mon Mar 14 07:56:14 PDT 2016 >>> >>> >>> 504 Gateway Timeout >>> >>>

Gateway Timeout

>>>

The gateway did not receive a timely response >>> from the upstream server or application.

>>> >>> >>> >>>> On Mar 10, 2016, at 1:06 PM, Fred Baker (fred) wrote: >>>> >>>> Would it help if I sent my script, perhaps? See attached. My model com= mand is: >>>> >>>> perl -w json-cisco-work.pl --wg --individual --debug test current > ci= sco-drafts.txt >>>> >>>> You will need to change one access, which seeks to read http://wwwin-p= eople.cisco.com/fred/cisco_exceptions; you can't get to it from outside Cis= co. I have attached it as a file. >>>> >>>> The debug option has it say what it is trying to read, giving you the = option of repeating the access. In the output following, you will notice th= at it correctly accessed >>>> >>>> "current" is a list of active internet drafts, derived from 1id-index.= txt. >>>> >>>> I ran the script twice, and got different results - something that has= been an issue all through this. It seems to be able to correctly access a = random number of json files, and then has some issue (in this case, "404 no= such file", in other cases a gateway failure or an internal error) on whic= h it chokes. >>>> >>>> Note that this all worked until recently. This is not new code. >>>> >>>> 119:fred@irp-lnx1% !nice >>>> nice csh /users/fred/WWW/json/new-work.sh 2015-10-20 2015-11-01 2016-0= 3-27 November-March-2016 >>>> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >>>> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format= =3Djson&limit=3D0&type__slug__in=3Ddraft-rfceditor' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format= =3Djson&limit=3D0&type__slug__in=3Ddraft-stream-ise' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format= =3Djson&limit=3D0&type__slug__in=3Ddraft-iesg' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format= =3Djson&limit=3D0&type__slug__in=3Ddraft-stream-ietf' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Dietf' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Darea' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Dwg' 2> /dev/null >>>> malformed JSON string, neither array, object, number, string or atom, = at character offset 0 [">>> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >>>> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format= =3Djson&limit=3D0&type__slug__in=3Ddraft-rfceditor' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format= =3Djson&limit=3D0&type__slug__in=3Ddraft-stream-ise' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format= =3Djson&limit=3D0&type__slug__in=3Ddraft-iesg' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/doc/state/?format= =3Djson&limit=3D0&type__slug__in=3Ddraft-stream-ietf' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Dietf' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Darea' 2> /dev/null >>>> accessing curl 'https://datatracker.ietf.org/api/v1/group/group/?forma= t=3Djson&limit=3D0&type__slug__in=3Dwg' 2> /dev/null >>>> malformed JSON string, neither array, object, number, string or atom, = at character offset 0 [">>> 120:fred@irp-lnx1% date;curl 'https://datatracker.ietf.org/api/v1/grou= p/group/?format=3Djson&limit=3D0&type__slug__in=3Dwg' >>>> Thu Mar 10 12:23:27 PST 2016 >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> 404 Not Found >>>> >>>> >>>> >>>> >>>> >>>> >>>> ... >>>> >>>> >>>>> On Mar 10, 2016, at 12:12 PM, Matt Larson via RT wrote: >>>>> >>>>> Hi Fred, >>>>> >>>>> We've done some further tuning, and believe that this is resolved. Pl= ease let >>>>> me know if you have any further issues. >>>>> >>>>> Matt >>>>> >>>>> On Thu Mar 10 09:44:29 2016, fred@cisco.com wrote: >>>>>> >>>>>>> On Mar 10, 2016, at 5:21 AM, Matt Larson via RT >>>>> action@ietf.org> wrote: >>>>>>> >>>>>>> Greetings, >>>>>>> >>>>>>> I believe this has stabilized now that the server move is completed= . >>>>>> I did some >>>>>>> testing and have been able to consistently pull that URL, along wit= h >>>>>> a sampling >>>>>>> of the others. >>>>>>> >>>>>>> I am going to resolve out this ticket, but please let us know if >>>>>> there are any >>>>>>> further issues. Replying to this email will re-open the ticket. >>>>>>> >>>>>>> Matt >>>>>> >>>>>> 105:fred@irp-lnx1% nice perl -w /users/fred/WWW/json/json-cisco- >>>>>> work.pl --wg --individual --debug test /users/fred/draft/.current > >>>>>> /users/fred/WWW/json/cisco-drafts.txt >>>>>> accessing http://wwwin-people.cisco.com/fred/cisco_exceptions >>>>>> accessing curl >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit= =3D0&type__slug__in=3Ddraft- >>>>>> rfceditor' 2> /dev/null >>>>>> accessing curl >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit= =3D0&type__slug__in=3Ddraft- >>>>>> stream-ise' 2> /dev/null >>>>>> accessing curl >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit= =3D0&type__slug__in=3Ddraft- >>>>>> iesg' 2> /dev/null >>>>>> accessing curl >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit= =3D0&type__slug__in=3Ddraft- >>>>>> stream-ietf' 2> /dev/null >>>>>> accessing curl >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Dietf' >>>>>> 2> /dev/null >>>>>> accessing curl >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Darea' >>>>>> 2> /dev/null >>>>>> accessing curl >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Dwg' >>>>>> 2> /dev/null >>>>>> malformed JSON string, neither array, object, number, string or atom= , >>>>>> at character offset 0 [">>>>> /users/fred/WWW/json/json-cisco-work.pl line 177 >>>>>> 106:fred@irp-lnx1% date;curl >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Dwg' >>>>>> Thu Mar 10 09:43:38 PST 2016 >>>>>> >>>>>> >>>>>> 504 Gateway Timeout >>>>>> >>>>>>

Gateway Timeout

>>>>>>

The gateway did not receive a timely response >>>>>> from the upstream server or application.

>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>>> On Tue Mar 08 22:16:23 2016, fred@cisco.com wrote: >>>>>>>> Over the past few days (at least, I'm not sure when it started >>>>>>>> happening) I am randomly getting errors that look like this. Often >>>>>>>> several - tens or hundreds - of transactions will work and then on= e >>>>>>>> fail. >>>>>>>> >>>>>>>> Suggestions? >>>>>>>> >>>>>>>> 144:fred@irp-lnx1% curl >>>>>>>> >>>>>>> >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/group/group/?format=3Djson&limit= =3D0&type__slug__in=3Dwg' >>>>>>>> >>>>>>>> >>>>>>>> 500 Internal Server Error >>>>>>>> >>>>>>>>

Internal Server Error

>>>>>>>>

The server encountered an internal error or >>>>>>>> misconfiguration and was unable to complete >>>>>>>> your request.

>>>>>>>>

Please contact the server administrator at >>>>>>>> ietf-action@ietf.org to inform them of the time this error >>>>>> occurred, >>>>>>>> and the actions you performed just before this error.

>>>>>>>>

More information about this error may be available >>>>>>>> in the server error log.

>>>>>>>>

Additionally, a 403 Forbidden >>>>>>>> error was encountered while trying to use an ErrorDocument to >>>>>> handle >>>>>>>> the request.

>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> My models, in case this is relevant: >>>>>>>> >>>>>>>> 145:fred@irp-lnx1% fgrep datatracker.ietf.org >>>>>>>> /users/fred/WWW/json/json-cisco-work.pl >>>>>>>> "curl >>>>>>>> >>>>>>> >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit= =3D0&type__slug__in=3Ddraft- >>>>>>>> stream-ietf' 2> /dev/null"; >>>>>>>> "curl >>>>>>>> >>>>>>> >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit= =3D0&type__slug__in=3Ddraft- >>>>>>>> iesg' 2> /dev/null"; >>>>>>>> "curl >>>>>>>> >>>>>>> >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit= =3D0&type__slug__in=3Ddraft- >>>>>>>> rfceditor' 2> /dev/null"; >>>>>>>> $curl_ise_rev =3D "curl >>>>>>>> >>>>>>> >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/state/?format=3Djson&limit= =3D0&type__slug__in=3Ddraft- >>>>>>>> stream-ise' 2> /dev/null"; >>>>>>>> "curl >>>>>>>> >>>>>>> >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/group/group/\?format=3Djson&limi= t=3D0&type__slug__in=3D%s' >>>>>>>> 2> /dev/null"; >>>>>>>> my $curl =3D "curl 'https://datatracker.ietf.org%s?format=3Djson' = 2> >>>>>>>> /dev/null"; >>>>>>>> "curl >>>>>>>> >>>>>>> >>>>>> >>>>> 'https://datatracker.ietf.org/api/v1/doc/document/\?format=3Djson\&na= me__contains=3D%s\&limit=3D0' >>>>>>>> 2> /dev/null"; >>>>>>>> "curl 'https://datatracker.ietf.org%s\?format=3Djson' 2> >>>>>>>> /dev/null"; >>>> >>>> >>> >>> >>> >> > From nobody Wed Mar 16 13:57:50 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 5CF9112D756 for ; Wed, 16 Mar 2016 13:57:49 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -114.522 X-Spam-Level: X-Spam-Status: No, score=-114.522 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id p0afG6hkC8NO for ; Wed, 16 Mar 2016 13:57:47 -0700 (PDT) Received: from alln-iport-7.cisco.com (alln-iport-7.cisco.com [173.37.142.94]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 0D3FA12D558 for ; Wed, 16 Mar 2016 13:57:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=5295; q=dns/txt; s=iport; t=1458161866; x=1459371466; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=N2/l6u43yG6Y3AQt4r6pyr3rXaqaVw9UwI79ULwYUSo=; b=in1LBBA6o7rDenk849XkAtFmgMIviNbjIgZbAwJOWrRUi5ZQVIrfaC5U VMZh9t/Z+ocUG6sfCl6Kxo61RUDHEBkKSUhI0EohGOEeyzBglbp0l+xIV BBKVBHts3vJq5XJ9MEYEOCCFB7dhsD2WqbJweuOqjHnvXXAf9NtFLNOUU A=; X-Files: signature.asc : 833 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0DAAgBayOlW/4MNJK1eg0ZTbga6Bg6Bb?= =?us-ascii?q?yOFagKBQzgUAQEBAQEBAWQnhEIBAQQnIjAQAgEIGCMLMiUCBA4FCQWIGQ7AUgE?= =?us-ascii?q?BAQEBAQEBAQEBAQEBAQEBAQEBAQ0IiBGCUYE3fYFOFAENVoJtgQ8FjTqKFwGDG?= =?us-ascii?q?4FmbYgSgjCMVYc/hz8BHgFDghAggTVqAQEBiSUBCBcdfgEBAQ?= X-IronPort-AV: E=Sophos;i="5.24,346,1454976000"; d="asc'?scan'208,217";a="250141549" Received: from alln-core-1.cisco.com ([173.36.13.131]) by alln-iport-7.cisco.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 16 Mar 2016 20:57:33 +0000 Received: from XCH-ALN-013.cisco.com (xch-aln-013.cisco.com [173.36.7.23]) by alln-core-1.cisco.com (8.14.5/8.14.5) with ESMTP id u2GKvXPp028374 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=FAIL); Wed, 16 Mar 2016 20:57:33 GMT Received: from xch-rcd-013.cisco.com (173.37.102.23) by XCH-ALN-013.cisco.com (173.36.7.23) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 16 Mar 2016 15:57:32 -0500 Received: from xch-rcd-013.cisco.com ([173.37.102.23]) by XCH-RCD-013.cisco.com ([173.37.102.23]) with mapi id 15.00.1104.009; Wed, 16 Mar 2016 15:57:32 -0500 From: "Fred Baker (fred)" To: Henrik Levkowetz Thread-Topic: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' Thread-Index: AQHRecsx1UhT4wNRQkCftWl5ULm1LJ9TEJwAgABJWgD//8THI4AAc7UAgAXR2wCAA1RPAIAAD+CAgAACvgCAAACrgIAABZMAgAAbqwA= Date: Wed, 16 Mar 2016 20:57:32 +0000 Message-ID: <4EC76836-B554-441E-A451-413559D6C59C@cisco.com> References: <990C21F7-2B71-4283-B129-C4089655DF16@cisco.com> <01A83A34-BF3F-4044-8FDA-F1197443BE56@cisco.com> <56E99CAA.1020205@levkowetz.com> <56E9B184.5020601@levkowetz.com> In-Reply-To: <56E9B184.5020601@levkowetz.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3112) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.19.64.117] Content-Type: multipart/signed; boundary="Apple-Mail=_58C09202-BF2C-4339-9DF8-9D38DB3A90D8"; protocol="application/pgp-signature"; micalg=pgp-sha1 MIME-Version: 1.0 Archived-At: Cc: "tools-discuss@ietf.org" , Robert Sparks Subject: Re: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Mar 2016 20:57:49 -0000 --Apple-Mail=_58C09202-BF2C-4339-9DF8-9D38DB3A90D8 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On Mar 16, 2016, at 12:18 PM, Henrik Levkowetz = wrote: > I have no immediate idea about why you'd get bad JSON occasionally. = If > it would be possible for you to catch the bad JSON when this happens, = it > might (or might not, of course) provide additional clues. I'd love to > see a sample if you can provide one. OK. I changed the code to use the try/catch logic. FYI, the code has = previously walked our local mirror of the internet draft directory to = find the subset of drafts that have author emails @cisco.com or that we = recognize, and which are current Cisco employees. We will now get the = metadata for each such file. I also stuck in an array named @iwonder, as "I wonder" what the second = line of a file response might be. The JSON file comes in as a single = line with no \n. sub get_drafts { my $base; my @words; my @iwonder; my $curl =3D "curl = 'https://datatracker.ietf.org/api/v1/doc/document/\?format=3Djson\&name=3D= %s\&limit=3D0' 2> /dev/null"; foreach my $name ( keys %drafts ) { # get objects (including but not limited to internet drafts) that expire = after today. @iwonder =3D (); open OBJECTS, '-|', sprintf( $curl, $name ) or die "can't access $name metadata"; my $json =3D ; @iwonder =3D readline OBJECTS unless (eof OBJECTS); close OBJECTS; if ( defined $json ) { my $decoded; try { $decoded =3D decode_json($json); } catch { printf STDERR "accessing %s\n", sprintf( $curl, $name ); warn "caught error: $_ JSON was %json"; $stop++; }; if ( defined $decoded->{'objects'} ) { I now ran the program in debug mode stopping in the "catch" clause, and = got the following. It looks like I asked for JSON metadata, and instead = got a "404 not found" in some odd format. Which is interesting as the = file was in the mirror image as of a few hours ago... %json ... 404 Not Found ... accessing curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name=3Ddr= aft-dseomn-trans-browsers&limit=3D0' 2> /dev/null caught error: JSON text must be an object or array (but found number, = string, true, false or null, use allow_nonref to allow this) at = /users/fred/WWW/json/json-cisco-work.pl line 262 JSON was %json at /users/fred/WWW/json/json-cisco-work.pl line 266. at /users/fred/WWW/json/json-cisco-work.pl line 266 = main::__ANON__[/users/fred/WWW/json/json-cisco-work.pl:268]('JSON text = must be an object or array (but found number, strin...') called at = /usr/cisco/packages/perl/perl-5.8.8/lib/site_perl/5.8.8/Try/Tiny.pm line = 100 Try::Tiny::try('CODE(0x960ae48)', = 'Try::Tiny::Catch=3DREF(0x960513c)') called at = /users/fred/WWW/json/json-cisco-work.pl line 268 main::get_drafts() called at = /users/fred/WWW/json/json-cisco-work.pl line 63 main::CODE(0x960531c)(/users/fred/WWW/json/json-cisco-work.pl:267): 267: $stop++; DB<3> x @iwonder 0 ' ' 1 ' ' 2 ' ' 3 ' ' 4 ' ' 5 ' ' 6 ' ' 7 ' ' 8 ' 404 Not Found ' 9 ' ' 10 ' ' 11 ' ' 12 ' ' 13 ' ' 14 ' ' 15 ' ' --Apple-Mail=_58C09202-BF2C-4339-9DF8-9D38DB3A90D8 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQIVAwUBVunIukayAOS/EQ8MAQLYiA//Tk8UG/mDabFc9pR2qIaS5OJAYLRF5JaA j6PI0+Krw06dkxEby99ecQGWduBSG7kn+Hrpq0zZd8wQOQK/VqLnH8Q3Ycn4B00s uPM5Sr+n1DAqwX7BZLhlnTffC+LTy7CZQ97wwjeZ7UQixgEc6CkR4MNJidVkXQ0Y XryuwrkDt548S9ljHwqumoyWAVYF3weOE9LUPNhLP39BoWD3N4lz6UPK7IOzVPog CDSk2H+/Yg3+Td0qalclRDst/IteYDPWogLve3wudNenQanwcsxwavWGjkkp1lEy LrHFnAZrC7uGZKkEJJh9xtOIyzcokAffGfHgL8q7sG8ZouLq6Fh2YS7MZe1EgivR Qeit9ND24Dw0w05wBsA/La/tbsGUSCCqwq1rfLWIPsO6DqboojiwWhVevmykjCLy VRAtS51cKPE/ZRuy83Uv+YEpiMbMGpvtjilxG+wnEXUFaGPYXgVsxkUOSGfmjuco zHgQ+UCNoJb7HpW2/WhXauowyEDLUdeyAJKDM5ASdVNSkZ10qRhIocPqDLGidU+y fs118mipLpewLSOmlSAuja7E9kwKbl+3thzbsUX8F8oykXC8l4Lq/I6FZNZspVWs ESMvCv9OWhOc3bq2+bW/EyBgJW/r9+Z5SbDBXWXlfWh7HfssHTL2KnaGA2jVFoyY NXsDE7nLtoA= =Inxz -----END PGP SIGNATURE----- --Apple-Mail=_58C09202-BF2C-4339-9DF8-9D38DB3A90D8-- From nobody Wed Mar 16 16:02:11 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id DEFBC12D60F for ; Wed, 16 Mar 2016 16:02:09 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -106.9 X-Spam-Level: X-Spam-Status: No, score=-106.9 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, RCVD_IN_DNSWL_HI=-5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id EqyGd2T4rDaj for ; Wed, 16 Mar 2016 16:02:07 -0700 (PDT) Received: from zinfandel.tools.ietf.org (zinfandel.tools.ietf.org [IPv6:2001:1890:123a::1:2a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id BE84C12D5CD for ; Wed, 16 Mar 2016 16:02:07 -0700 (PDT) Received: from 81-235-150-134-no105.tbcn.telia.com ([81.235.150.134]:55826 helo=[192.168.1.120]) by zinfandel.tools.ietf.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.82_1-5b7a7c0-XX) (envelope-from ) id 1agKS6-0001s1-SE; Wed, 16 Mar 2016 16:02:07 -0700 Message-ID: <56E9E5E7.7070004@levkowetz.com> Date: Thu, 17 Mar 2016 00:01:59 +0100 From: Henrik Levkowetz User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:31.0) Gecko/20100101 Thunderbird/31.8.0 MIME-Version: 1.0 To: "Fred Baker (fred)" References: <990C21F7-2B71-4283-B129-C4089655DF16@cisco.com> <01A83A34-BF3F-4044-8FDA-F1197443BE56@cisco.com> <56E99CAA.1020205@levkowetz.com> <56E9B184.5020601@levkowetz.com> <4EC76836-B554-441E-A451-413559D6C59C@cisco.com> In-Reply-To: <4EC76836-B554-441E-A451-413559D6C59C@cisco.com> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="fTl7s7peML9O44QbKxkFRjt4NTmV4RQRl" X-SA-Exim-Connect-IP: 81.235.150.134 X-SA-Exim-Rcpt-To: rjsparks@nostrum.com, tools-discuss@ietf.org, fred@cisco.com X-SA-Exim-Mail-From: henrik@levkowetz.com X-SA-Exim-Version: 4.2.1 (built Mon, 26 Dec 2011 16:24:06 +0000) X-SA-Exim-Scanned: Yes (on zinfandel.tools.ietf.org) Archived-At: Cc: "tools-discuss@ietf.org" , Robert Sparks Subject: Re: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Mar 2016 23:02:10 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --fTl7s7peML9O44QbKxkFRjt4NTmV4RQRl Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Fred, On 2016-03-16 21:57, Fred Baker (fred) wrote: >=20 > On Mar 16, 2016, at 12:18 PM, Henrik Levkowetz w= rote: >> I have no immediate idea about why you'd get bad JSON occasionally. I= f >> it would be possible for you to catch the bad JSON when this happens, = it >> might (or might not, of course) provide additional clues. I'd love to= >> see a sample if you can provide one. >=20 > OK. I changed the code to use the try/catch logic. FYI, the code has > previously walked our local mirror of the internet draft directory to > find the subset of drafts that have author emails @cisco.com or that > we recognize, and which are current Cisco employees. We will now get > the metadata for each such file. Right. > I also stuck in an array named @iwonder, as "I wonder" what the > second line of a file response might be. The JSON file comes in as a > single line with no \n. <> =20 > I now ran the program in debug mode stopping in the "catch" clause, and= got the following. It looks like I asked for JSON metadata, and instead = got a "404 not found" in some odd format. Which is interesting as the fil= e was in the mirror image as of a few hours ago... >=20 > %json > > ... > 404 Not Found > ... Oho! =46rom the more detailed html (which I snipped out) I see that this is in= deed a 404 page from the datatracker. I've now tweaked the 404 page so that it will (for the time being) give back the URL and query string it thought it was responding to. Asking fo= r the url https://datatracker.ietf.org/foo?bar=3Dbaz will give back a page with this at the beginning: 404 Not Found: /foo?bar=3Dbaz That, together with your debug mode code, should help figure out what the= datatracker _thinks_ it was asked for, and possibly let us pull some more= at the thread. Best regards, Henrik --fTl7s7peML9O44QbKxkFRjt4NTmV4RQRl Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAEBCAAGBQJW6eXnAAoJEE6bV0uPuxcahSwQALq15x0J/tfcM3R6ajgmC8rq Pc0cwWu2caWk2Jlx2thZO6kdhCMUyRve5nsxyV36LUZx7DgchckGdBIKtBRIIKsm QivzOkgsgcQKCHWlQjN9tGRYDQ/PoG6cVLfGZSTG77umF72JsMHt4toohH9g3lP1 XNhVf9I/aTDsBzHp112flRiLOYizM7tnCUqEZ4ROzQrml8rtlcaR9we0xy2QAn0+ 2Y+xguHlHDbS9Zm5LqrK7Snj4T7UWZceotXQIjFgTj7LXXNN3sJsul6tV6kMuQc1 um5nhAgYHE1wD/yGFPFjIomfyfgZxe3+gcFi15zcsFbZMqck5IoGSq1HFhBlS9QR rG5aY/VHWjK9ru8HOouNmHnFZzx0UD4Ps11OYHQSszQzTOoNal3WGq0zdj6QxGou P7/2CyKXzpsPBxmAcopnANAd5EJTYEpPxETVDtmbJxvBpxovSaIrWPT4a1iP+ZqH 45qnl8LcriWtPJjEswDLspNmj8T9fQMPCMY4+BQOQdsus/gbhcmt3v5Mr0Xj154V XaQE+v/jnqytezv6ua/GJVBn68Q1pVNa9hfcbL8yf5s1QehhwuG7jkuVY0PxJxtR YvFIccN41PoaQW24XVjdPRMlHXCMNv+PI+x04rdPlVkmSxZeHjj65PtmlqFhw0l2 PRoovTkM7NV33zdWOlA0 =4kN8 -----END PGP SIGNATURE----- --fTl7s7peML9O44QbKxkFRjt4NTmV4RQRl-- From nobody Wed Mar 16 18:51:01 2016 Return-Path: X-Original-To: tools-discuss@ietfa.amsl.com Delivered-To: tools-discuss@ietfa.amsl.com Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 2710112D829 for ; Wed, 16 Mar 2016 18:51:00 -0700 (PDT) X-Virus-Scanned: amavisd-new at amsl.com X-Spam-Flag: NO X-Spam-Score: -113.704 X-Spam-Level: X-Spam-Status: No, score=-113.704 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=0.001, HTML_TAG_BALANCE_HEAD=0.817, RCVD_IN_DNSWL_HI=-5, RCVD_IN_MSPIKE_H4=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.001, SPF_PASS=-0.001, USER_IN_DEF_DKIM_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=ham autolearn_force=no Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=cisco.com Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YriknBi0are1 for ; Wed, 16 Mar 2016 18:50:58 -0700 (PDT) Received: from alln-iport-5.cisco.com (alln-iport-5.cisco.com [173.37.142.92]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id C9C3312D70C for ; Wed, 16 Mar 2016 18:50:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=6300; q=dns/txt; s=iport; t=1458179457; x=1459389057; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=SlKVYLOoCWi2Z6WKId1DJ+OhTAODZpm1DPToVu4MK5Q=; b=HnDfgCycoFUS4DWVY+NINA5jMEj+1TXXZ6YD1lWa6PFOqtnW+Jkckr13 nvIy3pxa5lbSlRzHwJgfE/BHvQlRQ4/J0FciPMjWFiQMwQDjtqAV4Wlfm WyobFkaYk8xFFsdTg4CZyUpZhpHPzCPW19W4ysNf4U+9NGQX+51ABBzhl 0=; X-Files: signature.asc : 833 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0D9BQCcDOpW/5JdJa1egxA2U24GugsOg?= =?us-ascii?q?W8XDoVoAoE2OBQBAQEBAQEBZCeEQgEBBAEBAUYlCxACAQgYIwsnCxQRAgQOBQk?= =?us-ascii?q?FiBkOwEwBAQEBAQEBAQEBAQEBAQEBAQEBAQENCIgRCIJJgTeCSwoLBgEGVoJtg?= =?us-ascii?q?Q8FjTqKFwGDG4FmbYgSCYFcS4N+iFeHP4c/AR4BQ4IQIIE1agEBAQGJJQgXHX4?= =?us-ascii?q?BAQE?= X-IronPort-AV: E=Sophos;i="5.24,347,1454976000"; d="asc'?scan'208,217";a="248440496" Received: from rcdn-core-10.cisco.com ([173.37.93.146]) by alln-iport-5.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 17 Mar 2016 01:50:56 +0000 Received: from XCH-RCD-012.cisco.com (xch-rcd-012.cisco.com [173.37.102.22]) by rcdn-core-10.cisco.com (8.14.5/8.14.5) with ESMTP id u2H1ouqh025029 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=FAIL); Thu, 17 Mar 2016 01:50:56 GMT Received: from xch-rcd-013.cisco.com (173.37.102.23) by XCH-RCD-012.cisco.com (173.37.102.22) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Wed, 16 Mar 2016 20:50:55 -0500 Received: from xch-rcd-013.cisco.com ([173.37.102.23]) by XCH-RCD-013.cisco.com ([173.37.102.23]) with mapi id 15.00.1104.009; Wed, 16 Mar 2016 20:50:55 -0500 From: "Fred Baker (fred)" To: Henrik Levkowetz Thread-Topic: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' Thread-Index: AQHRecsx1UhT4wNRQkCftWl5ULm1LJ9TEJwAgABJWgD//8THI4AAc7UAgAXR2wCAA1RPAIAAD+CAgAACvgCAAACrgIAABZMAgAAbqwCAACLIgIAALzGA Date: Thu, 17 Mar 2016 01:50:55 +0000 Message-ID: References: <990C21F7-2B71-4283-B129-C4089655DF16@cisco.com> <01A83A34-BF3F-4044-8FDA-F1197443BE56@cisco.com> <56E99CAA.1020205@levkowetz.com> <56E9B184.5020601@levkowetz.com> <4EC76836-B554-441E-A451-413559D6C59C@cisco.com> <56E9E5E7.7070004@levkowetz.com> In-Reply-To: <56E9E5E7.7070004@levkowetz.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3112) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.19.64.117] Content-Type: multipart/signed; boundary="Apple-Mail=_83024A1B-EBE4-4E95-A63C-C303C9256CD7"; protocol="application/pgp-signature"; micalg=pgp-sha1 MIME-Version: 1.0 Archived-At: Cc: "tools-discuss@ietf.org" , Robert Sparks Subject: Re: [Tools-discuss] [www.ietf.org/rt #115169] Data tracker API failing with 'Internal Server Error' X-BeenThere: tools-discuss@ietf.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: IETF Tools Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Mar 2016 01:51:00 -0000 --Apple-Mail=_83024A1B-EBE4-4E95-A63C-C303C9256CD7 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii 404 Not Found: /error/HTTP_FORBIDDEN.html.var ' accessing curl = 'https://datatracker.ietf.org/api/v1/doc/document/?format=3Djson&name=3Ddr= aft-ietf-anima-bootstrapping-keyinfra&limit=3D0' 2> /dev/null caught error: JSON text must be an object or array (but found number, = string, true, false or null, use allow_nonref to allow this) at = /users/fred/WWW/json/json-cisco-work.pl line 290 at /users/fred/WWW/json/json-cisco-work.pl line 294 = main::__ANON__[/users/fred/WWW/json/json-cisco-work.pl:301]('JSON text = must be an object or array (but found number, strin...') called at = /usr/cisco/packages/perl/perl-5.8.8/lib/site_perl/5.8.8/Try/Tiny.pm line = 100 Try::Tiny::try('CODE(0xa6baa70)', = 'Try::Tiny::Catch=3DREF(0xa6c0ff4)') called at = /users/fred/WWW/json/json-cisco-work.pl line 301 main::get_drafts() called at = /users/fred/WWW/json/json-cisco-work.pl line 63 main::CODE(0xa6c0fa0)(/users/fred/WWW/json/json-cisco-work.pl:299): 299: die ""; DB<5> x $json 0 '' DB<6> x @iwonder 0 ' ' 1 '' 2 '' 3 '' 4 '' 5 ' ' 6 ' ' 7 ' ' 8 ' 404 Not Found: /error/HTTP_FORBIDDEN.html.var ' 9 ' ' 10 '' 11 ' ' 12 ' ' 13 ' ' 14 ' ' 15 '' 16 ' ' 17 ' ' 18 ' ' 19 ' ' 20 '