[hybi] websocket test suite

Greg Wilkins <gregw@intalio.com> Fri, 29 July 2011 00:02 UTC

Return-Path: <gregw@intalio.com>
X-Original-To: hybi@ietfa.amsl.com
Delivered-To: hybi@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 3A52111E80A2 for <hybi@ietfa.amsl.com>; Thu, 28 Jul 2011 17:02:27 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.882
X-Spam-Level:
X-Spam-Status: No, score=-2.882 tagged_above=-999 required=5 tests=[AWL=0.095, BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, RCVD_IN_DNSWL_LOW=-1]
Received: from mail.ietf.org ([64.170.98.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Z05RUp0G5fas for <hybi@ietfa.amsl.com>; Thu, 28 Jul 2011 17:02:26 -0700 (PDT)
Received: from mail-vw0-f44.google.com (mail-vw0-f44.google.com [209.85.212.44]) by ietfa.amsl.com (Postfix) with ESMTP id 9715E11E809C for <hybi@ietf.org>; Thu, 28 Jul 2011 17:02:26 -0700 (PDT)
Received: by vws12 with SMTP id 12so2889650vws.31 for <hybi@ietf.org>; Thu, 28 Jul 2011 17:02:25 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.52.26.236 with SMTP id o12mr630943vdg.497.1311897745707; Thu, 28 Jul 2011 17:02:25 -0700 (PDT)
Received: by 10.52.114.228 with HTTP; Thu, 28 Jul 2011 17:02:25 -0700 (PDT)
Date: Fri, 29 Jul 2011 10:02:25 +1000
Message-ID: <CAH_y2NFBNU7fiWWBoc2NNG0irjkOp7JAwDuNcAj-M2nFrGpVaw@mail.gmail.com>
From: Greg Wilkins <gregw@intalio.com>
To: Hybi <hybi@ietf.org>
Content-Type: text/plain; charset="ISO-8859-1"
Subject: [hybi] websocket test suite
X-BeenThere: hybi@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Server-Initiated HTTP <hybi.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/hybi>, <mailto:hybi-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/hybi>
List-Post: <mailto:hybi@ietf.org>
List-Help: <mailto:hybi-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/hybi>, <mailto:hybi-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 29 Jul 2011 00:02:27 -0000

All,

I'd like to restart the conversation around developing a standard set
of tests for websocket implementations.  The draft I had previously
published has expired, and reading it again now, I'm not sure it is a
good starting point as the approach adopted was a bit laissez faire
and was just a few test that was felt to check the bulk of the
specified behaviour.   I now think that what is needed is a more
rigorous approach with specific tests designed to verify each section
of the specification.  ie there should be traceability from a clause
in the spec to the test(s) that verify it.

So firstly, does anybody have suggestions of good tests suites
specified for other IETF efforts that we could use as a model to base
our tests on?

Anybody else interested in collaborating on this?

cheers