Re: [codec] Listening tests at Google

Jan Skoglund <jks@google.com> Wed, 14 September 2011 05:57 UTC

Return-Path: <jks@google.com>
X-Original-To: codec@ietfa.amsl.com
Delivered-To: codec@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 45D1E21F8C91 for <codec@ietfa.amsl.com>; Tue, 13 Sep 2011 22:57:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: 0
X-Spam-Level:
X-Spam-Status: No, score=x tagged_above=-999 required=5 tests=[]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 4wCnNzRzXLQ7 for <codec@ietfa.amsl.com>; Tue, 13 Sep 2011 22:57:46 -0700 (PDT)
Received: from smtp-out.google.com (smtp-out.google.com [216.239.44.51]) by ietfa.amsl.com (Postfix) with ESMTP id 406FE21F8C00 for <codec@ietf.org>; Tue, 13 Sep 2011 22:57:42 -0700 (PDT)
Received: from hpaq5.eem.corp.google.com (hpaq5.eem.corp.google.com [172.25.149.5]) by smtp-out.google.com with ESMTP id p8E5xg35000502 for <codec@ietf.org>; Tue, 13 Sep 2011 22:59:45 -0700
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=google.com; s=beta; t=1315979988; bh=v1NE1xEpY9i6ntyK/zrYmXX3UEo=; h=MIME-Version:In-Reply-To:References:From:Date:Message-ID:Subject: To:Content-Type; b=eaFsRvjDPWKrmLUrk7DVM5iObU1D2V3Zy4sKVOkonGeOGDFc34NX//vgQPKvolVIl a86B4vOEOgftfrsi9/RcA==
DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=dkim-signature:mime-version:in-reply-to:references:from:date: message-id:subject:to:content-type:x-system-of-record; b=K+OB/UoHBk8usNnSFvIOzL1ND82Qo9ds2KnPnlGJ4GIDaQftVBRR8Tk6TVtDs3j2U KZ6luh84ZthNhn8XGxpIQ==
Received: from qwm42 (qwm42.prod.google.com [10.241.196.42]) by hpaq5.eem.corp.google.com with ESMTP id p8E5xYrl007662 (version=TLSv1/SSLv3 cipher=RC4-SHA bits=128 verify=NOT) for <codec@ietf.org>; Tue, 13 Sep 2011 22:59:35 -0700
Received: by qwm42 with SMTP id 42so1472063qwm.16 for <codec@ietf.org>; Tue, 13 Sep 2011 22:59:34 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=beta; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=+YnqWlFKtp5PgCa0uIGmVfjKfn11F+BaccEkrz1s9ho=; b=Ev8g/8kz2eTnhGBVlO0F+gmAKNinHzvpdjN2t6yJfAIZvFf4i7Qri2bVSpjVjSh5Qu qRUAyh9o7m+N7nPaK0AQ==
Received: by 10.229.24.11 with SMTP id t11mr504619qcb.36.1315979974149; Tue, 13 Sep 2011 22:59:34 -0700 (PDT)
Received: by 10.229.24.11 with SMTP id t11mr504609qcb.36.1315979973357; Tue, 13 Sep 2011 22:59:33 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.229.13.211 with HTTP; Tue, 13 Sep 2011 22:59:11 -0700 (PDT)
In-Reply-To: <CA+KMCSXjHycc_JJP15SbRB4XUL7HSfQfpaC7EfDSw72TwQwLTA@mail.gmail.com>
References: <CA+KMCSXjHycc_JJP15SbRB4XUL7HSfQfpaC7EfDSw72TwQwLTA@mail.gmail.com>
From: Jan Skoglund <jks@google.com>
Date: Tue, 13 Sep 2011 22:59:11 -0700
Message-ID: <CA+KMCSWzNUVWNZsvTKsv_+N=A1keUyOhM5qB3yj+GcUEp2VcFQ@mail.gmail.com>
To: codec@ietf.org
Content-Type: multipart/mixed; boundary="0016364171a3d8132304ace076f5"
X-System-Of-Record: true
Subject: Re: [codec] Listening tests at Google
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 14 Sep 2011 05:57:47 -0000

Hey,

The listening tests at Google are now done and here are the results.

Regards,
Jan


On Fri, Aug 19, 2011 at 3:28 PM, Jan Skoglund <jks@google.com> wrote:
> Hey,
>
> We've prepared some listening tests for Opus on Mandarin speech and
> transcoding (English) speech at Google. We started the tests today and
> will have results at the end of August. The tests are split in four
> MUSHRA groups:
>
> Test 1a - Mandarin NB
> --------------------------
> Opus NB
> Speex NB
> iLBC NB
> Reference and 2 anchors (LP 3.5 kHz and MNRU of 15 dB)
>
> Test 1b - Mandarin "HD Voice" (WB, FB)
> --------------------------------------------------------
> Opus FB
> G.719 FB
> Opus WB
> Speex WB
> G.722.1 WB
> Reference and 2 anchors (LP 3.5 kHz and LP 7 kHz)
>
> Test 2a - Transcoding NB
> -------------------------------
> G.711 -> Opus NB
> G.711 -> AMR-NB
> Opus NB -> G.711 -> AMR-NB
> AMR-NB -> G.711 -> Opus NB
> AMR-NB -> G.711 -> AMR-NB
> Reference and 2 anchors (LP 3.5 kHz and MNRU of 15 dB)
>
> Test 2b - Transcoding WB
> --------------------------------
> Opus WB
> AMR-WB
> Opus WB -> AMR-WB
> AMR-WB -> Opus WB
> Reference and 2 anchors (LP 3.5 kHz and LP 7 kHz)
>
>
> Cheers,
> Jan
>