[codec] Listening tests at Google

Jan Skoglund <jks@google.com> Fri, 19 August 2011 22:27 UTC

Return-Path: <jks@google.com>
X-Original-To: codec@ietfa.amsl.com
Delivered-To: codec@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 79BD121F8C21 for <codec@ietfa.amsl.com>; Fri, 19 Aug 2011 15:27:38 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -105.977
X-Spam-Level:
X-Spam-Status: No, score=-105.977 tagged_above=-999 required=5 tests=[BAYES_00=-2.599, FM_FORGED_GMAIL=0.622, RCVD_IN_DNSWL_MED=-4, USER_IN_WHITELIST=-100]
Received: from mail.ietf.org ([12.22.58.30]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fK1WQayhQ1Zv for <codec@ietfa.amsl.com>; Fri, 19 Aug 2011 15:27:37 -0700 (PDT)
Received: from smtp-out.google.com (smtp-out.google.com [216.239.44.51]) by ietfa.amsl.com (Postfix) with ESMTP id 7B94F21F8BF0 for <codec@ietf.org>; Fri, 19 Aug 2011 15:27:37 -0700 (PDT)
Received: from hpaq1.eem.corp.google.com (hpaq1.eem.corp.google.com [172.25.149.1]) by smtp-out.google.com with ESMTP id p7JMSYYa026005 for <codec@ietf.org>; Fri, 19 Aug 2011 15:28:35 -0700
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=google.com; s=beta; t=1313792915; bh=t+iDiqOW/QK2lk2zFnxvDJOw0r0=; h=MIME-Version:From:Date:Message-ID:Subject:To:Content-Type; b=Px1LYRcmtujeS8yFJMTBwtnqEt4RHmHWMnWkMkIPuPvzxJk9FsMO0TfUYqWHlRlI2 EFa2Q9G7nUVZq6BQoFm+Q==
DomainKey-Signature: a=rsa-sha1; s=beta; d=google.com; c=nofws; q=dns; h=dkim-signature:mime-version:from:date:message-id:subject:to: content-type:x-system-of-record; b=dyyCaDg6bJ00DUBzRrDDyBWEy8zkomWw6cZpLxOIHe3vKeVcI7Znuyi46eo392oGM 3QlhKre0tCn0PjSa3/jBw==
Received: from qwf7 (qwf7.prod.google.com [10.241.194.71]) by hpaq1.eem.corp.google.com with ESMTP id p7JMQvrI004049 (version=TLSv1/SSLv3 cipher=RC4-SHA bits=128 verify=NOT) for <codec@ietf.org>; Fri, 19 Aug 2011 15:28:33 -0700
Received: by qwf7 with SMTP id 7so2116145qwf.10 for <codec@ietf.org>; Fri, 19 Aug 2011 15:28:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=beta; h=mime-version:from:date:message-id:subject:to:content-type; bh=vofiwZa+yNUiUaNwXjDOFLvQoTYAr3I6K6jlKUgTdEA=; b=R4tIKI68BdUHiWTRAXmzgeOzzeRWe23uAOG0dM9vBNTHYVVaMXawW3s/M41XnTVs6S GLYwH3NbL8+D8WgHIc8g==
Received: by 10.224.204.194 with SMTP id fn2mr316212qab.121.1313792913255; Fri, 19 Aug 2011 15:28:33 -0700 (PDT)
Received: by 10.224.204.194 with SMTP id fn2mr316207qab.121.1313792913072; Fri, 19 Aug 2011 15:28:33 -0700 (PDT)
MIME-Version: 1.0
Received: by 10.229.13.211 with HTTP; Fri, 19 Aug 2011 15:28:13 -0700 (PDT)
From: Jan Skoglund <jks@google.com>
Date: Fri, 19 Aug 2011 15:28:13 -0700
Message-ID: <CA+KMCSXjHycc_JJP15SbRB4XUL7HSfQfpaC7EfDSw72TwQwLTA@mail.gmail.com>
To: codec@ietf.org
Content-Type: text/plain; charset="ISO-8859-1"
X-System-Of-Record: true
Subject: [codec] Listening tests at Google
X-BeenThere: codec@ietf.org
X-Mailman-Version: 2.1.12
Precedence: list
List-Id: Codec WG <codec.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/codec>, <mailto:codec-request@ietf.org?subject=unsubscribe>
List-Archive: <http://www.ietf.org/mail-archive/web/codec>
List-Post: <mailto:codec@ietf.org>
List-Help: <mailto:codec-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/codec>, <mailto:codec-request@ietf.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Aug 2011 22:27:38 -0000

Hey,

We've prepared some listening tests for Opus on Mandarin speech and
transcoding (English) speech at Google. We started the tests today and
will have results at the end of August. The tests are split in four
MUSHRA groups:

Test 1a - Mandarin NB
--------------------------
Opus NB
Speex NB
iLBC NB
Reference and 2 anchors (LP 3.5 kHz and MNRU of 15 dB)

Test 1b - Mandarin "HD Voice" (WB, FB)
--------------------------------------------------------
Opus FB
G.719 FB
Opus WB
Speex WB
G.722.1 WB
Reference and 2 anchors (LP 3.5 kHz and LP 7 kHz)

Test 2a - Transcoding NB
-------------------------------
G.711 -> Opus NB
G.711 -> AMR-NB
Opus NB -> G.711 -> AMR-NB
AMR-NB -> G.711 -> Opus NB
AMR-NB -> G.711 -> AMR-NB
Reference and 2 anchors (LP 3.5 kHz and MNRU of 15 dB)

Test 2b - Transcoding WB
--------------------------------
Opus WB
AMR-WB
Opus WB -> AMR-WB
AMR-WB -> Opus WB
Reference and 2 anchors (LP 3.5 kHz and LP 7 kHz)


Cheers,
Jan