RE: [nfsv4] pNFS and metadata-intensive environments

["Noveck, Dave" <Dave.Noveck at netapp.com>]

Title: Message

If you can tolerate dividing your zillions of small files into multiple directories then the answer is put those directories on multiple metadata servers and tie them into a single multi-server namespace via referrals.  V4.0 had support for this but v4.1 is more explicit about this.  Only in the case of zillions of small files in a single directory do you have something that v4.1 won't be able to deal with.

-----Original Message-----
From: Touretsky, Gregory [mailto:gregory.touretsky at intel.com]
Sent: Thursday, September 21, 2006 2:28 PM
To: nfsv4 at ietf.org
Subject: [nfsv4] pNFS and metadata-intensive environments

Hi,

  pNFS architecture seems to be great solution for IO-intensive flows. However, considering metadata-intensive environment (80% of NFSops are getattr/lookup/access) and zillions of very small files (<10KB) - single MD server would become a bottleneck. Are there thoughts to overcome such a bottleneck, or it's considered too niche situation to deal with?

Gregory Touretsky

Intel IT - PCAM/EC EPT

Compute & Storage Platforms Technical Engineering Mgr

gregory.touretsky AT intel.com

(+) 972-4-865-6377, Fax: 04-865-5999

iNET: 465-6377, M/S: IDC-1B

_______________________________________________
nfsv4 mailing list
nfsv4 at ietf.org
https://www1.ietf.org/mailman/listinfo/nfsv4