HPFS ( High Performance File System ) is a file system created specifically for the OS/2 operating system to improve upon the limitations of the FAT file system. It was written by Gordon Letwin and others at Microsoft and added to OS/2 version 1.2 , at that time still a joint undertaking of Microsoft and IBM , and released in 1988.
60-501: HPFS may refer to: High Performance File System , a computer file system for OS/2 High Point Friends School , a school in North Carolina, US See also [ edit ] Hi Performance FileSystem (HFS), a computer file system for HP-UX HPF (disambiguation) Topics referred to by the same term [REDACTED] This disambiguation page lists articles associated with
120-561: A BPB with 32-bit entry for the number of sectors, as introduced since DOS 3.31 (see FAT16B below), keeping the cluster size and reducing the logical sector size in the BPB down to 512 bytes, while at the same time increasing the counts of logical sectors per cluster, reserved logical sectors, total logical sectors, and logical sectors per FAT by the same factor. A parallel development in MS-DOS / PC DOS which allowed an increase in
180-527: A confusing compatibility situation. Prior to 1995, versions of DOS accessed the disk via CHS addressing only. When Windows 95 (MS-DOS 7.0) introduced LBA disk access, partitions could start being physically located outside the first c. 8 GB of this disk and thereby out of the reach of the traditional CHS addressing scheme. Partitions partially or fully located beyond the CHS barrier therefore had to be hidden from non-LBA-enabled operating systems by using
240-472: A contiguous area of disk storage. Each entry contains either the number of the next cluster in the file, or else a marker indicating the end of the file, unused disk space, or special reserved areas of the disk. The root directory of the disk contains the number of the first cluster of each file in that directory. The operating system can then traverse the FAT, looking up the cluster number of each successive part of
300-851: A few hundred bytes in size. As MS-DOS 3.0 formatted all 16 MB-32 MB partitions in the FAT16 format, a 20 MB hard disk formatted under MS-DOS 3.0 was not accessible by MS-DOS 2.0. MS-DOS 3.0 to MS-DOS 3.30 could still access FAT12 partitions under 15 MB, but required all 16 MB-32 MB partitions to be FAT16, and so could not access MS-DOS 2.0 partitions in this size range. MS-DOS 3.31 and higher could access 16 MB-32 MB FAT12 partitions again. MS-DOS and PC DOS implementations of FAT12 and FAT16 could not access disk partitions larger than 32 megabytes. Several manufacturers developed their own FAT variants within their OEM versions of MS-DOS. Some vendors ( AST and NEC ) supported eight , instead of
360-410: A few values reserved to indicate unallocated space or the end of a list) and the size of the disk cluster. Even if only one byte of storage is needed to extend a file, an entire cluster must be allocated to it. As a result, large numbers of small files can result in clusters being allocated that may contain mostly "empty" data to meet the minimum cluster size. Originally designed as an 8-bit file system,
420-406: A formatted capacity of 160 KB (FAT ID 0xFE ) for single-sided 5.25-inch floppy drives, and PC DOS 1.1 added support for a double-sided format with 320 KB (FAT ID 0xFF ). PC DOS 2.0 introduced support for 9-sector floppy formats with 180 KB (FAT ID 0xFC ) and 360 KB (FAT ID 0xFD ). 86-DOS 1.00 and PC DOS 1.0 directory entries included only one date,
480-544: A hidden file called " EA␠DATA.␠SF " in the root directory of the FAT12 or FAT16 volume. This file is indexed by two previously reserved bytes in the file's (or directory's) directory entry at offset 0x14 . In the FAT32 format, these bytes hold the upper 16 bits of the starting cluster number of the file or directory, hence making it impossible to store OS/2 EAs on FAT32 using this method. However,
540-458: A larger storage capacity than the FAT12 and FAT16 filesystems. However, since HPFS lacks a journal , any recovery after an unexpected shutdown or other error state takes progressively longer as the filesystem grows. A utility such as CHKDSK would need to scan each entry in the filesystem to ensure no errors are present, a problem which is vastly reduced on NTFS, which simply replays the journal. FAT12 File Allocation Table ( FAT )
600-645: A licensing fee for each copy sold. This was a result of the Microsoft and IBM collaboration that gave both the right to use Windows and OS/2 technology. Due to the Microsoft dependence, limited partition size, file size limit of 2 GB and the long disk-check times after a crash, IBM ported the journaling file system , JFS , to OS/2 as a substitute. DOS and Linux support HPFS via third-party drivers. Windows NT versions 3.51 and earlier had native support for HPFS. Windows 95 and its successors Windows 98 and Windows Me have no support for HPFS. They listed
660-510: A logical file system with 8.3 filenames and makes the use of either FAT12, FAT16, FAT32 or exFAT mandatory for its physical layer for compatibility. The file system uses an index table stored on the device to identify chains of data storage areas associated with a file, the File Allocation Table ( FAT ). The FAT is statically allocated at the time of formatting. The table is a linked list of entries for each cluster ,
SECTION 10
#1732780684574720-463: A number of additional capabilities: HPFS also can keep 64 KB of metadata (" extended attributes ") per file. IBM offers two kinds of IFS drivers for this file system: HPFS386's cache is limited by the amount of available memory in OS/2's system memory arena and was implemented in 32-bit assembly language . HPFS386 is a ring 0 driver (allowing direct hardware access and direct interaction with
780-499: A pre-installed tool to convert a FAT file system into NTFS directly without the need to rewrite all files, though this cannot be reversed easily. The FAT file system is used in removable media such as floppy disks , super-floppies , memory and flash memory cards or USB flash drives . FAT is supported by portable devices such as PDAs , digital cameras , camcorders , media players , and mobile phones. The DCF file system adopted by almost all digital cameras since 1998 defines
840-449: A series of discussions between McDonald and Bill Gates . It was introduced with 8-bit table elements (and valid data cluster numbers up to 0xBF ) in a precursor to Microsoft 's Standalone Disk BASIC-80 for an 8080 -based successor of the NCR 7200 model VI data-entry terminal, equipped with 8-inch (200 mm) floppy disks, in 1977 or 1978. In 1978, Standalone Disk BASIC-80
900-439: Is 4 GB minus 1 byte, or 4,294,967,295 (2 − 1) bytes. This limit is a consequence of the 4-byte file length entry in the directory table and would also affect relatively huge FAT16 partitions enabled by a sufficient sector size. Like FAT12 and FAT16, FAT32 does not include direct built-in support for long filenames, but FAT32 volumes can optionally hold VFAT long filenames in addition to short filenames in exactly
960-453: Is a file system developed for personal computers and was the default filesystem for the MS-DOS and Windows 9x operating systems. Originally developed in 1977 for use on floppy disks , it was adapted for use on hard disks and other devices. The increase in disk drive capacity over time drove modifications to the design that resulted in versions: FAT12 , FAT16 , FAT32 , and exFAT . FAT
1020-561: Is also named FAT32X in order to indicate usage of LBA disk access instead of CHS. On such partitions, CHS-related geometry entries, namely the CHS sector addresses in the MBR as well as the number of sectors per track and the number of heads in the EBPB record, may contain no or misleading values and should not be used. OS/2 heavily depends on extended attributes (EAs) and stores them in
1080-421: Is determined when the volume is formatted, and is stored in a 16-bit field. For a given number RDE and sector size SS , the number RDS of root directory sectors is RDS = ceil((RDE × 32) / SS) , and RDE is normally chosen to fill these sectors, i.e., RDE × 32 = RDS × SS . FAT12 and FAT16 media typically use 512 root directory entries on non-floppy media. Some third-party tools, like mkdosfs, allow
1140-448: Is known as FAT16B . Since older versions of DOS were not designed to cope with more than 65,535 sectors, it was necessary to introduce a new partition type for this format in order to hide it from pre-3.31 issues of DOS. The original form of FAT16 (with less than 65,536 sectors) had a partition type 0x04 . To deal with disks larger than this, type 0x06 was introduced to indicate 65,536 or more sectors. In addition to this,
1200-509: Is proportionally larger. Much later, Windows NT increased the maximum cluster size to 64 KB, by considering the sectors-per-cluster count as unsigned. However, the resulting format was not compatible with any other FAT implementation of the time, and it generated greater internal fragmentation . Windows 98 , SE and ME also supported reading and writing this variant, but its disk utilities did not work with it and some FCB services are not available for such volumes. This contributes to
1260-549: Is used on floppy disks, FAT16 and FAT32 are typically found on the larger media. FAT is used internally for the EFI system partition in the boot stage of EFI -compliant computers. Hidden FAT filesystems are also used in the UEFI boot partition on modern PCs. FAT is still used in drives expected to be used by multiple operating systems, such as in shared Windows, Linux and DOS environments. Microsoft Windows additionally comes with
SECTION 20
#17327806845741320-482: The NTFS partitions of networked computers as "HPFS" , because NTFS and HPFS share the same filesystem identification number in the partition table. Windows NT 3.1 and 3.5 have native read/write support for local disks and can even be installed onto an HPFS partition. Windows NT 3.51 can also read and write from local HPFS formatted drives. Starting with Windows NT 4 the filesystem driver PINBALL.SYS enabling
1380-551: The Windows NT platform in 1993, but FAT remained the standard for the home user until the introduction of Windows XP in 2001. Windows Me was the final version of Windows to use FAT as its default file system. For floppy disks, FAT has been standardized as ECMA -107 and ISO / IEC 9293:1994 (superseding ISO 9293:1987 ). These standards cover FAT12 and FAT16 with only short 8.3 filename support; long filenames with VFAT were partially patented . While FAT12
1440-465: The command prompt , PowerShell or third-party tools, or by formatting the volume on a non-Windows system or on a Windows 9x system with FAT32 support and then transferring it to the Windows NT system. In August 2024, Microsoft released an update to Windows 11 preview builds that allows for the creation of FAT32 partitions up to 2TB in size. The maximal possible size for a file on a FAT32 volume
1500-509: The physical sector size (still 512 bytes) on the disk. The DOS-BIOS or System BIOS would then combine multiple physical sectors into logical sectors for the file system to work with. These changes were transparent to the file system implementation in the DOS kernel. The underlying DOS-BIOS translated these logical sectors into physical sectors according to partitioning information and the drive's physical geometry. The drawback of this approach
1560-529: The 16-bit disk sector count to 32 bits in the BPB. Although the on-disk changes were minor, the entire DOS disk driver had to be converted to use 32-bit sector numbers, a task complicated by the fact that it was written in 16-bit assembly language . The result was initially called the DOS 3.31 Large File System . Microsoft 's DSKPROBE tool refers to type 0x06 as BigFAT , whereas some older versions of FDISK described it as BIGDOS . Technically, it
1620-516: The FATs. FAT12 remains in use on all common floppy disks , including 1.44 MB and later 2.88 MB disks (media descriptor byte 0xF0 ). In 1984, IBM released the PC AT , which required PC DOS 3.0 to access its 20 MB hard disk. Microsoft introduced MS-DOS 3.0 in parallel. Cluster addresses were increased to 16-bit, allowing for up to 65,526 clusters per volume. However,
1680-547: The Windows NT line, native support for FAT32 arrived in Windows 2000 . A free FAT32 driver for Windows NT 4.0 was available from Winternals , a company later acquired by Microsoft. The acquisition of the driver from official sources is no longer possible. Since 1998, Caldera's dynamically loadable DRFAT32 driver could be used to enable FAT32 support in DR-DOS. The first version of DR-DOS to natively support FAT32 and LBA access
1740-498: The cluster number. The FAT32 boot sector uses a 32-bit field for the sector count, limiting the maximal FAT32 volume size to 2 terabytes with a sector size of 512 bytes . The maximum FAT32 volume size is 16 TB with a sector size of 4,096 bytes. The built-in Windows shell disk format tool on Windows NT arbitrarily only supports volume sizes up to 32 GB, but Windows supports reading and writing to preexisting larger FAT32 volumes, and these can be created with
1800-515: The disk driver was expanded to cope with more than 65,535 sectors as well. The only other difference between the original FAT16 and the newer FAT16B format is the usage of a newer BPB format with 32-bit sector entry. Therefore, newer operating systems supporting the FAT16B format can cope also with the original FAT16 format without any necessary changes. If partitions to be used by pre-DOS 3.31 issues of DOS need to be created by modern tools,
1860-403: The disk file as a cluster chain until the end of the file is reached. Sub-directories are implemented as special files containing the directory entries of their respective files. Each entry in the FAT linked list is a fixed number of bits: 12, 16 or 32. The maximum size of a file or a disk drive that can be accessed is the product of the largest number that can be stored in the entries (less
HPFS - Misplaced Pages Continue
1920-415: The file data area. Clusters containing bad sectors were marked unusable with the reserved value 0xFF7 in the FAT. While 86-DOS supported three disk formats (250.25 KB, 616 KB and 1232 KB, with FAT IDs 0xFF and 0xFE ) on 8-inch (200 mm) floppy drives, IBM PC DOS 1.0 , released with the original IBM Personal Computer in 1981, supported only an 8-sector floppy format with
1980-531: The kernel) with built-in SMB networking properties that are usable by various server daemons , whereas HPFS is a ring 3 driver. Thus, HPFS386 is faster than HPFS and highly optimized for server applications. It is also highly tunable by experienced administrators. Though IBM still had rights to HPFS, its agreement with Microsoft to continue licensing the HPFS386 version was contingent upon the company paying Microsoft
2040-524: The last modified date. PC DOS 1.1 added the last modified time. PC DOS 1.x file attributes included a hidden bit and system bit, with the remaining six bits undefined. At this time, DOS did not support sub-directories, but typically there were only a few dozen files on a diskette . The PC XT was the first PC with an IBM-supplied hard drive, and PC DOS 2.0 supported that hard drive with FAT12 ( FAT ID 0xF8 ). The fixed assumption of 8 sectors per clusters on hard disks practically limited
2100-399: The maximum number of clusters must increase as disk drive capacity increases, and so the number of bits used to identify each cluster has grown. The successive major variants of the FAT format are named after the number of table element bits: 12 ( FAT12 ), 16 ( FAT16 ), and 32 ( FAT32 ). There are several variants of the FAT file system (e.g. FAT12 , FAT16 and FAT32 ). FAT16 refers to both
2160-489: The maximum partition size to 16 MB for 512 byte sectors and 4 KB clusters. The BIOS Parameter Block ( BPB ) was introduced with PC DOS 2.0 as well, and this version also added read-only, archive , volume label , and directory attribute bits for hierarchical sub-directories. MS-DOS 3.0 introduced support for high-density 1.2 MB 5.25-inch diskettes (media descriptor 0xF9 ), which notably had 15 sectors per track, hence more space for
2220-483: The maximum possible FAT size was the introduction of multiple FAT partitions on a hard disk. To allow the use of more FAT partitions in a compatible way, a new partition type was introduced in PC ;DOS 3.2 (1986), the extended partition (EBR), which is a container for an additional partition called logical drive . Since PC DOS 3.3 (April 1987), there is another, optional extended partition containing
2280-484: The maximum possible number of sectors and the maximum partition size of 32 MB did not change. Although cluster addresses were 16 bits, this format was not what today is commonly understood as FAT16 . A partition type 0x04 indicates this form of FAT16 with less than 65,536 sectors (less than 32 MB for sector size 512). The benefit of FAT16 was the use of smaller clusters, making disk usage more efficient, particularly for large numbers of files only
2340-457: The new partition type 0x0E in the partition table instead. FAT16 partitions using this partition type are also named FAT16X . The only difference, compared to previous FAT16 partitions, is the fact that some CHS-related geometry entries in the BPB record, namely the number of sectors per track and the number of heads, may contain no or misleading values and should not be used. The number of root directory entries available for FAT12 and FAT16
2400-404: The next logical drive , and so on. The MBR of a hard disk can either define up to four primary partitions, or an extended partition in addition to up to three primary partitions. In November 1987, Compaq Personal Computer DOS 3.31 (a modified OEM version of MS-DOS 3.3 released by Compaq with their machines) introduced what today is simply known as the FAT16 format, with the expansion of
2460-621: The only criteria theoretically necessary to meet are a sector count of less than 65536, and the usage of the old partition ID ( 0x04 ). In practice however, type 0x01 and 0x04 primary partitions should not be physically located outside the first 32 MB of the disk, due to other restrictions in MS-DOS ;2.x, which could not cope with them otherwise. In 1988, the FAT16B improvement became more generally available through DR DOS 3.31, PC DOS 4.0, OS/2 1.1, and MS-DOS 4.0. The limit on partition size
HPFS - Misplaced Pages Continue
2520-498: The original group of FAT file systems with 16-bit wide cluster entries and also to later variants. " VFAT " is an optional extension for long file names, which can work on top of any FAT file system. Volumes using VFAT long-filenames can be read also by operating systems not supporting the VFAT extension. The original FAT file system (or FAT structure , as it was called initially) was designed and implemented by Marc McDonald , based on
2580-486: The read/write access is not shipped anymore. Later Windows versions do not ship with this driver. Note that this driver is limited to 4GB HPFS volumes. Microsoft retained rights to OS/2 technologies, including the HPFS filesystem, after they ceased collaboration with IBM. Since Windows NT 3.1 was designed for more rigorous (enterprise-class) use than previous versions of Windows, it included support for HPFS (and NTFS) giving it
2640-419: The same way as VFAT long filenames have been optionally implemented for FAT12 and FAT16 volumes. FAT32 was introduced with Windows 95 OSR2(MS-DOS 7.1) in 1996, although reformatting was needed to use it, and DriveSpace 3 (the version that came with Windows 95 OSR2 and Windows 98) never supported it. Windows 98 introduced a utility to convert existing hard disks from FAT16 to FAT32 without loss of data. In
2700-619: The size of directory entries was 16 bytes in Standalone Disk BASIC , MIDAS instead occupied 32 bytes per entry. Tim Paterson of Seattle Computer Products (SCP) was first introduced to Microsoft's FAT structure when he helped Bob O'Rear adapting the Standalone Disk BASIC-86 emulator port onto SCP's S-100 bus 8086 CPU board prototype during a guest week at Microsoft in May 1979. The final product
2760-658: The specifications of the file system itself. Therefore, even if default issues of MS-DOS and PC DOS were not able to cope with them, most of these vendor-specific FAT12 and FAT16 variants can be mounted by more flexible file system implementations in operating systems such as DR-DOS, simply by changing the partition ID to one of the recognized types. Also, if they no longer need to be recognized by their original operating systems, existing partitions can be "converted" into FAT12 and FAT16 volumes more compliant with versions of MS-DOS/PC DOS 4.0–6.3, which do not support sector sizes different from 512 bytes, by switching to
2820-405: The standard four , primary partition entries in their custom extended Master Boot Record ( MBR ), and they adapted MS-DOS to use more than a single primary partition. Other vendors worked around the volume size limits imposed by the 16-bit sector entries by increasing the apparent size of the sectors the file system operated on. These logical sectors were larger (up to 8192 bytes) than
2880-605: The table elements to 12 bits , reduced the number of FATs to two, redefined the semantics of some of the reserved cluster values, and modified the disk layout, so that the root directory was now located between the FAT and the data area for his implementation of FAT12 . Paterson also increased the nine-character (6.3) filename length limit to eleven characters to support CP/M -style 8.3 filenames and File Control Blocks . The format used in Microsoft Standalone Disk BASIC's 8-bit file system precursor
2940-415: The third-party FAT32 installable file system (IFS) driver FAT32.IFS version 0.70 and higher by Henk Kelder & Netlabs for OS/2, eComStation and ArcaOS stores extended attributes in extra files with filenames having the string " ␠EA.␠SF " appended to the regular filename of the file to which they belong. The driver also utilizes the byte at offset 0x0C in directory entries to store
3000-487: The title HPFS . If an internal link led you here, you may wish to change the link to point directly to the intended article. Retrieved from " https://en.wikipedia.org/w/index.php?title=HPFS&oldid=824638660 " Category : Disambiguation pages Hidden categories: Short description is different from Wikidata All article disambiguation pages All disambiguation pages High Performance File System Compared with FAT, HPFS provided
3060-504: The user to set this parameter. In order to overcome the volume size limit of FAT16, while at the same time allowing DOS real-mode code to handle the format, Microsoft designed a new version of the file system, FAT32 , which supported an increased number of possible clusters, but could reuse most of the existing code, so that the conventional memory footprint was increased by less than 5 KB under DOS. Cluster values are represented by 32-bit numbers, of which 28 bits are used to hold
SECTION 50
#17327806845743120-449: Was OEM DR-DOS 7.04 in 1999. That same year IMS introduced native FAT32 support with REAL/32 7.90, and IBM 4690 OS added FAT32 support with version 2. Ahead Software provided another dynamically loadable FAT32.EXE driver for DR-DOS 7.03 with Nero Burning ROM in 2004. IBM introduced native FAT32 support with OEM PC DOS 7.1 in 1999. Two partition types have been reserved for FAT32 partitions, 0x0B and 0x0C . The latter type
3180-436: Was dictated by the 8-bit signed count of sectors per cluster, which originally had a maximum power-of-two value of 64. With the standard hard disk sector size of 512 bytes, this gives a maximum of 32 KB cluster size, thereby fixing the "definitive" limit for the FAT16 partition size at 2 GB for sector size 512. On magneto-optical media, which can have 1 or 2 KB sectors instead of 0.5 KB, this size limit
3240-416: Was dropped with MS-DOS 1.20 . FAT12 used 12-bit entries for the cluster addresses; some values were reserved to mark the end of a chain of clusters, to mark unusable areas of the disk, or for other purposes, so the maximum number of clusters was limited to 4078. To conserve disk space, two 12-bit FAT entries used three consecutive 8-bit bytes on disk, requiring manipulation to unpack the 12-bit values. This
3300-918: Was increased memory used for sector buffering and deblocking. Since older DOS versions could not use large logical sectors, the OEMs introduced new partition IDs for their FAT variants in order to hide them from off-the-shelf issues of MS-DOS and PC DOS. Known partition IDs for logical sectored FATs include: 0x08 ( Commodore MS-DOS 3.x), 0x11 ( Leading Edge MS-DOS 3.x), 0x14 (AST MS-DOS 3.x), 0x24 (NEC MS-DOS 3.30 ), 0x56 ( AT&T MS-DOS 3.x), 0xE5 ( Tandy MS-DOS), 0xF2 ( Sperry IT MS-DOS 3.x, Unisys MS-DOS 3.3 – also used by Digital Research DOS Plus 2.1). OEM versions like Toshiba MS-DOS, Wyse MS-DOS 3.2 and 3.3, as well as Zenith MS-DOS are also known to have utilized logical sectoring. While non-standard and sub-optimal, these FAT variants are perfectly valid according to
3360-524: Was not supported by QDOS. By August 1980, QDOS had been renamed 86-DOS . Starting with 86-DOS 0.42 , the size and layout of directory entries was changed from 16 bytes to 32 bytes in order to add a file date stamp and increase the theoretical file size limit beyond the previous limit of 16 MB. 86-DOS 1.00 became available in early 1981. Later in 1981, 86-DOS evolved into Microsoft's MS-DOS and IBM PC DOS . The capability to read previously formatted volumes with 16-byte directory entries
3420-453: Was ported to the 8086 using an emulator on a DEC PDP-10 , since no real 8086 systems were available at this time. The FAT file system was also used in Microsoft's MDOS/MIDAS , an operating system for 8080/Z80 platforms written by McDonald since 1979. The Standalone Disk BASIC version supported three FATs, whereas this was a parameter for MIDAS. Reportedly, MIDAS was also prepared to support 10-bit, 12-bit and 16-bit FAT variants. While
3480-445: Was replaced with NTFS as the default file system on Microsoft operating systems starting with Windows XP . Nevertheless, FAT continues to be commonly used on relatively small capacity solid-state storage technologies such as SD card , MultiMediaCard (MMC) and eMMC because of its compatibility and ease of implementation. FAT was used on hard disks throughout the DOS and Windows 9x eras. Microsoft introduced NTFS with
3540-602: Was shown at Lifeboat Associates ' booth stand at the National Computer Conference in New York on June 4–7, 1979, where Paterson learned about the more sophisticated FAT implementation in MDOS/MIDAS and McDonald talked to him about the design of the file system. Between April and August 1980, while borrowing the FAT concept for SCP's own 8086 operating system QDOS 0.10 , Tim Paterson extended
3600-496: Was sufficient for the original floppy disk drives, and small hard disks up to 32 megabytes. The FAT16B version available with DOS 3.31 supported 32-bit sector numbers, and so increased the volume size limit. All the control structures fit inside the first track, to avoid head movement during read and write operations. Any bad sector in the control structures area would make the disk unusable. The DOS formatting tool rejected such disks completely. Bad sectors were allowed only in
#573426