Windows IT Pro is the authoritative and independent resource for windows nt, windows 2000, windows 2003, windows xp. Features a collection of resources and magazines for windows IT professionals.
  
  
  Advanced Search 


May 2008

Managing PST Files in Microsoft Outlook

Personal folders have evolved into a flexible and stable email-storage mechanism
RSS
Subscribe to Windows IT Pro | See More Outlook Web Access (OWA) Articles Here | Reprints

Executive Summary:

The evolution of PST files from ANSI to Unicode in Outlook 2003 has brought new flexibility and performance to email storage. But there are still caveats to consider. We show you how to manipulate PST file location and how to use them according your unique business requirements.

When Microsoft Outlook doesn’t depend on Exchange Server for email services, it uses personal folder (PST) files to store mailbox data. Also, where Exchange profiles are in use and Exchange Cached Mode (previously called offline mode) is configured, OST files are stored on the client. An OST file is a slave copy of a specific Exchange mailbox but otherwise maintains the same properties of a PST file. In her article “Common .pst File Questions” (InstantDoc ID 24017), Sue Mosher discussed some of the concerns and solutions associated with managing PST files for users. Most of those concerns remain valid today, but there are some new ones that warrant your attention. To make sound decisions about PST file usage in your environment, you need to understand a little bit about the evolution of PST files in general, as well as the differences between legacy PST files and the newer Unicode-based PST files. You might need to know how to manipulate their location and use according to your unique business requirements.

Personal Folder Evolution
PST files have undergone growing pains over the years. Older PST files had significant limitations that tested users’ patience. Early PST files had limitations of 16,384 folders and 16,384 items per folder. Outlook 98 introduced the Allow upgrade to larger tables setting, which made an irreversible change to the PST file headers and increased the maximum item count per folder to 65,536.

With Outlook 2003 came the option to use a new PST format based in Unicode. Unicode, as the name suggests, provides a single code set in which unique numbers are assigned to any letter or character, regardless of language. This feature provides better support for foreign languages, including Scandinavian languages. The most notable feature of Unicode PST files compared with their ANSI predecessors is the elimination of the 2GB file size limitation, which I’ll discuss later. Figure 1 shows the option to create a legacy ANSI PST file or the new Unicode PST file in Outlook 2003 on Windows XP.

In Outlook 2003, Microsoft made many improvements to PST files, affecting both the ANSI format and the new Unicode PST format. The system now uses multiple indices and larger caches, accessing more content from a cache, including sorting choices. Unicode PST files also benefit from a larger sort buffer, which improves performance and index recoverability. In Outlook 2003 and later, PST files also reduce the amount of file-level fragmentation by increasing PST size in sensible blocks of 2MB each when the PST file is 20MB or larger. (Outlook assumes blocks of 256KB for PST files smaller than 20MB.) This just in time and just enough algorithm makes for more efficient use of drive space. And the system has a better handle on managing table indices to free up resources. For example, Outlook will no longer store indices for smaller tables when they can be easily recreated on demand. PST files created with Outlook 2003 or later recycle item IDs, letting Outlook go beyond the previous limitation of 128 million items over the life of the PST file. However, a PST file can still have a maximum of only 128 million items at one time. Hopefully, you haven’t hit that ceiling!

In addition to offering full Unicode support, Unicode PST files have the benefit of removing the crippling 2GB limitation that legacy PST files face. Perhaps you understand the frustration of hitting the 2GB threshold without reasonable warning and without reasonable or obvious options once you’ve hit it. When trying to access an ANSI PST file that has reached the critical 2GB size, Outlook will return an error message such as Errors have been detected in this file. Quit all mail-enabled applications, then use the Inbox Repair Tool. The Inbox Repair Tool (scanpst.exe) won’t resolve this error. As outlined in the Microsoft article “Oversized PST and OST crop tool” (support.microsoft.com/kb/296088), the data storage file has exceeded the 2GB limit and needs to be cropped. The article provides a link to the Microsoft Download Center, from which you can download a utility called Pst2gb (pst2gb. exe). Pst2gb essentially trims the PST file to a usable size without user input on what content gets unceremoniously removed. The new limit is 33TB—more theoretical than practical. (I don’t think you’ll need to call Microsoft anytime soon for the Pst33tb.exe utility.) And because Unicode PST files also shed the limit of 65,536 items per folder, there’s no limit to the number of items per folder except for the 128 million item limit for the entire PST file, as I mentioned earlier.

Converting to Unicode
The new benefits of Unicode PST files are automatically realized when you create them in Outlook 2007 or Outlook 2003. However, existing PST files in ANSI format represent an administrative challenge should they require upgrading to the new Unicode PST format. You can convert existing legacy PST files to Unicode PST files in several ways.

Although there’s no in-place upgrade for actual PST files, you can use a few methods to move PST content from ANSI PST files to new Unicode PST files manually. First, when you create a new profile without pointing to a specific PST file, Outlook will create a new Unicode PST file in the default location. At this point, you can either use File, Import and select the ANSI PST file or open the ANSI PST file from within Outlook and manually move the data to the new PST file. (Whereas the Import option changes the time stamp on the data to the date and time of the import, manually moving the content between PST files retains the original time stamp.) Second, you can use Outlook’s archive feature to move the data. Create a new Unicode PST file (be selecting File, New, Outlook Data File), then select File, Archive and select the new Unicode PST file as the archive destination. When the data has been archived, select the new Unicode archive PST file as the destination for new content for the profile.

You can also use a third-party application to accomplish this task. For example, Pete Maclean’s Upstart (www.maclean.com/upstart/index.html) can migrate content from a set of PST files in a common location to new Unicode PST files, leaving the originals intact. This solution might make particular sense for enterprise migrations of PST data in which large numbers of PST files need conversion to Unicode PST files. An enterprise solution might save a lot of time from manually migrating large numbers of PST files.

No matter which method you use, you should save a backup copy of the original PST files before moving content. Converting to Unicode PST files isn’t a reversible process, and the result is that Outlook versions prior to Outlook 2003 won’t be able to access content. Trying to use Outlook 2002 or earlier to open Unicode PST files will return an error such as This .pst file is not compatible with this version of the Personal Folders information service. Contact your Administrator.

Are PST Files Bad?
There’s a long-running mantra among Exchange administrators that PST files are “bad.” What those administrators mean is that, for many reasons, a PST file isn’t the best choice as a primary storage location for mailbox data. Consider the following:

  • The Microsoft article “Personal folder files are unsupported over a LAN or over a WAN link” (support.microsoft.com/ kb/297019/en-us) advises that PST file access isn’t supported over the network.
  • PST files need to be stored locally on users’ workstations, which can complicate your backup and recovery efforts.
  • PST files consume more drive space than the equivalent content on the Exchange server.
  • PST files have no mechanism to support Single Instance Storage (SIS).
  • Content stored in a PST file can’t be accessed simultaneously from another source, such as another workstation or Outlook Web Access (OWA).
  • PST files lack significant security. Passwords, for example, can be easily broken or stripped with the right tools.
  • If a user needs a local copy of his or her mailbox, cached Exchange mode is preferred. This mode creates a slave copy of the mailbox using an .ost extension. The user can work with the local copy of the mailbox in the event of connectivity interruption between the workstation and the Exchange server. The OST file will synchronize with the Exchange mailbox when connectivity is restored.

Certainly, however, there are times where PST files are beneficial in a corporate environment. Remember that many businesses are using Outlook to access messaging solutions other than Exchange, and these solutions most likely employ Internet protocols POP3 or IMAP4. The latter protocol synchronizes with the server mailbox, but the former might be best configured to leave a copy of messages on the server to reduce allor- nothing dependency on the local PST file. PST files do make inexpensive archives, but from a corporate perspective, archives might need to be centrally managed and searchable for compliance and discovery reasons.

Controlling the Default Folder Location
By default, Outlook keeps PST files in a folder deep inside the users’ profile folder hierarchy, thus providing basic security when other users share the same workstation. In XP, you’ll find the files at \Documents and Settings\username\Local Settings\Application Data\Microsoft\Outlook, and in Windows Vista, you’ll find them at \Users username\AppData\Local\Microsoft Outlook.

If you don’t like email storage to be buried in a user profile, or if you use automation across different client OSs, one recommendation might be to standardize the PST file location to a specific place (e.g., D:\email). Doing so might simplify an automated backup of workstation email, for example. To configure an Outlook data storage location, you can use the Office 2007 Customization Tool (OCT), which can assign the default folder location for new PST or OST files for Outlook 2007. The tool’s predecessor, the Custom Installation Wizard (CIW) for Outlook 2003, can also perform this function for new installations. Figure 2 shows the OCT option. You’ll find the setting under Features, Modify User Settings. Navigate to Microsoft Office Outlook 2007, Miscellaneous, PST Settings. This configuration won’t move PST files already in use but will assign a default location for their creation.

Continue to page 2

   Previous  [1]  2  Next 


Reader Comments
Another issue with PST files is that you can't read a PST if it's on a CD or DVD. You need to copy it locally and remove the read-only bit.

If a PST is already embedded in the user's profile, exit. Move the PST file into a good location (I prefer under My Documents and then create a folder called My Email). OPen Outlook, it will ask where the PST file is. Browse to it. That's it.

Of course an alternative to a large PST is two or more smaller PST files.

ebraiter@videotron.ca April 30, 2008 (Article Rating: )


One important limitation of the new unicode PSTs is that they can't be read by exmerge. Exmerge can only work with the old PST format.

Where this frequently comes into play is if you create PSTs as an intermediate storage format while transferring data from one Exchange server to another. Resist the temptation to get around the 2 GB limit by creating unicode PSTs on the client side unless you want to do the import from the client side as well.

sbinder May 11, 2008 (Article Rating: )


You must log on before posting a comment.

If you don't have a username & password, please register now.




Top Viewed ArticlesView all articles
Managing Virtual Sprawl

As some wise person once said, nothing is ever truly free. Such is the case with VMs, which can quickly mutate from a cost-reducing Dr. Jekyll into a time-consuming, profligate nightmare that would do Mr. Hyde proud. ...

WinInfo Short Takes: Week of May 19, 2008

An often irreverent look at some of the week's other news, including OLPC and Windows XP, the XP SP3 constant reboot issue, Yahoo! vs. Icahn, 10 million Xbox 360s in North America, April video game stats, Microsoft innovation, CBS and CNET, and much more ...

The Memory-Optimization Hoax

Don't believe the hype. At best, RAM optimizers have no effect. At worst, they seriously degrade performance. ...


Exchange Server and Outlook Whitepapers Recent Lessons in Disaster Recovery

How to Evaluate and Choose a Messaging Archiving Solution

An IT Investment That Pays Real Dividends: Building ROI with your Email System

Related Events Mastering Exchange 2007 Server Management – May 29, 2008 (11:00 AM EST)

Check out our list of Free Email Newsletters!

Exchange Server and Outlook eBooks Spam Fighting and Email Security for the 21st Century

Understanding and Leveraging Code Signing Technologies

The Expert's Guide for Exchange 2003: Preparing for, Moving to, and Supporting Exchange Server 2003

Related Exchange Server and Outlook Resources Order Windows IT Pro VIP and SAVE!!
Get it all with Windows IT Pro VIP A $500+ value foir only $279!

Monthly Online Pass - Only $5.95!
Get instant access to 9,000+ articles from Windows IT Pro Magazine!!

Buy One Get One!
Order Windows IT Pro & Get SQL Server Magazine FREE!

TechNet Virtual Labs
Evaluate and test Microsoft's newest products.

Exchange & Outlook UPDATE eNewsletter
News, strategies, products, and developments in Exchange Server and Outlook messaging.



ADS BY GOOGLE SPONSORED LINKS FEATURED LINKS

EXCHANGE 2007 Mastery Series – May 29, 2008
3 Info-packed eLearning seminars for only $99! Learn the pros and cons of your mailbox high availability options, see real-world examples of Transport Rules, and get started with basic PowerShell commands with Mark Arnold, MCSE+M and Microsoft MVP.

Windows IT Pro Master CD: Take the Experts with You!
Find the solutions you need in thousands of searchable articles, helpful bonus content, and loads of expert advice with the Windows IT Pro Master CD. Order comes with a 1-year subscription to the new, online articles posted every day!

Making the Case for Oracle Database on Windows
One of the best-kept secrets in the IT industry is the depth of support Oracle offers to customers deploying its databases on Microsoft Windows platforms.

SQL Server Magazine Master CD: Take the Experts with You!
Find the solutions you need in thousands of searchable articles, helpful bonus content, and loads of expert advice with the SQL Server Magazine Master CD. Order comes with a 1-year subscription to the new, online articles posted every day!

Attention User Group Leaders...
Announcing the eNews Generator—a FREE HTML e-newsletter builder for user group leaders. Build your HTML and text e-newsletters in minutes. And add Windows IT Pro & SQL Server Mag articles alongside your own message!.

Become a fan of Windows IT Pro on Facebook
Join the Windows IT Pro fan club on Facebook. Chat with other IT Pros, upload your pictures, check out what's up n' coming in the next issue and more!



Solve the 12 Toughest Active Directory Management Tasks Today
No matter which management tasks you’re dealing with, you’ll discover a new set of ideas about how to best manage your Active Directory environment.

Get Started with Oracle on Windows DVD
Learn how Oracle gives you the power to grow by providing a scalable, easy-to-use platform for running your business at a price you can afford.

Exchange and Outlook Update Fundamentals CD
Gain an introduction to Exchange, learn server security requirements, and understand how unified communications can play a role in your messaging strategies with this free Exchange CD.

Virtualization Essentials – Free Online Conference :: June 24th
Learn virtualization basics - Discover how to reduce IT costs while increasing the efficiency, utilization, and flexibility of your existing computer hardware. Register Today!

Gain enhanced insight into and control over your IT systems.
View this web seminar to learn about the latest and greatest features and product enhancements in the Systems Center Configuration Manager SP1 and R2.

11 Myths About Microsoft Exchange Backup & Recovery
This white paper will guide you in overcoming Exchange Backup and Recovery myths with careful planning and the right toolset.
Windows IT Pro Home Register About Us Affiliates / Licensing Press Room Media Kit Contact Us/Customer Service  
SQL Connected Home IT Library SuperSite FAQ Wininfo News
Europe Edition Office & SharePoint Pro Windows Dev Pro Windows Excavator 
 
 Windows IT Pro is a Division of Penton Media Inc.
 Copyright © 2008 Penton Media, Inc., All rights reserved. Terms and Use | Privacy Statement | Reprints and Licensing