Reliable Cross-Browser Testing, Part 1: Internet Explorer

Advertisement

In a perfect world, cross-browser testing would be straightforward. We would download a legacy version of a browser, run it, and be able to instantly test our pages and scripts without a single care in the world. The reality of cross-browser testing, though, is very different. Issues such as runtime conflicts when running multiple versions of the same browser and inaccurate third-party testing tools mean we can spend hours just evaluating whether a testing set-up is anywhere near reliable.

I’m a user-interface developer at AOL (yes, we’re not dead yet!), and in this multi-part post I’ll take you through the exact set-up we use to accurately test content that will be potentially viewed by up to millions of users with a very diverse set of browsers. This set-up is similar to the one used by some of my colleagues at Opera, Mozilla and Google, so, fingers crossed, we’re doing this optimally.

A quick note before we begin. Setting up accurate testing for Internet Explorer as outlined in this post requires a bit of effort. So, please check your website analytics first to ensure that a sufficient number of IE users visit your website in the first place to warrant this effort.

Internet Explorer 6 To 10

Let’s begin with our old friend, Internet Explorer (IE). As most of us know, running multiple versions of the original Internet Explorer executables on the same system is very difficult due to issues ranging from runtime version conflicts to operating-system incompatibility. In truth, I don’t think Microsoft ever considered a scenario in which developers needed a way to achieve this back when it was first conceiving IE 6, 7 and 8.

This has left developers in a chasm of uncertainty, forced through trial and error to discover a way to accurately test what is (for better or worse) the world’s most widely used set of browsers.

In this section, I’ll take you through some IE testing options that you may be using or have heard of before. I’ll explain why they might not be reliable; and then I’ll present the solutions we currently use at AOL for production websites.

In case you’re interested, our team generally uses IE 7 as a baseline, although we do also test stable, beta and preview or dev-channel versions of Chrome, Firefox, Opera, Safari and, of course, IE 8 to 10.

Our reason for using IE 7 as a baseline comes down to our global website analytics: IE 6, 7 and 8 are the most common browsers used to access our websites. However, we stopped supporting IE 6 as of a few months ago. The reality is that IE 6 has major compatibility issues with modern technologies, and our team has found that we are able to deliver projects up to 20% more quickly when we don’t have to worry about catering a basic experience to it.

Most Third-Party IE Testing Tools Are Unreliable

A Google search for third-party IE testing tools will result in at least ten different options, nine of which are likely to be unreliable. Let’s go through a sample of them, in case you’re using one of them to test against staging or production websites at your work.

The following reviews may sound a little harsh, but the purpose is to stress the importance of using approaches that have been well engineered, tried and tested over time.

IETester

Unfortunately, IETester1 is probably the most popular third-party tool that I see designers and developers use to test multiple versions of IE. When I first tried it, I too was drawn by the promise of a single application that would solve all of my IE testing woes. However, all that glitters is not gold.

screenshot

The tool has a number of inconsistencies when testing IE 6, 7 and 8, with none providing a 1:1 experience of the original browsers. Our and many other teams have confirmed not only that the rendered output of IETester varies significantly from any real version of IE, but that pop-up interactions cause failures, Flash and CSS filters don’t work in user mode, conditional CSS comments often fail, and switching between versions makes it very prone to crashing.

In short, it’s unreliable, and this should be enough for any developer to consider alternatives.

Multiple IE

TredoSoft’s Multiple IE2 is another tool that often shows up when searching for an IE testing solution. Unfortunately, it too suffers from a number of issues, including inaccurate rendering. One common complaint is that people experience IE 5.5 rendering bugs even when they’re just testing IE 6; this certainly is not something we want to deal with at a time when many of us are trying to ditch IE 6 completely.

Multiple IE isn’t updated regularly either, and if the long thread of user issues experienced with it since its release doesn’t put you off, then consider that the tool’s IE textboxes actually break in a number of circumstances.

screenshot

To the best of my knowledge, both IETester and Multiple IE rely on an exploit known as DLL redirection in order to bypass issues with DLL naming conflicts, allowing the tools to attempt to run standalone copies of IE. I would recommend avoiding such tools, because implementing a completely sandboxed environment for IE that is as accurate as running the originals independently is very difficult.

Expression Web SuperPreview

Next up is Microsoft’s Expression Web SuperPreview3, which claims to simplify the process of testing and debugging layouts across multiple versions of Web browsers.

screenshot

Unfortunately, you won’t be able to test complete user interaction, JavaScript, DOM manipulation, animation or much else with this tool. We live in an age when the Web can be very dynamic and, in some cases, highly interactive. A tool like this might work for baseline testing, but not for accurate cross-browser testing.

BrowserLabs, Browsershots, BrowserCam

I personally use Adobe’s BrowserLabs4 — or sometimes Browsershots5, if a static layout test is absolutely necessary. But again, neither of these options allow you to test interactions with your pages. The same goes for BrowserCam6. These services simply weren’t designed for this purpose, but we still regularly see designers and developers using them as if they were.

I’m not in any way saying to flat out avoid these services, but rather that they’re inadequate for complete cross-browser testing. Designers and developers need to know exactly what a user sees when they interact with their website. No visitor will be using a static page renderer, so why rely on one yourself?

Windows Virtual PC

One other solution you’ll probably come across is Microsoft’s Virtual PC7, with time-bombed images8 for IE6 to 8.

For a brief time this was considered to be the answer to cries from developers for a better solution. Unfortunately, it is by far the most inadequate (and demanding) solution to testing that I’ve seen proposed in the past few years. At least 12 GB of disk space is required to install all of the images, and the images regularly expire during the year.

A cross-browser testing environment for legacy browsers should have reasonable system requirements and, for the most part, not require regular manual updating in order to continue using it. Because the Virtual PC option fails these criteria, I can’t recommend using it either.

Browser And Document Modes

We’ve looked at third-party tools, but what about Microsoft’s current solutions to these problems?

Both IE 9 and IE 10 PP2 support switchable document and browser modes via the F12 Developer Tools for cross-version compatibility testing. To be specific, browser-version testing here is made possible using a kind of emulation.

screenshot

“Document mode” determines what features a page has access to and what can be adjusted based on the page’s doc type, X-UA-compatible meta tag and headers. For example, the standards document mode allows the page to take advantage of IE’s implementation of ECMAScript 5 (ES5), while the IE 7 and 8 standards modes offer an alternative experience.

“Browser mode,” on the other hand, emulates different IE browser version behaviors and can be changed directly from the IE Developer Tools. Emulation is achieved in a few different ways, but it includes altering both the document mode and the user-agent string. In case you’re wondering, the UA string is adjusted here to ensure that code that relies on UA sniffing functions as though the correct version of the browser were being used.

screenshot

It is worth noting that IE 9 shipped with a newer JavaScript engine, called Chakra. While the browser itself supports a number of compatibility modes, because the JavaScript engine itself differs significantly from what shipped with IE 6, 7 and 8, there are acknowledged differences9 between the experience in IE 9 and testing in a standalone browser.

That aside, there are, unfortunately, a number of quirks in the way that both document mode and browser mode function. Our team has run into scenarios where IE returns the wrong user-agent string to the server; and, as with the third-party tools, there have been several instances of inaccuracies with the expected rendering when tested against the original browsers.

Finally (and rather strangely), these modes have a number of issues of their own that are not present in IE 6, 7 or 8, making it even more difficult to establish whether the issues experienced are specific to a browser version or just the mode being used.

For these reasons, I would urge developers not to rely strictly on document or browser mode for their cross-version testing needs.

Accurate IE Testing Solutions

Option 1: Virtual Machines + IECollection

We’ve reviewed a number of solutions that don’t provide an accurate means of testing multiple versions of IE. So, what does work? The answer lies in using dedicated virtual machines (VMs) and a tool called IE Collection1510.

screenshot

Out of the box, Utilu’s IE Collection offers the following:

  • A tested collection of standalone versions of IE, including versions 1 through 9;
  • Confirmed support for accurate rendering when compared against the original IE executables;
  • Confirmed support (to date) for the correct IE JavaScript engine implementations that shipped with the originals;
  • Confirmed support for the correct UA strings being detectable (not that you should be UA-string testing in the first place — however, if needed, it’s there);
  • Support for both the 32-bit and 64-bit versions of Windows XP, 2003, Vista and 7;
  • Access to the IE Developer Toolbar, which comes with the standard IE Collection set-up; this is compatible with IE 5 and above, but you also have the option to install Firebug Lite if you prefer that.

Although the majority of IE versions are supported and function reliably within the collection, there are known issues with versions of IE 7 when used under Windows Vista or Windows 7 (as noted on Utilu’s website). I’ll discuss how we handle this limitation shortly, but let’s first briefly go over virtual machines.

screenshot

A virtual machine (VM) is a sandboxed “guest” operating system that run within a normal “host” operating system. It effectively enables you to install and run a dedicated copy of almost any other operating system on your current one and to share a configurable set of memory and disk resources between the two. For example, a Windows 7 VM could easily be run on Mac OS X, as could an Ubuntu VM be run on Windows, and so on.

You’ll need two things to get started using VMs: a virtualization tool to create VMs on your OS, and a CD or image of the operating system that you wish to run as a virtual machine. Your company should be able to furnish you with Windows licenses relatively easily (… famous last words). If you’re a college student, you could probably get licenses for Windows XP SP3, Vista and 7 for free through the MSDN Academic Alliance11 program.

You could set up a number of different configurations to test Windows and IE, but if you’re using IE Collection, I would generally recommend the following:

  • Windows 7 for IE 6, 8, 9, 10;
  • Windows XP (SP3) for IE 7.

You shouldn’t need to support anything below IE 6 nowadays, but IE 4 to 5.5 also work fine on XP SP3.

At AOL, we use a combination of VirtualBox12, Parallels13 and VMware14 for our virtualization needs. I prefer Sun’s VirtualBox because it has the following advantages:

  • It’s free, providing a lower barrier to entry for developers who cannot afford commercial licenses for Parallels or VMware;
  • In my experience, it tends to perform more optimally than Parallels or VMware under the same configuration settings;
  • It has a marginally better UI than the alternatives.

That said, VMware is considered better if you’re working with a standalone server. At the end of the day, all three options are equally valid, and both Parallels and VMware come with trial versions that you can easily evaluate. Choose whichever option best suits your needs.

Pro tip: Remember to configure your VM to use the minimim amount of memory needed to test, unless you are using a dedicated testing box. By default, not all virtualization tools are configured to do this. This will simply ensure that the rest of your OS runs more smoothly.

Here are the three steps to setting this up:

  1. If you’re a Mac user, I recommend using a 32-bit Windows 7 Pro or Ultimate image (or installation CD), with a minimum of 17 GB of disk space allocated for the installation. 512 MB of virtualized RAM (which can be adjusted in the settings panel) should work fine for testing on a non-dedicated testing machine, but use more if feasible. You can create this as a new VM using VirtualBox, which I have configured to run at a resolution of between 800 × 600 and 1024 × 768 pixels. Windows users have two options. If you’re already running a version of Windows 7, skip to step 2, where we’ll begin installing IE Collection. If you’re running a different version of Windows and would like to run a virtualized copy of Windows 7 on top of it, then follow the steps above for Mac users. Mac and Windows users should boot up their VM or desktop Windows installation before proceeding to step 2.
  2. Next, download IE Collection1510 from Utilu’s website, and then install Windows 7 on either your VM or your primary system, depending on your set-up. This will give you access to IE 6, 8 and 9. I usually install IE 10 for testing purposes separately, but bear in mind that it is only in the platform preview phase at the time of writing. Ideally, install only the bare essentials to test on any VM in order to avoid excessive start-up times.
  3. Mac and Windows users: to address the issue of IE 7 not working on Windows 7, you’ll have to create another virtual machine with Windows XP installed (ideally with SP3). Because no reliability issues have been reported for running either IE Collection’s IE 7 or the original IE 716 on this OS, your bases should be covered here. As stated in my previous instructions, obtain a Windows XP image or installation CD, and create a new VM using VirtualBox. Boot it up, install IE7 through the link above, and you should be good to go.

That’s it really! Some developers prefer to run IE 6 and 7 on XP (step 3) rather than on Windows 7 or Vista, because XP accounts for the majority of users who have yet to upgrade to IE 8 or 9. This, too, is completely valid; the set-up is flexible enough to support a little personal preference.

Next, for the sake of being thorough, let’s look at some alternatives to the set-up I’ve recommended above.

Option 2: Dedicated VMs for Each Version of IE

Pragmatic developers might wish to maintain a dedicated VM for each version of IE being tested. On these VMs, rather than using any third-party tools, they would install the original, official IEs instead.

screenshot

The reasoning behind this is that it potentially minimizes the risk of individual browser configurations or overrides from interfering with one another, and it ensures that you get only the exact version of IE that you wish to test (and, in turn, the corresponding JavaScript engine in that version).

If you’re setting up dedicated VMs for individual releases of IE, I recommend the following set-up:

  • Windows XP (SP3) for IE 6,
  • Windows Vista (SP2) for IE 7,
  • Windows Vista (SP2) for IE 8,
  • Windows 7 for IE 9 and 10.

Knowing now about dedicated VMs, you might be wondering why we don’t use this set-up at AOL. I can only speak for my team, but we moved away from this approach because running three to four VMs on the same system and still using it efficiently for other tasks can become unmanageable.

With a minimum configuration of 512 MB of RAM per VM, we would be looking at around 2 GB of RAM (if not more) just for testing purposes. This set-up might work if you currently have 8 GB or more of system memory. But if not, there’s still hope.

We could always get a dedicated box just for testing purposes, and run all of our virtual machines directly on there instead. I recently acquired a second box at work for this very purpose. But at the end of the day, both options 1 and 2 are set-ups you can rely on.

Option 3: VNC or RDP + Dedicated Testing Boxes

screenshot

A few companies (such as ZURB) prefer to use a form of remote desktop access to allow designers and developers to log into a dedicated testing box or set of boxes for cross-browser testing, over a network. The benefit of this is reduced demand on memory for each client. And this can be implemented in a few ways; VNC and RDP are the first that come to mind.

Virtual network computing (VNC) is a platform-independent desktop sharing system that allows you to remotely control another computer. It transmits both keyboard and mouse events from one system to another, relaying screen updates back in the other direction over a network. Similarly, RDP allows users to access applications over a network, but it is a proprietary protocol developed by Microsoft. If you happen to be running Mac OS X, VNC is already built in, but a number of VNC clients are also available in the wild, such as RealVNC17. On the RDP side of things, Mac users can use Apple’s own Remote Desktop 18 and Remote Desktop Connection19 by Microsoft.

You might be wondering what the differences are between VNC and RDP. RDP is semantic and is more aware of controls, fonts and other graphical primitives, while VNC is a little “dumber” in this regard. VNC, though, permits a session to be shared on the target machine, which might be useful for multi-user demos; whereas RDP does not, as far as I’m aware.

With the decreased memory requirements, you might then wonder why we don’t opt to use remote desktops for testing at AOL. The primary reason is that, in some cases, testing over a network can result in packets (effectively, frames) being dropped, which can affect our ability to test highly interactive applications or websites. Also, websites that make use of rich-media experiences based on canvas, SVG or otherwise aren’t reliably tested over networks for this reason. But don’t let our experience put you off. I know of teams in other companies that haven’t run into these issues, and remote testing might be suitable for some networks more than others.

Option 4: Remote Testing Through a Third-Party Service

If your team is unable to purchase or rent dedicated boxes for remote testing due to cost, there are third-party services you can use which which readily host host multiple versions of Windows, along with historic versions of IE and other browsers out of the box for a low subscription fee.

BrowserStack.com20 and Browserling21 are two such options. You might be surprised to know that both actually support local testing of your servers and files through ssh tunneling and as long as your company are comfortable with content being tested in this manner, it’s an adequate and affordable way of getting reliable cross-browser testing into your business.

If I had to personally recommend one of the services over the other, it would definitely be BrowserStack. They offer a wider range of browser versions and OS versions than Browserling and also include debugging and developer tools as a part of their service.

There is however one downside to the services recommended above: at the time of writing, neither currently appear to support the Firefox nightlies/builds for FF7,8,9, Opera.next nor the dev/beta/canary builds of Google Chrome.

I personally like the flexibility to test how my projects might render and function in upcoming browsers as this provides you with a level of comfort about a release – eg. if FF7 gets released next week, I’d rather be able to patch projects before everyone starts updating rather than after. That said, this isn’t a concern thats shared by a lot of developers or designers, so feel free to try out BrowserStack or Browserling if Options 1-3 aren’t for you.

Another Alternative For Developers Wishing To Avoid Purchasing Multiple Licenses

Some developers may be familiar with Microsofts virtual machine disk images which I mentioned earlier. It can be quite a challenging task getting these images to work with anything other than Microsofts VirtualPC, however a recent project called IEVMS22 (thanks to Paul Irish for the heads up) attempts to solve this problem. IEVMS offers a set of scripts that facilitate using the images with VirtualBox on Linux or OSX and with a single command it’s possible to have IE6 – IE9 running in separate virtual machines.

The project also offers a clean snapshot mode, potentially enabling developers to roll-back these VMs so that its possible to have them working indefinitely. This project does (at the time of writing) suffer from a few minor bugs that are being worked out, but is certainly worth looking at if it sounds more appealing than the alternatives. Bear in mind that this script will still need to download the 10-12GB of disk images required for the VMs and I’m not sure if IEVMS breaks the EULA, so ensure this won’t be an issue before launching the scripts.

Conclusion

I hope this guide has come in handy. Please feel free to share your own stories and experiences of cross-version testing IE, because they may help other readers decide which option to try out first.

In part 2 of this post, we’ll look at cross-browser testing modern browsers. See you then!

(al)

Footnotes

  1. 1 http://www.my-debugbar.com/wiki/IETester/HomePage
  2. 2 http://tredosoft.com/Multiple_IE
  3. 3 expression.microsoft.com/en-us/dd565874
  4. 4 https://browserlab.adobe.com/en-us/index.html
  5. 5 http://browsershots.org
  6. 6 http://browsercam.com
  7. 7 http://www.microsoft.com/windows/virtual-pc/
  8. 8 http://www.microsoft.com/download/en/details.aspx?id=11575
  9. 9 http://blogs.msdn.com/b/ie/archive/2011/03/24/ie9-s-document-modes-and-javascript.aspx
  10. 10 http://utilu.com/IECollection/
  11. 11 http://msdn.microsoft.com/en-us/academic/bb250591
  12. 12 http://virtualbox.org
  13. 13 http://www.parallels.com/uk/products/desktop/
  14. 14 http://www.vmware.com/
  15. 15 http://utilu.com/IECollection/
  16. 16 http://www.microsoft.com/download/en/details.aspx?id=2
  17. 17 http://realvnc.com
  18. 18 http://www.apple.com/remotedesktop/
  19. 19 http://www.microsoft.com/mac/remote-desktop-client
  20. 20 http://www.browserstack.com/features
  21. 21 http://browserling.com/
  22. 22 https://github.com/xdissent/ievms

↑ Back to top Tweet itShare on Facebook

Addy Osmani is a Developer Programs Engineer on the Chrome team at Google. A passionate JavaScript developer, he has written open-source books like 'Learning JavaScript Design Patterns' and 'Developing Backbone Applications', having also contributed to open-source projects like Modernizr and jQuery. He is currently working on 'Yeoman' - an opinionated workflow for building beautiful applications.

Advertising
  1. 1

    so to test in various versions of IE you propose 3 virtual machines and 3 operating systems. hilarious, and ridiculous. you think my company is going to buy windows xp, windows vista, and windows 7, just to test IE??

    and how do i get a legal copy of windows xp? it’s not made anymore!

    this joke article should be re-titled: “Dowload illegal torrents of all operating systems to test IE”

    0
    • 52

      I can completely sympathize with smaller companies who might not be able to afford multiple licenses to Windows for this setup (btw, XP can still be purchased). Whilst dedicated VMs are what I consider to be the perfect testing configuration you can get by paying for something a lot more affordable like BrowserStack or CrossBrowserTesting. They do have their limitations, but again, this might work better for your budget.

      An alternative (possibly better option than BrowserStack) mentioned in the post are Microsofts time-bombed IE testing images that are free, but require a re-download every couple of months once they expire. We’ll be updating the post shortly with some additional tips around this and a script called IEVMS that you might be interested in.

      0
  2. 103

    Reliable Cross-Browser Testing, Part 2: Mozilla Firefox

    Utilu Mozilla Firefox Collection: http://utilu.com/UtiluMFC/

    Utilu Mozilla Firefox Collection contains multiple standalone versions of Mozilla Firefox plus Firebug and Web Developer add-ons.

    0
  3. 154

    As a rule of thumb I only test as far back as the current version of the browser and 2 versions prior. So let’s say IE 9 is the latest. I would test IE 9, 8 and 7. This applies to other browsers as well.

    Theres no point of testing IE 6. Microsoft doesn’t support it and is actively encouraging users to upgrade, google ditched it before then and it’s just completely broken. It’s time to move the web forward, W3C standards are the way to go!

    0
    • 205

      Agreed. I mentioned this in another comment but IE6 is really just covered for the sake of being thorough as at Aol, IE7 is the baseline we work from.

      My personal rule of thumb when it comes to testing other browsers is current -2 (and in the case of browsers like Firefox and Chrome with accelerated release cycles/dev snapshots), current +2 as well.

      0
  4. 256

    Good stuff Addy. I was wondering if you’ve had any experience with Multi-Browser Viewer (multibrowserviewer.com/)?

    0
    • 307

      Multi-browser viewer is an excellent solution. It provides all of the virtualization without the pain. I’ve used it for over a year and love it.

      0
  5. 358

    So which of the 3 alternatives you guys use at AOL?

    0
  6. 409

    so which of the 3 alternative you guys use at AOL?

    0
    • 460

      The team I’m on use the first option outlined, however I know of others that use option 3.

      0
  7. 511

    I have IE6-9 thinApped on my box — it makes really easy to test against different versions and you don’t need to maintain a separate vm layer.

    I run the same solution on my MBP but in a w7 vm (under parallels)

    This setup is the best and least messy that I’ve tested
    so far.

    0
  8. 562

    Take a look at Microsoft Expression Web 4 Super Preview. They have a new Remote Browsers service which is still in beta. They have Internet Explorer 6 – 9 ; Safari 4-5, Firefox 3-5; and Chrome.

    Also, there is an interaction mode.

    0
  9. 613

    All this just to test for the worst browser family available. Don’t get me wrong this is a fantastic article. I’ve struggled with proper IE testing like everyone else and I’ve tried several of the methods mentioned above. As I was reading this however I couldn’t fight the feeling of an overwhelming cost/benefit disparity in doing all this. I’ve reached the point where I test everything in all the latest browsers and if the browser type used to visit my site is an old version of IE I display an information box with upgrade paths for my users.

    At the end of the day developing for old IE browsers is simply too time consuming and most clients (who don’t understand why this is time consuming) aren’t willing to pay enough money for a site to make that extra testing worthwhile. Naturally if a client insists I negotiate a fair price or I don’t take the job but … oh man I just hate IE so much.

    0
  10. 664
  11. 715

    Thank you so much for this article.

    0
  12. 766

    After a lot of experimenting and comparing I can only really recommend the “one machine/vm for every version of IE” that needs to be tested. Maybe with a quad core it might be possible to run up to 3 vms simultaneously… Don’t throw away your old machines!

    0
  13. 817

    Awesome post.

    A few additions and corrections though:

    1) Third-party tools: make sure to keep Spoon (formerly Xenocode) in your bookmarks, watchlist, and test-drives: http://spoon.net/Browsers — former Xenocode allowed you to virtualize any kind of browser/application as a local, stand-alone, single-file executable without installation through some terrific black magic. Xenocode redirects to Spoon now, and looks like their goal is to move that magic to the next level…

    2) Option #1: VMware provides VMware Player on http://www.vmware.com/products/player/ for free. It is perfectly sufficient and suitable for cross-browser testing (and more). It has many more features than Microsoft’s Virtual PC, and also comes with a feature called “Unity” that allows you to run an application from inside the VM in your parent system.

    3) Option #3: RDP natively supports to access and share sessions with multiple users, but the feature is not available in desktop systems.

    Anyway, thanks for writing up this summary! Wish I would’ve known about these options and pitfalls years ago… :)

    P.S.: *Love* the final “in part 2 […] we’ll look at cross-browser testing MODERN BROWSERS.” LOL! So true… :-D

    0
  14. 868

    I’m just trying this new tool to test in different browsers: http://ow.ly/6xz6D I find it very useful.

    0
  15. 919

    You have suggested to use XP for IE7 testing with IECollection in “Option 1″, and to use Vista for the same task in “Option 2″.

    Can you clarify what is the difference?

    0
  16. 970

    Win7 comes with multiple winxp instances, unfortunately i can not run all at the same time, even I have 8G RAM, the xp multiple instances just takes all the memory.

    0
  17. 1021

    Very broad and honest article. I currently use VMware Fusion virtualising Windows 7 with IE Collection. It does the trick.

    Thanks for letting us know about all of the other options out there!

    0
  18. 1072

    i cannot get IE7 and IE8 to work on windows 7 running on parallels. it simply is greyed-out in the installation window. so i cannot tick their boxes. pretty useless for me then.

    0
    • 1123

      Same Problem here. Can’t check IE8.

      0
      • 1174

        I also had this same problem with IE Collection. Installed Windows7 Pro through Virtual Box on a Mac. Downloaded IE Collection, but I could only install IE6. IE7 (which I wasn’t expecting to work because of Addy’s comments) and IE8 were greyed out in the installation window. And on top of that, both versions of IE6 crash when I try to use them. I can’t find an explanation on the web as to why IE8 won’t install.

        btw – great article.

        0
        • 1225

          yeah, i’m in exactly the same camp as you.

          running Win 7 on parallels, can’t install 7 or 8, and when I run 6 it doesn’t work properly at all. I remembered having tried IE Collection a few years back and deciding it wasn’t quite up to the task, now i think I remember why…

          0
          • 1276

            Multi-Browser Viewer has a standalone versions of all IE versions, including IE8 and is included in the free trial and it runs in parallels.

            0
    • 1327

      Yep, 3 months later, and this is still the case. I’m running Win 7 in VMware and IE Collection has proven fruitless. I think it’s fairly safe to say this isn’t an option for cross-browser testing anymore.

      0
  19. 1378

    Great article!! It was extremely helpful, and helped solve some of the problems that I have been having with IE 9! Thank you for writing/sharing this!

    0
  20. 1429

    I think IETester gets an unjustifiable amount of bad-press, when, for IE6 emulation at least, it’s an easy to set up, resource-light and mostly accurate solution. Yes, there are some inconsistencies with the real IE6 browser, but these are actually few and far between; occasionally annoying, but certainly not widespread enough to give it a resounding thumbs down

    Within any team with a dedicated tester as long as *they* have a more robust copy of IE6 (eg on a VM) then IETester suffices the vast majority of the time for your developers. In about 4 years of front-end development I’ve only come across an IE6 bug not-reproducible in IETester (or the opposite, a false bug thrown in IETester) a handful of times.

    PS – one tiny correction/addition – IE8 also has multiple browser modes, and reproducing IE7 from within IE8 generally works a lot better than trying to do it from within IE9

    0
  21. 1480

    Awesome article! Started looking at cross-browser tests last week and this was a priceless help for me. Looking forward to part 2.
    Regarding cross-browser script tests, do you have any recommendations?

    Thanks,
    Ricardo

    0
  22. 1531

    Different VM instances for each verion of IE 6,7,8,9…
    Then FF 3.6..
    =) the way to go!

    0
  23. 1582

    Competition for browser market share between Chrome and IE is going to be more fierce. The advent of mobile computing will add more complexity. In this situation you want an end to end cross-browser solution. eggPlant from TestPlant is a perfect tool to try.

    0
  24. 1633

    This article is excellent and very detailed, thank you!
    Will give spoon.net a try after reading about it in the comments!

    0
  25. 1684

    IE 7 and IE 8 are greyed out in window 7. make this software rather pointless.

    0
  26. 1735

    I believe this site contains some very excellent information for everyone . “The test of every religious, political, or educational system is the man that it forms.” by Henri Frdric Amiel.

    0
  27. 1786

    Hi, I have been using Virtualbox to perform all my IE testing from like 2 years now. That includes all the mayor browsers like firefox, chrome, safari and opera.

    But recently, one guy in my company started to said than IExplorer acts different from a virtual machine than a real pc with Windows.

    I want to know if this is even real. I mean real facts, not just some-rare-cases that all we got sometimes around IE. We can’t trust 100% on what we’re seeing on IExplorer running on virtuals vs real machines?

    Thanks in advance.
    – Mario

    0
  28. 1837

    Just want to mention that even if VM are probably the way to go, there are some situations where you cannot use that. At this time I’m working on a big application where every developper has already a virtual machine for local development. Unless you hace a monster computer, you won’t be able to run two virtual machines :(

    0
  29. 1888

    All you need is VirtualBox software (free) and a developer copy of Windows8 (free). Follow this tutorial. Worked for me. https://centroy.com/blog/testing-internet-explorer-mac-its-actually-quite-easy

    0

↑ Back to top