Let me follow up my inflammatory title with all due respect for CVS and what it has brought us, besides a thousand years of pain. Who knows how many man-hours were saved by CVS? Of course, there is always the argument about how many man-hours have been lost due to it as well, but then again we all know the importance of proper backups... especially when dealing with source code control systems. While CVS is one of the oldest, its legacy of suggesting it will do one thing and will do another is probably its most-emulated feature, so it is by no means unique in that regard.
Until recently, however, it was unique in that it was essentially the only Free, Open Source remote source code control system with anonymous access. This means that it has often been the distribution method of choice for prerelease versions of software. While more recently it has been all but superseded and is gradually being supplanted by more modern FOSS source control systems like subversion, git, or bzr (all of which were designed at least in part to address specific, grating failings of CVS) it still enjoys a substantial amount of inertia and it is still the primary source control system for a number of major public repositories.
As mostly a putterer in the software development world, I am somewhere between a user and a programmer. I believe the term is either "Power User" or "Wanker" depending on where you're sitting, but either way I find myself compiling a lot of code from source so that I can play with bleeding-edge features. Many popular projects have already been compiled and even packaged for you, one of today's primary examples being Ubuntu Personal Package Archives ("PPAs"). There are always those edge cases however which are either not packaged or just difficult to find, or which perhaps do not track the features you would like. Luckily, most distributions make it very easy to build software (if you can just figure out the right -dev package names, of course) and so as long as the software in the repository actually builds (never a safe bet) you can generally build anything you can download.
Therein lies the basic problem. While some repositories can be downloaded very trivially, CVS has some major failings that make it altogether undesirable for this purpose. It is of course (at least nominally) acceptable for its primary purpose, which is to allow the checking in and out of various revisions and branches of files with locking behavior, and assisting with merges between revisions. But when it comes to downloading whole repositories, even people with fairly good connections will often have problems. A user on a modem (once the norm, and still not uncommon unfortunately) is in serious trouble. The biggest problem is that CVS' behavior when it fails is anything but pretty. There is no command intended to simply resume the last broken command which failed due only to a network error, and when CVS fails in the middle of transferring a file the results are somewhat unpredictable. While CVS is intended to do the right thing if you check out a directory which is already partially checked out, in practice it often will leave the last directory in which it was working unfinished from the point of the error, resulting in entire trees of the directory structure left unordered.
The solution is to produce "CVS snapshots", an archive of a successful anonymous CVS checkout. This permits first-time downloading of the tree. However, it should not be necessary in the first place. Downloading the files need be no more complicated than a recursive http get, a potentially complicated but typically straightforward operation; in fact, it should be substantially easier due to the ready availability of directory information. In practice, a user on a poor connection will have to babysit CVS for hours to download any substantially-sized codebase.
This message is as much a plea for sense as a rant against CVS. Please, please convert your repositories to some, any other format. If subversion is acceptable to you (it is no more awkward and significantly less offensive to use on Unix systems than CVS, and reportedly a joy to use on Windows via TortoiseSVN) then there is a single tool which can convert your repository to the svn format. There is a learning curve with any new tool, but this is one which will probably save a great number of your hairs from being torn out, and which will certainly save you from having to hear people like me cry about your chosen source control system. It would get a lot more people out there running your testing version, too...