Setting up SVN
First things first you need apache2 and PHP.
Annoyingly when you first try “apt-get install apache2″ Debian will ask you for the CD! Having already removed the CD-ROM this was a potential issue 
All you need to do is remove the CD from the source list, open the list in an editor using “nano /etc/apt/sources.list” and comment out the line with the CD on.
Now apache can be installed from the web sources. When done going to http://server-ip should show you a working apache page.
Install PHP5 and PHP apache support using the following command “apt-get install php5 libapache2-mod-php5 php5-curl php5-gd“. When done restart apache “/etc/init.d/apache2 restart“.
I used bits from this guide and this guide to install SVN and WebSVN. Also if, like me, you need to import an existing repository follow this guide.