Where do you actually get a marriage license?

I know this is probably a dumb question...I found on my counties webpage the qualifications and rules for obtaining a marriage license and it has the form available, but doesn't say what actual office you need to turn it into. When I tried to call the courthouse I didn't know which office to be directed to. Also the women in our state have to have a blood test done prior. If anyone knows anything about that, such as are is there a certain place you have to have it done at...I know it's probably different in different places, but I keep finding new things to stress about lol.