if you have a lot of other processes running on your machine, your CPU might be balancing load between all of them. You could stop the processes, or use your OS to mark your thread as higher priority.
(But this probably isn't the case - OSs are pretty smart at this stuff.)
You could also parallelize your code and get it to run on multiple cores of your CPU.