Well, for starters, you need to realize that the body isn't supposed to sit all day... spinal structures inevitably make adaptive changes to compensate for this behavior, and that's what ultimately leads to chronic back pain.
That being said, not everyone has the luxury of changing jobs... so make sure your work environment is ergonomically sound.
From there, you might consider performing the posterior chain exercises discussed in a book titled "Foundation" by Dr. Eric Goodman. Here's a link to the book on Amazon (it's about $14). In my opinion, it's very useful in combating the effects of prolonged sitting.
Link - http://is.gd/sittingrelief
I recommend doing Planks. They will help you a lot :)
Go for this link http://www.wikihow.com/Get-Rid-of-Bad-Back-Pain. It will definitely help you and give you different tips relieving you from your back pain. :)