Login or Sign Up to become a member!
LessThanDot Sit Logo

LessThanDot

Data Management

Less Than Dot is a community of passionate IT professionals and enthusiasts dedicated to sharing technical knowledge, experience, and assistance. Inside you will find reference materials, interesting technical discussions, and expert tips and commentary. Once you register for an account you will have immediate access to the forums and all past articles and commentaries.

LTD Social Sitings

Lessthandot twitter Lessthandot Linkedin Lessthandot friendfeed Lessthandot facebook Lessthandot rss

Note: Watch for social icons on posts by your favorite authors to follow their postings on these and other social sites.

Your profile

    Search

    XML Feeds

    Google Ads

    « Grouping datetime values in half hour blocks in SQL ServerIs an index seek always better or faster than an index scan? »
    comments

    There are a few things a good DBA really can't live without in his or her arsenal of tools to better manage a wide array of instances. This includes OLAP and OLTP strategies. One of those tools is a good compression tool. I’ve never been one to promote software and kind of hate it when others try to jam it down my throat. I have what I need to make the decision on my own and know how to use Google and read reviews along with statistics provided. That being said I'm going to go off that typically demeanor and talk a bit about Quests LiteSpeed product and how I think it can benefit most DBAs. LiteSpeed is only one of many products out there first off. I tested four different products when I was given the budget and task to implement compression in the company I currently am employed with. I implore you to do the same and don't just take any DBAs word no matter what the amount of experience they have is or given reputations. You gain experience from taking in others knowledge and putting it to test on your own and making your own “final” decisions. Every installation is different and the calculations you have to take into account for choosing the product that fits you is always going to vary.

    At a high level, compression software in itself can give you a vast amount of options that you simply may not be able to grasp without.

    1. Onsite retention of backups
    2. Log shipping abilities that otherwise can flood pipes
    3. Compression options nonexistent in other concepts
    4. Ability to use partially native SQL Server tasks still
    5. Extremely low account of training required
    6. Fast implementation
    7. Very slight interruption to the native internal functionality of SQL Server

    The last point is the greatest reason I chose Quest. It’s a mouth full of a statement to say the least. The key factor of #7 is the fact that there is a very small amount of change that goes into SQL Server to achieve the products full potential. With a few other products that I will not name, objects and change was required to the master or msdb databases. Certain features were also required to be turned on that I just was not willing to turn on for security reasons. We work hard to secure data and something like backups should not compromise that.

    Onsite retention is to the point it makes you invincible to requests for data. In the growing audit prone level we exist in these days, you must be able to produce data in a quick manner. This of course depends on your disk and data size as far as retention. 500GB of disk with high compression rates will give you a vast amount of space to work with databases in the 100GB ranges though. In the installation I’m currently maintaining, I have been given the ability with compression to withstand request in a timely fashion of a month in the past. That means simply, I have a month’s worth of backups on local disk. This consists of databases well exceeding the 200GB range. In an earlier blog I mentioned the importance of reporting to management of where the database server installations are and the state of the data. This includes reporting on disk savings and data recovery abilities. In the last 2 weeks alone that report has shown a 12.98TB savings. This is an 82% saving over uncompressed backups. Yeah, that is a number that pays for itself. Backup retention alone is the selling point.

    In my current installation and DR strategy I am using log shipping also. I have the allowance and business acceptance of the time difference in recovery. In short that means my analysis of time spans between log shipments and a failure is accepted by the business. Log shipping is a good DR strategy for small to mid-size companies. You can’t beat the cost savings but MUST have the business buy in for the distance in data recovery between shipments. Most inexperienced and experienced DBAs will argue that the hard part of a DR strategy on LS is the fail-back strategy. Honestly, that to me is a show of lack of ability to use what you have to manage your data in these events. Fail-back strategy can be as simple as database level triggers on the DR standby servers to initiate the same backup strategy on the DR site that you already have on the primary site. Yes people. If you fail over to a DR site you probably should backup the data over there once it is your production data. You would be surprised how many times this is overlooked and if at that time your DR goes down I wouldn’t want to be in your shoes without backups starting up once a failover. To do this, have your DR site setup to automatically create and start backups using the same tools and landscape from you primary servers. The fail-back strategy is simply to bring the primary instances and databases up to speed and in sync with data with the backups that run on your DR site in the event of a disaster. That is the cheapest and completely sound way to bring things back online after the disaster is situated. It works! And it works very well in my experience.

    This all fits in place with log shipping and compression with LiteSpeed by giving you the means of compressing large log backups down to almost nothing and having the ability to send them down the pipe without interruption to the business operations. You could take the compression out of the picture here but then you’re forced to go farther out in time between the backups to allow copy time to the standby servers. That in most cases is not acceptable by the business. When I tested and implemented LiteSpeed for log shipping it was literally a 10 minute setup. This was impressive to me. Even more impressive was the fact it worked the first time around. I did test against other compression options for log shipping and this one was just vastly better than the other installation and configurations required. Again, just my experience of using the product and you have to take it to heart as much as you trust my word and from your own testing.

    There really isn’t much more I can say to why getting budget for compression tools in-house is important and can really make you a better DBA. My choice of LiteSpeed was based off my revamped landscape when I was hired to do just that. The tools work and work very well. I’ve been impressed with the staff at Quest and the response I’ve been given when I did have to contact them. They seem to pride themselves on having on hand some of the best people in our field. That alone tells me the level of quality. LiteSpeed has a nice added feature of a log reader tool inside the console as well. That is pretty cool and nice not to have multiple different installations just to have that ability.
    So there you have my promo and probably the last one you’ll ever hear me give on a named tool I recommend. I’m hoping you take from this not that you should go out and get LiteSpeed but more that you should be compressing your backups and not relying on offsite tape only. There is nothing more irritating than users over your back while you wait a day to get tape back. Compression tools make you look good and keep the concept of backup/recovery down to a much quicker responsive task. The cost savings is much higher than some think also and it can be an easy sell for management to purchase these tools. After my review of SQL Server 2008 Enterprise with compression features I’m still staying with my configurations, but keep that new 2008 feature in mind as well. Then again if your DB's fit on a thumb drive I'm guessing this will all be a waste of reading time to you :)

    Btw…when I say don’t rely on tape, this doesn’t mean you shouldn’t send tape offsite. DB gods help you if you don’t do that ;)

    LiteSpeed backup analyzer (also a great feature!)

    About the Author

    Ted Krueger is a SQL Server MVP and has been working in development and database administration for 13+ years. Specialties range from High Availability and Disaster / Recovery setup and testing methods down to custom assembly development for SQL Server Reporting Services. Ted blogs and is also one of the founders of LessThanDot.com technology community. Some of the articles focused on are Backup / Recovery, Security, SSIS and working on SQL Server and using all of the SQL Server features available to create stable and scalable database services. @onpnt Personal Blog over at http://onpnt.wordpress.com/
    Social SitingsTwitterLinkedInLTD RSS Feed
    3483 views
    InstapaperVote on HN

    7 comments

    Comment from: SQLDenis [Member] Email
    *****
    SQLDenis compressions is helping for sure, makes thing backup and restore faster and as you mentioned saves space. Sp beside LiteSpeed are there any other tools in your arsenal? I like SQLCompare myself, saved me countless times
    05/27/09 @ 07:59
    Comment from: Ted Krueger (onpnt) [Member]
    Ted Krueger (onpnt) Thanks Denis. Yes, I just recently (within the last week) added SQLCompare and Data Compare to my tools. I was asking for it here for quite some time and finally got it. It has saved me countless SMO scripting time :)

    I was going to blog on monitoring tools but to put it here, I also use Idera for monitoring. However I will be mixing that up with a upcoming purchase of Quests Oracle monitoring tools. That is important to note for others in picking monitoring tools. Plan for the future and see if the company has the ability to imcorporate more types of database servers over the primary one. Would make life easier if my selection would have been more accommodating to SQL Server and Oracle
    05/27/09 @ 08:21
    Comment from: SteveO [Visitor]
    ****-
    SteveO Can we get some times and sizes before compression and after? How about delta in size as well?

    I am looking at sub 1TB db and I want to reduce the time for backup.

    Also is a restore going to be faster or slower from a compressed backup? Same size db.

    TIA

    __Stephen
    05/27/09 @ 10:41
    Comment from: Ted Krueger (onpnt) [Member]
    Ted Krueger (onpnt) Thanks Steve. I'll follow up with stats shortly. I higly recommend downloading the trial though. LiteSpeed has a extremely good backup analyzer that you can run to gain the advantage quickly over these statistics. I've added the image into the blog on a small database to show testing on compression rates. To give really hard numbers is hard and they do have statistical papers showing in their labs on servers you may be able to base off over my servers and configurations.
    05/27/09 @ 10:56
    Comment from: SteveO [Visitor]
    SteveO Would you believe that they found me and gave me a call?

    From their lips:

    compression around 85% reduction
    time Spent 70% faster.

    They did state that it all depends ;-> on my hardware as well.

    they also stated that it is a preprocessor to what SQL Server does and that my having Avamar will not be effected in any way and that Avamar will take the now smaller output file and still deposit it on the linux share.

    Sounds pretty cool to me that I don't lose investment $$$ on not being able to use Avamar.

    05/27/09 @ 12:24
    Comment from: Ted Krueger (onpnt) [Member]
    Ted Krueger (onpnt) That's good news on Avamar. I swear I didn't give you up to them. Not sure how they "found you". If you want go ahead and start a thread in the forums also on any setup/cons/pros/general quetsions you have. There are a ew of us using it and I bet we can get some good content out there
    05/27/09 @ 13:01
    Comment from: Jeffrey Aven [Visitor] · http://www.hyperbac.com/sqlserver
    Jeffrey Aven HyperBac for SQL Server is another one you should add to the list for third party SQL compression. It was developed by original developers of LiteSpeed, and has a completely different file system architecture which gives it numerous advantages over LiteSpeed and others, giving you the same speed and compression, with much more flexibility, extensibility, seamless native integration and most importantly much lower licensing and maintenance cost, a must for hardcore SQL DBAs!
    05/27/09 @ 14:21

    Leave a comment


    Your email address will not be revealed on this site.

    To mislead the spambots.

    Your URL will be displayed.
    (Line breaks become <br />)
    (Name, email & website)
    (Allow users to contact you through a message form (your email will not be revealed.)