Tag Archives: Veeam

More Than Meets the Eye… Veeam Backup Performance

Recently I was sent a link to a video that showed an end user comparing Veeam to a competitors offering covering backup performance, restore capabilities and UI. It mainly focused on the comparison of incremental backup jobs and their completion times. It showed that the Veeam job was taking a significantly longer time to complete for the same dataset. The comparison was chalk and cheese and didn’t paint Veeam in a very good light.

Now, without knowing 100% the backend configuration that the user was testing against or the configuration of the Veeam components, storage platforms and backup jobs vs the competitors setup…the discrepancy between both job completion times was too great and something had to be amiss. This was not an apples to apples comparison.

TL:DR – I was able to cut the time to complete an incremental backup job from 24 minutes to under 4 minutes by scaling out Veeam infrastructure components and tweaking transport mode options to suit the dataset from using the default configuration settings and server setup. Lesson being to not take inferred performance at face value, there are a lot of factors that go into backup speed.

Before I continue, it’s important for me to state that I have seen Veeam perform exceptionally well under a number of different scenarios and know from my own experience at my previous roles at large service providers that it can handle 1000s of VMs and scale up to handle larger environments. That said, like any environment you need to understand how to properly scope and size backup components to suite…that includes more than just the backup server and veeam components… storage obviously plays a huge role in backup performance as does the design of the virtualisation platform as well as networking.

I haven’t set out in this post to put together a guide on how to scale Veeam…rather I have focused on trying to debunk the differential in job completion time I saw in the video. I went into my lab and started to think about how scaling Veeam components and choosing different options for backups and proxies can hugely impact the time it takes for backup jobs to complete. For the testing I used a Veeam Backup & Replication server that I had deployed with the Update 4 release and had active jobs that where in operation for more than a month.

The Veeam Backup & Replication server is on a VMware Virtual Machine running on modest 2vCPU and 8GB of RAM. Initially I had this running as an all in one Backup Server and Proxy setup. I have a SOBR repository consisting of two ReFS formatted local VMDK (underlying storage is vSAN) extents and a Capacity Tier extent going to Amazon S3. The backup job consisted of nine VMs with a footprint of about 162GB. A small dataset but one which was based of real world workloads. The job was running Forward Incremental, keeping 14 restore points running every 4 hours with a Synthetic Full running every 24 hours (initial purpose of was to demo Cloud Tier) and on average the incremental’s where taking between 23 to 25 minutes to complete.

The time to complete the incremental job was not an issue for me in the lab, but it provided a good opportunity to test out what would happen if I looked to scale out the Veeam components and tweak the default configuration settings.

Adding Proxies

As a first step I deployed three virtual proxies (2vCPU and 4GB RAM) into the environment and configured the job to use them in hot-add mode. Right away the job time decreased down by ~50% to 12 minutes. Basically, more proxies means more disks are able to be processed in parallel when in hot-add mode so it’s logical that the speed of the backup would increase.

Adding More Proxies

As a second step I deployed three more proxies into the environment and configured the job to use all six in hot-add mode. This didn’t result in a significantly faster time to what it was at three proxies, but again, this will vary depending on the amount of VMs and size of those VMs disks in a job. Again, Veeam offers the flexibility to scale and grow with the environment. This is not a one size fits all approach and you are not locked into a particular appliance size that may max out requiring additional significant spend.

Change Transport Mode

Next I changed the job back to use three proxies, but this time I forced the proxies to use network mode. To read more about Transport modes, head here.

This resulted in a sub 4 minute job completion to read a similar incremental data set as the previous runs. A ~20 minute difference after just a few tweaks of the configuration!

Removing Surplus Proxies and Balancing Things Out

For the example above I introduced proxies however the right balance of proxies and network mode was the most optimal configuration for this particular job in order to lower the job completion window. In fact in my last test I was able to get the job to complete consistently around the 5 minute mark by just using the one proxy with network mode.

Conclusion:

So with that, you can see that by tweaking some settings and scaling out Veeam components I was able to bring a job completion time down by more than 20 minutes. Veeam offers the flexibility to scale and grow with any environment. This is not a one size fits all approach and you are not locked into a particular appliance size that will scale out requiring additional and significant spend while also locking you in by way of restricted backup date portability. Again, this is just a quick example of what can be done with the flexibility of the Veeam platform and that what you see as a default out of the box experience (or a poorly configured/problematic environment) isn’t what should be expected for all use cases. Milage will vary…but don’t let first/misleading impressions sway you…there is always more than meets the eye!

Sources:

https://bp.veeam.expert/

Backup & Replication 9.5 Update 4 – What’s In It For Service Providers

For ten plus years Veeam has continued to develop new innovative features and enhancements supporting our Cloud and Service Provider partners. As I posted earlier this week, there is a proven track record built upon a strong foundation of Veeam technology that backs up our strong leadership position in the Service Provider space. This accelerated in v7 with vCloud Director support…continued with Cloud Connect Backup in v8, Cloud Connect Replication in the v9 release and even more through the Backup and Replication 9.5 releases and Updates.

In my initial v9.5 Update 4 Top New Features post I covered off new core features and enhancements that are included in Update 4. Specifically there are a number of new features that VCSPs can take advantage of…

Over the next few weeks I am going to deep dive into each of the features listed above as they all deserve their own dedicated blog posts. With a release as huge as this, there is no shortage of content that can be created off the back up Update 4!

Beyond the core enhancements, there are also a significant number of general enhancements that are referenced in the What’s New Document. I’ve gone through that document and pulled out the ones that relate specifically to Cloud and Service Provider operations for those running IaaS and B/R/DRaaS offerings.

  • Maximum supported individual disk size and backup file size have been increased 10 times. With the default 1MB block size, the new theoretical VBK format maximums are 120TB for each disk in backup. Tested maximum is 100TB for both individual disks and backup files.
  • Optimized backup job initialization and finalization steps, resulting in up to 50% times faster backups of small VMs
  • Added experimental support for block cloning on deduplicated files for Windows Server 2019 ReFS
  • vPower NFS write cache performance has been improved, significantly improving I/O performance of instantly recovered VMs and making a better use of SSD drives often dedicated by customers to write cache.
  • vPower NFS scalability has been improved to more efficiently leverage expanded I/O capacity of scale-out backup repository for increased number of VMs that can be running concurrently
  • Support for Paravirtual SCSI controllers with more than 16 disks attached
  • Added JSON support
  • Added RESTful API coverage for viewing and managing agent-based jobs and their backups
  • Added the ability to export the selected restore point of a particular object in the backup job as a standalone full backup file (VBK)
  • Added ability to instantly publish a point-in-time state of any backed-up database to the selected SQL Server for dev/test purposes by running the database directly from the backup file
  • Added the ability to export a point-in-time state of any backed up database to a native SQL Server backup (.BAK file) to simplify the process of providing the database backup to SQL developers, BaaS clients or Microsoft Support
  • Added the ability to schedule Active Full backups on a particular day of the month, as opposed to just weekdays
  • Instant recovery of agent backups to a Hyper-V VM now support Windows 10 Hyper-V as the target hypervisor. This is particularly useful for managed service providers by enabling them to create low-cost all-in-one BCDR appliances to deploy at their clients’ premises.

What I pulled out above is just a small subset of all the general enhancements in Update 4. For Cloud Connect, there is a Post in the Veeam Forums here that goes through specific new features and enhancements in greater detail as well as fixes and known issues.

Stay tuned for future posts on the core new features and enhancements in Update 4 for Veeam Cloud and Service Providers.

References:

https://www.veeam.com/kb2878

http://www.veeam.com/veeam_backup_9_5_whats_new_wn.pdf

http://www.veeam.com/veeam_backup_9_5_u4_release_notes_rn.pdf

Veeam for Service Providers…Ten Plus Years of Innovation!

I remember the day I first came across Veeam. It was mid 2010 and I was working for Anittel at the time. We had a large virtualisation platform that hosted a number of high profile sites including a well known e-commerce site. There had been a serious data breach on one of those site and we were required by the Australian Federal Police to restore the website logs from a couple weeks back when the breach had first taken place.

We were using a well known product at the time to backup our vSphere platform and from the outside everything seemed ok. All backup reports where green and we thought the backups where verified. To cut a long and painful story short, when we came to restore the website logs we found that the backups had not worked as expected and we couldn’t retrieve data off a secondary partition due to a huge unknown bug in the software.

That was the end for that backup application (and interestingly enough they went out of business a few years later) and that afternoon we downloaded Veeam Backup & Replication v4 and went to work pushing that out into production. We (and I have) never looked back from there. Veeam did in fact Just Work! At that stage there were enough features in the software to cover all of the requirements for a VMware based hosting platform, and over the years as v5 and v6 were released more and more features and enhancements were released that made Veeam even better service providers.

By the time I left Anittel and headed to Zettagrid, Veeam had introduced more innovative features like Instant VM Recovery, vCloud Director Support, Cloud Connect Backup, the Scale Out Backup Repository just to name a few. In fact Veeam impressed me so much with their Service Provider features that I joined the company where I now focus my time on working with Service Providers as part of the Veeam Product Strategy Team focusing on our cloud and service providers products and features.

While I could bang on about all the features that Veeam has released over the years to enable us to become a significant player in the Cloud and Service Provider space, a picture tells a thousand words…and an interactive timeline showing just how innovative and focused Veeam has been on enabling our Cloud and Service Provider partners to succeed is priceless!

No other vendor has this track record of producing specific Cloud and Service Provider features and enhancements over the years and as you can see over the last three to five years we have moved with the industry to continue innovating in the cloud space by accelerating feature development and bringing great technology to the market.

If you are a Cloud and Service Provider and not using Veeam…what are you waiting for?

https://anthonyspiteri.net/veeam-vcsp-reverse-roadmap/

Update 4 Launch Event Video and Recap Links

Yesterday we officially launched Update 4 for Veeam Backup & Replication 9.5 along with Veeam ONE and updated Veeam Agents for Windows and Linux. We had a live launch event streamed from our Velocity partner event which can be viewed below. For those interested in what is contained within this release, it’s worth a view to get an understanding of some of the key features of Update 4 as as well as see a couple of live demos we did on main stage.

3:57 – Ratmir Timashev Intro
11:20 – Danny Allan and Anton Gostev Intro
20:30 – Anthony Spiteri Cloud Tier Demo
38:06 – Michal Cade Staged and Secure Restore Demo
47:35 – Rick Vanover Veeam ONE Demo

Michael Cade and I also where guests on the Virtually Speaking podcast yesterday where we went into a little depth around Cloud Tier, Datalabs and Service Provider enhancements in Update 4.

https://blogs.vmware.com/virtualblocks/2019/01/22/vspeaking-podcast-veeam-availability-suite-9-5-u4-for-vmware/

Other Launch Posts:

Veeam Executive Blog – Danny Allan

My Top Three Favorite Veeam 9.5 Update 4 Features – Melissa Palmer

Storage Review

TechTarget

Veeam Velocity 2019 – Update 4 Launch and Innovation Awards

This time next week we will be well into Veeam Velocity 2019. In previous years, this event acts as our global sales kick off however this year we have incorporated partners into the event and will be using it as a platform to launch the next major version of our Veeam Availability Suite. Specifically we are launching Veeam Backup & Replication 9.5 Update 4 which includes a ton of new features and enhancements to our platform and I can truly say that we have raised the bar when it comes to innovation in the availability space.

There are a number of internal and partner related sessions happening over the three days with the highlight being the offical Launch Event for the Veeam Availability Suite 9.5 Update 4. This will be live streamed from the event and you can register to view the stream here. During the event I will be on stage with other members of the Veeam Product Strategy team where we will be showing live demo’s of some of the key new features of Update 4.

For those attending, you can view all sessions and build your session schedule through the Velocity 2019 app. You can find the app on the Google Play or Apple App Store by searching “CrowdCompass AttendeeHub” in the store. Download the app then search for Velocity 2019!

You can access the online version of the app here.

Veeam Innovation Awards @ Velocity 2019

At Velocity 2019 will host the second edition of our VIAs for partners. The Veeam Innovation Awards program seeks to celebrate Veeam partners who are thinking differently about IT as a key strategic component to meet the demands of today’s business. Similar to the first VIAs held at VeeamON 2018 last year, the second iteration of the awards heavily features VCSPs who consistently lead the way when it comes to pushing the boundaries of innovation in our space.

This time around we have already announced the main prize winners:

  • iLand
  • Offsite Data Sync
  • PhoenixNAP
  • Zettagrid

What we are doing for Velocity is announcing a best of show by way of having the public vote on each of the winners video submission which effectively go through each of their own innovative technology solutions and pitch their solutions to the voting audience. The voting is only open until this Friday, so I would encourage all people who work in and around Veeam to cast their vote.

References:

https://www.veeam.com/blog/join-veeam-launch-event.html

https://go.veeam.com/innovation-awards-2019

VCSP Important Notice: 9.5 Update 4 RTM Is Out…With vCloud Director Replication Support and more!

Today, Veeam has made available to our VCSP partners the RTM of Update 4 for Backup & Replication 9.5 (Build 9.5.4.2399). Update 4 is what we term a breaking update, meaning that if a Cloud Connect tenant upgrades from any previous 9.5 version before VCSPs this will break backup or replication functionality. With that in mind the RTM has been made available for our VCSP partners to ensure it is installed and tested before being pushed out to production before the GA release.

Veeam Backup & Replication releases from 9.0 (build 9.0.0.1715) can write backups via Cloud Connect to a cloud repository on 9.5 Update 4. For Cloud Connect Replication, existing Hardware Plan based replicas can go to a cloud host on 9.5 Update 4. To take advantage of the new vCloud Director based replication, tenants need to also be on Update 4.

As I detailed yesterday, there are a number of updates that need to be applied to Veeam ONE, Veeam Availability Console and Veeam Backup for Microsoft Office 365.

VCSP Features and Enhancements:

Update 4 is a very significant update and contains a number of enhancements and known issue fixes with a lot of those enhancements aimed at improving the scalability of the Backup & Replication platform that VCSPs can take advantage of. One important note is around the new Instance-based licensing model that all VCSPs should be aware of. There is an initial guide here, information in the VCSP Forums and there will be emails sent to explain the changes.

  • vCloud Director support – Massive Feature Enhancement! Simplifies setting up Veeam based DRaaS for Service Provides with vCD, and enhances tenants experience with additional capabilities provided by vCD
  • Capacity Tier – Move tenant’s backup files as they age out of operational restore window to a cheaper storage – AWS S3, Azure Blob or on premises object storage
  • Gateway pools – Create and assign pools of cloud gateways to the tenants
  • Tenant to tape jobs – Cloud Connect backups can be written to tape with the hand of GFS media pool and Backup to Tape jobs
  • Tenant-driven password change – Tenants can now change the password they use to connect to the service provider by editing one on the registered service provider
  • Platform Support – vCloud Director 9.5, VMware 6.7 Update 1 and Windows 2019 (1809) support.

There has also been a lot of work to improve and enhance scalability in the Backup & Replication Cloud Connect functionality to accomodate the increasing usage of Veeam Agent for Windows and Linux of which there is a new version (3.0) coming at the same time of Update 4 GA. For Veeam Availability Console, Update 4 will be taken advantage of fully in the upcoming major release a little later after the Update 4 GA.

Conclusion:

Once again, Update 4 for Veeam Backup & Replication is an important update to apply for VCSPs running Cloud Connect services in preparation for the GA release which will happen in about two weeks at our Velocity event. Once released I’ll link to the VeeamKB for a detailed look at the fixes but for the moment, if you have the ability to download the update do so and have it applied to your instances. For more info in the RTM, head to the VCSP Forum post here.

Important Updates for VAC, VBO and Veeam ONE … Update 4 is Coming!

Things are moving here at Veeam with the impending release of Veeam Backup & Replication 9.5 Update 4. In preparation for the release there have been a number of update patches released for our supporting platform products. Importantly for our Veeam Cloud and Service Providers who are expected to receive RTM details any day now, it’s important to understand that the following patches need to be applied ASAP before your main IaaS Veeam or Cloud Connect instances are updated to Update 4.

https://www.veeam.com/kb2832 – Veeam ONE
https://www.veeam.com/kb2835 – Veeam Availability Console
https://www.veeam.com/kb2809 – Veeam Backup for Microsoft Office 365

For Veeam ONE there is a little manual work to be done by way of an MSSQL script. If not executed before Update 4 is deployed, Veeam Cloud Connect monitoring and reporting in Veeam ONE 9.5 Update 3 will stop working.

For Veeam Availability Console,

the patch update is a Cumulative Patch for Update 1 of 2.0. This adds immediate compatibility support for Veeam Backup & Replication 9.5 Update 4 as well as Cloud Connect 9.5 Update 4 compatibility support which is how VAC does it’s communicating between the server instance and remote sites for monitoring and management of remote Backup Servers and Agents. Note that there are new features in Update 4 which will not be supported in this version of VAC…the next major release of VAC will add supportability for those features not supported.

As well as the Update 4 compatibility, there are also a number of resolved issues, the full list of which can be viewed in the VeeamKB. To apply the patch, head to the VeeamKB and follow the instructions. You need to have at least VAC 2.0 Update 1 Build 2.0.2.1750 as shown below.

From there, make sure you have a backup of the database, close down the Web UI and execute all three MSI packages as administrator on the server.

Once completed the patches are applied and VAC 2.0 Update 1 is up to date running on version number Server Version 2.0.2.1913. Note that updated Windows for Agent Builds have been pushed out and can be upgraded as per my post a few months back.

For Veeam Backup for Microsoft Office 365,

It’s important to note that standalone instances and also those installed ontop of instances with Veeam Backup & Replication Update 4, which would be most VCSPs who are utilising the Self Service feature through Cloud Connect need to be updated. DO NOT install on those running Update 3 or 3a. You need to running at least 2.0.0.567 or 2.0.0.594 before installing this cumulative patch before updating.

Like the Update patch for VAC, this is a Cumulative Patch and also includes a number of important resolved issues relating to SharePoint and OneDrive, Exchange Online, restore operations and general server fixes. The full list can be found in the Resolved Issues section of the VeeamKB. For those with tenants that run the Explorers for Exchange or SharePoint seperate to an installation of Veeam Backup & Replication 9.5 or those running pre Update 4 versions, there are also upgrades for both contained in the patch release.

All set for Update 4!

With all that in place, VCSPs should be ready to deploy the RTM of Update 4 when it becomes available. Stay tuned for more information on that front. There is lots to love about Update 4 for Service Providers and customers alike!

 

2018 Year of Travel – A Few Interesting Stats

This year was my second full year working for Veeam and my role being global, requires me to travel to locations and events where my team presents content and engages with technical and social communities. We also travel to various Veeam related training and enablement events throughout the year as well as customer and partner meetings where and when required. This time around, I knew what to expect of a travel year and like 2017, I found this year to be just right in terms of time away working verses being at home working and also being with the family.

There where lots of highlights this year but the one that stands out was Michael Cade and myself presenting at VMworld for the second year in a row. The big difference this year was that we presented around the automating and orchestration of Veeam on VMware Cloud on AWS…to have the live demo work flawlessly after months of work was extremely satisfying. Other highlights include presenting at VeeamON and the regional VeeamOn Forums and Tours and two trips to Prague to visit our new R&D headquarters and be part of the Veeam Vanguard Summit for 2018.

So…what does all that travel look like?

Being homed in Perth, Western Australia I’m pretty much in the most isolated capital city in the world, meaning any flight is going to be significant. Even just flying to Sydney takes four to five hours…the same time it takes me to fly to Singapore. I love looking at stats and there are a number of tools out there that manage flight info. I use Tripit to keep track of all my tips, and there are now a number of sites and mobile application that let you import your flight data to analyse.

With that my raw stats for 2018 are shown below:

2017/2018
Trips 17/17
Days 104/102
Distance 262,769/291,866 km
Cities 24/20
Countries 9/10

Amazingly the numbers where very similar to 2017 however I covered a lot more kilo meters. 102 days away equates to 27.9% travel which is very manageable. Of those days I spent nearly 17 days total fly time in the air which when you think about it is amazing in it’s self. I took 68 flights with 27 domestic and 41 international.

I made it, 7.4x around the Earth, 0.77x to the moon and 0.00199 to the sun.

A new app I discovered this year was App In The Air. It’s the best i’ve used and provides some interesting stats and also helps compile the travel year video embedded above. The summary below gives me great insight into the travel year.

So that’s a quick round up of what my year looked like living the life of a Global Technologist at Veeam. Let’s see how 2019 shapes up!

 

AWS re:Invent 2018 – Veeam and N2WS Recap and Thoughts

There was so much to take away from AWS re:Invent last week. In my opinion, having attended a lot of industry events over the past ten or so years, this years re:Invent has left the industry with a lot to think about it! AWS vigorously defended their position as the number one Public Cloud destination (in their eyes) while trying to lay a path for future growth by expanding into the true enterprise space. Also, with the announcement of Outposts set a path to try and dominate the hybrid world with an on-premises offering.

Instead of writing down my extended thoughts it’s more consumable to hear Rick Vanover and myself talk about the event from a Veeam perspective in the short embedded video below. I’ve also embedded a video with David Hill and Sebastian Straub covering things from an N2WS perspective, as well as talk about the N2WS related announcements at re:Invent 2018.

I’ve also posted the Veeam session video here:

Veeam’s AWS re:Invent 2018 Session Posted

This week, myself and David Hill presented at AWS re:Invent 2018 around what at Veeam is offering by way of providing data protection and availability for native AWS workloads, VMware Cloud on AWS workloads and how we are leveraging AWS technologies to offer new features in the upcoming Update 4 release of Backup & Replication 9.5.

For those that where not at AWS re:Invent this week or for those who could not attend the session on Wednesday, the video recording has been posted on the offical AWS YouTube page.

We had some audio issues at the start which made for some interesting banter between David and myself…but once we got into it we talked about the following:

  • The N2WS 2.4 Release
  • Veeam VTL and AWS Storage Gateway
  • Update 4 Cloud Tier
  • Update 4 Cloud Mobility
  • Data Protection for VMware Cloud on AWS

I wanted to highlight the Cloud Tier section where I give an overview and quick deepdive into the smarts behind the new repository feature coming in Update 4. The live demo of me using our Patented Instant VM Recovery feature to bring up a VM with data residing in Amazon S3 is a great example of the power of this upcoming feature. Not only does it allow storage efficiencies locally but offloading old data to Object Storage for long term retention, but is also is intelligent enough to recover quickly and efficiently with its Intelligent Block Recovery.

« Older Entries