Some backups of the virtual machines fail

The backup is launched correctly but no backups of all the machines are made.
How can I see the log?
How can I trace the error?
Can you extend the trial while I get it fixed?

Thank you

If you’re running the backups in cron, here is how to set up the cron command to output to a log file:

./vertical cron "00 3 * * *" --email --subject '"Successful Backup"' --failure-subject '"Backup FAILED"' --threads 8 "&> /path/to/log/file"

I’ve extended your trial licenses by one more month.

Ok, i will try!
Thank you!!

Sorry, the backup continues to fail. The error says “Memory error”
This is the log:

2018-09-26 17:35:02.733830 INFO PROGRAM_VERSION Vertical Backup 1.2.0
2018-09-26 17:35:04.133764 INFO LICENSE_INFO Licensed to sistemas@xxxx.xxx; expires on 2018-10-17
2018-09-26 17:35:04.152570 INFO STORAGE_CREATE Storage set to /vmfs/volumes/NFSBackup/storageManolo2017/
2018-09-26 17:35:04.162775 INFO SNAPSHOT_GETALLVM Listing all virtual machines
2018-09-26 17:35:04.897054 INFO BACKUP_VM Backing up XXXXXBALLDATA, id: 16, vmx path: /vmfs/volumes/datastore2/XXXXXBALLDATA/XXXXXBALLDATA.vmx, guest os: windows8Server64Guest
2018-09-26 17:35:04.926770 INFO BACKUP_PREV Last backup at revision 11 found
2018-09-26 17:35:05.649702 INFO SNAPSHOT_POWER Virtual machine XXXXXBALLDATA is powered on
2018-09-26 17:35:05.649930 INFO SNAPSHOT_REMOVE Removing all snapshots of XXXXXBALLDATA
2018-09-26 17:35:07.377291 INFO SNAPSHOT_CREATE Creating a new virtual machine snapshot for XXXXXBALLDATA
2018-09-26 17:35:49.434527 INFO BACKUP_UPLOAD Uploaded file /vmfs/volumes/datastore2/XXXXXBALLDATA/disco1a.vmdk
2018-09-26 17:35:49.502089 INFO BACKUP_UPLOAD Uploaded file /vmfs/volumes/datastore2/XXXXXBALLDATA/disco3.vmdk
2018-09-26 17:35:49.504678 INFO BACKUP_UPLOAD Uploading file disco1a-flat.vmdk
2018-09-26 17:35:57.595305 INFO RESTORE_THREAD Using 8 uploading threads
2018-09-26 17:42:59.371746 INFO BACKUP_UPLOAD Uploaded file disco1a-flat.vmdk 148.10MB/s 00:07:01
2018-09-26 17:42:59.373358 INFO BACKUP_UPLOAD Uploading file disco3-flat.vmdk
2018-09-26 17:43:14.750364 INFO RESTORE_THREAD Using 8 uploading threads
2018-09-26 19:00:25.629673 INFO BACKUP_UPLOAD Uploaded file disco3-flat.vmdk 207.86MB/s 01:17:10
2018-09-26 19:00:25.732661 INFO BACKUP_UPLOAD Uploaded file XXXXXBALLDATA.vmx
2018-09-26 19:00:25.760501 INFO BACKUP_UPLOAD Uploaded file XXXXXBALLDATA.vmxf
2018-09-26 19:00:37.061544 INFO BACKUP_DONE Backup XXXXXBALLDATA@esxi55 at revision 12 has been successfully completed
2018-09-26 19:00:37.061705 INFO BACKUP_STATS Total 1025104 chunks, 1025098.30M bytes; 27582 new, 27579.00M bytes, 16344.08M uploaded
2018-09-26 19:00:37.061792 INFO BACKUP_TIME Total backup time: 01:24:48
2018-09-26 19:00:37.217565 INFO SNAPSHOT_REMOVE Removing all snapshots of XXXXXBALLDATA
2018-09-26 19:00:45.883680 INFO BACKUP_VM Backing up XXXXXXXXXX-quimica01, id: 17, vmx path: /vmfs/volumes/datastore2/XXXXXXXXXX-quimica01/XXXXXXXXXX-quimica01.vmx, guest os: centos64Guest
2018-09-26 19:00:45.919034 INFO BACKUP_PREV Last backup at revision 11 found
2018-09-26 19:00:46.608972 INFO SNAPSHOT_POWER Virtual machine XXXXXXXXXX-quimica01 is powered on
2018-09-26 19:00:46.609221 INFO SNAPSHOT_REMOVE Removing all snapshots of XXXXXXXXXX-quimica01
2018-09-26 19:00:48.331816 INFO SNAPSHOT_CREATE Creating a new virtual machine snapshot for XXXXXXXXXX-quimica01
2018-09-26 19:00:53.530548 INFO BACKUP_UPLOAD Uploaded file /vmfs/volumes/datastore2/XXXXXXXXXX-quimica01/XXXXXXXXXX-quimica01.vmdk
2018-09-26 19:00:53.532804 INFO BACKUP_UPLOAD Uploading file XXXXXXXXXX-quimica01-flat.vmdk
2018-09-26 19:00:54.530054 INFO RESTORE_THREAD Using 8 uploading threads
2018-09-26 19:02:39.239243 INFO BACKUP_UPLOAD Uploaded file XXXXXXXXXX-quimica01-flat.vmdk 488.97MB/s 00:01:44
2018-09-26 19:02:39.262870 INFO BACKUP_UPLOAD Uploaded file XXXXXXXXXX-quimica01.vmx
2018-09-26 19:02:39.291092 INFO BACKUP_UPLOAD Uploaded file XXXXXXXXXX-quimica01.vmxf
2018-09-26 19:02:41.774054 INFO BACKUP_DONE Backup XXXXXXXXXX-quimica01@esxi55 at revision 12 has been successfully completed
2018-09-26 19:02:41.774196 INFO BACKUP_STATS Total 51209 chunks, 51203.72M bytes; 559 new, 556.27M bytes, 188.42M uploaded
2018-09-26 19:02:41.774280 INFO BACKUP_TIME Total backup time: 00:01:48
2018-09-26 19:02:41.777842 INFO SNAPSHOT_REMOVE Removing all snapshots of XXXXXXXXXX-quimica01
2018-09-26 19:02:43.299283 INFO BACKUP_VM Backing up XXXXXA01, id: 20, vmx path: /vmfs/volumes/datastore2/XXXXXA01/XXXXXA01.vmx, guest os: centos64Guest
2018-09-26 19:02:43.316623 INFO BACKUP_PREV Last backup at revision 11 found
2018-09-26 19:02:44.041481 INFO SNAPSHOT_POWER Virtual machine XXXXXA01 is powered on
2018-09-26 19:02:44.041707 INFO SNAPSHOT_REMOVE Removing all snapshots of XXXXXA01
2018-09-26 19:02:45.860195 INFO SNAPSHOT_CREATE Creating a new virtual machine snapshot for XXXXXA01
2018-09-26 19:02:51.120721 INFO BACKUP_UPLOAD Uploaded file /vmfs/volumes/datastore2/XXXXXA01/XXXXXA01.vmdk
2018-09-26 19:02:51.125421 INFO BACKUP_UPLOAD Uploading file XXXXXA01-flat.vmdk
2018-09-26 19:02:51.443454 INFO RESTORE_THREAD Using 8 uploading threads
2018-09-26 19:03:34.870515 INFO BACKUP_UPLOAD Uploaded file XXXXXA01-flat.vmdk 235.80MB/s 00:00:43
2018-09-26 19:03:34.902546 INFO BACKUP_UPLOAD Uploaded file XXXXXA01.vmx
2018-09-26 19:03:34.953223 INFO BACKUP_UPLOAD Uploaded file XXXXXA01.vmxf
2018-09-26 19:03:36.114973 INFO BACKUP_DONE Backup XXXXXA01@esxi55 at revision 12 has been successfully completed
2018-09-26 19:03:36.115115 INFO BACKUP_STATS Total 10246 chunks, 10240.75M bytes; 566 new, 563.66M bytes, 177.59M uploaded
2018-09-26 19:03:36.115199 INFO BACKUP_TIME Total backup time: 00:00:45
2018-09-26 19:03:36.115978 INFO SNAPSHOT_REMOVE Removing all snapshots of XXXXXA01
2018-09-26 19:03:37.652156 INFO BACKUP_VM Backing up NAS01, id: 21, vmx path: /vmfs/volumes/datastore2/NAS01/NAS01.vmx, guest os: centos64Guest
2018-09-26 19:03:37.670544 INFO BACKUP_PREV Last backup at revision 10 found
2018-09-26 19:03:38.380511 INFO SNAPSHOT_POWER Virtual machine NAS01 is powered on
2018-09-26 19:03:38.380728 INFO SNAPSHOT_REMOVE Removing all snapshots of NAS01
2018-09-26 19:03:40.150227 INFO SNAPSHOT_CREATE Creating a new virtual machine snapshot for NAS01
2018-09-26 19:03:45.833801 INFO BACKUP_UPLOAD Uploaded file /vmfs/volumes/datastore2/NAS01/NAS01.vmdk
2018-09-26 19:03:45.844118 INFO BACKUP_UPLOAD Uploaded file /vmfs/volumes/datastore2/NAS01/NAS01_1.vmdk
2018-09-26 19:03:45.846152 INFO BACKUP_UPLOAD Uploading file NAS01_1-flat.vmdk
2018-09-26 19:04:01.751632 INFO RESTORE_THREAD Using 8 uploading threads
2018-09-26 20:41:18.858793 INFO BACKUP_UPLOAD Uploaded file NAS01_1-flat.vmdk 179.64MB/s 01:37:17
2018-09-26 20:41:18.883835 INFO BACKUP_UPLOAD Uploading file NAS01-flat.vmdk
2018-09-26 20:41:26.628756 INFO RESTORE_THREAD Using 8 uploading threads
2018-09-26 20:42:42.022092 INFO BACKUP_UPLOAD Uploaded file NAS01-flat.vmdk 434.63MB/s 00:01:15
2018-09-26 20:42:42.121986 INFO BACKUP_UPLOAD Uploaded file NAS01.vmx
2018-09-26 20:42:42.144519 INFO BACKUP_UPLOAD Uploaded file NAS01.vmxf
2018-09-26 20:43:06.930612 INFO BACKUP_DONE Backup NAS01@esxi55 at revision 11 has been successfully completed
2018-09-26 20:43:06.930802 INFO BACKUP_STATS Total 1081429 chunks, 1081422.38M bytes; 22511 new, 22508.00M bytes, 16409.06M uploaded
2018-09-26 20:43:06.930891 INFO BACKUP_TIME Total backup time: 01:39:21
2018-09-26 20:43:07.015001 INFO SNAPSHOT_REMOVE Removing all snapshots of NAS01
2018-09-26 20:43:30.910308 INFO BACKUP_VM Backing up XXXXXTIC01, id: 25, vmx path: /vmfs/volumes/datastore3/XXXXXTIC01/XXXXXTIC01.vmx, guest os: windows8Server64Guest
2018-09-26 20:43:30.928529 INFO BACKUP_LISTING No previous backup found. Listing existing chunks
2018-09-26 21:09:09.027399 INFO COMMAND_FAILURE Failed to run command ‘/bin/vim-cmd vmsvc/power.getstate 25’: MemoryError()
2018-09-26 21:09:09.027641 ERROR COMMAND_FAILURE Failed to run command ‘/bin/vim-cmd vmsvc/power.getstate 25’: MemoryError()

The --no-chunk-listing option should help:

./vertical backup --no-chunk-listing vmname 

Usually Vertical Backup will try to load the list of all chunks in the storage into memory for the first backup of a virtual machine. This list may be too large to fit into the memory so the --no-chunk-listing option will skip this step. Once the initial backup is done, this option won’t be needed, because subsequent backups will only load the list of chunks in the last backup into memory.

Ok. I see this error at console with --no-chunk-listing option:

/vmfs/volumes/4dc2032e-c8a149fa-1119-d4856444cd6e/verticalbackup # ./vertical backup --no-chunk-listing XXXXXTIC01
Vertical Backup 1.2.0
Licensed to sistemas@nubecao.com; expires on 2018-10-17
Storage set to /vmfs/volumes/NFSBackup/storageManolo2017/
Listing all virtual machines
Backing up XXXXXTIC01, id: 25, vmx path: /vmfs/volumes/datastore3/XXXXXTIC01/XXXXXTIC01.vmx, guest os: windows8Server64Guest
No previous backup found
Virtual machine XXXXXTIC01 is powered on
Removing all snapshots of XXXXXTIC01
Creating a new virtual machine snapshot for XXXXXTIC01
Failed to read file ‘/vmfs/volumes/datastore3/XXXXXTIC01/XXXXXTIC01_2.vmdk’: No such file or directory
Backup can’t proceed when there is no snapshot and an attempt to create a new one failed
Removing all snapshots of XXXXXTIC01

But in the vmx file the is disabled (I have deleted this disk)

XXXXXTIC01.vmx

scsi1.pciSlotNumber = “224”
scsi1.virtualDev = “lsisas1068”
scsi1.present = “TRUE”
scsi1:0.deviceType = “scsi-hardDisk”
scsi1:0.fileName = “XXXXXTIC01_2.vmdk”
sched.scsi1:0.vFlash.enabled = “FALSE”
scsi1:0.present = “FALSE”
scsi1:0.redo = “”

Vertical Backup doesn’t parse the line that disables the disk, but you can exclude that disk with the --exclude-disk option:

./vertical backup --no-chunk-listing --exclude-disk "*XXXXXTIC01_2.vmdk" vmname 

I had this same issue. Before I found this thread, I powered down the VM. Edited the .vmx file and removed the disabled references to the removed vmdk which in my case was at the end of the file prefixed with scsi0:2, saved the new vmx file, powered up the VM and the error went away without updating my backup script.