Backup forum

A place to discuss Backup software and online services

You are not signed in.

Announcement

Signed in and can't post? Click here!Hot Tags: account Android Archive cleanup Code42 CrashPlan Backup bug bugs cleanup CcrPU Delete desktop error fail failed failure feature request idevsutil iDrive community incremental internet issue linux log login mac Mobile password performance progress QNAP REST restore Security slow speed suggestions support sync Synology upgrade upload windows backblaze carbonite SugarSync Dropbox Veeam Memopal Netgear Asustor Pro Softnet Corporation Raghu Kulkarni

#1 2022-03-12 06:16:37

TroyBayliss
Member
Registered: 2022-03-11
Posts: 27

Not all files being backed up

Hi there

I have just started using IDrive to Cloud backup a laptop's data.

On the laptop I have created a D partition within which I save user data, and from which I have IDrive configured to backup from.

When I ran the backup, and then ran it again, IDrive reports that there are 9,522 files. I cross-checked that figure with Tree Size Free which reported that the D partition hold at those times held 9,692 files.

Is there a way that I am able to reconfigure IDrive such that it saves all files in the partition it is pointed to?; in other do what it is tasked to do rather than only partially do what it is tasked to do.

Appreciate all the wisdom and assistance Steve and other members are able to share with me.  And appreciate your patience with me as a newby -- I am probably staring a simple setting in the face that I have not enabled, which may solve the problem.

I did attempt to self-help via the IDrive website, though was surprised -- I could not find a key word search at the FAQ page, so chose at this stage not to read / skim through everything there to maybe discover problem solution.

Regards

Offline

 

#2 2022-03-12 12:20:05

SteveA
Administrator
Registered: 2018-02-23
Posts: 405
Website

Re: Not all files being backed up

Does the backup session log show which files were skipped?

Do the filenames of any skipped files match any patterns in Settings - Exclude files / folders from backup?

Also have a look in "Tracefile.txt":

You can find it in:

C:\ProgramData\IDrive\IBCOMMON\-profile- (-profile- is your backup profile name)

Offline

 

#3 2022-03-14 08:38:45

TroyBayliss
Member
Registered: 2022-03-11
Posts: 27

Re: Not all files being backed up

Hi Steve

Backup session log does not list files not backed up per se.

Re exclusion set, I have 'Files / folders with full path Names' selected, and then have all primary folder-path presented options ticked -- all of those options are C partition related.  I am backing up D partition folders / files, so in that way, there should be no exclusions applying to my selected backup.

Re 'Tracefile.txt' -- I had a look at it though did not see any particular folder / files / paths etc listed for exclusion or error in backing up. However, I may have missed something otherwise obvious to a more experienced person. I am happy to paste relevant part of the txt file, for more specialist review - just let me know. If posting that information though, I will redact email address and profile name information from the pasted content.

Very open to your further suggestions / assistance.

Regards

Offline

 

#4 2022-03-14 08:43:23

SteveA
Administrator
Registered: 2018-02-23
Posts: 405
Website

Re: Not all files being backed up

Yes, post an excerpt here (redacted for privacy).

Offline

 

#5 2022-03-14 09:39:57

TroyBayliss
Member
Registered: 2022-03-11
Posts: 27

Re: Not all files being backed up

Hi Steve

The file excerpt will be very long indeed. 

On further review I note that quite a few lines in the file, although fairly generic references, may be a clue, and as an interim step at least, seeking your feedback on my finding -- these lines are identical and read as follows:
'Error in CreateThumbnail. Reason: The specified path, file name, or both are too long. The fully qualified file name must be less than 260 characters, and the directory name must be less than 248 characters.'

So it seems, that a bunch of 'unamed' files are exceeding allowed file path. Your thoughts most welcome.

If my conclusion is correct, is there an app / program you recommend I use, which is user friendly, for someone inexperienced like me to use, to list those files and their paths so I can address the issue, so will then backup successfully to IDrive?

Regards
John

Offline

 

#6 2022-03-14 12:44:23

TroyBayliss
Member
Registered: 2022-03-11
Posts: 27

Re: Not all files being backed up

Hi Steve

I have downloaded and run 'Path Length Checker' from MAJOR GEEKS, and now have a spread sheet I can sort by path length.

There are quite a few files / paths that exceed 260 characters.  -- I am sorting a decent proportion of these down to <= 230 characters. Another lot I will look at resolving in a subsequent review.

With the first lot sorted, I am running IDrive backup to see what the results are this time.

Regards

Offline

 

#7 2022-03-14 14:36:47

SteveA
Administrator
Registered: 2018-02-23
Posts: 405
Website

Re: Not all files being backed up

Glad you found something - I was going to knock up a script to do something like that!

Offline

 

#8 2022-03-14 16:09:54

SteveA
Administrator
Registered: 2018-02-23
Posts: 405
Website

Re: Not all files being backed up

Its academic now, but here's a Windows Batch file that will find path lengths greater than X:

Code:

@echo off
setlocal enabledelayedexpansion
set /A MaxLen=%1
for /f "tokens=*" %%a in ('dir /b /s /a:-D') do (
  set String=%%a
  set /A Length=0
  for /L %%b in (1,1,1000) do ( if "!String:~%%b!"=="" if !length!==0 set /A length=%%b )
  if !length! GTR !MaxLen! echo !String!
)
setlocal

Save it to something like CheckPathLength.cmd and run from a CMD prompt in the folder you want to check. Supply an argument of the max path length (eg 260) and it will list any paths exceeding this value.

Unfortunately its a bit slow, so if you run it on the root of a drive it could take a while! Suggest piping the output to a file.

For example:

D:\>CheckPathLength 260 >LongFilePaths.txt

then go and get a coffee wink

Offline

 

#9 2022-03-15 06:23:59

TroyBayliss
Member
Registered: 2022-03-11
Posts: 27

Re: Not all files being backed up

Many thanks Steve

Running a batch file is new for me -- nice opportunity to learn that as well.

I am not certain the problem is fully resolved, however is definitely much improved.

I have some other pressing commitments though over the net week or so -- likely I will clarify some more related things in a week or so.  Are you ok with the case remaining open in the interim?

Regards

Offline

 

#10 2022-03-15 08:17:01

SteveA
Administrator
Registered: 2018-02-23
Posts: 405
Website

Re: Not all files being backed up

Whenever you're ready.

Offline

 

#11 2022-03-26 07:40:03

TroyBayliss
Member
Registered: 2022-03-11
Posts: 27

Re: Not all files being backed up

Hi Steve

Am back.

Is the following text at the bottom of Activity Log summary, included no matter what occurred at a particular backup:
[Some of the files / folders you have chosen may have been excluded from backup. This means that the backup of these particular files / folders will not take place. View the list of excluded files / folders from the Settings tab.]

I note the use of the word 'may' in the above tet, which is not categorical; just inferring that could be though not certain is the case.

Regards
John

Offline

 

#12 2022-03-26 19:56:17

SteveA
Administrator
Registered: 2018-02-23
Posts: 405
Website

Re: Not all files being backed up

I don't know for sure, but I suspect its included at all times, like a disclaimer.

Offline

 

#13 2022-04-01 13:34:30

TroyBayliss
Member
Registered: 2022-03-11
Posts: 27

Re: Not all files being backed up

Hi Steve

What do recommend is a fail-safe way for me to cross-check that IDrive is backing up all files in pre-set backup path?

Offline

 

#14 2022-04-01 14:14:49

SteveA
Administrator
Registered: 2018-02-23
Posts: 405
Website

Re: Not all files being backed up

In the IDrive Windows client, in the Restore section, you can right-click a folder and select "Get folder size".

Hopefully the results will tally with what Windows reports.

Offline

 

#15 2022-04-01 23:33:16

TroyBayliss
Member
Registered: 2022-03-11
Posts: 27

Re: Not all files being backed up

Hi Steve

Many thanks for heads-up.  I am new to IDrive and learning as I go.

I did the 'Get folder size' action on the drive I backup on my main computer, and returned 216.91GB and a file count of 15604.

When I navigated to the same drive within 'File explorer', and selected 'Properties', used space was presented as 153GB -- also noting that 'Compress this drive to save disk space' is unticked.


I am very open to any ideas on which method to further use to compare to find a match with the data that IDrive is presenting?

Regards

Offline

 

Board footer

Protect your brand, users & email deliverability. Let’s Encrypt- free, automated, and open certificate authority (CA) StatusCake Monitoring Service Stop Forum Spam

Powered by © Copyright 2002–2005 Rickard Andersson
SteveA's forums are free for everyone to use, however if you would like to contribute to the upkeep I would be grateful for any donation!