Is there a limit to exlusions?

Server
1

Hi,

I currently have quite a large list of excluded files/folders in my backups:

*.apache.log*;*/wp-content/cache/*;*/uploads/DELETE/*;*/uploads/*/DELETE/*;*/public_html/hosting/*;*/NOT_USED/*;*/node_modules_OLD/*;*/links/uploads/xlarge/*;*/links/uploads/small/*;*/links/uploads/mobi/*;*/links/uploads/medium/*;*/links/uploads/large/*;*/Gites/*;*/french/Detailed/*;*/french/*;*/espanol/Detailed/*;*/espanol/*;*/english/Detailed/*;*/english/*;*/Detailed/*;*/Chambres_D_Hotes/*;*/booking_images/*;*/admin/tmp/*;*/*-chambres-d-hotes/*;*/*-chambres-d-hote/*;*/*-chambre-d-hotes/*;*/*-chambre-d-hote/*;*.log;*.dat;*.compiled;*.bytes;*.bak;*.bytes;*.compiled;*.log;*.shtml;*/.sass-cache/*;*/2018.bak/*;*/bodywisegym.co.uk/*;*/home/specialnoise/mail/specialnoise.com/*;*/sess_*;*/templates/admin/help/*;*/tmp/*;*/websouq/*;*glinks_DomainsIgnoreList.sql.gz;*wp-content/cache/*;/home/*/mail/*/.Drafts/*;/home/*/mail/*/.Sent/*;/home/*/mail/*/.Trash/*;/home/*/peekio.com/public_html/*/index.html;/home/*/peekio.com/public_html/*/more*.html;/home/*/peekio.com/public_html/Arts/*;/home/*/peekio.com/public_html/Business/*;/home/*/peekio.com/public_html/Computers/*;/home/*/peekio.com/public_html/Cool/*;/home/*/peekio.com/public_html/Games/*;/home/*/peekio.com/public_html/Health/*;/home/*/peekio.com/public_html/Home/*;/home/*/peekio.com/public_html/Netscape/*;/home/*/peekio.com/public_html/New/*;/home/*/peekio.com/public_html/News/*;/home/*/peekio.com/public_html/Ratings/*;/home/*/peekio.com/public_html/Recreation/*;/home/*/peekio.com/public_html/Reference/*;/home/*/peekio.com/public_html/Regional/*;/home/*/peekio.com/public_html/Science/*;/home/*/peekio.com/public_html/Shopping/*;/home/*/peekio.com/public_html/Society/*;/home/*/peekio.com/public_html/Sports/*;/home/*/peekio.com/public_html/World/*;/home/*/web/*/private/*;/home/camera/*;/home/spider/web/crawler.pagething.com/public_html/websites-*/*/*.txt;*/ical-import-logs/*;*/static-maps/*;*/index.html;*/more*.html;*/clone_dbs/*;*/html_versions/*;ical-*.txt

I need to add all of these as well:

/India/
/Slovakia/
/2018-test/
/Heberg_ment_Gratuit/
/Madagascar/
/Ireland/
/Austria/
/Senegal/
/Latvia/
/rss/
/Turkey/
/Morocco/
/Norway/
/New_Zealand/
/Italy/
/South_Africa/
/Costa_Rica/
/USA/
/Belgium/
/Portugal/
/Australia/
/Argentina/
/Luxemburg/
/chambres-d-hotes/
/Croatia/
/Venezuela/
/Tunisie/
/Finland/
/Detailed/
/Ecuador/
/Canada/
/Hollande/
/Serbia/
/Albania/
/Lithuania/
/Sweden/
/Germany/
/Belarus/
/Bresil/
/Mauritius/
/Philippines/
/Iceland/
/Mexico/
/Poland/
/Reservations_en_ligne/
/Thailand/
/Switzerland/
/Israel/
/Belize/
/Hungary/
/2022/
/Greece/
/test-newer/
/Malta/
/Spain/
/Russia/
/Sri_Lanka/
/Great_Britain/
/Ukraine/
/Bulgaria/
/Romania/
/Czek/
/Slovenia/
/Peru/
/Google_Maps/
/Chine/
/Cambodia/
/Denmark/
/Estonia/
/Offers/
/Bosnia/
/Andorre/

So my questions:

  1. is there a limit to the number exclusions you can set?
  2. Is there a better way to write the rules? i.e could I do:

/(India|Slovakia|2018-test)/

instead of 3 different rules? Does it even make a difference?

Thanks!

Andy

1 Like
2

There is no limit. Might cause performance problems at some point :wink:

No, it is only basic glob syntax (plus : for everything except path separator).

I’d be more specific, i.e. */more*.html looks a bit to generic to me. But up to you, of course.

1 Like
3

Thanks. Thats a shame there isn’t more control on the exclusion rules - it would be nice if it has (even basic) regexes, like \d+ .

Unfortunatly with the more*.html its a bit tricky. We have pages like more2.html, all the way up to more123.html (for example), so its impossible to add all of those in as exclusions :frowning:

4

There is infinite control over exclusions, inslusions and everything else. Just write your own script to execute backup, where you can do anything you like. Schedule it properly and you will be delighted. I’ve done that for one of my “special needs” server and it works as I wanted it.

5

Thanks Robert. Do you have an example? What language is it in?