lftp reverse mirror silently skips files in subfoldersHow to use rsync over FTPlftp not removing remote files for meWhat's a simple app to mirror a folder of files (windows) to a remote server (linux)?How do I mirror a folder (copy only missing and changed files recursively) in windows?Best way to mirror files to an external hard drive?Mirror productive files on a local virtual machineSync/mirror directory with Rackspace Cloud files bucketMirror directory, only purging files in destination directory older than 7 dayslftp mirror leaves empty folders on remotelftp mirror files from a directory tree into single directoryrecursively download multiple directories with wildcards via lftp
Public transport tickets in UK for two weeks
Why would a rational buyer offer to buy with no conditions precedent?
I know that there is a preselected candidate for a position to be filled at my department. What should I do?
What weight should be given to writers groups critiques?
Why did the person in charge of a principality not just declare themself king?
What did the 'turbo' button actually do?
Is there any relationship between frequency of signal and distance it travels?
How did NASA Langley end up with the first 737?
便利な工具 what does な means
Must a warlock replace spells with new spells of exactly their Pact Magic spell slot level?
Need to read my home electrical Meter
Popcorn is the only acceptable snack to consume while watching a movie
Mercedes C180 (W204) dash symbol
What are the conditions for RAA?
How to patch glass cuts in a bicycle tire?
What was the idiom for something that we take without a doubt?
Are black holes spherical during merger?
Is superuser the same as root?
Is it legal to meet with potential future employers in the UK, whilst visiting from the USA
Make 24 using exactly three 3s
How to melt snow without fire or body heat?
Why do Russians almost not use verbs of possession akin to "have"?
Why does the hash of infinity have the digits of π?
How can I tell if I'm being too picky as a referee?
lftp reverse mirror silently skips files in subfolders
How to use rsync over FTPlftp not removing remote files for meWhat's a simple app to mirror a folder of files (windows) to a remote server (linux)?How do I mirror a folder (copy only missing and changed files recursively) in windows?Best way to mirror files to an external hard drive?Mirror productive files on a local virtual machineSync/mirror directory with Rackspace Cloud files bucketMirror directory, only purging files in destination directory older than 7 dayslftp mirror leaves empty folders on remotelftp mirror files from a directory tree into single directoryrecursively download multiple directories with wildcards via lftp
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I'm using lftp to push content to an ftp-only web-server. It worked to upload the files recursively at first, and even incrementally.
Any idea why this would skip files changed in a subfolder, but not skip files changed in the home directory?
Details:
I'm using the reverse mirror mode, which pushes local data up to the server instead of downloading it from the server. Throughout the web, this is the recommended option for recursive upgrade.
Here's the full script (from this answer)
#!/bin/bash
HOST="..."
USER="..."
PASS="..."
FTPURL="ftp://$USER:$PASS@$HOST"
LCD="/local/directory"
#RCD=""
#RCDCMD=cd $RCD;
#DELETE="--delete"
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
The related question, was solved by permission issues, which is not an issue in this case. Everything is "rwxr-xr-x" on the server.
Further Testing:
The lftp seems to work intermittently. For example, I will run the command twice, and it skips the changes, then the third time it works, correctly copying the changed files up to the server.
mirroring mirror recursive
edited Apr 13 '17 at 12:14
Community♦
1
asked Dec 11 '15 at 15:30
Josiah YoderJosiah Yoder
1064
|
show 1 more comment
I'm using lftp to push content to an ftp-only web-server. It worked to upload the files recursively at first, and even incrementally.
Any idea why this would skip files changed in a subfolder, but not skip files changed in the home directory?
Details:
I'm using the reverse mirror mode, which pushes local data up to the server instead of downloading it from the server. Throughout the web, this is the recommended option for recursive upgrade.
Here's the full script (from this answer)
#!/bin/bash
HOST="..."
USER="..."
PASS="..."
FTPURL="ftp://$USER:$PASS@$HOST"
LCD="/local/directory"
#RCD=""
#RCDCMD=cd $RCD;
#DELETE="--delete"
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
The related question, was solved by permission issues, which is not an issue in this case. Everything is "rwxr-xr-x" on the server.
Further Testing:
The lftp seems to work intermittently. For example, I will run the command twice, and it skips the changes, then the third time it works, correctly copying the changed files up to the server.
mirroring mirror recursive
edited Apr 13 '17 at 12:14
Community♦
1
asked Dec 11 '15 at 15:30
Josiah YoderJosiah Yoder
1064
doesls -Rwork on the remote server?
– mc0e
Dec 11 '15 at 16:13
I do not have SSH login on this server. Are you referring to an ftp command?
– Josiah Yoder
Dec 12 '15 at 22:01
Please do not downvote this question without providing feedback about what is wrong with it. I believe the question is well-researched, and likely a common problem for those who must use lftp instead of rsync because, like me, they don't have ssh access to a website.
– Josiah Yoder
Dec 12 '15 at 22:02
ls -Rgets a mention in the lftp man page. I presume it's an lftp command.
– mc0e
Dec 13 '15 at 1:44
Yes, lftp'sls -Rcommand works. On the other hand, files in recursive directories are also being correctly copied now too. Looks like I need to do some more testing on when the bug occurs and when it doesn't.
– Josiah Yoder
Dec 16 '15 at 22:32
|
show 1 more comment
I'm using lftp to push content to an ftp-only web-server. It worked to upload the files recursively at first, and even incrementally.
Any idea why this would skip files changed in a subfolder, but not skip files changed in the home directory?
Details:
I'm using the reverse mirror mode, which pushes local data up to the server instead of downloading it from the server. Throughout the web, this is the recommended option for recursive upgrade.
Here's the full script (from this answer)
#!/bin/bash
HOST="..."
USER="..."
PASS="..."
FTPURL="ftp://$USER:$PASS@$HOST"
LCD="/local/directory"
#RCD=""
#RCDCMD=cd $RCD;
#DELETE="--delete"
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
The related question, was solved by permission issues, which is not an issue in this case. Everything is "rwxr-xr-x" on the server.
Further Testing:
The lftp seems to work intermittently. For example, I will run the command twice, and it skips the changes, then the third time it works, correctly copying the changed files up to the server.
mirroring mirror recursive
edited Apr 13 '17 at 12:14
Community♦
1
asked Dec 11 '15 at 15:30
Josiah YoderJosiah Yoder
1064
I'm using lftp to push content to an ftp-only web-server. It worked to upload the files recursively at first, and even incrementally.
Any idea why this would skip files changed in a subfolder, but not skip files changed in the home directory?
Details:
I'm using the reverse mirror mode, which pushes local data up to the server instead of downloading it from the server. Throughout the web, this is the recommended option for recursive upgrade.
Here's the full script (from this answer)
#!/bin/bash
HOST="..."
USER="..."
PASS="..."
FTPURL="ftp://$USER:$PASS@$HOST"
LCD="/local/directory"
#RCD=""
#RCDCMD=cd $RCD;
#DELETE="--delete"
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
The related question, was solved by permission issues, which is not an issue in this case. Everything is "rwxr-xr-x" on the server.
Further Testing:
The lftp seems to work intermittently. For example, I will run the command twice, and it skips the changes, then the third time it works, correctly copying the changed files up to the server.
mirroring mirror recursive
mirroring mirror recursive
edited Apr 13 '17 at 12:14
Community♦
1
asked Dec 11 '15 at 15:30
Josiah YoderJosiah Yoder
1064
edited Apr 13 '17 at 12:14
Community♦
1
asked Dec 11 '15 at 15:30
Josiah YoderJosiah Yoder
1064
edited Apr 13 '17 at 12:14
Community♦
1
edited Apr 13 '17 at 12:14
Community♦
1
edited Apr 13 '17 at 12:14
Community♦
1
1
asked Dec 11 '15 at 15:30
Josiah YoderJosiah Yoder
1064
asked Dec 11 '15 at 15:30
Josiah YoderJosiah Yoder
1064
asked Dec 11 '15 at 15:30
Josiah YoderJosiah Yoder
1064
1064
doesls -Rwork on the remote server?
– mc0e
Dec 11 '15 at 16:13
I do not have SSH login on this server. Are you referring to an ftp command?
– Josiah Yoder
Dec 12 '15 at 22:01
Please do not downvote this question without providing feedback about what is wrong with it. I believe the question is well-researched, and likely a common problem for those who must use lftp instead of rsync because, like me, they don't have ssh access to a website.
– Josiah Yoder
Dec 12 '15 at 22:02
ls -Rgets a mention in the lftp man page. I presume it's an lftp command.
– mc0e
Dec 13 '15 at 1:44
Yes, lftp'sls -Rcommand works. On the other hand, files in recursive directories are also being correctly copied now too. Looks like I need to do some more testing on when the bug occurs and when it doesn't.
– Josiah Yoder
Dec 16 '15 at 22:32
|
show 1 more comment
doesls -Rwork on the remote server?
– mc0e
Dec 11 '15 at 16:13
I do not have SSH login on this server. Are you referring to an ftp command?
– Josiah Yoder
Dec 12 '15 at 22:01
Please do not downvote this question without providing feedback about what is wrong with it. I believe the question is well-researched, and likely a common problem for those who must use lftp instead of rsync because, like me, they don't have ssh access to a website.
– Josiah Yoder
Dec 12 '15 at 22:02
ls -Rgets a mention in the lftp man page. I presume it's an lftp command.
– mc0e
Dec 13 '15 at 1:44
Yes, lftp'sls -Rcommand works. On the other hand, files in recursive directories are also being correctly copied now too. Looks like I need to do some more testing on when the bug occurs and when it doesn't.
– Josiah Yoder
Dec 16 '15 at 22:32
does
ls -R work on the remote server?– mc0e
Dec 11 '15 at 16:13
does
ls -R work on the remote server?– mc0e
Dec 11 '15 at 16:13
I do not have SSH login on this server. Are you referring to an ftp command?
– Josiah Yoder
Dec 12 '15 at 22:01
I do not have SSH login on this server. Are you referring to an ftp command?
– Josiah Yoder
Dec 12 '15 at 22:01
Please do not downvote this question without providing feedback about what is wrong with it. I believe the question is well-researched, and likely a common problem for those who must use lftp instead of rsync because, like me, they don't have ssh access to a website.
– Josiah Yoder
Dec 12 '15 at 22:02
Please do not downvote this question without providing feedback about what is wrong with it. I believe the question is well-researched, and likely a common problem for those who must use lftp instead of rsync because, like me, they don't have ssh access to a website.
– Josiah Yoder
Dec 12 '15 at 22:02
ls -R gets a mention in the lftp man page. I presume it's an lftp command.– mc0e
Dec 13 '15 at 1:44
ls -R gets a mention in the lftp man page. I presume it's an lftp command.– mc0e
Dec 13 '15 at 1:44
Yes, lftp's
ls -R command works. On the other hand, files in recursive directories are also being correctly copied now too. Looks like I need to do some more testing on when the bug occurs and when it doesn't.– Josiah Yoder
Dec 16 '15 at 22:32
Yes, lftp's
ls -R command works. On the other hand, files in recursive directories are also being correctly copied now too. Looks like I need to do some more testing on when the bug occurs and when it doesn't.– Josiah Yoder
Dec 16 '15 at 22:32
|
show 1 more comment
1 Answer
1
active
oldest
votes
Within the lftp command, run an ls -R before the mirror.
# Set variables as in the question
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
ls -R; # This is the key line!
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
I'm going to continue testing, but this has worked every time I've tested it so far...
answered Jan 4 '16 at 19:06
Josiah YoderJosiah Yoder
1064
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f742459%2flftp-reverse-mirror-silently-skips-files-in-subfolders%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Within the lftp command, run an ls -R before the mirror.
# Set variables as in the question
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
ls -R; # This is the key line!
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
I'm going to continue testing, but this has worked every time I've tested it so far...
answered Jan 4 '16 at 19:06
Josiah YoderJosiah Yoder
1064
add a comment |
Within the lftp command, run an ls -R before the mirror.
# Set variables as in the question
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
ls -R; # This is the key line!
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
I'm going to continue testing, but this has worked every time I've tested it so far...
answered Jan 4 '16 at 19:06
Josiah YoderJosiah Yoder
1064
add a comment |
Within the lftp command, run an ls -R before the mirror.
# Set variables as in the question
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
ls -R; # This is the key line!
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
I'm going to continue testing, but this has worked every time I've tested it so far...
answered Jan 4 '16 at 19:06
Josiah YoderJosiah Yoder
1064
Within the lftp command, run an ls -R before the mirror.
# Set variables as in the question
lftp -c "set ftp:ssl-allow no;
set ftp:list-options -a;
open '$FTPURL';
lcd $LCD;
ls -R; # This is the key line!
$RCDCMD
mirror --reverse
$DELETE
--verbose
--exclude-glob .*swp
--exclude-glob .*swn
--exclude-glob .*swo"
I'm going to continue testing, but this has worked every time I've tested it so far...
answered Jan 4 '16 at 19:06
Josiah YoderJosiah Yoder
1064
answered Jan 4 '16 at 19:06
Josiah YoderJosiah Yoder
1064
answered Jan 4 '16 at 19:06
Josiah YoderJosiah Yoder
1064
answered Jan 4 '16 at 19:06
Josiah YoderJosiah Yoder
1064
1064
add a comment |
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f742459%2flftp-reverse-mirror-silently-skips-files-in-subfolders%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
does
ls -Rwork on the remote server?– mc0e
Dec 11 '15 at 16:13
I do not have SSH login on this server. Are you referring to an ftp command?
– Josiah Yoder
Dec 12 '15 at 22:01
Please do not downvote this question without providing feedback about what is wrong with it. I believe the question is well-researched, and likely a common problem for those who must use lftp instead of rsync because, like me, they don't have ssh access to a website.
– Josiah Yoder
Dec 12 '15 at 22:02
ls -Rgets a mention in the lftp man page. I presume it's an lftp command.– mc0e
Dec 13 '15 at 1:44
Yes, lftp's
ls -Rcommand works. On the other hand, files in recursive directories are also being correctly copied now too. Looks like I need to do some more testing on when the bug occurs and when it doesn't.– Josiah Yoder
Dec 16 '15 at 22:32