How to speed up FTP backup of MD?

asdf · May 13, 2024 at 6:53 PM

I wrote a simple batch file to take backups of a multi robot cell thru FTP, inspired by https://www.onerobotics.com/posts/2013/usi…e-productivity/

It works great however it takes about 30min to pull a backup from all 6 robots in this cell. Is there any simple way to speed this up or things to look for that could be slowing it down?

Batch File goes like this, repeated for each robot:

open #IPAddr
anon
prompt
bin
lcd U:\_RobBackups\Station_1
mget *.*
quit

Thanks!

hermann · May 13, 2024 at 8:15 PM

Handle all robots parallel, or at least 3 and 3.

ssaul · May 13, 2024 at 8:41 PM

actualmente uso un programa de cuesta 10 dolares se llama ERBU ( https://www.robotbackerupper.com/ ) mi celda con mas de 20 y realiza el respaldo aproximadante en 5 minutos

Beek · May 13, 2024 at 9:30 PM

Why not just use the onerobotics backuptool? I'm backing up about 30 robots in less than 2min.

asdf · May 15, 2024 at 3:27 PM

I tried the BackupTool from One Robotics . Didn't show any error messages, the file structure of the generated backup looks correct but there are no actual files from the robots.

Any one using this tool have a similar issue?

Here is what was printed in terminal after the backup:

Code

2024/05/14 19:08:41 Backing up project...
2024/05/14 19:08:41 Backing up Stn_7 at 192.168.1.17
2024/05/14 19:08:41 Backing up Stn_2 at 192.168.1.12
2024/05/14 19:08:41 Backing up Stn_5 at 192.168.1.15
2024/05/14 19:08:41 Backing up Stn_3 at 192.168.1.13
2024/05/14 19:08:41 Backing up Stn_6 at 192.168.1.16
2024/05/14 19:08:41 Backing up Stn_1 at 192.168.1.11
2024/05/14 19:08:42 Finished backing up Stn_6 in 989.4589ms
2024/05/14 19:08:43 Finished backing up Stn_2 in 1.1966157s
2024/05/14 19:08:43 Finished backing up Stn_5 in 1.2025263s
2024/05/14 19:08:43 Finished backing up Stn_1 in 1.2135842s
2024/05/14 19:08:43 Finished backing up Stn_3 in 1.4684226s
2024/05/14 19:08:44 Finished backing up Stn_7 in 2.2063012s
2024/05/14 19:08:44 Backed up all robots in 2.2114668s

Display More

Thanks!

cattmampbell · May 20, 2024 at 4:13 PM

Quote from asdf

I tried the BackupTool from One Robotics . Didn't show any error messages, the file structure of the generated backup looks correct but there are no actual files from the robots.
Any one using this tool have a similar issue?

I have been using backuptool on a daily basis since 2018 with R-30iA, R-30iB, and R-30iB+ robot controllers. The main issue that I have experienced is when the TCP/IP connection to one (or more) robots is intermittent (or nonexistent) while backuptool is running — causing backuptool to exit with an error — effectively stopping backuptool for all robots (regardless if the TCP/IP connection is intermittent or not) — resulting in one or more robots with incomplete backups.

I've come up with a workaround and haven't run into this issue since implementing it. I have included an example below:

C:\backuptool\backup_tool.csv

Code: C:\backuptool\backup_tool.csv

r01 172.18.75.91
r02 172.18.75.92
r03 172.18.75.93

C:\backuptool\backuptool_backup_all.bat

Code: C:\backuptool\backuptool_backup_all.bat

@ECHO OFF
@TITLE BackupTool backup all

:: Create BACKUP_TOOL_JSON variable.
@SET "BACKUP_TOOL_JSON="

:: Append `{` to BACKUP_TOOL_JSON.
:: EXAMPLE: {
@SET "BACKUP_TOOL_JSON={"

:: Append `"Destination":` to BACKUP_TOOL_JSON.
:: EXAMPLE: {"Destination":
@SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"Destination":"

:: Append `"C:\\backuptool\\backups"` and `,` to BACKUP_TOOL_JSON.
:: EXAMPLE: {"Destination":"C:\\backuptool\\backups",
@SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"C:\\backuptool\\backups","

:: Append `"Version":` to BACKUP_TOOL_JSON.
:: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":
@SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"Version":"

:: Append `"1.0.0",` and `,` to BACKUP_TOOL_JSON.
:: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0",
@SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"1.0.0","

:: Append `"Robots":` to BACKUP_TOOL_JSON.
:: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":
@SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"Robots":["

:: Append `[` to BACKUP_TOOL_JSON.
:: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[
@SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%["

:: Loop over each line of C:\backup_tool.csv.
FOR /F "usebackq tokens=1,2" %%I IN ("C:\backuptool\backup_tool.csv") DO (
   :: PING `%%J` (robot IP address).
   PING -n 1 -l 32 -w 1000 -4 %%J
   
   :: When PING is successful:
   @IF %ERRORLEVEL% EQU 0 (
       :: Append `{` to BACKUP_TOOL_JSON.
       :: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{
       @SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%{"

       :: Append `"Name":` to BACKUP_TOOL_JSON.
       :: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":
       @SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"Name":"

       :: Append `"%%I"` (robot name) to BACKUP_TOOL_JSON.
       :: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01",
       @SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"%%I","

       :: Append `"Host":` to BACKUP_TOOL_JSON.
       :: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01","Host":
       @SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"Host":"

       :: Append `"%%J"` (robot IP address) to BACKUP_TOOL_JSON.
       :: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01","Host":"172.18.75.91"
       @SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%"%%J""                          

       :: Append `}` and `,` to BACKUP_TOOL_JSON.
       :: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01","Host":"172.18.75.91"},
       @SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%},"                           
   )
)

:: When the last character of BACKUP_TOOL_JSON is equal-to ",":
:: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01","Host":"172.18.75.91"},{"Name":"r02","Host":"172.18.75.92"},{"Name":"r03","Host":"172.18.75.93",
@IF "%BACKUP_TOOL_JSON:~-1%"=="," (
   :: Remove the last character of BACKUP_TOOL_JSON.
   :: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01","Host":"172.18.75.91"},{"Name":"r02","Host":"172.18.75.92"},{"Name":"r03","Host":"172.18.75.93"
    @SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON:~0,-1%"
)

:: Append `]` to BACKUP_TOOL_JSON.
:: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01","Host":"172.18.75.91"},{"Name":"r02","Host":"172.18.75.92"},{"Name":"r03","Host":"172.18.75.93"}]
@SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%]"

:: Append the `}` BACKUP_TOOL_JSON variable.
:: EXAMPLE: {"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01","Host":"172.18.75.91"},{"Name":"r02","Host":"172.18.75.92"},{"Name":"r03","Host":"172.18.75.93"}]}
@SET "BACKUP_TOOL_JSON=%BACKUP_TOOL_JSON%}"

:: Write BACKUP_TOOL_JSON to "C:\backuptool\backup_tool.json".
@ECHO %BACKUP_TOOL_JSON%> "C:\backuptool\backup_tool.json"

:: When Windows is 32-bit, use "C:\backuptool\BackupTool-v1.0.0\backup-win-386.exe".
@IF "%PROCESSOR_ARCHITECTURE%"=="x86" (
   "C:\backuptool\BackupTool-v1.0.0\backup-win-386.exe" backup all
)

:: When Windows is 64-bit, use "C:\backuptool\BackupTool-v1.0.0\backup-win-amd64.exe".
@IF "%PROCESSOR_ARCHITECTURE%"=="AMD64" (
   "C:\backuptool\BackupTool-v1.0.0\backup-win-amd64.exe" backup all
)

:: If %ERRORLEVEL% is not equal-to 0, prompt the user to continue.
@IF NOT ERRORLEVEL 0 (
   @COLOR 0C
   @ECHO ERROR: BackupTool exited with ERRORLEVEL [%ERRORLEVEL%]
   @PAUSE
   @COLOR 0F
)

@CLS
@TIMEOUT /T 3 /NOBREAK
@ECHO ON
@EXIT /B 0

Display More

C:\backuptool\backup_tool.json

I'll be the first to admit that the JSON generated by the backuptool_backup_all.bat file is ugly, but it is valid JSON.

Code: C:\backuptool\backup_tool.json

{"Destination":"C:\\backuptool\\backups","Version":"1.0.0","Robots":[{"Name":"r01","Host":"172.18.75.91"},{"Name":"r02","Host":"172.18.75.92"},{"Name":"r03","Host":"172.18.75.93"}]}

Additionally, you can open Command Prompt and run the TREE command to see the directory/file structure...

Code

@TREE "C:\backuptool" /F /A 
C:\BACKUPTOOL
|   backup_tool.csv
|   backup_tool.json
|   backuptool_backup_all.bat
|
+---BackupTool-v1.0.0
|       LICENSE.txt
|       README.txt
|       backup-win-386.exe
|       backup-win-amd64.exe
|
\---backups
   \---2024-05-20T10-00-00_all
           +---r01
           |       accntg.dg 
           |       ...
           |
           +---r02
           |       accntg.dg 
           |       ...
           |
           \---r03
                   accntg.dg 
                   ...

Display More

jstolaruk · May 22, 2024 at 4:12 AM

Jay at onerobotics updated the backuptool last year (2023, backuptool-v1.1.0a.exe) and I no longer see that timeout abort problem. Last October he stated that he was working on a desktop application version, but I got to busy to follow up.

How to speed up FTP backup of MD?

Advertising from our partners

How to see your Job Posting (search or recruit) here in Robot-Forum.com

Similar Threads

R538 Ethernet/IP I/O Adp installed? Do I have to activate the option in some hidden menu?

Issues with Initial Setup / Jogging