adbsync.exe - Win32 command line syncer

Renate · Sep 17, 2013

Well, how about this?

I cleaned up the code so that it will indicate directories that are not matched.
It still won't poke its nose down directories when it need not.

Code:

E:\Handy\New>adbsync /ld /v E:\Handy\ mnt/sdcard/DCIM/Camera

H                2013-09-17 00:53  Bogus
H             9  2013-09-17 01:43  Goodbye
H             7  2013-09-17 01:43  Hello

H   Host dir only               1
    Files match                68
H   Host file only              2

/l (with nothing) will list everything, in this case 71 lines.
Download in the signature.

osm0sis · Sep 18, 2013

Works absolutely perfectly! Thank you so much for your efforts!

I'm selecting out the host only files and removing them with a batch script now

:

Code:

[PLAIN]echo Removing old files . . .
type backup.log | bin\grep -E ^H" " | bin\cut -c 36- | bin\cut --delimiter=+ --fields=1 > host.log
echo ..\host.log >> host.log
for /f "delims=" %%f in ('type host.log') do @bin\rm -R "sdcard/%%f"
echo.

echo Cleaning up empty directories . . .
for /f "delims=" %%d in ('dir /s /b /ad ^| sort /r') do @rd "%%d" > nul 2>&1
echo.[/PLAIN]

Would it be alright if I put out a zip of my batch automation for your utility? It's got a customizable mountPoint, ignorePattern and onlyPattern variables, as well as a parsed ini file for long paths/filenames to ignore and zip up instead of having adbsync try to pull the files and halt. :good:

Edit: Renate NST gave permission via PM so ADBsync sdcard Backup v1.0 is now available in my Odds and Ends thread, if anyone is interested in a one-click automated backup solution.

roustabout · Jan 8, 2014

thanks so much for this. I wound up in a situation where I had no recent backups, couldn't get the gui to load, couldn't get my sdcard to mount - but had ADB available. Flashing a ROM was failing to get farther than that, so to have any chance I was going to have to nuke the device.

I was able to use adbsync to pull a lot of /data/data with great success. (I really only needed the information a single app was keeping but it's nice to have been able to pull so much more in case I think 'ooh! but...!' in a few weeks.)

and lo - a complete partition wipe and my device reanimated. After which I was able to restore the database for the app that had a few months' data in it, and it worked out fine.

osm0sis · Jun 4, 2014

@Renate NST

Hey! Hope things are well. I've been wondering, will adbsync prefer the larger file if one is found on each end with the same timestamp? I'm thinking along the lines of adb/USB issues causing broken transfers and hoping adbsync will replace the partially downloaded files with the complete ones.

Edit: Actually it looks like an interrupted transfer results in a smaller Host file with a newer timestamp. Any way you can think of to accommodate that use case so it can resume and complete the A->H sync?

Renate · Jun 12, 2014

Hmm, with writing to Android devices there could be an issue if the transfer were interrupted.
If the connection were the problem adbsync could be clever enough to retry.
If adbsync were interrupted somehow (^C should not break files) then the knowledge of the interrupted file would be lost.

In the other direction, to the host, adbsync could be changed to write temp files and only delete the old file and rename upon safe completion.

I've never had any of this happen to me.
If it did, I'd just delete the offending file and re-sync.

JVital2013 · Jun 18, 2014

Thanks for this great utility, it works great for me!

Are you planning on incorporating the ability to delete files from the target that were deleted from the source when you're only syncing one way? For example, if I manually delete somefile.foo on my computer and I use the /a flag with adbsync, I want it to delete somefile.foo from my phone as well.

Renate · Jun 18, 2014

Sorry, the adbd daemon on Android devices does not support any mechanism for file deletion in the file sync service.

I'd have to open a separate shell service on adbd to delete files.
I may get around to implementing that.

JVital2013 · Jun 18, 2014

Renate NST said:
Sorry, the adbd daemon on Android devices does not support any mechanism for file deletion in the file sync service.

I'd have to open a separate shell service on adbd to delete files.
I may get around to implementing that.

That would be awesome

. Right now I'm using the program to sync my music with iTunes and it works really well, but if I delete a song from iTunes I need to manually delete song from my phone. Not a big deal, but it would be a nice feature to automate it.

Also, are you planning on making the software open source at any point?

osm0sis · Jul 6, 2014

Here's an interesting issue. Fails every time it hits this file:

Code:

<-            0  2014-07-05 18:03  0/multirom/roms/LPV79/data/app/sensor_ctl_socket -
Error "No such device or address" from ADB

And again with:

Code:

<-            0  2014-06-30 18:11  0/multirom/roms/LPV79/data/cam_socket1 -
Error "No such device or address" from ADB

Edit: Here's the complete list of what I had to ignore: sensor_ctl_socket;cam_socket*;wpa_ctrl_597-*;ndebugsocket

Anyway just seems like something adbsync might want to detect to prevent failures. :good:

demlv · Jul 7, 2014

I keep getting "heap commit failed" errors. No idea how to pull a log, but I'd be happy to try with some guidance.

Sent from my Galaxy Nexus using Tapatalk

Renate · Jul 7, 2014

osm0sis said:
Fails every time it hits this file:

Could you do this and paste it?

Code:

# busybox stat [i]nastyfile[/i] -c '%f %F'

demlv said:
I keep getting "heap commit failed" errors.

About how many files are in the tree that you are syncing?

demlv · Jul 8, 2014

Renate NST said:
About how many files are in the tree that you are syncing?

Thousands....the entire contents of my virtual SD card. This worked previously.

The 'pull' doesn't all get stored in memory before being written to disk/flash/storage does it?

Anticipating possible question here: PC w/ 8gb memory running Windows 7 and virtual memory enabled.

Renate · Jul 8, 2014

demlv said:
Thousands..

I figured as much.
I store the tree, not the contents.
Could you tell me how many thousands?

demlv · Jul 8, 2014

Renate NST said:
I figured as much.
I store the tree, not the contents.
Could you tell me how many thousands?

Here goes -- to be clear, I am using adbsync as implemented in osm0sis' "ADBsync sdcard backup" script which is built on top of your utility. Link to thread here: http://xdaforums.com/showthread.php?t=2239421

According to FX File Explorer on my phone, the virtual SD card that I am trying to pull presently holds 32,250 files in 5002 folders totaling 13.9gb of space. About 24,600 of the files form part of clockworkmod recovery dedupe-style nandroid phone backups, so each file seems to carry the name of its calculated hash -- every one of those 24,000+ files has a name that is about 60 characters long.

For what it's worth, I have a backup on my PC (from when this all worked perfectly a few months ago) and according to the PC that backup consists of 72,179 files in 4,749 folders occupying 24.9gb -- with even more of the CWM nandroid backup files with the same type of long names.

Renate · Jul 8, 2014

I double checked that everything was working correctly.
I have to look at the old version (September 16, 2013) to see if there was a problem.
Load the current adbsync.exe from the signature.

Note: This does not fix the issue that @osm0sis brought up a few posts earlier.

demlv · Jul 8, 2014

Renate NST said:
I double checked that everything was working correctly.
I have to look at the old version (September 16, 2013) to see if there was a problem.
Load the current adbsync.exe from the signature.

Note: This does not fix the issue that @osm0sis brought up a few posts earlier.

I just confirmed that the version supplied by osm0sis in his .zip has a different file size. I will use the newest version linked in your signature as soon as I have a chance and will report back. Thanks for troubleshooting my issue. :good:

Renate · Jul 8, 2014

I meant that the version packed in that zip was from September 16, 2013.
(I looked at it already.)

I always put the Build Date in my Windows executables.
You can see that under "Properties" in Windows (File) Explorer.

Unrelated, my Win32 utility apkstamp.exe (in the signature) will tell you when an APK was compiled vs. when it was downloaded.

osm0sis · Jul 8, 2014

Renate NST said:
Could you do this and paste it?

Code:

# busybox stat [i]nastyfile[/i] -c '%f %F'

Renate NST said:
I double checked that everything was working correctly.
I have to look at the old version (September 16, 2013) to see if there was a problem.
Load the current adbsync.exe from the signature.

Note: This does not fix the issue that @osm0sis brought up a few posts earlier.

The busybox in TWRP isn't accepting the -c option for stat, but here's the output of -f and without any args:

Code:

  File: "sensor_ctl_socket"
    ID: d3609fe804970d6b Namelen: 255     Type: ext2/ext3
Block size: 4096      
Blocks: Total: 6924146    Free: 4320206    Available: 4320206
Inodes: Total: 1761280    Free: 1713300
  File: 'sensor_ctl_socket'
  Size: 0         	Blocks: 0          IO Block: 4096   socket
Device: b31eh/45854d	Inode: 1671176     Links: 1    
Access: (0766/srwxrw-rw-)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2014-07-05 15:03:00.000000000
Modify: 2014-07-05 15:03:00.000000000
Change: 2014-07-05 15:03:00.000000000

Thanks for looking into it.

Edit: Booted into the device, the ROM busybox reports "c1f6 socket", the cam sockets are both c1f8, c1c0 for /data/system/ndebugsocket, and c1b0 for wpa_ctrl_* in /data/misc/wifi/sockets/

Renate · Jul 9, 2014

Thanks for the info about Unix sockets, @osm0sis

Download the new version in the signature.

osm0sis · Aug 7, 2014

Renate NST said:
Thanks for the info about Unix sockets, @osm0sis

Download the new version in the signature.

@Renate NST Thought of another small request..

Could adbsync automatically substitute _ for filename characters that are acceptable on Linux but not Windows? I'm mainly seeing this with photos I take with Hangouts for MMS being saved with :'s as <whatever>:nopm:.jpg. Thanks for the ongoing work! This tool is indispensable.

adbsync.exe - Win32 command line syncer

Recognized Contributor / Inactive Recognized Dev

Senior Recognized Developer / Contributor

Senior Member

Senior Recognized Developer / Contributor

Recognized Contributor / Inactive Recognized Dev

Member

Recognized Contributor / Inactive Recognized Dev

Member

Senior Recognized Developer / Contributor

Senior Member

Recognized Contributor / Inactive Recognized Dev

Senior Member

Recognized Contributor / Inactive Recognized Dev

Senior Member

Recognized Contributor / Inactive Recognized Dev

Senior Member

Recognized Contributor / Inactive Recognized Dev

Senior Recognized Developer / Contributor

Recognized Contributor / Inactive Recognized Dev

Senior Recognized Developer / Contributor

Similar threads

Top Liked Posts