[Bug Report] Thumbnail cache limited?

[DualJoe]

Hi,
i lose some (not all) video thumbnails every 1-2 days. Is there a maximum file count/cache size for thumbnails or something that deletes old entries? I'm pretty sure i'm not having 1706 new videos every day that would roundrobin the cache.

Edit:
My cache currently holds 1706 files with 75.4M.
/storage/sdcard1/Android/data/com.mxtech.videoplayer.ad/cache/image

# ls -1 |wc -l
1706

# du -sh
75.4M   .

 

[CDB-Man]

Curious, if custom ROM, does your ROM have some sort of cache-size management?

 

[DualJoe]

Curious, if custom ROM, does your ROM have some sort of cache-size management?

No, nothing special.
I mount some video folders occasionally to /mnt/cifs/ that get scanned by mx player as well. Maybe that confuses mx player. But if i remember correctly it also happened between two non-cifs sessions already.

The mx coder is not here? Only at Google forums?

 

[CDB-Man]

Google Forum's been closed for a few months now, the developer's moved here along with the rest of us. See the note in my signature.
@bleu8888 is there some sort of internal MX cap on total thumbnail folder size?

 

[DualJoe]

My cache is still rising. Doesn't look like i'm hitting any cap here.. now 1767 files and 77.8MB.
I tested it some more and it looks like its related to the cifs share indeed (its transparent though... MX doesn't know about it. It just sees many new files). The bug seems to work "two-ways". Once cifs is mounted "local files 1" (some specific files) thumbs are missing. If i unmount cifs "local files 2" (other files) are missing. Something seems to collide here. I cannot see any relation between these files though. There are some dupe files present locally (on my phone) that are also on my desktop (cifs share) but i'm sure there are also files that are not.

I will try to setup a scenario with local files only so you can test it better. Will report back.

 

[bleu8888]

My cache is still rising. Doesn't look like i'm hitting any cap here.. now 1767 files and 77.8MB.
I tested it some more and it looks like its related to the cifs share indeed (its transparent though... MX doesn't know about it. It just sees many new files). The bug seems to work "two-ways". Once cifs is mounted "local files 1" (some specific files) thumbs are missing. If i unmount cifs "local files 2" (other files) are missing. Something seems to collide here. I cannot see any relation between these files though. There are some dupe files present locally (on my phone) that are also on my desktop (cifs share) but i'm sure there are also files that are not.

I will try to setup a scenario with local files only so you can test it better. Will report back.

I will check it out. Thanks

 

[bleu8888]

Hi,
i lose some (not all) video thumbnails every 1-2 days. Is there a maximum file count/cache size for thumbnails or something that deletes old entries? I'm pretty sure i'm not having 1706 new videos every day that would roundrobin the cache.

Edit:
My cache currently holds 1706 files with 75.4M.
/storage/sdcard1/Android/data/com.mxtech.videoplayer.ad/cache/image

# ls -1 |wc -l
1706

# du -sh
75.4M   .

I believe this issue is fixed on latest test version
https://sites.google.com/site/mxvpen/translation/test-build

Feedback will be appreciated.
Thanks

 

[DualJoe]

I believe this issue is fixed on latest test version
https://sites.google.com/site/mxvpen/translation/test-build

Feedback will be appreciated.
Thanks

Thanks, but still same behavior. I flushed the cache so i can trace the cache file count better and i've noticed the cache fluctuates indeed (when i add/remove folders). I once have 139 files. Then, when i mount new folders there's 102 files only so MX seems to try to keep it clean (what actually is a good thing). But there are always the same files missing.

These are the folders i've set in MX player. The cifs folder is either not present, empty or filled depending if mounted or not. Not sure if MX Player gets maybe confused by that behavior.

 

[bleu8888]

Thanks, but still same behavior. I flushed the cache so i can trace the cache file count better and i've noticed the cache fluctuates indeed (when i add/remove folders). I once have 139 files. Then, when i mount new folders there's 102 files only so MX seems to try to keep it clean (what actually is a good thing). But there are always the same files missing.

These are the folders i've set in MX player. The cifs folder is either not present, empty or filled depending if mounted or not. Not sure if MX Player gets maybe confused by that behavior.

Woud you try again using latest beta version?
https://sites.google.com/site/mxvpen/translation/test-build

There is a rule for thumbnail extraction. If thumbnail extraction failed once, MX will never try again.
If storage is mounted from CIFS, MX Player will fail to extract thumbnail frequently. So it will not try to extract thumbnail because it failed once. This issue might be fixed on this build.

To make it work correctly, clear entire MX Player data.

 

[DualJoe]

Woud you try again using latest beta version?
https://sites.google.com/site/mxvpen/translation/test-build

Bingo! Works. Thank you very much. :victory:

 

[DualJoe]

@bleu8888:
I've noticed that thumbnail caching acts kinda weird especially when you use the 'Quit' button (or kill the app by system settings). Currently it only caches one video here (the one on the bottom on the attached video). The behavior is dynamic though. Sometimes it caches, sometimes it does not. You probably won't notice it if you leave the player by 'back' or 'home' button. This seems completely independent from existent network/cifs folders. Can you confirm this behavior?

 

[bleu8888]

@bleu8888:
I've noticed that thumbnail caching acts kinda weird especially when you use the 'Quit' button (or kill the app by system settings). Currently it only caches one video here (the one on the bottom on the attached video). The behavior is dynamic though. Sometimes it caches, sometimes it does not. You probably won't notice it if you leave the player by 'back' or 'home' button. This seems completely independent from existent network/cifs folders. Can you confirm this behavior?

MX Player keep track of thumbnail list on an internal database.
This database looks like being corrupted when app is closed forcibly.
Database will be changed more robust on next version.

 

[DualJoe]

I've wiped app settings and it's working again. I also had a folder conflict (/sdcard/Android/data and /external_sd/Android/data) that was bind mounted (mirrored) manually. Currently it's working again properly (after fixing that). But the bug always needed some time to come back. Will see... Thanks so far.

 

[DualJoe]

MX Player keep track of thumbnail list on an internal database.
This database looks like being corrupted when app is closed forcibly.
Database will be changed more robust on next version.

Unfortunately, it didn't improve the situation. It just needs some days and thumbnails get lost again. The only fix is to clear the cache to start all over. Small databases seem to work properly. That's probably why it always works when resetting MX Player. But the larger the database gets the more thumbnails get lost. Sometimes whole folders are lost and sometimes just some single files whereas the latter case is more often and leads to "persistent dead files" (thumbnails that are not stored at all - they get recreated every time one restarts MX Player). For some reason MX Player refuses to add these files or it maybe collides somewhere.

 

[bleu8888]

Unfortunately, it didn't improve the situation. It just needs some days and thumbnails get lost again. The only fix is to clear the cache to start all over. Small databases seem to work properly. That's probably why it always works when resetting MX Player. But the larger the database gets the more thumbnails get lost. Sometimes whole folders are lost and sometimes just some single files whereas the latter case is more often and leads to "persistent dead files" (thumbnails that are not stored at all - they get recreated every time one restarts MX Player). For some reason MX Player refuses to add these files or it maybe collides somewhere.

This might be due to corruption of database or file system itself.
Log will be left on this case. Would you send log after finding thumbnail lost?

 

[DualJoe]

This might be due to corruption of database or file system itself.
Log will be left on this case. Would you send log after finding thumbnail lost?

Sure.
Full log is attached below. It contains: MX Player start, folder opened, one thumbnail appears delayed, MX Player quit. The video folder contains 13 files, all videos. Custom codec/ffmpeg is enabled.

Here is a quickly filtered version of the log (full log below):

02-07 12:26:22.106 I/ActivityManager(735): Start proc com.mxtech.videoplayer.ad for activity com.mxtech.videoplayer.ad/.ActivityMediaList: pid=26208 uid=10083 gids={50083, 3003, 1028, 1015}
02-07 12:26:22.346 I/MX (26208): CpuFamily=[1] CpuFeatures=[2047] CpuCount=[4] os.arch=[armv7l] ABIs=[armeabi-v7a;armeabi]
02-07 12:26:22.376 E/MX (26208): 26208 | Can't find symbol graphics #12
02-07 12:26:22.386 I/MX (26208): Application=[MX Player] Version=[1.7.37] Manufacturer=[samsung] Model=[GT-I9506] Display=[cm_ks01lte-userdebug 4.4.4 KTU84Q 0098ae16e5 test-keys] Brand=[samsung] Product=[ks01ltexx] Android=[4.4.4]
02-07 12:26:22.706 V/MX.Player.List.Media/MediaListFragment(26208): 5 items are built up. (33ms)
02-07 12:26:24.066 V/MX.Player.List.Media/MediaListFragment(26208): 13 items are built up. (8ms)
02-07 12:26:24.326 I/MX (26249): Application=[MX Player] Version=[1.7.37] Manufacturer=[samsung] Model=[GT-I9506] Display=[cm_ks01lte-userdebug 4.4.4 KTU84Q 0098ae16e5 test-keys] Brand=[samsung] Product=[ks01ltexx] Android=[4.4.4]
02-07 12:26:24.516 I/MX (26249): CpuFamily=[1] CpuFeatures=[2047] CpuCount=[4] os.arch=[armv7l] ABIs=[armeabi-v7a;armeabi]
02-07 12:26:24.516 E/MX (26249): 26249 | Can't find symbol graphics #12
02-07 12:26:24.526 I/MX.Player.List.Media(26208): Connected to ComponentInfo{com.mxtech.videoplayer.ad/com.mxtech.media.service.FFService}
02-07 12:26:24.766 I/MX.Player.Loader.Heavy(26208): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos3/Koreus.mp4
02-07 12:26:24.766 I/MX (26249): 26260 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
02-07 12:26:24.766 W/MX.FFmpeg(26249): full chroma interpolation for destination format 'rgb565le' not yet implemented
02-07 12:26:28.956 I/ActivityManager(735): Killing 26249:com.mxtech.videoplayer.ad:remote/u0a83 (adj 11): kill background
02-07 12:26:28.956 I/ActivityManager(735): Killing 26208:com.mxtech.videoplayer.ad/u0a83 (adj 9): kill background

This is the mediainfo of the video (in case it matters):

General
Complete name                            : Koreus.mp4
Format                                   : MPEG-4
Format profile                           : Base Media
Codec ID                                 : isom
File size                                : 1.34 MiB
Duration                                 : 49s 250ms
Overall bit rate mode                    : Variable
Overall bit rate                         : 228 Kbps
Writing application                      : Lavf54.63.104

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : Baseline@L3.0
Format settings, CABAC                   : No
Format settings, ReFrames                : 5 frames
Format settings, GOP                     : M=1, N=90
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 49s 232ms
Bit rate                                 : 175 Kbps
Width                                    : 400 pixels
Height                                   : 224 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 29.970 fps
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.065
Stream size                              : 1.03 MiB (77%)
Writing library                          : x264 core 142
Encoding settings                        : cabac=0 / ref=5 / deblock=1:0:0 / analyse=0x1:0x131 / me=umh / subme=10 / psy=0 / mixed_ref=1 / me_range=24 / chroma_me=1 / trellis=2 / 8x8dct=0 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=0 / threads=24 / lookahead_threads=1 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=0 / weightp=0 / keyint=90 / keyint_min=9 / scenecut=40 / intra_refresh=0 / rc_lookahead=60 / rc=crf / mbtree=1 / crf=27.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / vbv_maxrate=450 / vbv_bufsize=900 / crf_max=0.0 / nal_hrd=none / filler=0 / ip_ratio=1.40 / aq=2:1.00

Audio
ID                                       : 2
Format                                   : AAC
Format/Info                              : Advanced Audio Codec
Format profile                           : HE-AACv2 / HE-AAC / LC
Codec ID                                 : 40
Duration                                 : 49s 250ms
Bit rate mode                            : Variable
Bit rate                                 : 48.0 Kbps
Maximum bit rate                         : 128 Kbps
Channel(s)                               : 2 channels / 1 channel / 1 channel
Channel positions                        : Front: L R / Front: C / Front: C
Sampling rate                            : 44.1 KHz / 44.1 KHz / 22.05 KHz
Compression mode                         : Lossy
Stream size                              : 289 KiB (21%)
Language                                 : unk

Edit:
And this is a log of another folder that gets completely rescanned every time i restart MX Player:

I/Timeline( 1111): Timeline: Activity_launch_request id:com.mxtech.videoplayer.ad time:4385133
I/ActivityManager( 734): Start proc com.mxtech.videoplayer.ad for activity com.mxtech.videoplayer.ad/.ActivityMediaList: pid=4666 uid=10083 gids={50083, 3003, 1028, 1015}
I/MX ( 4666): CpuFamily=[1] CpuFeatures=[2047] CpuCount=[4] os.arch=[armv7l] ABIs=[armeabi-v7a;armeabi]
E/MX ( 4666): 4666 | Can't find symbol graphics #12
I/MX ( 4666): Application=[MX Player] Version=[1.7.37] Manufacturer=[samsung] Model=[GT-I9506] Display=[cm_ks01lte-userdebug 4.4.4 KTU84Q 0098ae16e5 test-keys] Brand=[samsung] Product=[ks01ltexx] Android=[4.4.4]
V/MX.Player.List.Media( 4666): onCreate(com.mxtech.videoplayer.ad.ActivityMediaList@4276b468) saved:null intent:Intent { act=android.intent.action.MAIN cat=[android.intent.category.LAUNCHER] flg=0x10200000 cmp=com.mxtech.videoplayer.ad/.ActivityMediaList bnds=[280,1305][520,1605] }
V/MX.Player.List.Media/MediaListFragment( 4666): 5 items are built up. (27ms)
I/ActivityManager( 734): Displayed com.mxtech.videoplayer.ad/.ActivityMediaList: +747ms
I/Timeline( 734): Timeline: Activity_windows_visible id: ActivityRecord{4311d158 u0 com.mxtech.videoplayer.ad/.ActivityMediaList t22} time:4385917
V/MX.Player.List.Media/MediaListFragment( 4666): 9 items are built up. (8ms)
I/ActivityManager( 734): Start proc com.mxtech.videoplayer.ad:remote for service com.mxtech.videoplayer.ad/com.mxtech.media.service.FFService: pid=4707 uid=10083 gids={50083, 3003, 1028, 1015}
D/ActivityThread( 4707): handleBindApplication:com.mxtech.videoplayer.ad:remote
I/MX ( 4707): Application=[MX Player] Version=[1.7.37] Manufacturer=[samsung] Model=[GT-I9506] Display=[cm_ks01lte-userdebug 4.4.4 KTU84Q 0098ae16e5 test-keys] Brand=[samsung] Product=[ks01ltexx] Android=[4.4.4]
I/MX ( 4707): CpuFamily=[1] CpuFeatures=[2047] CpuCount=[4] os.arch=[armv7l] ABIs=[armeabi-v7a;armeabi]
E/MX ( 4707): 4707 | Can't find symbol graphics #12
I/MX.Player.List.Media( 4666): Connected to ComponentInfo{com.mxtech.videoplayer.ad/com.mxtech.media.service.FFService}
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/Enter Pyongyang.mp4
I/MX ( 4707): 4719 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/Harzinger.mp4
I/MX ( 4707): 4718 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/One Pants No Hands.mp4
I/MX ( 4707): 4719 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/Pomsta 8 - PARANORMAL PRANK.mp4
I/MX ( 4707): 4719 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/Right Guard Sort review - FUNNY.mp4
I/MX ( 4707): 4719 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/Sex In The Bathroom Prank.mp4
I/MX ( 4707): 4722 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/Sudden Hail Storm Surprise In Novosibirsk, Russia.mp4
I/MX ( 4707): 4719 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/MX.Player.List.Media( 4666): Connected to ComponentInfo{com.mxtech.videoplayer.ad/com.mxtech.media.service.FFService}
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/Top GONE WRONG Pranks In The Hood 2014.mp4
I/MX ( 4707): 4722 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/MX.Player.Loader.Heavy( 4666): Extracting ffmpeg thumb from /storage/sdcard1/videos/Videos2/Truck Loading.mp4
I/MX ( 4707): 4719 | Container format='mov,mp4,m4a,3gp,3g2,mj2'
I/ActivityManager( 734): Killing 4707:com.mxtech.videoplayer.ad:remote/u0a83 (adj 9): kill background
I/ActivityManager( 734): Killing 4666:com.mxtech.videoplayer.ad/u0a83 (adj 9): kill background

 

[bleu8888]

Sure.
Full log is attached below. It contains: MX Player start, folder opened, one thumbnail appears delayed, MX Player quit. The video folder contains 13 files, all videos. Custom codec/ffmpeg is enabled.

Here is a quickly filtered version of the log (full log below):
This is the mediainfo of the video (in case it matters):

General
Complete name                            : Koreus.mp4
Format                                   : MPEG-4
Format profile                           : Base Media
Codec ID                                 : isom
File size                                : 1.34 MiB
Duration                                 : 49s 250ms
Overall bit rate mode                    : Variable
Overall bit rate                         : 228 Kbps
Writing application                      : Lavf54.63.104

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : Baseline@L3.0
Format settings, CABAC                   : No
Format settings, ReFrames                : 5 frames
Format settings, GOP                     : M=1, N=90
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 49s 232ms
Bit rate                                 : 175 Kbps
Width                                    : 400 pixels
Height                                   : 224 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 29.970 fps
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.065
Stream size                              : 1.03 MiB (77%)
Writing library                          : x264 core 142
Encoding settings                        : cabac=0 / ref=5 / deblock=1:0:0 / analyse=0x1:0x131 / me=umh / subme=10 / psy=0 / mixed_ref=1 / me_range=24 / chroma_me=1 / trellis=2 / 8x8dct=0 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=0 / threads=24 / lookahead_threads=1 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=0 / weightp=0 / keyint=90 / keyint_min=9 / scenecut=40 / intra_refresh=0 / rc_lookahead=60 / rc=crf / mbtree=1 / crf=27.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / vbv_maxrate=450 / vbv_bufsize=900 / crf_max=0.0 / nal_hrd=none / filler=0 / ip_ratio=1.40 / aq=2:1.00

Audio
ID                                       : 2
Format                                   : AAC
Format/Info                              : Advanced Audio Codec
Format profile                           : HE-AACv2 / HE-AAC / LC
Codec ID                                 : 40
Duration                                 : 49s 250ms
Bit rate mode                            : Variable
Bit rate                                 : 48.0 Kbps
Maximum bit rate                         : 128 Kbps
Channel(s)                               : 2 channels / 1 channel / 1 channel
Channel positions                        : Front: L R / Front: C / Front: C
Sampling rate                            : 44.1 KHz / 44.1 KHz / 22.05 KHz
Compression mode                         : Lossy
Stream size                              : 289 KiB (21%)
Language                                 : unk

Edit:
And this is a log of another folder that gets completely rescanned every time i restart MX Player:

@DualJoe I've made some improvement on writing thumbnail cache.
Kindly try latest test build: https://sites.google.com/site/mxvpen/translation/test-build
If problme continues, please send log again.

Thanks

 

[DualJoe]

There seems to be some kind of auto-pruning of the thumbnail cache. If folders are not present (eg. when USB or network drive are not connected) they get deleted after some time. I'm not sure when exactly. Maybe after some sessions or chronologically after a specific time. They do survive for some days though. But they are clearly gone if the folders don't come back in time.

Can you add an option to disable this behavior so the thumbnail cache can only increase? There could be a companion option 'prune now' so one could prepare the environment (mount all folders) before pruning.