Trying to get the dual screen stretch in Chrome applied to other apps

[SirataXero]

Hey guys,

I haven't done Android dev in a long time, but I'd be very interested in starting again just to figure out how to make all (or at least a few of the major) apps work in dual screen stretched mode like Chrome does. I'll have the phone by tomorrow, but does anyone know where to even begin looking into something like this?

If we can figure out how to make it happen, I'll gladly start modifying apps and share them so that they can be stretched across the dual screen. I'm sure it's just a flag in the App Manifest or something very straight forward like that.

Any devs with any pointers?

 

[SirataXero]

Here's the contents of my app Manifest of chrome on my Note 10+.
https://pastebin.com/14nWYsD1

Can anyone please paste the manifest from their G8x?

If you have Solid Explorer, on the left slide out tab, tap on Applications, then in System Apps find Chrome. Inside there's a button on top that says "Browse". Just tap that and the manifest file should be in the root folder (first thing you see).

Could someone please paste their Chrome manifest file from there?

Thanks!

 

[SirataXero]

For example, in the Samsung one there's a few tags like this to enable Samsung (and Note) specific features within Chrome:

<meta-data 
     name="com.samsung.android.sdk.multiwindow.enable" value="true">
</meta-data>
<meta-data 
     name="com.samsung.android.sdk.multiwindow.penwindow enable" value="true">
</meta-data>

If we can find something like this for the LG sdk, we can enable split screen mode in any app we want.

I will extract my own Chrome app manifest tomorrow, but I won't be able to modify an existing apps until Monday or so. .

 

[SirataXero]

For completeness sake, and for anyone else who wants to follow along, here's the manifest from the LG G8X Chrome app:
https://pastebin.com/cz3zLrXq

Todo: find something LG Specific in the new manifest, copy it over to manifest files of other apps and see if it works. Unfortunately this is going to take me a while since I don't have my PC this weekend. More to come this coming week!

 

[SirataXero]

Update: looks like both versions are the same. Which means the info is not in the manifest file. I'm not sure where else it would be...

Will keep looking this weekend...

 

[SirataXero]

So it looks like I'm using this thread as a progress marker.

I found an app called "second launcher". Trying to see if this is a lead or a dead end.
For those interested, here's the manifest file:
https://pastebin.com/YgyLUgJn

This might be of particular interest...

<provider android:name="com.lge.secondlauncher.allapps.AllAppsDBProvider" 
android:readPermission="com.lge.secondlauncher.permission.READ_SETTINGS" 
android:writePermission="com.lge.secondlauncher.permission.WRITE_SETTINGS" 
android:exported="true" 
android:authorities="com.lge.secondlauncher.AllAppsDBProvider">
</provider>

 

[rainbowtuba]

Thanks for this, man. I'm shocked only chrome and whale use wide view.
You probably already know this, but:
The second launcher is the home for the left screen. I'm using Nova Launcher right now and it only affects the right screen. The left is still using Second Launcher

 

[SirataXero]

Hey, yeah I gathered as much. I'm trying to see if there's a list or something in this app that is basically an allow list.

What I found interesting is that on apps that are allowed to stretch, when they do stretch across both screens, it affects everything not just that app. The keyboard, notification shade, task bar, etc etc. This capability exists, and there's just one place where there's an allow list somewhere. I just have to find it...

 

[SirataXero]

Including when taking screenshots.

All I did between these two screen caps, is press the wide view button. I took the screenshots from the hardware buttons so it's a system wide recognition of the new "wide" state...

 

[SirataXero]

I just learned a couple things:

1. Wide view is definitely just a resizing of the screen/elements. If you have wide view on and you're asked for a fingerprint, the whole thing breaks. The fingerprint symbol is in between the two screens and you have to tap it to enable the scanner on the main screen. I.e. you need 2 fingers to use it. (Screenshot below).
2. I found LG development site with a guide on how to enable widescreen view in apps. It seems a bit incomplete, but I'm looking into it.
3. Wide screen works in 2 different modes: 1) the entire Android interface stretches across both screens, the break in the middle is not handled and it's a bit wonky. 2) The app knows there's 2 screens and behaves accordingly. Only certain activities are opened on the second screen and there's information exchange (i.e. gallery app/camera app).
This second more seems a bit more involved/complicated. The first mode just tells Android that the two screens are just one big screen, feel free to stretch across. This is the one I will focus on for now. Maybe if I get time, I can make apps behave across both screens.

What this means: you probably won't see an app which shows independent "panes" like Gmail across both screens, or an e-reader with pages across both screen, unless they are specifically coded by the original developers. A lucky break could be if the app is coded as such, and could somehow be convinced that the doi is changing or it is now in landscape mode. Then it could switch to it's different configuration.

Anyway, let's see what I can uncover. Maybe on Monday I will dust of my old laptop, and try to get the LG dual screen demo app working. Once it does, I can try to extract and modify currently installed apps.

 

[harysviewty]

I just learned a couple things:

1. Wide view is definitely just a resizing of the screen/elements. If you have wide view on and you're asked for a fingerprint, the whole thing breaks. The fingerprint symbol is in between the two screens and you have to tap it to enable the scanner on the main screen. I.e. you need 2 fingers to use it. (Screenshot below).
2. I found LG development site with a guide on how to enable widescreen view in apps. It seems a bit incomplete, but I'm looking into it.
3. Wide screen works in 2 different modes: 1) the entire Android interface stretches across both screens, the break in the middle is not handled and it's a bit wonky. 2) The app knows there's 2 screens and behaves accordingly. Only certain activities are opened on the second screen and there's information exchange (i.e. gallery app/camera app).
This second more seems a bit more involved/complicated. The first mode just tells Android that the two screens are just one big screen, feel free to stretch across. This is the one I will focus on for now. Maybe if I get time, I can make apps behave across both screens.

What this means: you probably won't see an app which shows independent "panes" like Gmail across both screens, or an e-reader with pages across both screen, unless they are specifically coded by the original developers. A lucky break could be if the app is coded as such, and could somehow be convinced that the doi is changing or it is now in landscape mode. Then it could switch to it's different configuration.

Anyway, let's see what I can uncover. Maybe on Monday I will dust of my old laptop, and try to get the LG dual screen demo app working. Once it does, I can try to extract and modify currently installed apps.

2. Where did you find the guidance? All I know is the old dualscreen api sdk with no wide mode

Have you tried force all apps resizeable & secondary display option in developer menu?

I also think there is some kind of lists for dual screen wide mode supported apps. Just like the lists of some apps to access certain features (auxillary PentaCamera, multi window etc)

Have you tried to launch QSlide on wide view mode? There's a developer kit to launch some apps using qslide

 

[rainbowtuba]

2. Where did you find the guidance? All I know is the old dualscreen api sdk with no wide mode

Have you tried force all apps resizeable & secondary display option in developer menu?

I also think there is some kind of lists for dual screen wide mode supported apps. Just like the lists of some apps to access certain features (auxillary PentaCamera, multi window etc)

Have you tried to launch QSlide on wide view mode? There's a developer kit to launch some apps using qslide

Lg has a link to their LG Dual Screen SDK on thier site. Looks like a great start


EDIT: It also looks like the system uses Googles Foldable screen API 29 even though my phone is only running Android 9. I assume this means that the device needs to have the "resizeableActivity=true" in order for the Wide View button to appear. I am looking through Whale and Chrome now to see if that is indeed the case and if an older version of either without this snjipped of code supports wide screen

Looks like it's probably "com.naver.WhaleMediaStandaloneDualFullScreenActivity" where things get interesting... Looking through chrome now



Within the manifest of Chrome:

<activity theme="@7F14024B" name="org.chromium.chrome.browser.media.PictureInPictureActivity" exported="false" 
excludeFromRecents="true" 
configChanges="0x00000D80" noHistory="true" 
resizeableActivity="true" 
supportsPictureInPicture="true">
		</activity>

Final edit: AAAANNNDD here's the manifest for whale:

<activity android:theme="@7F140101" android:name="com.naver.whale.dualscreen.DualScreenTabActivity" android:exported="false" android:taskAffinity="com.naver.whale.dualscreen" android:excludeFromRecents="true" android:configChanges="0x00001FB3" android:windowSoftInputMode="0x00000010" android:hardwareAccelerated="false" 
[COLOR="red"]android:resizeableActivity="true"[/COLOR]
android:supportsPictureInPicture="true">
<intent-filter>
<action android:name="com.naver.whale.dualtab">
</action>
<category android:name="android.intent.category.BROWSABLE">
</category>
</intent-filter>
</activity>

So I'm pretty sure this is the puzzle piece we need. If we can root the device, we can force this activity any app an force full screen.

Though, Gmail has this and it does not do any sort of multi screen view for me... Hmm...

 

[SirataXero]

Yes! Thank you!
This is what I saw earlier as well, that it says it used the Google foldable APIs but did they back port it? I assumed (like most Android manufacturers I e. Samsung) that they just developed their own thing, so I was surprised to see them mention Android foldables.
Do you think all it needs is the resizable activity true in the manifest? If that's the case, I'm going to try it on some of my apps and see what happens!

Will report back later tonight!

 

[rainbowtuba]

I don't know for sure if it's the only thing, but Google's Dev notes on foldables mention this specifically, good luck!

I may mess with something here or there myself, this dual screen thing has a ton of potential

 

[SirataXero]

Yeah so I don't think that's it. I checked GMail and also checked Google Maps. Both of those have this in their main activity but neither of them support it. It may be PART of the puzzle, but it's definitely not the missing piece. Will keep looking further.

 

[SirataXero]

So I found something that bothers me a bit....
http://mobile.developer.lge.com/support/forums/sdk/?pageMode=Detail&tID=10018522&listPage=%2Fsupport%2Fforums%2Fsdk%2F

Thank you for your interest in LG Dual Screen.
Unfortunately, 3rd party apps can't use the APIs. Because those APIs can use only LG System App.

God, I really hope that's not true. So far it seems to be. Since Chrome/Whale browser, etc. are system apps.... Google Maps is not, so it can't... same with GMail…. honestly if this is true, I might return this phone. This is huge for me....

Ignore that, I think this is only valid for those specific APIs that the person in the forum referred to... please ignore my comments, carry on...

 

[SirataXero]

I was able to have the device spit out information about the two displays that are available. The second display definitely comes up as an HDMI display. I think I have a lead on how to get full screen apps to show up. More to come.

Here's the info that I found: https://pastebin.com/wrSzNsJT

 

[harysviewty]

I was able to have the device spit out information about the two displays that are available. The second display definitely comes up as an HDMI display. I think I have a lead on how to get full screen apps to show up. More to come.

Here's the info that I found: https://pastebin.com/wrSzNsJT

You can install 'Sentio' and 'Taskbar' now. It's like Samsung DeX, to trigger HDMI mirroring

---------- Post added at 01:54 PM ---------- Previous post was at 01:50 PM ----------

So I found something that bothers me a bit....
http://mobile.developer.lge.com/sup...il&tID=10018522&listPage=/support/forums/sdk/



God, I really hope that's not true. So far it seems to be. Since Chrome/Whale browser, etc. are system apps.... Google Maps is not, so it can't... same with GMail…. honestly if this is true, I might return this phone. This is huge for me....

Ignore that, I think this is only valid for those specific APIs that the person in the forum referred to... please ignore my comments, carry on...

Some Korean apps (not system apps) can use dual screen perfectly. So it's not true. I believe it's like how LG older Multi-Window feature works, there are some lists of packages names for supported apps. There's also a way to build the code inside an app

---------- Post added at 01:55 PM ---------- Previous post was at 01:54 PM ----------

Yeah so I don't think that's it. I checked GMail and also checked Google Maps. Both of those have this in their main activity but neither of them support it. It may be PART of the puzzle, but it's definitely not the missing piece. Will keep looking further.

Can you open a link in chrome or whale that will trigger Gmail or gmaps to open automatically?
Make sure you've enabled force resizeable app apps in developer menu

 

[rainbowtuba]

Can you open a link in chrome or whale that will trigger Gmail or gmaps to open automatically?
Make sure you've enabled force resizeable app apps in developer menu

Just tried it, unfortunately it shuts down wide screen moose and opens Gmail on the main screen only


Also, have those apps a shot. You can do some dual screen settings, but nothing like one large screen. Maybe I didn't go through enough settings, but I couldn't get the second screen to play nice

 

[SirataXero]

You can install 'Sentio' and 'Taskbar' now. It's like Samsung DeX, to trigger HDMI mirroring

Tried both. Neither of them saw the second screen until it was pushed over to the second screen, then I had to re-enable settings and permissions. They basically just behave like two independent devices... it's very odd.

Some Korean apps (not system apps) can use dual screen perfectly. So it's not true. I believe it's like how LG older Multi-Window feature works, there are some lists of packages names for supported apps. There's also a way to build the code inside an app

Do you know which apps? Are these available in the app store? (Even if just Korean version of Play Store). Could you tell me which ones (or send me APKs of them) so I can try them out/look through them?

Can you open a link in chrome or whale that will trigger Gmail or gmaps to open automatically?
Make sure you've enabled force resizeable app apps in developer menu

Yup, I've enabled the setting, enabled the flag in ADB, nothing happens. Gmail or Maps just instantly close down wide view and open up on one screen.