Sie sind nicht angemeldet.

Lieber Besucher, herzlich willkommen bei: krpano.com Forum. Falls dies Ihr erster Besuch auf dieser Seite ist, lesen Sie sich bitte die Hilfe durch. Dort wird Ihnen die Bedienung dieser Seite näher erläutert. Darüber hinaus sollten Sie sich registrieren, um alle Funktionen dieser Seite nutzen zu können. Benutzen Sie das Registrierungsformular, um sich zu registrieren oder informieren Sie sich ausführlich über den Registrierungsvorgang. Falls Sie sich bereits zu einem früheren Zeitpunkt registriert haben, können Sie sich hier anmelden.

milotimbol

Fortgeschrittener

  • »milotimbol« ist der Autor dieses Themas

Beiträge: 242

Wohnort: Philippines

Beruf: Software Developer

  • Nachricht senden

1

Dienstag, 25. Juli 2023, 02:12

Reverse engineering matteport coordinates

Hi All,

I stumbled upon this article a few weeks back

https://codespace.help/posts/2023-03-24-…lxgjyf6CXSk45IM

I followed it and was able to successfully get an OBJ with texture. I used it as a dollhouse in krpano successfully.

The next thing I did was download the matterport 360 panoramas by listening to the network, downloading the tiles and then using krpano re-tile to convert them back to a sphere.

The part where I got stuck is trying to map the matterport numbers to krpano so I can put the 360 panorama and align it to the 3D model. See screenshot below



The closest I got is the screenshot below



It seems to fit but just need to rotate the image 90 degrees and cant seem to do it in krpano. So I did it in photoshop, which I believe shouldnt be the case since the purpose of this is to make everything automated.

Anyway my questions are
1. Is there a way to rotate the image without moving the depthmap? I
2. Has anyone successfully done this? like convert a matterport 360 tour to a krpano tour without using blender or everpano and just directly mapping matterport numbers to krpano.

kme

Fortgeschrittener

Beiträge: 310

Wohnort: Belgium

Beruf: Long time coder, product manager and 3D enthousiast

  • Nachricht senden

2

Dienstag, 25. Juli 2023, 08:57

iif you send the glb and the json file, i can have a look at converting them into krpano coordinates

3

Dienstag, 25. Juli 2023, 09:55

@milotimbol

thanks!
first i though that uv-mapped low-res model is also visible in the transition (for better quality) ...
but i guess thats not true and it is only used for the dollhouse, what do you think?
https://www.nationalgallery.org.uk/visit…ry-wing-vr-tour

about rotating see here
https://krpano.com/docu/xml/#depthmap.align

ps. such a tour could be done better by krpano,
but it needs more work / coding, so it would be more expensive.

Dieser Beitrag wurde bereits 4 mal editiert, zuletzt von »indexofrefraction« (25. Juli 2023, 10:12)


kme

Fortgeschrittener

Beiträge: 310

Wohnort: Belgium

Beruf: Long time coder, product manager and 3D enthousiast

  • Nachricht senden

4

Dienstag, 25. Juli 2023, 10:46

first i though that uv-mapped low-res model is also visible in the transition (for better quality) ...
but i guess thats not true and it is only used for the dollhouse, what do you think?


From what I understand, the model is also used for the transitions between panos inside matterport. But not sure.

5

Dienstag, 25. Juli 2023, 12:25

used yes, but there seems to be just the projection of point a fading to point b
the uv-mapping texture only used when you go into dollhouse mode

Dieser Beitrag wurde bereits 1 mal editiert, zuletzt von »indexofrefraction« (26. Juli 2023, 10:34)


kme

Fortgeschrittener

Beiträge: 310

Wohnort: Belgium

Beruf: Long time coder, product manager and 3D enthousiast

  • Nachricht senden

6

Dienstag, 25. Juli 2023, 13:34

Yes, that is also how I preceive it: only the model is used for the 3D transitions between panos, no texture. Texture + model is used in the dollhouse.

milotimbol

Fortgeschrittener

  • »milotimbol« ist der Autor dieses Themas

Beiträge: 242

Wohnort: Philippines

Beruf: Software Developer

  • Nachricht senden

7

Dienstag, 25. Juli 2023, 13:39

@indexofrefraction

I am not sure but based on looking at the files downloaded it seems there is only one 3d file for dollhouse and transition but I could be wrong, I will look into this some more.

I cannot see a depthmap align where can I find this in the documentation?

Quellcode

1
2
3
4
5
6
7
8
9
10
11
12
<depthmap url="..."
          enabled="true"
          rendermode="depthmap"
          background="none"
          scale="1.0"
          offset="0.0"
          subdiv=""
          encoding="gray"
          axis="+x+y+z"
          cull="front"
          center="0,0,0"
          />


@kristof I will prepare the files and send them to you

8

Dienstag, 25. Juli 2023, 14:34

@milo
yes 1 model only, used in 2 ways:
1) spherical projection with transition fading
2) uv-mapped for dollhouse

milotimbol

Fortgeschrittener

  • »milotimbol« ist der Autor dieses Themas

Beiträge: 242

Wohnort: Philippines

Beruf: Software Developer

  • Nachricht senden

9

Dienstag, 25. Juli 2023, 14:56

you sent me this link https://krpano.com/docu/xml/#depthmap.align doesnt seem to go to a section in the documentation. Can you point me to where the align for the depthmap is in the documentation?

10

Dienstag, 25. Juli 2023, 15:00

you sent me this link https://krpano.com/docu/xml/#depthmap.align doesnt seem to go to a section in the documentation. Can you point me to where the align for the depthmap is in the documentation?

you need to be in the 1.21 documentation
you can select that on the top left (click the version number)

or just use this link
https://krpano.com/docu/xml/?version=121

milotimbol

Fortgeschrittener

  • »milotimbol« ist der Autor dieses Themas

Beiträge: 242

Wohnort: Philippines

Beruf: Software Developer

  • Nachricht senden

11

Dienstag, 25. Juli 2023, 15:35

Thanks I can see it now, I didnt know I was looking at old documentation.

https://krpano.com/docu/xml/?version=121#depthmap

Quellcode

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
<depthmap url="..."
          texurl=""
          enabled="true"
          hittest="false"
          hittestmode="cpu"
          rendermode="auto"
          textured="auto"
          background="none"
          backgroundurl=""
          mapmode="1"
          offset="0.0"
          curve="1.0"
          scale="1.0"
          farscale="1.0"
          encoding="gray"
          axis="+x+y+z"
          cull="front"
          origin="0|0|0"
          align="0|0|0"
          subdiv=""
          />

12

Dienstag, 25. Juli 2023, 20:20

yes, the websites behaviour is confusing here...

13

Donnerstag, 27. Juli 2023, 17:54

please help with complete video

Hello, Timblo going good job. hope you succussed in task.


Please help us with video

14

Freitag, 4. August 2023, 15:14

HOPE YOU SHARE VIDEO SOON
Thanks I can see it now, I didnt know I was looking at old documentation.

https://krpano.com/docu/xml/?version=121#depthmap

Quellcode

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
<depthmap url="..." 
          texurl=""
          enabled="true"
          hittest="false"
          hittestmode="cpu"
          rendermode="auto"
          textured="auto"
          background="none"
          backgroundurl=""
          mapmode="1"
          offset="0.0"
          curve="1.0"
          scale="1.0"
          farscale="1.0"
          encoding="gray"
          axis="+x+y+z"
          cull="front"
          origin="0|0|0"
          align="0|0|0"
          subdiv=""
          />

15

Samstag, 19. August 2023, 14:44

HOPE YOU SHARE VIDEO SOON
Thanks I can see it now, I didnt know I was looking at old documentation.

https://krpano.com/docu/xml/?version=121#depthmap

Quellcode

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
<depthmap url="..." 
          texurl=""
          enabled="true"
          hittest="false"
          hittestmode="cpu"
          rendermode="auto"
          textured="auto"
          background="none"
          backgroundurl=""
          mapmode="1"
          offset="0.0"
          curve="1.0"
          scale="1.0"
          farscale="1.0"
          encoding="gray"
          axis="+x+y+z"
          cull="front"
          origin="0|0|0"
          align="0|0|0"
          subdiv=""
          />
Waiting for reply

16

Donnerstag, 14. September 2023, 11:56

convert quaternions into depthmap.align

Hi All,

I stumbled upon this article a few weeks back

Hi All,

I stumbled upon this article a few weeks back

Hi All,

I stumbled upon this article a few weeks back

https://codespace.help/posts/2023-03-24-matterport-protocol/?fbclid=IwAR0-k-ZZ4KMw-9-I4WzVpdpfPup8hPs19em_O8KrBjZLlxgjyf6CXSk45IM

I followed it and was able to successfully get an OBJ with texture. I used it as a dollhouse in krpano successfully.

The next thing I did was download the matterport 360 panoramas by listening to the network, downloading the tiles and then using krpano re-tile to convert them back to a sphere.

The part where I got stuck is trying to map the matterport numbers to krpano so I can put the 360 panorama and align it to the 3D model. See screenshot below



The closest I got is the screenshot below



It seems to fit but just need to rotate the image 90 degrees and cant seem to do it in krpano. So I did it in photoshop, which I believe shouldnt be the case since the purpose of this is to make everything automated.

Anyway my questions are
1. Is there a way to rotate the image without moving the depthmap? I
2. Has anyone successfully done this? like convert a matterport 360 tour to a krpano tour without using blender or everpano and just directly mapping matterport numbers to krpano.[quote='milotimbol','index.php?page=Thread&postID=90806#post90806']Hi All,

I stumbled upon this article a few weeks back

[url]https://codespace.help/posts/2023-03-24-matterport-protocol/?fbclid=IwAR0-k-ZZ4KMw-9-I4WzVpdpfPup8hPs19em_O8KrBjZLlxgjyf6CXSk45IM


I followed it and was able to successfully get an OBJ with texture. I used it as a dollhouse in krpano successfully.

The next thing I did was download the matterport 360 panoramas by listening to the network, downloading the tiles and then using krpano re-tile to convert them back to a sphere.

The part where I got stuck is trying to map the matterport numbers to krpano so I can put the 360 panorama and align it to the 3D model. See screenshot below



The closest I got is the screenshot below



It seems to fit but just need to rotate the image 90 degrees and cant seem to do it in krpano. So I did it in photoshop, which I believe shouldnt be the case since the purpose of this is to make everything automated.

Anyway my questions are
1. Is there a way to rotate the image without moving the depthmap? I
2. Has anyone successfully done this? like convert a matterport 360 tour to a krpano tour without using blender or everpano and just directly mapping matterport numbers to krpano.
May I ask how to convert w, x, y, and z in rotation quaternions into angles that depthmap.align can use[/url][/quote]

kme

Fortgeschrittener

Beiträge: 310

Wohnort: Belgium

Beruf: Long time coder, product manager and 3D enthousiast

  • Nachricht senden

17

Donnerstag, 14. September 2023, 12:27

threejs has some functions for it:

https://jsfiddle.net/sn15a60o/

18

Donnerstag, 14. September 2023, 13:04

threejs has some functions for it:

https://jsfiddle.net/sn15a60o/


















I tried to convert quaternions to Euler angles, but the rotation angles of the model and panoramic image were incorrect when I included them in the krpano depthmap. My quaternion is:
Rotation:{
'x': -0.0012495082253
, "y": -0.005800439912
, "z": 0.5733134798673
, "w": 0.8193146205387
}


Converting to Euler angle is:
x: 0.300
y: -0.629
z: 69.958
But I need to set align="-0.0012495082253 | -110 | 0.005800439912" to work properly
My axis="- y+x+z", scale="100", origin="image"

19

Donnerstag, 14. September 2023, 23:23

Hi,

after some testing - when using the threejs quaternion to euler functions,
then the order "ZXY" and the following depthmap.align mapping seems to fit:

depthmap.align = (x) | (z-90) | (-y)

Best regards,
Klaus

20

Freitag, 15. September 2023, 05:15

Hi,

after some testing - when using the threejs quaternion to euler functions,
then the order "ZXY" and the following depthmap.align mapping seems to fit:

depthmap.align = (x) | (z-90) | (-y)

Best regards,
Klaus
After my testing, I found that it can work

depthmap.align = (x) | (z-180) | (-y)

I'm not sure why it's -180. Can someone explain