krpano 1.23 - 3D Gaussian Splatting Support

woohoo!!!
It's awesome

Thanks for this great update !

Thank you Klaus!

A superb development, better than I expected, and this is just the first iteration!

Is there any chance that krpano tools will get the ability to create tours containing splats? This would seem to be a bit simpler than making tours with 3D models and depthmaps.

Dear KRpano Team,

I recently saw the impressive new feature in KRpano that allows viewing Gaussian Splatting models, and I’m very interested in using it.

I’ve been using KRpano for many years to publish traditional panoramas and have always appreciated its flexibility and performance. Now, I have several high-quality 3D Gaussian Splatting (3DGS) models that I would like to publish and share with clients and friends using the new viewer.

However, I haven’t been able to find any documentation or tutorial on your website explaining how to use this new feature. Could you please point me to any available guides, or let me know if a tutorial will be released soon?

Thank you in advance for your help and for continuing to push the boundaries of immersive content!

Best regards,
Gregory Arbit

Quote from GregoryA24

However, I haven’t been able to find any documentation or tutorial on your website explaining how to use this new feature. Could you please point me to any available guides, or let me know if a tutorial will be released soon?

It works like any other Krpano project.

Just have a look at the xml file of the splat demo : https://krpano.com/viewsource.htm…ts-examples.xml

To display your splat here his the doc : https://krpano.com/docu/xml/#image.splats

Thank you Klaus and Jerome!

Will work on it, maybe in the future it will be just another tab in krpano Tools

Klaus,

Are there any plans to add collision detection for splats? I've gotten a bit spoiled by that in depthmaped environments.

So the demo g.splat on Quest 3 stutters a lot.
Is there a much lighter, smaller example somewhere which moves buttersmooth in VR?

Please tell me how to take pictures to make a Gaussian splat. I can't find information on how and which images to upload to krpano to do this. Klaus you are the BEST !!!!!!!

Hi Vasilii,

For begining, I would recommend you to check this video

Basically, to make your Gaussian splat model you need - digital camera or phone, and 3 apps - Reality Scan, PostShot, SuperSplat and some patient to practice.

All the best,

Gregory

Quote from GregoryA24

Hi Vasilii,

For begining, I would recommend you to check this video

.

Basically, to make your Gaussian splat model you need - digital camera or phone, and 3 apps - Reality Scan, PostShot, SuperSplat and some patient to practice.

All the best,

Gregory

I use the policam service.
I upload photos taken with a camera or a copter there. I download the file in the ply format and throw it into the browser using this link https://krpano.com/releases/1.23/viewer/krpano.html ?xml=examples/3d-gaussian-splatting/shaders-demo.xml&antialias=false
next, I copy xml from the splat model tab, I'm stuck on this action. I still can't figure out how to view the project on my computer and upload it to my website. I understand that you need to create an html file to open it. But I still can't figure out how to do this for my project.

Quote from klaus.krpano

Hi,

right, basically just define/add a <splat> element with the url to the splat file.

The splats-example even provides a little helper tool for aligning the splat model.

E.g.

1. open the splats example: https://krpano.com/releases/1.23/…antialias=false
2. drop your splat file (.splat, .ply or .compressed.ply) into it
3. click 'Splat Model'
4. optionally adjust scale, rotation and translation
   (for very wrong orientated models, it can help enabling the 'architectural view' by right-click and keeping the view in the middle area for finding good rotation values)
5. then click 'Get XML' and paste the code into the xml file

Best regards,
Klaus

I use the policam service.
I upload photos taken with a camera or a copter there. I download the file in the ply format and throw it into the browser using this link https://krpano.com/releases/1.23/viewer/krpano.html ?xml=examples/3d-gaussian-splatting/shaders-demo.xml&antialias=false
next, I copy the xml from the splat model tab. I'm stuck on this action. I still can't figure out how to view the project on my computer and upload it to my website. I understand that you need to create an html file to open it. But I still can't figure out how to do this for my project. Is there any tutorial for beginners in this topic so that it is clear from the steps how to dо. Thanks.

Quote from GregoryA24

Dear KRpano Team,

I recently saw the impressive new feature in KRpano that allows viewing Gaussian Splatting models, and I’m very interested in using it.

I’ve been using KRpano for many years to publish traditional panoramas and have always appreciated its flexibility and performance. Now, I have several high-quality 3D Gaussian Splatting (3DGS) models that I would like to publish and share with clients and friends using the new viewer.

However, I haven’t been able to find any documentation or tutorial on your website explaining how to use this new feature. Could you please point me to any available guides, or let me know if a tutorial will be released soon?

Thank you in advance for your help and for continuing to push the boundaries of immersive content!

Best regards,
Gregory Arbit

Display More

Hello. Have you figured out how to create a project?) I use the policam service. From there, I download the ply file and then simplify it. Next, I upload it to the browser after opening this link. https://krpano.com/releases/1.23/viewer/krpano.html ?xml=examples/3d-gaussian-splatting/splats-examples.xml&antialias=false
I do everything according to the instructions, but when I paste it into an xml file, there is very little code. In general, I don't understand at all how to create an html file for viewing later. People write that everything is easy to do, look at the documentation, but the problem is that I'm not very good at coding. I understand what it says. It's not very clear how to implement this. It's a pity there are no instructions for any example from the beginning of creating splat to turning it into a watchable html file.

I've been quite impressed by the triangle splatting project (https://github.com/trianglesplatting/triangle-splatting) and I'm wondering if you will consider also supporting that way of displaying radiance fields?

This method creates a 'soup' of 3D triangles, each with a spherical harmonic radiance field, that can supposedly be rendered more efficiently than a Gaussian 'soup', and with better visual fidelity. The training process definitely runs faster than for a Gaussian splat, I can do it in 30 minutes on my little gaming laptop.

Despite the title of their paper, that team has not produced a usable viewer, and their native renderer runs much slower than real time. It is possible to build one-off viewers by exporting their triangles to a game engine, so far only via the primitive .off file format, with fully opaque triangles. However if you would like to experiment with rendering triangle splats, I would be glad to help by implementing exports in other formats.

Hello, Vasilii

No, I am still working on it. Unfortunatly, I have to refresh my knowledges about the KRpano html, xml structure.

But it is ok, the 3d-gaussian-splatting viewer is great.

Hope to shre the results soon.

Gregory