Phantom
This was a really random experiment I did cus I saw one of my friends quote tweet a post about 3DGS and it seemed relly easy to do.
I was right I was able to setup a job queue really quickly to generate few test Gaussian Splats using Apple’s new SHARP model and view them using sparkjs.
The model is really good btw and it’s small enough where you can run it locally, tho I don’t recommend running it locally if like me you own a base model macbook lol.
It does have some limitations ofc for eg. it’s kinda bad at estimating depth for imgs that appear more flat. It’s also not great at isometric images and manga art but I’m sure this will be improved in the near future.
Each file you get from it is around 60mb which is not ideal for web but good thing is you can convert them to a .sog format* which reduces the file size significantly by automatically quantizing the data.
I also added Gyroscope support that lets you mimic realistic First Person Motion while viewing a splat by moving your phone around.
Had a lot of fun making it and it turned out pretty cool too. It’s public so you can try whenever tyfr.