General https://developer.apple.com/forums/topics/spatial-computing/spatial-computing-general Discuss Spatial Computing on Apple Platforms. Detecting collisions between fingertip and world mesh https://developer.apple.com/forums/thread/767368 I'm using hand tracking to detect collisions between fingertips and entities that I have placed in the scene. I'm using the .mixed environment. However, I want to detect when a fingertip touches a real-world object such as a wall. No matter what I try, I can't get the collision to fire. I'm using the SceneReconstructionProvider to give me world meshes, which I use to create ModelEntity objects to which I add a CollisionComponent with the shape of the object. I can render the meshes just fine, but nothing I do seems to allow collisions to work. Surely this is possible, what am I missing? Tue, 29 Oct 2024 04:43:12 GMT rkeniger iOS 18.1 Rc https://developer.apple.com/forums/thread/767271 I’ve updated to iOS 18.1 public beta when it released and I got the problem when I was in public beta 4 to rc and the problem never fixed with the time limit when I ask for more time it never give me more time it’s just says waiting for parent approval I have this problem until ios 18.1 RC can u fix it I’m on iPhone 11 pro max Sun, 27 Oct 2024 19:42:21 GMT Tejauni Synchronizing Physical Properties of EntityEquipment in TableTopKi https://developer.apple.com/forums/thread/767261 I am working on adding synchronized physical properties to EntityEquipment in TableTopKit, allowing seamless coordination during GroupActivities sessions between players. Current Approach and Limitations I have tried setting EntityEquipment's state to DieState and treating it as a TossableRepresentation object. This approach achieves basic physical properties synchronized across players. However, it has several limitations: No Collision Detection Between Dice: Multiple dice do not collide with each other. Shape Limitations: Custom shapes, like parallelepipeds, cannot be configured. Below is ... Sun, 27 Oct 2024 15:41:10 GMT matt_novoselov Determining if an ObjectAnchor is currently observed https://developer.apple.com/forums/thread/767251 I'm writing code using ObjectAnchor for Vision OS. If an object is tracked, and then becomes not visible (either because the user looked in a different direction, or because the tracked object was occluded by another object), it is still tracked and you get anchor updates (e.g., object permanence). For my application, it would be very helpful if I could determine if the object is currently being observed, or it is not currently observed and just assumed to be in the same location as seen previously. ObjectAnchor.isTracked just seems to indicate whether it is getting anchor updates. I don't see... Sun, 27 Oct 2024 14:09:43 GMT William Pugh Apple Vision Pro Rental / Leasing Service https://developer.apple.com/forums/thread/767214 Regarding the Apple Vision Pro, is there a possibility to get a kind of rental device or leasing device from Apple? Background: I'm a fresh VisionOS dev. I have a low budget. I'm living in Japan. That means Vision Pro is roughly 150% the USD price. Regards Sat, 26 Oct 2024 13:39:48 GMT Chris483 Xcode 16 crashes my Vision Pro Object Tracking App https://developer.apple.com/forums/thread/767203 I created an Object & Hand Tracking app based on the sample code released here by Apple. https://developer.apple.com/documentation/visionos/exploring_object_tracking_with_arkit The app worked great and everything was fine, but I realized I was coding on Xcode 16 beta 3, so I installed the latest Xcode 16 from the App Store and tested by app there, and it completely crashed. No idea why. Here is the console dyld[1457]: Symbol not found: _$ss13withTaskGroup2of9returning9isolation4bodyq_xm_q_mScA_pSgYiq_ScGyxGzYaXEtYas8SendableRzr0_lF Referenced from: <3AF14FE4-0A5F-381C-9FC5-E2520728FC6... Sat, 26 Oct 2024 08:09:50 GMT swakitaki WebXR Immersive AR Support & DOM Overlays https://developer.apple.com/forums/thread/767133 As mentioned in https://forums.developer.apple.com/forums/thread/756736?answerId=810096022#810096022 Is there any update about the full support to WebXR AR Module, which should enable immersive-ar mode? Are the features such as DOM overlays and WebGPU bindings on the roadmap? Is it possible to capture stereoscopic video either internally or externally or via airplay for debugging purposes? Thanks Fri, 25 Oct 2024 11:11:45 GMT nomadsole Handling user-initiated re-centering in group immersive space? https://developer.apple.com/forums/thread/766985 Hi, currently tinkering with a little shareplay app for the Vision Pro that allows people to facetime and shareplay to play with random 3d models (as well as move them around, which should sync the model positions for everyone in relative space). When the users start their facetime call, then open the immersive space to see the 3d models, the models load in properly in context of the group immersive space's coordinate system, and moving the models reflects the new positions real-time for each participant. The main issue comes if/when users use the digital crown to re-center their view. It appe... Wed, 23 Oct 2024 20:36:56 GMT kvdcm VisionOS only provides limited window initialization positions. https://developer.apple.com/forums/thread/766938 As the title states, this severely limits the flexibility of multi-window applications in creating a good user experience. Even effects like the ones shown below cannot be achieved. Wed, 23 Oct 2024 10:31:10 GMT _rdy How can I implement the expand effect when clicking on a contact's avatar like in visionos's messages apps? https://developer.apple.com/forums/thread/766833 I found that there is such a click-to-expand horizontally and smoothly effect in the system application called "message", which is good. I wonder if I can add a similar effect to my own app. If possible, are there any implementation ideas or examples that I can refer to? Thanks! Tue, 22 Oct 2024 09:53:28 GMT _rdy How to Play Timeline Animations via code https://developer.apple.com/forums/thread/766800 Hi everyone, I need to synchronize the playback of RealityKit Timelines via SharePlay. To do this I am trying to get the references of the timelines using "AnimationPlaybackController" and "AnimationResource". In my realitykit scene I have configured both an animation (with blender), and a timeline, the animation starts correctly when the realitykit scene starts, the timeline not. Below the code: struct ContentView: View { @State private var subscriptions = [EventSubscription]() @Environment(AppModel.self) private var appModel let rootEntity = Entity() ... Tue, 22 Oct 2024 07:56:43 GMT poool88 Spatial streaming from iPhone https://developer.apple.com/forums/thread/766666 Hi, I am trying to stream spatial video in realtime from my iPhone 16. I am able to record spatial video as a file output using: let videoDeviceOutput = AVCaptureMovieFileOutput() However, when I try to grab the raw sample buffer, it doesn't include any spatial information: let captureOutput = AVCaptureVideoDataOutput() //when init camera session.addOutput(captureOutput) captureOutput.setSampleBufferDelegate(self, queue: sessionQueue) //finally func captureOutput(_ output: AVCaptureOutput, didOutput sampleBuffer: CMSampleBuffer, from connection: AVCaptureConnection) { //use sample bu... Sun, 20 Oct 2024 13:12:17 GMT AbhiStack Is dismissWindow actually asynchronous? https://developer.apple.com/forums/thread/766651 On visionOS, I have discovered that if dismissWindow is followed immediately by a call to openWindow, the new window does not open where the user is looking at. Instead, it appears at the same location as the dismissed window. However, if I open the new window after a small delay, or after UIScene's willDeactivateNotification, the new window correctly opens in front of the user. (I tested this within a opened immersive space.) Does this imply that dismissWindow is actually asynchronous, in the sense that it requires extra time to reset certain internal states before the next openWindow can be ... Sun, 20 Oct 2024 07:51:20 GMT NSCruiser How to set the AttractionCenter for a ParticleEmitterComponent in a System with real time updates https://developer.apple.com/forums/thread/766609 I am trying to achieve an effect such that the particles of a particle system are attracted to my hand entity. The hand entity is essentially an AnchorEntity that is tracking my right hand. let particleEmitterEntities = context.entities(matching: particleEmitterQuery, updatingSystemWhen: .rendering) for particleEmitterEntity in particleEmitterEntities { if var particleEmitter = particleEmitterEntity.components[ParticleEmitterComponent.self] { particleEmitter.mainEmitter.attractionCenter = rightHandEntity.position(relativeTo: nil) // trying to get the world ... Sat, 19 Oct 2024 08:32:47 GMT doomdave RealityView Limits VisionOS https://developer.apple.com/forums/thread/766611 Im asking myself we are the limits of RealityView. For example is it possible to place an entity on postion (x=800m,y=0,z=-900m) What happens if i walk from my (0,0,0) to this point, will i see the entity then ? Does someone know where are the limits ? Sat, 19 Oct 2024 05:40:00 GMT Billaehbong Synchronizing Multi-User AR Experiences on Apple Vision Pro https://developer.apple.com/forums/thread/766561 Hello Developers, I am currently in the initial planning stages of my bachelor thesis in computer science, where I will be developing an application in collaboration with a manufacturer of large-scale machinery. One of the core features I aim to implement is the ability for multiple Apple Vision Pro users to view the same object in augmented reality simultaneously, each from their respective positions relative to the object. I am still exploring how best to achieve this feature. My initial approach involves designating one device as the host of a "room" within the application, allowing other u... Fri, 18 Oct 2024 10:29:01 GMT Revin93 Understanding the Distance for Physical Object Visibility in Vision Pro Immersive System https://developer.apple.com/forums/thread/766522 I understand that the system helps maintain user comfort by automatically adjusting the opacity of content in certain situations, like when someone moves too quickly or gets too close to a physical object. The content in front of them dims briefly to allow a clearer view of their surroundings. And I'd like to know the specific distance at which the system begins to show the physical object, or what criteria are used for this adjustment. Fri, 18 Oct 2024 03:58:34 GMT Caty visionOS pushWindow being dismissed on app foreground https://developer.apple.com/forums/thread/766521 We seen to have found an issue when using the pushWindow action on visionOS. The issue occurs if the app is backgrounded then reopened by selecting the apps icon on the home screen. Any window that is opened via the pushWindow action is then dismissed. We've been able to replicate the issue in a small sample project. Replication steps Open app Open window via the push action Press the digital crown On the home screen select the apps icon again The pushed window will now be dismissed. There is a sample project linked here that shows off the issue, including a video of the bug in progress Fri, 18 Oct 2024 01:34:15 GMT JamesW-ios USDZ with Blend Shapes Workflow Recommendations https://developer.apple.com/forums/thread/766484 Hi, since RealityKit 4 now supports Blend Shapes I was wondering if there are any workflow or tooling recommendations to bake/export them into a USDZ. Are Blender or Cinema4D capable to do that out of the box? Should we look into NVIDIA omniverse (https://docs.omniverse.nvidia.com/connect/latest/blender/manual.htm) So far this topic seems very sparsely documented and I would appreciate any hints. Thank you! Thu, 17 Oct 2024 15:24:52 GMT arthurfromberlin Reality Composer Pro timelines management, but using code https://developer.apple.com/forums/thread/766459 Is it possible to manage the behavior of timeline totally from code? I am exploring the Compose interactive 3D content in Reality Composer Pro sample project after seeing the related video, but the example shows only the use of Behaviors from RCP to activate timelines actions. I was wondering if it is possible to, somehow, retrieve some kind of timeline controller that allows me access to its informations just like the AnimationPlaybackController does with single animations. What I would like to achieve is being able to play/pause/retrieve timestamp from them in order to allow synchronization ... Thu, 17 Oct 2024 10:46:47 GMT Edo_Dev